Hugging Face's logo
Bertrand Charpentier's picture
11788 6 32

Bertrand Charpentier

sharpenb
sandordaroczi's profile picture 21world's profile picture GigaBoy's profile picture
·
https://sharpenb.github.io/

AI & ML interests

Efficient & Reliable ML

Recent Activity

posted an update 1 day ago
How to deploy compressed ML models in your pipeline? We wrote a series of blogs on this topics. Hope that it can be helpful to people: - Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline - Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai - Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
updated a collection 9 days ago
Text-to-text Generation Models (LLMs, Llama, GPT, ...)
View all activity

Organizations

Pruna AI's profile picture Social Post Explorers's profile picture

sharpenb's activity

posted an update 1 day ago
view post
Post
389
How to deploy compressed ML models in your pipeline?

We wrote a series of blogs on this topics. Hope that it can be helpful to people:
- Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline
- Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai
- Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination

Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
replied to their post 19 days ago
view reply

Thanks for the notification! Indeed we support only Linux for now. We would be happy to work on the token problem. If you could share your colab config and the trace here or on our discord, it would help us :)

posted an update 21 days ago