Marc Sun's picture

Marc Sun

marcsun13

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

Organizations

Hugging Face's profile picture Hugging Face Internal Testing Organization's profile picture HuggingFaceM4's profile picture Hugging Face OSS Metrics's profile picture accelerate's profile picture Hugging Face TB Research's profile picture Quanto library's profile picture LocalLLaMA's profile picture MLX Community's profile picture Hugging Face 1Bit LLMs's profile picture Paris AI Running Club's profile picture LLHF's profile picture SLLHF's profile picture Hugging Quants's profile picture Hugging Face Party @ PyTorch Conference's profile picture qrias's profile picture DDUF's profile picture

marcsun13's activity

published an article 4 months ago
view article
Article

Introducing SynthID Text

• 39
published an article 5 months ago
view article
Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

• 217
published an article 5 months ago
view article
Article

Accelerate 1.0.0

• 52
published an article 7 months ago
view article
Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

• 227
published an article 11 months ago
view article
Article

quanto: a pytorch quantization toolkit

• 33
published an article over 1 year ago
view article
Article

Overview of natively supported quantization schemes in 🤗 Transformers

• 11
published an article over 1 year ago
view article
Article

Making LLMs lighter with AutoGPTQ and transformers

• 39