Marc Sun
marcsun13
·
AI & ML interests
LLM, Quantization, Training, Inference
Recent Activity
Organizations
marcsun13's activity
-
-
-
-
-
-
-
-
-
-
-
view article
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
view article
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
published
an
article
over 1 year ago
view article
Overview of natively supported quantization schemes in 🤗 Transformers
published
an
article
over 1 year ago
view article
Making LLMs lighter with AutoGPTQ and transformers