Article
Building Cost-Efficient Enterprise RAG applications with Intel Gaudi 2 and Intel Xeon
•
12
Haihao Shen
Haihao
AI & ML interests
LLM quantization, sparsity, and acceleration
Recent Activity
liked
a model
14 days ago
OPEA/MiniMax-Text-01-int4-sym-inc-preview
liked
a model
14 days ago
OPEA/Meta-Llama-3.1-405B-Instruct-int4-sym-inc
liked
a model
14 days ago
OPEA/DeepSeek-V3-int4-sym-awq-inc
Organizations
Haihao's activity
published
an
article
9 months ago
published
an
article
about 1 year ago
Article
Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding
•
9