Edit Models filters

Inference Providers

HF Inference API

Misc

arxiv: 2402.13228

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

59

Full-text search

Active filters: 2402.13228

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-3_5bpw_exl2

Text Generation • Updated May 20, 2024 • 5

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-3_75bpw_exl2

Text Generation • Updated May 20, 2024 • 5

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw3-exl2

Text Generation • Updated May 19, 2024 • 7 • 1

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-4_0bpw_exl2

Text Generation • Updated May 20, 2024 • 8

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw3.5-exl2

Text Generation • Updated May 19, 2024 • 5

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-4_25bpw_exl2

Text Generation • Updated May 20, 2024 • 6

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw3.7-exl2

Text Generation • Updated May 19, 2024 • 6

blockblockblock/Smaug-Llama-3-70B-Instruct-bpw4-exl2

Text Generation • Updated May 19, 2024 • 9

LoneStriker/Smaug-Llama-3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 6

LoneStriker/Smaug-Llama-3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 6

LoneStriker/Smaug-Llama-3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 6

LoneStriker/Smaug-Llama-3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 8

LoneStriker/Smaug-Llama-3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 6

LoneStriker/Smaug-Llama-3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 6

LoneStriker/Smaug-Llama-3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated May 19, 2024 • 10

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-5_0bpw_exl2

Text Generation • Updated May 20, 2024 • 6

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-6_0bpw_exl2

Text Generation • Updated May 20, 2024 • 6

Zoyd/abacusai_Smaug-Llama-3-70B-Instruct-6_5bpw_exl2

Text Generation • Updated May 20, 2024 • 6

RichardErkhov/abacusai_-_Llama-3-Smaug-8B-4bits

Text Generation • Updated May 21, 2024 • 75

RichardErkhov/abacusai_-_Smaug-72B-v0.1-gguf

Updated Jun 18, 2024 • 49

speakleash/Bielik-11B-v2.1-Instruct

Text Generation • Updated Oct 26, 2024 • 1.84k • 3

QuantFactory/Bielik-11B-v2.2-Instruct-GGUF

Updated Aug 30, 2024 • 18 • 1

koesn/Llama-3-Smaug-8B-GGUF

Updated Sep 6, 2024 • 28

RichardErkhov/abacusai_-_Smaug-34B-v0.1-gguf

Updated Sep 15, 2024 • 4

QuantFactory/Bielik-11B-v2.3-Instruct-GGUF

Updated Sep 24, 2024 • 103 • 1

RichardErkhov/speakleash_-_Bielik-11B-v2.1-Instruct-gguf

Updated Oct 18, 2024 • 11

RichardErkhov/abacusai_-_Llama-3-Smaug-8B-gguf

Updated Nov 3, 2024 • 2

RichardErkhov/abacusai_-_Smaug-Mixtral-v0.1-gguf

Updated Nov 5, 2024 • 11

mav23/Bielik-11B-v2.2-Instruct-GGUF

Updated Nov 13, 2024 • 5