allenai/OLMoE-1B-7B-0125
Text Generation
•
Updated
•
24
•
4
Improved OLMoE for iOS app. Read more: https://allenai.org/blog/olmoe-app
Note 🧱Base version of OLMoE. Use as foundation for post-training or Fine Tuning.
Note 🤖 Instruct variant of OLMoE. Use it in chat models
Note 📲 Quantized version of OLMoE. Great for running locally on device.
Note 📚1️⃣ Pretrain data mix.
Note 📚2️⃣ Mid-train data mix.
Note 📚3️⃣ Post-train SFT data mix.
Note 📚4️⃣ Post-train preference data mix (DPO).
Note SFT only verision of OLMoE. Use allenai/OLMoE-1B-7B-0125-Instruct instead.
Note SFT + DPO only verision of OLMoE. Use allenai/OLMoE-1B-7B-0125-Instruct instead.
Note Quantized version of base model. Use allenai/OLMoE-1B-7B-0125-Instruct-GGUF instead.