Zheng Zian(Andy)'s picture

Zheng Zian(Andy)

OrionZheng

·

https://zheng-zian-andy.com

AI & ML interests

LLM, Mixture-of-Experts, Data-Centric AI

Recent Activity

new activity 15 days ago

OrionZheng/openmoe-8b:Model source code

liked a dataset 4 months ago

MixEval/MixEval-X

authored a paper 4 months ago

OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models

View all activity

Organizations

None yet

Papers 2

arxiv:2410.13754

arxiv:2402.01739

models 11

OrionZheng/openmoe-34b-200B

Text Generation • Updated Jan 19, 2024 • 15 • 11

OrionZheng/openmoe-8b-chat

Text Generation • Updated Jan 19, 2024 • 32 • 8

OrionZheng/openmoe-8b

Text Generation • Updated Jan 19, 2024 • 36 • 3

OrionZheng/openmoe-8b-1T

Text Generation • Updated Jan 19, 2024 • 28 • 2

OrionZheng/openmoe-8b-800B

Text Generation • Updated Jan 19, 2024 • 19 • 1

OrionZheng/openmoe-8b-600B

Text Generation • Updated Jan 19, 2024 • 20

OrionZheng/openmoe-8b-400B

Text Generation • Updated Jan 19, 2024 • 15

OrionZheng/openmoe-8b-200B

Text Generation • Updated Jan 19, 2024 • 17 • 2

OrionZheng/openmoe-base

Text Generation • Updated Jan 19, 2024 • 99 • 4

OrionZheng/openmoe-8b-890B

Text Generation • Updated Jan 12, 2024 • 19

datasets

None public yet