Guoqing Zheng
Guoqing Zheng is a language technology researcher whose work covers reasoning in small language models, synthetic training data, and decentralized mixture-of-experts systems. He studied computer science at Shanghai Jiao Tong University and earned an M.S. and Ph.D. at Carnegie Mellon. From 2018 to 2025, he served as a principal researcher at Microsoft Research. In 2023 he coauthored Orca 2; in July 2024 he coauthored AgentInstruct, which generated 25 million instruction pairs for language-model training. In 2025, he coauthored a paper introducing DDOME, a decentralized mixture-of-experts framework, and since 2025 he is a researcher at Percepta AI.
Timeline
-
2009–2018
Degrees at SJTU and CMU
He earns a B.E. in computer science at Shanghai Jiao Tong University in 2009 and an M.E. there in 2012. At Carnegie Mellon, he completes an M.S. in language technologies in 2014 and a Ph.D. in language and information technology in 2018, with Yiming Yang as his academic advisor.
-
2018–2025
Principal researcher at Microsoft
From 2018 to 2025, he serves as a principal researcher at Microsoft Research.
-
2023
Orca 2 for model reasoning
In 2023, he coauthors Orca 2: Teaching Small Language Models How to Reason. The paper teaches smaller language models to choose among strategies such as step-by-step reasoning, recall then generate, recall-reason-generate, and direct answer.
-
2024
AgentInstruct training data
In July 2024, he coauthors AgentInstruct, an agentic framework that generates synthetic data from raw text and code. The team creates a 25-million-pair post-training dataset for teaching language-model skills such as text editing, tool use, coding, and reading comprehension.
-
2025
DDOME for decentralized learning
In 2025, he coauthors “Learning to Specialize,” which introduces DDOME, a decentralized Mixture-of-Experts framework for allocating domain-specific expertise. In federated-learning tests, DDOME improves accuracy by 4% to 24% over state-of-the-art baselines.
-
Since 2025
Researcher at Percepta AI
Since 2025, he is a researcher at Percepta AI. His research focuses on large-scale machine learning, natural language processing, and information retrieval.
Sources and credits
Photo: We have no published photo of Guoqing Zheng yet. Send us a free-licensed photo.
- Guoqing Zheng
- Guoqing Zheng - Language Technologies Institute - School of Computer Science - Carnegie Mellon University
- Guoqing Zheng — Lacuna
- Orca - Microsoft Research: Publications
- Orca 2: Teaching Small Language Models How to Reason
- AgentInstruct: Toward Generative Teaching with Agentic Flows - Microsoft Research
- Learning to Specialize: Joint Gating-Expert Training for Adaptive MoEs in Decentralized Settings