Satyen Kale
Satyen Kale is a machine-learning researcher whose work spans online algorithms, optimization and federated learning. He earned degrees in computer science at IIT Bombay and Princeton, then held research roles at Microsoft Research, Yahoo Research, IBM Research and Google Research. His papers on online boosting and Adam's convergence won Best Paper Awards at ICML 2015 and ICLR 2018; he also received the COLT 2018 Best Student Paper Award and coauthored SCAFFOLD for federated learning. He is a research scientist at Apple Machine Learning Research in New York, where his research includes distributed large language model training.
Timeline
-
2002–2007
Degrees at IIT Bombay and Princeton
At IIT Bombay, he earns a B.Tech. in computer science and engineering in 2002. At Princeton, he earns an M.A. in computer science in 2004 and completes a Ph.D. in 2007 under Sanjeev Arora.
-
2007–2013
Research at Microsoft, Yahoo and IBM
From 2007 to 2009, he is a postdoctoral researcher at Microsoft Research. He takes a postdoctoral role at Yahoo Research in 2009 and joins IBM Research as a research staff member in 2011, where he remains through 2013.
-
2013–2024
Yahoo Research and Google Research
At Yahoo Research, he becomes a senior research scientist in 2013 and serves through 2016; he also holds adjunct appointments at Columbia University in 2016 and 2019. In 2016, he joins Google Research as a staff research scientist and stays through 2024.
-
2015
An ICML online boosting award
In 2015, he coauthors a study with Alina Beygelzimer and Haipeng Luo that develops two online boosting algorithms for turning weak online learners into strong ones. ICML names it a Best Paper Award winner in 2015.
-
2017–2019
Program chair for COLT and ALT
He serves as program chair for COLT in 2017 and ALT in 2019.
-
2018
Adam convergence and awards
With Sashank J. Reddi and Sanjiv Kumar, he coauthors “On the Convergence of Adam and Beyond” in 2018. The paper identifies one cause of Adam's convergence failures and proposes new variants that retain long-term gradient information; it wins ICLR's Best Paper Award in 2018. Kale also receives the COLT Best Student Paper Award in 2018.
-
2020
SCAFFOLD for federated learning
In 2020, he coauthors SCAFFOLD, a federated learning algorithm that uses control variates to correct client drift. The method requires fewer communication rounds and works across clients with heterogeneous data.
-
Since 2024
Research scientist at Apple
In 2024, he joins Apple Machine Learning Research as a research scientist in New York and works on efficient algorithms for machine learning, including federated learning and distributed training of large language models. At a Lehigh University seminar in March 2026, he presents work on stacking for faster pretraining of large language models.
Career
- Since 2024AppleResearch scientist
- 2017–2024Google
- 2016–2019Columbia UniversityAdjunct
- 2016–2024Google ResearchStaff research scientist
- 2011–2013IBM ResearchResearch staff member
- 2009–2016YahooPostdoctoral researcher, Senior research scientist
- 2009–2013IBM
- 2007–2009Microsoft ResearchPostdoctoral researcher
- 2007–2009Microsoft
Education
- 2007Princeton UniversityPh.D.
- 2004Princeton UniversityM.A.
- 2002IIT BombayB.Tech.
Most-cited works
- On the Convergence of Adam and BeyondWith Sanjiv Kumar
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningWith Mehryar Mohri
- Logarithmic regret algorithms for online convex optimizationWith Elad Hazan
- Privacy, accuracy, and consistency tooWith Boaz Barak, Cynthia Dwork, Frank McSherry and Kunal Talwar
- Taming the Monster: A Fast and Simple Algorithm for Contextual BanditsWith John Langford and Robert E. Schapire
Sources and credits
Photo: We have no published photo of Satyen Kale yet. Send us a free-licensed photo.
- Satyen Kale's webpage – Satyen's professional website
- Graduate Alumni | CS
- [1502.02651] Optimal and Adaptive Algorithms for Online Boosting
- Awards | ICML Lille
- ISE Spring 2026 Seminar Series - Lehigh University Events Calendar
- [1904.09237] On the Convergence of Adam and Beyond
- Google at ICLR 2018
- SCAFFOLD: Stochastic Controlled Averaging for Federated Learning

