Researcher

Satyen Kale

Satyen Kale is a machine-learning researcher whose work spans online algorithms, optimization and federated learning. He earned degrees in computer science at IIT Bombay and Princeton, then held research roles at Microsoft Research, Yahoo Research, IBM Research and Google Research. His papers on online boosting and Adam's convergence won Best Paper Awards at ICML 2015 and ICLR 2018; he also received the COLT 2018 Best Student Paper Award and coauthored SCAFFOLD for federated learning. He is a research scientist at Apple Machine Learning Research in New York, where his research includes distributed large language model training.

Now at
Apple
Works
146
Citations
10,071
h-index
37

Publication numbers from OpenAlex, as of 22 October 2026.

Timeline

  1. 2002–2007

    Degrees at IIT Bombay and Princeton

    At IIT Bombay, he earns a B.Tech. in computer science and engineering in 2002. At Princeton, he earns an M.A. in computer science in 2004 and completes a Ph.D. in 2007 under Sanjeev Arora.

  2. 2007–2013

    Research at Microsoft, Yahoo and IBM

    From 2007 to 2009, he is a postdoctoral researcher at Microsoft Research. He takes a postdoctoral role at Yahoo Research in 2009 and joins IBM Research as a research staff member in 2011, where he remains through 2013.

  3. 2013–2024

    Yahoo Research and Google Research

    At Yahoo Research, he becomes a senior research scientist in 2013 and serves through 2016; he also holds adjunct appointments at Columbia University in 2016 and 2019. In 2016, he joins Google Research as a staff research scientist and stays through 2024.

  4. 2015

    An ICML online boosting award

    In 2015, he coauthors a study with Alina Beygelzimer and Haipeng Luo that develops two online boosting algorithms for turning weak online learners into strong ones. ICML names it a Best Paper Award winner in 2015.

  5. 2017–2019

    Program chair for COLT and ALT

    He serves as program chair for COLT in 2017 and ALT in 2019.

  6. 2018

    Adam convergence and awards

    With Sashank J. Reddi and Sanjiv Kumar, he coauthors “On the Convergence of Adam and Beyond” in 2018. The paper identifies one cause of Adam's convergence failures and proposes new variants that retain long-term gradient information; it wins ICLR's Best Paper Award in 2018. Kale also receives the COLT Best Student Paper Award in 2018.

  7. 2020

    SCAFFOLD for federated learning

    In 2020, he coauthors SCAFFOLD, a federated learning algorithm that uses control variates to correct client drift. The method requires fewer communication rounds and works across clients with heterogeneous data.

  8. Since 2024

    Research scientist at Apple

    In 2024, he joins Apple Machine Learning Research as a research scientist in New York and works on efficient algorithms for machine learning, including federated learning and distributed training of large language models. At a Lehigh University seminar in March 2026, he presents work on stacking for faster pretraining of large language models.

Career

  1. Since 2024AppleResearch scientist
  2. 2017–2024Google
  3. 2016–2019Columbia UniversityAdjunct
  4. 2016–2024Google ResearchStaff research scientist
  5. 2011–2013IBM ResearchResearch staff member
  6. 2009–2016YahooPostdoctoral researcher, Senior research scientist
  7. 2009–2013IBM
  8. 2007–2009Microsoft ResearchPostdoctoral researcher
  9. 2007–2009Microsoft

Education

  1. 2007Princeton UniversityPh.D.
  2. 2004Princeton UniversityM.A.
  3. 2002IIT BombayB.Tech.

Most-cited works

  1. On the Convergence of Adam and Beyond2019 · 1,771 citationsWith Sanjiv Kumar
  2. SCAFFOLD: Stochastic Controlled Averaging for Federated Learning2019 · 1,732 citationsWith Mehryar Mohri
  3. Logarithmic regret algorithms for online convex optimization2007 · Machine Learning · 836 citationsWith Elad Hazan
  4. Privacy, accuracy, and consistency too2007 · ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems (PODS) · 468 citationsWith Boaz Barak, Cynthia Dwork, Frank McSherry and Kunal Talwar
  5. Taming the Monster: A Fast and Simple Algorithm for Contextual Bandits2014 · 286 citationsWith John Langford and Robert E. Schapire

Sources and credits

Photo: We have no published photo of Satyen Kale yet. Send us a free-licensed photo.

  1. Satyen Kale's webpage – Satyen's professional website satyenkale.com. Checked 20 October 2026.
  2. Graduate Alumni | CS cs.princeton.edu. Checked 20 October 2026.
  3. [1502.02651] Optimal and Adaptive Algorithms for Online Boosting arxiv.org. Checked 20 October 2026.
  4. Awards | ICML Lille icml.cc. Checked 20 October 2026.
  5. ISE Spring 2026 Seminar Series - Lehigh University Events Calendar eventscalendar.lehigh.edu. Checked 20 October 2026.
  6. [1904.09237] On the Convergence of Adam and Beyond arxiv.org. Checked 20 October 2026.
  7. Google at ICLR 2018 research.google. Checked 20 October 2026.
  8. SCAFFOLD: Stochastic Controlled Averaging for Federated Learning proceedings.mlr.press. Checked 20 October 2026.