Patrick Nguyen
Patrick Nguyen is a speech-recognition researcher whose papers run from eigenvoice speaker adaptation to deep neural network acoustic models and end-to-end speech systems. After starting a company for real-time foreign exchange trading in 1998 and earning a doctorate at EPFL in 2002, he worked at Panasonic's Speech Technology Laboratory in Santa Barbara and then at Microsoft Research from 2004 to 2010, where he and Geoffrey Zweig wrote on segmental conditional random fields. By 2011 he was a research scientist at Google, where he coauthored the 2012 paper Deep Neural Networks for Acoustic Modeling in Speech Recognition and took part in sequence-to-sequence speech recognition and multispeaker speech synthesis work in 2017 and 2018. In 2019 he coauthored the Lingvo framework and the StarNet point-cloud detector. He is a research scientist at Google.
Timeline
-
1998–2002
A trading startup and a doctorate
In 1998, he starts a company that provides a market-maker platform for real-time foreign exchange trading. He receives his doctorate from EPFL in 2002.
-
1999–2004
Eigenvoices at Panasonic
He works at the Panasonic Speech Technology Laboratory in Santa Barbara from 2000 to 2004. His 1999 Eurospeech paper with Christian Wellekens and Jean-Claude Junqua applies eigenvoices, a rapid speaker adaptation technique, to speech recognition in noisy environments, and "Rapid speaker adaptation in eigenvoice space" appears in IEEE Transactions on Speech and Audio Processing in 2000.
-
2004–2010
Microsoft Research and segmental CRFs
He works at Microsoft Research in Redmond from 2004 to 2010. In 2008, he contributes to the winning English-to-Chinese machine translation effort in a NIST competition. With Geoffrey Zweig, he publishes "A Segmental CRF Approach to Large Vocabulary Continuous Speech Recognition" in 2009, which proposes a segmental conditional random field framework built on acoustic detectors.
-
By 2011
Google Research in Mountain View
By 2011, he is a research scientist in Google Research in Mountain View, a coauthor of about 15 granted patents, and a member of the organizing committee of ASRU 2011. In July 2011, he speaks to the SF Bay ACM chapter on segmental conditional random fields in speech recognition, work done with Geoff Zweig at Microsoft Research.
-
2012
Deep networks for acoustic modeling
In 2012, he is one of eleven authors, including Geoffrey Hinton, Li Deng and Dong Yu, of "Deep Neural Networks for Acoustic Modeling in Speech Recognition" in Signal Processing Magazine. The paper presents the shared views of four research groups on deep neural networks that outperform Gaussian mixture models on a variety of speech recognition benchmarks.
-
2017–2018
Sequence-to-sequence speech at Google
In 2017, he is a Google Brain contributor to "State-of-the-art Speech Recognition With Sequence-to-Sequence Models," a joint effort with the Speech team whose end-to-end model reaches a 5.6% word error rate on a voice search task, against 6.7% for the best conventional system. In 2018, he coauthors "Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis," a system that generates speech in the voice of many speakers, including speakers unseen during training.
-
2019
Lingvo and StarNet
In 2019, he coauthors Lingvo, a TensorFlow framework for sequence-to-sequence models that dozens of researchers already use in more than 20 papers. He also coauthors StarNet, a point-based detector for LiDAR point clouds that is competitive with or better than convolutional baselines on the Waymo Open Dataset and KITTI.
-
As of October 2026
Research scientist at Google
He is a research scientist at Google, with interests in speech recognition, machine learning, natural language processing and speaker recognition. His 2012 paper on deep neural networks for acoustic modeling has more than 15,000 citations.
Career
- NowGoogleResearch Scientist
- 2017–2018Google Brain
- From 2011Google ResearchResearch Scientist
- 2004–2010Microsoft Research
- 2000–2004Panasonic
Education
- 2002EPFLDoctorate
Sources and credits
Photo: We have no published photo of Patrick Nguyen yet. Send us a free-licensed photo.
- Free ACM talk on Speech Recognition - SF Bay ACM
- ISCA Archive - Maximum likelihood eigenspace and MLLR for speech recognition in noisy environments
- Patrick Nguyen - Google Scholar
- A Segmental CRF Approach to Large Vocabulary Continuous Speech Recognition - Microsoft Research
- Deep Neural Networks for Acoustic Modeling in Speech Recognition - Google Research
- Improving End-to-End Models For Speech Recognition - Google Research Blog
- State-of-the-art Speech Recognition With Sequence-to-Sequence Models - arXiv
- Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis - arXiv
- Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling - arXiv
- StarNet: Targeted Computation for Object Detection in Point Clouds - arXiv



