Pascal Bergsträßer
Pascal Bergsträßer is a theoretical computer scientist whose paper "Transformers are Inherently Succinct," written with Ryan Cotterell and Anthony Widjaja Lin, was named an ICLR 2026 Outstanding Paper. His doctoral work in Kaiserslautern, supervised by Anthony Widjaja Lin and Georg Zetzsche, centered on Ramsey quantifiers and their applications to verification. He completed his PhD in 2025, after papers on Ramsey quantifiers in 2022 and 2023 and a summer 2024 visit to the Simons Institute for the Theory of Computing as a visiting graduate student. In October 2025, he and his coauthors showed that fixed-precision transformers can be exponentially more succinct than linear temporal logic and recurrent neural networks, which makes basic verification problems for transformers EXPSPACE-complete. He is a postdoctoral researcher in the Department of Computer Science at RPTU in Kaiserslautern, working on logic, automata theory and formal verification.
Timeline
-
May 2022
Ramsey quantifiers over automatic structures
In May 2022, he posts a paper on Ramsey quantifiers over automatic structures with Moses Ganardi, Anthony W. Lin and Georg Zetzsche. It studies quantifiers that express the existence of an infinite directed clique, and it links them to reachability with Büchi conditions in regular model checking and to monadic decomposability of automatic relations.
-
November 2023
Ramsey quantifiers in linear arithmetic
In November 2023, he posts "Ramsey Quantifiers in Linear Arithmetics" with Moses Ganardi, Anthony W. Lin and Georg Zetzsche. The paper gives an algorithm for eliminating Ramsey quantifiers from linear integer, linear real and linear integer-real arithmetic, with applications to program termination and to monadic decomposability of SMT formulas.
-
2024
Visiting the Simons Institute
In summer 2024, he is a visiting graduate student at the Simons Institute for the Theory of Computing, in the Extended Reunion program on theoretical foundations of computer systems. A PhD student in theoretical computer science at the University of Kaiserslautern-Landau, supervised by Anthony W. Lin and Georg Zetzsche, he works on Ramsey quantifiers in first-order theories and their applications to verification, such as monadic decomposability and liveness.
-
2025
A doctorate in Kaiserslautern
He completes his PhD in 2025 in the group of Anthony W. Lin, professor of theoretical computer science (automated reasoning) at the University of Kaiserslautern-Landau.
-
October 2025
Succinctness of transformers
In October 2025, he posts "Transformers are Inherently Succinct" on arXiv with Ryan Cotterell and Anthony W. Lin. The paper proves that fixed-precision transformers can be exponentially more succinct than linear temporal logic and recurrent neural networks, and doubly exponentially more succinct than finite automata. As a consequence, basic verification problems for transformers, such as emptiness and equivalence, are EXPSPACE-complete.
-
November 2025
The REAL tool for Ramsey quantifiers
In November 2025, he coauthors "Fast Ramsey Quantifier Elimination in LIRA" with Kilian Lichtner, Moses Ganardi, Anthony W. Lin and Georg Zetzsche. The paper presents REAL, a tool that eliminates Ramsey quantifiers in existential linear arithmetic over integers, reals and the mixed case, and extends the FASTer verification tool to liveness checking.
-
April 2026
An ICLR 2026 Outstanding Paper
In April 2026, ICLR names "Transformers are Inherently Succinct," by Pascal Bergsträßer, Ryan Cotterell and Anthony Widjaja Lin, one of its two Outstanding Papers for 2026. The ICLR 2026 Outstanding Paper Committee describes it as a new perspective on the power of the Transformer architecture, based on how succinctly transformers can encode some concepts compared to models such as RNNs.
-
As of October 2026
Postdoc in Kaiserslautern
He is a postdoctoral researcher in the Department of Computer Science at RPTU in Kaiserslautern, with research interests in logic, automata theory and formal verification. He works in the research group of Anthony W. Lin.
Career
- NowRPTU University Kaiserslautern-LandauPostdoctoral Researcher
- 2024Simons Institute for the Theory of ComputingVisiting Graduate Student
Education
Sources and credits
Photo: We have no published photo of Pascal Bergsträßer yet. Send us a free-licensed photo.
- [2205.09015] Ramsey Quantifiers over Automatic Structures: Complexity and Applications to Verification
- [2311.04031] Ramsey Quantifiers in Linear Arithmetics
- Pascal Bergsträßer | Simons Institute for the Theory of Computing
- Homepage of Anthony Widjaja Lin [previously Anthony W. To]
- [2510.19315] Transformers are Inherently Succinct
- [2511.05323] Fast Ramsey Quantifier Elimination in LIRA (with applications to liveness checking)
- Announcing the ICLR 2026 Outstanding Papers
- Pascal Bergsträßer - RPTU


