Matei Zaharia is a Romanian-Canadian computer scientist and entrepreneur. He is an Associate Professor of Computer Science at Stanford University and the co-founder and Chief Technologist of Databricks.
The Creation of Apache Spark
Zaharia completed his Bachelor's at the University of Waterloo and earned his Ph.D. from UC Berkeley in 2013, advised by Ion Stoica and Scott Shenker. During his time at Berkeley's AMPLab, he created the **Apache Spark** cluster-computing framework. Spark was designed to address the speed limitations of Hadoop MapReduce by caching data in-memory, accelerating big data processing up to 100 times.
Databricks and MLsys Research
In 2013, Zaharia co-founded Databricks. At Stanford and Berkeley, his research focuses on systems for large-scale data analysis and machine learning (MLsys), developing frameworks that simplify the training, deployment, and evaluation of large language models.