Member-only story
This Is The Reason Why Groq Has Become The “Formula 1” Of AI Inference Chips.
A story of Groq, an American tech company that outperforms every cloud-based inference provider by providing the world’s fastest conference speed with LLM.
Groq was founded in 2016 by a group of former Google engineers led by Jonathan Ross.
Jonathan worked at Google and made his mark by designing the Tensor Processing Units (TPUs).
After this, he was approached by Microsoft and Amazon with tempting offers.
One of these companies suggested to Jonathan that Google and China are the leaders and dominating players in the AI industry.
They said it would be bad if only these two entities controlled the world’s most powerful AI.
The company wanted Jonathan to join them, and he should help them to become a check on their power.
But Ross had a different opinion on this and believed that “three is not that much better than two.” He wanted to make AI available to everyone.
With this vision, he founded Groq, which is today the leader in ultra-AI inference and provides the fastest inference speed, especially for language models.
