What is Groq?
One of the most surprising AI revelations of the week.
Hey Everyone,
While I’m still down and out struggling with Covid, this week I got a chance to try out Groq. And it’s really fast.
Groq is on a mission to set the standard for GenAI inference speed, helping real-time AI applications come to life today.
In fact it appears orders of magnitude faster than everyone else.
Groq is serving answers from Mistral at an unprecedented speed of almost 500 T/s. That is substantially faster than we have seen before, namely what we are used to with GPT-3.5.
To test out just how fast it is try it for yourself:
Keep reading with a 7-day free trial
Subscribe to The Nvidia Patterns to keep reading this post and get 7 days of free access to the full post archives.