Elon Musk: Grok 2 due in August, Grok 3 by year’s end

BY Sophia

Published 3 Jul 2024

Free Bionic Hand and Human Hand Finger Pointing Stock Photo

Elon Musk, the owner of X (formerly Twitter), revealed that the next generations of Grok, X’s artificial intelligence tool, are set to be released later this year: Grok 2 in August and Grok 3 by the end of 2024. 

“It takes a lot of work to purge LLMs from the Internet training data. Grok 2, which comes out in August, will be a giant improvement in this regard,” Musk said, responding to a post about Large Language Models (LLMs) training on each other’s data. 

The developers of Grok and xAI are focused on “purging” LLM datasets from the Internet to enhance data quality for the upcoming Grok versions compared to model outputs of other chatbots, such as OpenAI. 

Closed Partnership with OpenAI

Musk, a co-founder of OpenAI, parted ways with the company after disagreements and launched Grok in November 2023 in response to OpenAI’s ChatGPT chatbot. 

Despite its advancements, Musk’s chatbot is less popular than alternatives such as ChatGPT, Gemini, and Claude because X doesn’t offer a free version of Grok, and the possibility of a free version in the future is unclear. 

The Artificial Intelligence (AI) assistant’s current version is Grok 1.5, released in March with a context length of 128,000 tokens. Grok 2 is expected to build on this, with further advancements in reasoning capabilities. 

Grok’s Wit and Wisdom: Benchmark Beatdown 

Inspired by iconic AI characters such as JARVIS from Iron Man and the Guide from The Hitchhiker’s Guide to the Galaxy, Grok overall emphasizes humor in its responses to create a more lifelike and engaging user experience. 

Grok 1.5 previously scored lower than OpenAI’s Generative Pre-trained Transformer 4 (GPT-4) on the MMLU, MATH, and GSM8K benchmarks but surpassed it on the HumanEval.

The upcoming Grok 2 shows improved performance in established benchmarks such as MATH and HumanEval, promising enhanced capabilities for real-time knowledge processing, reasoning, accuracy, and user interaction experience.

The Dawn of AI: Grok’s Next Leap 

Musk also shared that the even more powerful Grok 3 is also in the works, anticipated to launch by year-end, promising to deliver even greater advancements in AI, and potentially setting new standards in the industry. 

“Grok 3 end of year after training on 100k H100s should be really something special,” Musk added, stating that the upcoming version will be trained on 100,000 of Nvidia’s H100 Graphic Processing Units (GPUs) potentially expanding the capabilities of AI assistants. 

As xAI continues to innovate under Elon Musk’s vision and a partnership with Dell Technologies and Nvidia, Grok may redefine AI interaction in the future.