Elon Musk’s AI chatbot, X.ai, has unveiled its latest generative AI model, Grok-1.5, set to enhance the capabilities of social network X’s Grok chatbot in the near future.
Described as a significant improvement over its predecessor, Grok-1, Grok-1.5 boasts enhanced reasoning abilities, particularly in coding and math-related tasks. Benchmark results and specifications published by X suggest substantial performance gains for Grok-1.5, including a doubling of scores on the MATH benchmark and significant improvements on the HumanEval test.
However, the true impact of these improvements in real-world usage remains uncertain. Commonly used AI benchmarks may not accurately reflect how average users interact with models like Grok-1.5.
One enhancement is the increased context capacity of Grok-1.5 compared to Grok-1, allowing it to consider a 128,000-token context, which improves its understanding and retention of conversation content.
X.ai highlights Grok’s unique ability to address topics typically avoided by other AI models, such as conspiracies and controversial political ideas, often responding with a rebellious tone or rude language upon request. It’s unclear if Grok-1.5 introduces changes in these areas, as X.ai does not address this in its announcement.
Early testers on X will soon have access to Grok-1.5, along with several new features, including thread summarization and content suggestion. This announcement follows X.ai’s decision to open source Grok-1, although without the necessary code for further training. Additionally, Musk has hinted at expanding access to Grok, previously available only to premium customers, to a broader user base on X.