X.AI Showcases Grok-1.5 Generative AI Model Ahead of X Chatbot Upgrade
X.ai has unveiled the newest iteration of its Grok large language model, Grok-1.5. The Elon Musk-founded company will deploy the new generative AI model to power its eponymous chatbot X (formerly Twitter) soon.
Grok-1.5
Grok-1.5 enhances several aspects of the earlier Grok-1 model, particularly in logic, math, and composing code. Benchmark tests showed it more than doubled Grok-1’s score on the MATH mathematics benchmark and jumped more than 10% on the HumanEval test for coding and problem-solving prowess. Another major upgrade for Grok-1.5 is an enormously expanded context window of 128,000 tokens, far beyond Grok-1’s 8,000 tokens. The larger context windows will allow applications employing Grok-1.5 to maintain conversations for longer and refer to earlier parts of the discussion and lengthier inputs.
“This allows Grok to have an increased memory capacity of up to 16 times the previous context length, enabling it to utilize information from substantially longer documents,” X.ai explained in a blog post. “Furthermore, the model can handle longer and more complex prompts, while still maintaining its instruction-following capability as its context window expands. In the Needle In A Haystack (NIAH) evaluation, Grok-1.5 demonstrated powerful retrieval capabilities for embedded text within contexts of up to 128K tokens in length, achieving perfect retrieval results.”
Musk has repeatedly boasted that the real difference with Grok is that it has fewer guardrails around problematic or controversial issues that other AI assistants avoid. That includes sarcastic rejection of any queries it does refuse to answer. However, X.ai did not specify if Grok-1.5 carries over these unrestrictive traits or introduces any related changes compared to previous versions. Grok-1.5 comes right after X.ai made Grok-1 open-source, albeit not the fine-tuning and training data used on the model. Musk has also announced plans to widen access to the Grok chatbot to more X Premium subscribers.
Follow @voicebotaiFollow @erichschwartz
