Elon Musk's answer to ChatGPT is getting an update to make it better at math, coding and more. Musk's xAI has launched Grok-1.5 to early testers with "improved capabilities and reasoning" and the ability to process longer contexts. The company claims it now stacks up against GPT-4, Gemini Pro 1.5 and Claude 3 Opus in several areas.
Going by xAI's numbers, Grok-1.5 appears to be a large improvement over Grok-1. It shot up to 50.6 percent in the MATH benchmark, over double the previous score. It also climbed to 90 percent and 74.1 percent in GSM8K (math word problems) and HumanEval (coding), respectively, compared to 62.9 percent and 63.2 percent before. Those numbers are within shouting distance of Gemini Pro 1.5, GPT-4 and Claude 3 Opus — in fact, the HumanEval coding score beats all rivals except Claude 3 Opus.
It can also process long contexts of up to 128K tokens within its context window, meaning it can amalgamate data from more sources to understand a situation. "This allows Grok to have an increased memory capacity of up to 16 times the previous context length, enabling it to utilize information from substantially longer documents," the company said.
xAI didn't detail Grok's progress in other areas, though, where it still may be lagging (academic scores, multimodal and others). And Grok-1.5 may not keep its position for long. ChatGPT 5 is set to arrive sometime this summer, promising a feature set that "makes it feel like you are communicating with a person rather than a machine," according to OpenAI.
Currently, Grok is only available for users of the Premium+ tier on X (formerly Twitter), though Elon Musk recently promised to open it up to X's regular Premium users. The company also recently open sourced its Grok chatbot, after Musk sued OpenAI and Sam Altman for allegedly abandoning its non-profit mission.
This article originally appeared on Engadget at https://www.engadget.com/elon-musks-updated-grok-ai-claims-to-be-better-at-coding-and-math-120056776.html?src=rss https://www.engadget.com/elon-musks-updated-grok-ai-claims-to-be-better-at-coding-and-math-120056776.html?src=rssAk chcete pridať komentár, prihláste sa
Ostatné príspevky v tejto skupine
Over the past few years, I’ve developed a peaceful little routine to make up for time spent cooped up inside working on sunny days: after I’ve closed my laptop for the day, I throw my sneakers on,
Ah, Flappy Bird. It’s been a long time since I last gave any thought to the game-turned-cultural-phenomenon that briefly had us all in a chokehold a decade ago. At least, that was the case
Resident Evil 6 has sold surprisingly well on the Nintendo Switch since it was ported to the console in 2019, despite it being almost universally panned by fans of the series. As spotted b
ICQ, which used to be a very popular messaging app for a short period in the 90s and the early aughts, only has a month left before it joins the other apps and software of old in the great big farm
