ChatGPT was the tech story of 2023 because it put the power of language AI directly into the hands of consumers. And yet ChatGPT was just the outside wrapper, the user interface, sitting atop a stack of foundation models, server chips, and other enabling technologies all working in the background. And it’s from within the realm of these enabling technologies that some of 2023’s most meaningful advancements came.
ChatGPT got a brain upgrade with the addition of OpenAI’s new GPT-4 model in March 2023. GPT-4 immediately outperformed competing models from Google, Meta, and Anthropic on a range of benchmarks, delivering more factual answers with fewer “hallucinations” and better reasoning and problem solving (it reached human-level scores on standardized tests), with enhanced safety guardrails. Importantly, GPT-4 is multimodal; that is, it can generate responses from text, image, and audio input.
The surprising performance of LLMs like GPT-4 owes a lot to supersizing not just the models but also the amount of computing power used to train them. Training GPT-4 reportedly required between 10,000 and 25,000 of Nvidia’s A100 graphics processing units (GPUs). In fact, the GPUs used to train the biggest LLMs have come almost exclusively from Nvidia, whose chips have become table stakes for researchers trying to build toward state-of-the-art performance.
Even as many enterprises struggled to apply generative AI in meaningful ways in 2023, the tech industry sunk billions into the race toward bigger and smarter models. Meta made big waves in 2023 with the release of its family of Llama LLMs on the open-source repository Hugging Face (Llama models have been downloaded more than 30 million times). In July, Anthropic debuted its new Claude 2 LLM, which was immediately recognized for its nuanced text generation and summarization skill and its capacity to remember hundreds of pages of prompt information. Cohere continued pushing on the performance of its language models, which Amazon AWS began distributing through its Bedrock AI platform in July.
While 2023 was a big year for advances in the biggest component parts of the AI hardware and software stack—LLMs and GPUs—a whole ecosystem of supporting infrastructure is just beginning to define itself. It’s quite possible that 2024’s biggest stories will concern smaller models that run on phones, or new governance systems that hold AI systems true to company policies, transparency requirements from laws like the EU’s AI Act, and state laws on data privacy, bias, and discrimination.
Explore the full 2024 list of Fast Company’s Most Innovative Companies, 606 organizations that are reshaping industries and culture. We’ve selected the firms making the biggest impact across 58 categories, including advertising, artificial intelligence, design, sustainability, and more.
Melden Sie sich an, um einen Kommentar hinzuzufügen
Andere Beiträge in dieser Gruppe
Aside from the obvious, one of the best parts of the work-from-home revolution is being able to outfit your workspace as you see fit.
And if you spend your days squinting at a tiny lapto
Child psychologists tell us that around the age of five or six, children begin to seriously contemplate the world around them. It’s a glorious moment every parent recognizes—when young minds start
During January’s unprecedented wildfires in Los Angeles, Watch Duty—a digital platform providing real-time fire data—became the go-to app for tracking the unfolding disaster and is credit
Yahoo’s bet on creator-led content appears to be paying off. Yahoo Creators, the media company’s publishing platform for creators, had its most lucrative month yet in June.
Launched in M
From being the face of memestock mania to going viral for inadvertently stapling the screens of brand-new video game consoles, GameStop is no stranger to infamy.
Last month, during the m
