How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Établi 5mo | 18 mars 2025, 11:50:23


Connectez-vous pour ajouter un commentaire

Autres messages de ce groupe

How AI will radically change military command structures

Despite two centuries of evolution, the structure of a modern military staff would be recognizable to Napoleon. At the same time, m

20 août 2025, 17:20:02 | Fast company - tech
This startup knows what AI is saying about your brand

Internet users are increasingly turning to AI tools like ChatGPT, rath

20 août 2025, 14:50:08 | Fast company - tech
OpenAI gave GPT-5 an emotional lobotomy, and it crippled the model

It’s rare for a tech titan to show any weakness or humanity. Yet even OpenAI’s notoriously understated CEO Sam Altman had to admit this week that the rollout of the company’s

20 août 2025, 14:50:06 | Fast company - tech
An engineer explains how AI can prevent satellite disasters in space

With satellite mega-constellations like SpaceX’s Starlink deploying thousands of spacecraft, monitoring their health has become an enormous challenge. Traditional methods can’t easily scale

20 août 2025, 12:30:15 | Fast company - tech
Landline phones are back—and they’re helping kids connect safely with friends

In today’s world, communication is largely done through one of two methods: smartphones or social media. Young children, however, rarely have access to either—and experts say they shouldn’t have a

20 août 2025, 12:30:12 | Fast company - tech