How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Utworzony 2mo | 18 mar 2025, 11:50:23


Zaloguj się, aby dodać komentarz

Inne posty w tej grupie

Elon Musk’s Grok AI is replying to tweets with claims about ‘white genocide’ in South Africa

X users who interacted with the chatbot Grok on Wednesday were confronted with replies about the legitimacy of white genocide in South Africa—often regardless of context.

In one post, a

14 maj 2025, 20:50:03 | Fast company - tech
How Headspace and Ozlo help people drift off with sound

Ever wonder why the sound of rain makes you instantly drowsy, but a ticking clock drives you up the wall? That’s because not all noise soothes the brain in the same way. Sleep sounds might seem li

14 maj 2025, 16:20:06 | Fast company - tech
Elon Musk’s DOGE is launching a new AI retirement system. It was built mostly under Biden

Elon Musk’s Department of Government Efficiency (DOGE) has spent its first 100 days slashing

14 maj 2025, 16:20:05 | Fast company - tech
Uber launches affordable Route Share service and new savings features at GO-GET 2025

Uber is on Wednesday launching its own version of a bus system along busy routes, calling it its most affordable ride option yet.

The rideshare company has introduced Route Share, a new

14 maj 2025, 16:20:05 | Fast company - tech
Sony announces record surge in profits for Q1. Here’s how they did it

Japanese technology and entertainment company Sony logged an 18% rise

14 maj 2025, 16:20:04 | Fast company - tech