How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Erstellt 5mo | 18.03.2025, 11:50:23


Melden Sie sich an, um einen Kommentar hinzuzufügen

Andere Beiträge in dieser Gruppe

Pinterest’s male audience is booming. Here’s what they’re searching for

A growing number of men are flocking to Pinterest.

The company’s first-ever trend report reveals that male users now make up

06.08.2025, 12:30:04 | Fast company - tech
‘We’re short about a million workers’: Rebecca Shi on immigration’s economic toll

As the Trump administration ramps up mass deportations, impacting businesses across numerous sectors, the American Business Immigration Coalition (ABIC) is advocating for policy reform. Rebecca Sh

06.08.2025, 10:10:06 | Fast company - tech
Palantir hits $1 billion in quarterly sales for the first time, avoids DOGE cuts

Shares of Palantir Technologies sailed past previous record highs Tuesday after

05.08.2025, 20:20:04 | Fast company - tech
How Tesla’s Autopilot verdict could stifle Musk’s robotaxi expansion

A court verdict against Tesla last week, stemming from a fatal 2019 crash of an Aut

05.08.2025, 17:50:11 | Fast company - tech
Cloudflare vs. Perplexity: a web scraping war with big implications for AI

When the web was established several decades ago, it was built on a number of principles. Among them was a key, overarching standard dubbed “netiquette”: Do unto others as you’d want done unto you

05.08.2025, 17:50:09 | Fast company - tech