How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 2mo | Mar 18, 2025, 11:50:23 AM


Login to add comment

Other posts in this group

Meta AI ‘personalized’ chatbot revives privacy fears

As the arms race in the artificial intelligence world ramps up, Big Tech companies are rushing to become your default AI source. Meta, last week, launched the Meta AI app to challenge ChatGPT and

May 7, 2025, 12:40:03 PM | Fast company - tech
Elon Musk’s new city puts SpaceX in the driver’s seat. Could public services be at risk?

Residents living near SpaceX headquarters in Boca Chica, Texas, will soon have a new public body through which to raise concerns about everything from road maintenance to garbage collection. Earli

May 7, 2025, 12:40:02 PM | Fast company - tech
What happens when you mix random stuff in a bowl for 100 days? TikTok found out

Ever wondered what happens when you add random household items to the same bowl every day for 100 days straight?

Well, you’re in luck. One TikTok account has made it their mission to fin

May 7, 2025, 10:20:05 AM | Fast company - tech
Why TikTok Shop can’t shake its knockoff problem

TikTok has spent nearly $1 billion cracking down on intellectual property violations in its marketplace. So why is TikTok Shop still flooded with knockoffs?

From July to December 2024, t

May 7, 2025, 10:20:04 AM | Fast company - tech
My favorite tools for a focused, restful second half of the day

This article is republished with permission from Wonder Tools, a newsletter that helps you discover the most useful sites and apps. 

May 7, 2025, 5:40:03 AM | Fast company - tech
An Arizona family used AI to recreate a road rage victim’s voice

The family of a man killed in a 2021 road rage incident in Arizona used artificial intelligence to portray the victim delivering his own impact statement during his killer’s sentencing hearing, ac

May 6, 2025, 10:40:04 PM | Fast company - tech
Justice Department asks court to break up Google’s ad tech business

The U.S. Justice Department is doubling down on its attempt to break up Google by asking a federal judg

May 6, 2025, 8:30:03 PM | Fast company - tech