How DeepSeek engineered a hyper-efficient rival to ChatGPT

DeepSeek is No. 12 on the list of the World’s 50 Most Innovative Companies of 2025. Explore the full list of companies that are reshaping industries and culture.

The Chinese company DeepSeek delivered a one-two punch in December and January, when it released a pair of state-of-the-art AI models that require far less computing power and capital than those of western AI companies. This immediately called into question the belief that the U.S. leads the world in AI—and roiled the markets.

Generative models use a lot of memory and computing power while they’re reasoning through problems because they must “remember” a lot of contextual information. DeepSeek invented a way to compress some of that data, easing the workload of the GPUs during both model training and content generation.

With a U.S. ban preventing DeepSeek from accessing the most powerful Nvidia GPUs, the company innovated on known engineering approaches to achieve efficiencies that conserved GPU horsepower. DeepSeek’s researchers found a
way to improve what’s known as mixture-of-experts architecture that divides a large language model into segments that contain specialized
knowledge.

The company also invented a more efficient way to teach its smaller model, DeepSeek-R1, how to reason. The researchers fed a relatively small amount of reinforcement learning data (questions and answers generated by its larger DeepSeek-V3 model, along with its “train of thought”) to R1. The researchers then gave the model a series of problems to solve, and rewarded it with special code for good answers. Eventually R1 began to “think” about the most promising routes to favorable answers and the reward.

DeepSeek faces fierce competition from other AI labs, but instead of keeping its research breakthroughs a secret, it shared its methods through research papers and by open-sourcing its models for others to use and modify. The message: Cutting-edge large language models are becoming an open secret.

Explore the full 2025 list of Fast Company’s Most Innovative Companies, 609 organizations that are reshaping industries and culture. We’ve selected the companies making the biggest impact across 58 categories, including advertisingapplied AIbiotechretailsustainability, and more.

https://www.fastcompany.com/91270727/deepseek-most-innovative-companies-2025?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 5mo | Mar 18, 2025, 11:50:23 AM


Login to add comment

Other posts in this group

RushTok is back. TikTok still can’t get enough of sorority recruitment

The internet’s favorite programming is back on: #RushTok season is officially upon us. 

If this is your first time tuning in, “rush” is the informal name for the recruitment process

Aug 7, 2025, 7:10:02 AM | Fast company - tech
Instagram launches map feature. It looks a lot like Snap Map

Location sharing among friends, family, and significant others has quietly become the norm in recent years.

Now Instagram is looking for a piece of the action with the launch of a

Aug 7, 2025, 12:10:05 AM | Fast company - tech
WhatsApp removes 6.8 million accounts linked to scam centers

WhatsApp has taken down 6.8 million accounts that were “linked to criminal scam centers” target

Aug 6, 2025, 9:40:06 PM | Fast company - tech
Google wants you to be a citizen data scientist

For more than a decade, enterprise teams bought into the promise of business intelligence platforms delivering “decision-making at the speed of thought.” But most discovered the opposite: slow-mov

Aug 6, 2025, 7:30:04 PM | Fast company - tech
Apple to invest another $100 billion in the U.S.

President Donald Trump on Wednesday is expected to celebrate at the White House a commitment by

Aug 6, 2025, 7:30:03 PM | Fast company - tech
Character.AI launches social feed to let users interact, create, and share with AI personas

Character.AI is going social, adding an interactive feed to its mobile apps. 

Rolled out on Monday, the new social feed may initially look similar

Aug 6, 2025, 5:10:05 PM | Fast company - tech
Exclusive: Google Gemini adds AI tutoring, heating up the fight for student users

Just in time for the new school year, Google has introduced a tool called Guided Learning within its Gemini chatbot. Unlike tools that offer instant answers, Guided Learning breaks down complex pro

Aug 6, 2025, 5:10:04 PM | Fast company - tech