How Anthropic has doubled down on AI safety

Anthropic, which was formed by a group of safety-conscious defectors from OpenAI, spent 2023 establishing itself as one of just a handful of envelope-pushing developers of commercial AI models.

The company raised almost $7 billion in 2023 (from Amazon and Google, among others), and last October it told investors that it was generating revenue at a $100 million annualized run rate. In July, the startup launched the second major release of its LLM, dubbed Claude 2, with improved performance on standardized tests, a larger memory for text input, and improved computer coding ability.

Numerous AI app developers use Claude 2’s API (often alongside those of other state-of-the-art models) for its unique skills in text summary and generation. On the safety side, the company implemented a novel way of keeping Claude away from toxic or dangerous content—an approach the company calls “Constitutional AI.”

Instead of laboriously providing a model with human feedback, the researchers give a model a list of general principles (a “constitution”) to follow when creating its responses. A second AI then monitors the first, continually critiquing how well it follows the principles.

Explore the full 2024 list of Fast Company’s Most Innovative Companies, 606 organizations that are reshaping industries and culture. We’ve selected the firms making the biggest impact across 58 categories, including advertising, artificial intelligence, design, sustainability, and more.

https://www.fastcompany.com/91033423/anthropic-most-innovative-companies-2024?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 1y | Mar 19, 2024, 12:20:03 PM


Login to add comment

Other posts in this group

How AI is transforming corporate finance

The role of the CFO is evolving—and fast. In today’s volatile business environment, finance leaders are navigating everything from unpredictable tariffs to tightening regulations and rising geopol

Jul 5, 2025, 1:10:03 PM | Fast company - tech
Want to move data between Apple and Google Maps? Try this  workaround

In June, Google released its newest smartphone operating system, Android 16. The same month, Apple previewed its next smartphone oper

Jul 5, 2025, 10:40:07 AM | Fast company - tech
Tally lets you design great free surveys in 60 seconds

This article is republished with permission from Wonder Tools, a newsletter that helps you discover the most useful sites and apps. 

Jul 4, 2025, 1:50:03 PM | Fast company - tech
How China is leading the humanoid robots race

I’ve worked at the bleeding edge of robotics innovation in the United States for almost my entire professional life. Never before have I seen another country advance so quickly.

In

Jul 4, 2025, 9:20:03 AM | Fast company - tech
‘There is nothing that Aquaphor will not fix’: The internet is in love with this no-frills skin ointment

Aquaphor has become this summer’s hottest accessory.

The no-frills beauty staple—once relegated to the bottom of your bag, the glove box, or a bedside drawer—is now dangling from

Jul 3, 2025, 11:50:07 PM | Fast company - tech
Is Tesla screwed?

Elon Musk’s anger over the One Big Beautiful Bill Act was evident this week a

Jul 3, 2025, 5:10:05 PM | Fast company - tech