How Anthropic has doubled down on AI safety

Anthropic, which was formed by a group of safety-conscious defectors from OpenAI, spent 2023 establishing itself as one of just a handful of envelope-pushing developers of commercial AI models.

The company raised almost $7 billion in 2023 (from Amazon and Google, among others), and last October it told investors that it was generating revenue at a $100 million annualized run rate. In July, the startup launched the second major release of its LLM, dubbed Claude 2, with improved performance on standardized tests, a larger memory for text input, and improved computer coding ability.

Numerous AI app developers use Claude 2’s API (often alongside those of other state-of-the-art models) for its unique skills in text summary and generation. On the safety side, the company implemented a novel way of keeping Claude away from toxic or dangerous content—an approach the company calls “Constitutional AI.”

Instead of laboriously providing a model with human feedback, the researchers give a model a list of general principles (a “constitution”) to follow when creating its responses. A second AI then monitors the first, continually critiquing how well it follows the principles.

Explore the full 2024 list of Fast Company’s Most Innovative Companies, 606 organizations that are reshaping industries and culture. We’ve selected the firms making the biggest impact across 58 categories, including advertising, artificial intelligence, design, sustainability, and more.

https://www.fastcompany.com/91033423/anthropic-most-innovative-companies-2024?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

созданный 1y | 19 мар. 2024 г., 12:20:03


Войдите, чтобы добавить комментарий

Другие сообщения в этой группе

5 work-from-home purchases worth splurging for

Aside from the obvious, one of the best parts of the work-from-home revolution is being able to outfit your workspace as you see fit.

And if you spend your days squinting at a tiny lapto

14 июл. 2025 г., 05:40:05 | Fast company - tech
A newly discovered exoplanet rekindles humanity’s oldest question: Are we alone?

Child psychologists tell us that around the age of five or six, children begin to seriously contemplate the world around them. It’s a glorious moment every parent recognizes—when young minds start

13 июл. 2025 г., 11:10:06 | Fast company - tech
How Watch Duty became a go-to app during natural disasters

During January’s unprecedented wildfires in Los Angeles, Watch Duty—a digital platform providing real-time fire data—became the go-to app for tracking the unfolding disaster and is credit

13 июл. 2025 г., 06:30:05 | Fast company - tech
Why the AI pin won’t be the next iPhone

One of the most frequent questions I’ve been getting from business execs lately is whether the

12 июл. 2025 г., 12:10:02 | Fast company - tech
Microsoft will soon delete your Authenticator passwords. Here are 3 password manager alternatives

Users of Microsoft apps are having a rough year. First, in May, the Windows maker

12 июл. 2025 г., 09:40:03 | Fast company - tech
Yahoo Creators platform hits record revenue as publisher bets big on influencer-led content

Yahoo’s bet on creator-led content appears to be paying off. Yahoo Creators, the media company’s publishing platform for creators, had its most lucrative month yet in June.

Launched in M

11 июл. 2025 г., 17:30:04 | Fast company - tech
GameStop’s Nintendo Switch 2 stapler sells for more than $100,000 on eBay after viral mishap

From being the face of memestock mania to going viral for inadvertently stapling the screens of brand-new video game consoles, GameStop is no stranger to infamy.

Last month, during the m

11 июл. 2025 г., 12:50:04 | Fast company - tech