How Anthropic has doubled down on AI safety

Anthropic, which was formed by a group of safety-conscious defectors from OpenAI, spent 2023 establishing itself as one of just a handful of envelope-pushing developers of commercial AI models.

The company raised almost $7 billion in 2023 (from Amazon and Google, among others), and last October it told investors that it was generating revenue at a $100 million annualized run rate. In July, the startup launched the second major release of its LLM, dubbed Claude 2, with improved performance on standardized tests, a larger memory for text input, and improved computer coding ability.

Numerous AI app developers use Claude 2’s API (often alongside those of other state-of-the-art models) for its unique skills in text summary and generation. On the safety side, the company implemented a novel way of keeping Claude away from toxic or dangerous content—an approach the company calls “Constitutional AI.”

Instead of laboriously providing a model with human feedback, the researchers give a model a list of general principles (a “constitution”) to follow when creating its responses. A second AI then monitors the first, continually critiquing how well it follows the principles.

Explore the full 2024 list of Fast Company’s Most Innovative Companies, 606 organizations that are reshaping industries and culture. We’ve selected the firms making the biggest impact across 58 categories, including advertising, artificial intelligence, design, sustainability, and more.

https://www.fastcompany.com/91033423/anthropic-most-innovative-companies-2024?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Creată 1y | 19 mar. 2024, 12:20:03


Autentifică-te pentru a adăuga comentarii

Alte posturi din acest grup

Tesla sets annual meeting for November amid shareholder pressure

Tesla has scheduled an annual shareholders meeting for November, one day after the

10 iul. 2025, 20:40:02 | Fast company - tech
OpenAI vs. Google could be the heavyweight battle of the half-century

Welcome to AI DecodedFast Company’s weekly newsletter that breaks down the most important news in

10 iul. 2025, 18:20:04 | Fast company - tech
The internet is obsessed with ‘Umamusume: Pretty Derby’

The internet’s latest obsession: training and cheering on anthropomorphized anime horses as they race around a track.

First released in 2021 as a mobile game for iOS and Android, Uma

10 iul. 2025, 15:50:09 | Fast company - tech
These Uber alums are building an army of AI agents for the workforce

Minh Pham and JJ Ford have a knack for riding the waves of new tech.

The duo joined Uber in its early days, helping to spearhead mobile development. When CEO Travis Kalanick was

10 iul. 2025, 15:50:07 | Fast company - tech