How Anthropic has doubled down on AI safety

Anthropic, which was formed by a group of safety-conscious defectors from OpenAI, spent 2023 establishing itself as one of just a handful of envelope-pushing developers of commercial AI models.

The company raised almost $7 billion in 2023 (from Amazon and Google, among others), and last October it told investors that it was generating revenue at a $100 million annualized run rate. In July, the startup launched the second major release of its LLM, dubbed Claude 2, with improved performance on standardized tests, a larger memory for text input, and improved computer coding ability.

Numerous AI app developers use Claude 2’s API (often alongside those of other state-of-the-art models) for its unique skills in text summary and generation. On the safety side, the company implemented a novel way of keeping Claude away from toxic or dangerous content—an approach the company calls “Constitutional AI.”

Instead of laboriously providing a model with human feedback, the researchers give a model a list of general principles (a “constitution”) to follow when creating its responses. A second AI then monitors the first, continually critiquing how well it follows the principles.

Explore the full 2024 list of Fast Company’s Most Innovative Companies, 606 organizations that are reshaping industries and culture. We’ve selected the firms making the biggest impact across 58 categories, including advertising, artificial intelligence, design, sustainability, and more.

https://www.fastcompany.com/91033423/anthropic-most-innovative-companies-2024?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Vytvorené 1y | 19. 3. 2024, 12:20:03


Ak chcete pridať komentár, prihláste sa

Ostatné príspevky v tejto skupine

Linda Yaccarino was supposed to tame X. Elon Musk wouldn’t let her

Some news stories are gobsmackingly obvious in their importance. Others are complete nonstories. So what to make of the

9. 7. 2025, 19:10:07 | Fast company - tech
Apple’s next CEO: A new look at Tim Cook’s potential successors after latest exec shakeup

Yesterday, Apple unexpectedly announced the most radical shakeup to its C-suite in years. The company revealed that Jeff Williams, its current chief operating officer (COO), will be departing the

9. 7. 2025, 16:40:09 | Fast company - tech
PBS chief Paula Kerger warns public broadcasting could collapse in small communities if Congress strips federal funding

As Congress moves to make massive cuts to public broadcasting this week, Paula Kerger, president and CEO of the Public Broadcasting Service (PBS), gives an unflinching look at the organization’s f

9. 7. 2025, 14:30:04 | Fast company - tech
These personality types are most likely to cheat using AI

As recent graduates proudly showcase their use of ChatGPT for final projects, some may wonder: What kind of person turns to

9. 7. 2025, 14:30:04 | Fast company - tech