Meta’s new AI model can check other models’ work

Facebook owner Meta said on Friday it was releasing a batch of new AI models from its research division, including a “Self-Taught Evaluator” that may offer a path toward less human involvement in the AI development process.

The release follows Meta’s introduction of the tool in an August paper, which detailed how it relies upon the same “chain of thought” technique used by OpenAI’s recently released o1 models to get it to make reliable judgments about models’ responses.

That technique involves breaking down complex problems into smaller logical steps and appears to improve the accuracy of responses on challenging problems in subjects like science, coding and math.

Meta’s researchers used entirely AI-generated data to train the evaluator model, eliminating human input at that stage as well.

The ability to use AI to evaluate AI reliably offers a glimpse at a possible pathway toward building autonomous AI agents that can learn from their own mistakes, two of the Meta researchers behind the project told Reuters.

Many in the AI field envision such agents as digital assistants intelligent enough to carry out a vast array of tasks without human intervention.

Self-improving models could cut out the need for an often expensive and inefficient process used today called Reinforcement Learning from Human Feedback, which requires input from human annotators who must have specialized expertise to label data accurately and verify that answers to complex math and writing queries are correct.

“We hope, as AI becomes more and more super-human, that it will get better and better at checking its work, so that it will actually be better than the average human,” said Jason Weston, one of the researchers.

“The idea of being self-taught and able to self-evaluate is basically crucial to the idea of getting to this sort of super-human level of AI,” he said.

Other companies including Google and Anthropic have also published research on the concept of RLAIF, or Reinforcement Learning from AI Feedback. Unlike Meta, however, those companies tend not to release their models for public use.

Other AI tools released by Meta on Friday included an update to the company’s image-identification Segment Anything model, a tool that speeds up LLM response generation times and datasets that can be used to aid the discovery of new inorganic materials.

—Katie Paul, Reuters

https://www.fastcompany.com/91213556/meta-ai-model-self-taught-evaluator?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Établi 10mo | 21 oct. 2024, 23:10:17


Connectez-vous pour ajouter un commentaire

Autres messages de ce groupe

Smarter AI is supercharging battery innovation 

The global race for better batteries has never been more intense. Electric vehicles, drones, and next-generation aircraft all depend on high-performance energy storage—yet the traditiona

24 août 2025, 11:40:14 | Fast company - tech
AI passed the aesthetic Turing Test, raising big questions for art

Pick up an August 2025 issue of Vogue, and you’ll come across an advertisement for the brand Guess featur

24 août 2025, 09:20:14 | Fast company - tech
This word-search website is the brain boost you never knew you needed

Language is the original technology, the tool we’ve all used to coordinate with each other for thousands of years. Our success in life—both professionally and in relationships—depends on it.

24 août 2025, 00:10:13 | Fast company - tech
Dropbox Passwords is shutting down. Do this before your passwords are deleted for good

It’s been a bad year for password managers. First, Microsoft announced earlier this summer that its popular Microsoft Authenticator app would be

23 août 2025, 10:10:09 | Fast company - tech
The TikTok dorm water panic is officially here

Instead of worrying about making friends or keeping up with their studies, new college students have a different concern on their minds: dorm water.

“Praying dorm water doesn’t ruin my h

22 août 2025, 20:20:07 | Fast company - tech
Reddit—and a dash of AI—do what Google and ChatGPT can’t

Hello, everyone, and thanks once again for reading Fast Company’s Plugged In.

For years, some of the world’s most

22 août 2025, 20:20:06 | Fast company - tech