AI researcher and industry insider Ali Farhadi doesn’t mince words when it comes to open-source artificial intelligence: “Openness is the only way forward,” he says.
Farhadi is a professor at the University of Washington as well as the CEO of the Allen Institute for AI (AI2), one of the most active nonprofit AI research institutes in the nation. The institute has three main areas of focus: Open Ecosystem, empowering others with AI capabilities; AI for scientists, helping them do their work by mitigating the information overload in the science industries; and AI for the Planet, providing tools to protect the environment.
AI2 has become a leading voice in the industry’s fierce debate over how open new AI technology should be. Farhadi has shaped groundbreaking projects such as foundational AI research (including the first iteration of a language model, eLMo), and AI2 spin-off startup Xnor.ai (bought by Apple in 2020).
Farhadi was a third year assistant professor at UW when AI2’s founder, Paul Allen, called and asked him to join. Despite being advised to focus on securing tenure at the time, he embraced the role.
“It was such a unique opportunity that I had, I didn’t need to think twice. So I jumped on it, and it’s been sort of a game changer in my career,” Farhadi says. “In retrospect, this was the best decision I’ve ever made, not only to help my tenure and my research, but also I’ve learned so much doing this that defined my career.”
Since joining AI2 in 2015, AI2’s startup incubator has sold two spin-off companies: Kitt.ai was acquired by the Chinese search engine powerhouse Baidu in 2017; and Xnor.ai, which specialized in low-power, edge-based artificial intelligence tools, was bought by Apple in 2020. The Xnor.ai deal was around $200 million, and Farhadi actually left to join Apple for a stint.
He came back as CEO of the Allen Institute in 2023 to advocate for an open approach to AI. “It was an easy decision, and felt like going back home, but also the timing was sort of critical, given how AI was evolving,” Farhadi says.
Under Farhadi’s leadership, AI2 launched OLMo, a series of open language models. Unlike other proprietary models, which often operate behind limited APIs, OLMo offers complete openness by releasing full model weights, training code, training logs, training metrics in the form of Weights & Biases logs, and inference code.
Every model has publicly accessible code, weights, and 500-plus intermediate checkpoints, supported by tools to trace back to the exact data that was used at that point during training. Underpinning OLMo’s success is the Dolma data set. Publicly available on Hugging Face, it contains a mix of web content, academic publications, code, books, and encyclopedic materials.
AI2 released the latest version of oLMo, OLMo 1.7–7B, as well as its underlying data set, Dolma 1.7, in April 2024. Now scoring a 52 on MMLU, the model sits above Llama 2–7B, approaches Llama 2–13B, and outperforms Llama 2–13B on GSM8K.
“To me, open source means I should be able to grab what you’ve developed, understand it, change it, and build upon it,” Farhadi says. “Without that, we’re crippling the potential of researchers and developers.”
Farhadi says he is acutely aware of the risks posed by AI, but he insists secrecy is not the solution. “Having these black box solutions where people don’t know much about it would only increase the chances of unintended damage,” he adds. “The biggest problem with AI today is that we don’t fully understand these systems. Opening them up allows millions of practitioners to participate in solving those gaps.”
This story is part of AI 20, our monthlong series of profiles spotlighting the most interesting technologists, entrepreneurs, corporate leaders, and creative thinkers shaping the world of artificial intelligence.
Войдите, чтобы добавить комментарий
Другие сообщения в этой группе
Sudden equipment failures. Supply chain surprises. Retaining staff as the goalposts move in real time. These aren’t challenges I’ve faced as a tech founder—but I have faced them running restaurant
Amazon recently announced that it had deployed its one-millionth robot across its work
On this week’s Most Innovative Companies podcast, Cloudflare COO Michelle Zatlyn talks with Fast Company staff writer David Salazar about hitting $1B in revenue and going global, as well as
If you’ve built an audience around documenting your 9-to-5 online, what happens after you hand in your notice?
That’s the conundrum facing Connor Hubbard, aka “hubs.life,” a creator who
OpenAI should continue to be
WhatsApp should prepare to leave the Russian market, a lawmaker who regulates the IT sector
