Llion Jones Joins Sakana AI to Pursue Generative AI Research
Introduction
Llion Jones, a prominent figure in the field of artificial intelligence (AI), recently left his position at Google after 12 years to co-found Sakana AI, a generative AI research lab based in Tokyo. Alongside fellow ex-Google researcher David Ha, Jones aims to explore innovative approaches to AI and develop groundbreaking technologies.
The Decision to Leave Google
Jones, who holds a master’s degree in advanced computer science from the University of Birmingham, expressed no ill will towards Google. However, he realized that the company’s size was hindering his ability to pursue the work he was passionate about. The bureaucratic nature of the organization made it difficult for him to make progress. According to Jones, “I think the bureaucracy had built to the point where I just felt like I couldn’t get anything done.”
Contributions to Generative AI
Jones played a significant role in AI research during his time at Google. He co-authored a pivotal Transformers research paper in 2017, which greatly influenced the development of generative AI. The innovations outlined in the paper were instrumental in the creation of OpenAI’s viral chatbot ChatGPT. Jones and his team explored nature-inspired methods as an alternative to massive AI models, demonstrating their creativity and unique perspective.
Challenges and Opportunities
Google, like other tech giants, has been investing heavily in AI models and incorporating generative AI into its products. However, Jones believes that this intense focus on a single technology limits innovation. He highlighted the challenges of navigating internal politics and resource allocation within a large company. In contrast, Sakana AI aims to remain agile and open to new ideas.
The Future of Sakana AI
Sakana AI, founded by Jones and Ha, is committed to exploring the potential of large language models (LLMs) and generative AI. While they have not yet announced any investors or finalized their plans, they aim to attract like-minded individuals who wish to push the boundaries of AI research. Jones and Ha envision a future where language models are an integral part of technological advancements.
Views on OpenAI
Both Jones and Ha hold reservations about OpenAI, despite its achievements in popularizing generative AI. Ha described the organization as becoming “so big and a bit bureaucratic,” similar to certain groups within Google. Jones expressed his belief that OpenAI lacks true innovation and has built upon the research he conducted at Google without proper acknowledgment. However, OpenAI has not released their technologies under an open-source license.
The Expansion of Sakana AI
Sakana AI has already brought on board a part-time researcher from academia and plans to hire more individuals in the future. While they have not recruited any former Google employees yet, they remain open to the possibility.
Conclusion
Llion Jones’ decision to leave Google and co-found Sakana AI with David Ha reflects his desire for greater autonomy and the pursuit of innovative AI research. Sakana AI aims to break free from the constraints of bureaucratic organizations and explore new avenues in generative AI.
