Two well-known former Google researchers, David Ha and Llion Jones, unveiled Sakana AI on Thursday, a brand-new AI firm based in Tokyo.
According to Jones, Sakana AI will concentrate on developing fresh architectures for foundation models.
Jones is the fifth author of Google’s research paper “Attention Is All You Need” from 2017, which presented the “transformer” deep learning architecture that later served as the foundation for the popular chatbot ChatGPT and the ongoing competition to create products using generative AI.
Ha formerly served as the Stability AI head of research and a Google Brain researcher.
The whole “Attention Is All You Need” paper’s author has since quit Google.
Millions of dollars have been invested in the authors’ new businesses by venture capitalists, including Aidan Gomez, who launched Cohere, a company that produces massive language models, and Noam Shazeer, who runs the AI chatbot startup Character. AI.