Sakana's Fugu Ultra v1.1 AI Router Surpasses Fable 5, Defies Expectations
Sakana's updated Fugu Ultra v1.1 AI model router has achieved a significant performance boost, outperforming Anthropic's Fable 5 without even including it in its model pool. This development marks a substantial improvement over the initial version of Fugu, which received criticism for its high token usage, slow speed, and subpar results.
The latest update to Sakana's Fugu Ultra AI model router, version 1.1, has yielded impressive results, with performance gains of up to 7.9 points over its predecessor. Notably, Fugu Ultra v1.1 has surpassed Anthropic's Fable 5 in most benchmarks, a feat that is all the more remarkable given that Fable 5 is not part of the router's model pool. This achievement is a testament to the effectiveness of Sakana's approach, which involves distributing each query across a pool of top-tier models to optimize performance. The updated router has shown significant improvements on ProgramBench and TerminalBench 2.1, with scores that underscore its enhanced capabilities.
The pricing for Fugu Ultra v1.1 remains competitive, with costs set at $5 per million input tokens and $30 per million output tokens. This pricing strategy is likely to appeal to developers and businesses looking for a high-performance AI solution without incurring exorbitant costs. Furthermore, Sakana has implemented a streamlined process for adding new top-tier models to the pool, which typically takes about two weeks of training and evaluation. This efficient onboarding process ensures that the router stays up-to-date with the latest advancements in AI technology. The addition of a Claude Code-compatible endpoint also enhances the user experience, allowing for seamless integration and direct calling of Fugu from the terminal.
The initial version of Fugu received a lukewarm reception due to its limitations, including high token usage, slow speed, and poor results. However, the updates incorporated into Fugu Ultra v1.1 have addressed many of these concerns, positioning the router as a formidable competitor in the AI landscape. The fact that Fugu Ultra v1.1 outperforms Fable 5, a model from a major player in the field, underscores the significance of this development. It also highlights the dynamic nature of the AI sector, where innovation and continuous improvement can rapidly alter the competitive landscape. For developers and businesses, this means that there are now more viable options for high-performance AI solutions, which can drive innovation and growth in various applications.
The implications of Fugu Ultra v1.1's performance are far-reaching, particularly for users who require robust and efficient AI capabilities. As the AI sector continues to evolve, the ability to leverage high-performance models like Fugu Ultra v1.1 can be a decisive factor in driving success. However, it's also important to note that Sakana still does not serve the EU or EEA due to regulatory hurdles, which may limit the accessibility of this technology for some users. Despite this, the progress made with Fugu Ultra v1.1 is a positive indicator of the advancements being made in AI technology, and its impact is likely to be felt across the industry. For AI model users and developers, the emergence of Fugu Ultra v1.1 as a top-tier performer means that there are now more options for achieving high-performance results, which can accelerate innovation and adoption of AI solutions.