TAIPEI (Taiwan News) — Not Diamond said Tuesday (July 30) it has secured NT$75.4 million (US$2.3 million) in funding to develop its AI router.
Co-founder and CTO Tung Tze-yang (佟澤陽) said Not Diamond is critical to achieving artificial general intelligence and ensuring the safety of such systems. The company said its AI router outperforms every foundation model on all the major benchmarks but at a significantly reduced cost.
“If you look at how human society has evolved, it is a story of specialization and collaboration. Each one of us is a specialist at the job we perform in society,” said Tung. “Just as the internet allowed humans to coordinate and collaborate to achieve greater outcomes than the sum of any one part, we believe Not Diamond can do the same for AI systems.”
Not Diamond said from early-stage startups to Fortune 500 companies, engineering teams want to maximize LLM response quality while reducing costs and latency. However, figuring out when and how to call the right model is incredibly non-trivial, and developers are forced to manually navigate a broad and confusing landscape of models with various strengths and weaknesses at varying price points, latencies, and context windows.
Every AI developer today will say that building in this space requires ongoing maintenance as new models are released every week and old models are constantly updated, the company explained.
Not Diamond said it solved this problem by developing an AI router with the following features:
- Out-of-the-box performance that beats every foundation model on all major benchmark evaluations at significantly lower costs and latency
- An elegant workflow for training custom routers optimized to customer data and use cases
- A prompt translation interface to jointly optimize prompts for each model being routed to
- Strong data privacy guarantees with the option to either fuzzy hash all data sent to the API or seamlessly deploy directly to private infrastructure
“Since adopting Not Diamond, we have seen a 10% improvement in our measured LLM output quality with an equivalent 10% reduction in our inference costs and latency,” said CTO of Samwell AI Tilen Babnik. “Not Diamond has become absolutely critical to our workflow. There is no other routing product in the market today that is as effective or developer-friendly.”
"In the future, every company will be an AI company, and every AI company will need routing," former Head of GTM at OpenAI Zack Kass said. “Tomas, Tze-Yang, and Jeffrey are some of the most exceptional founders I’ve ever met, and the early customer feedback has been stellar. I couldn’t be more bullish on what they’re building.”
“When we met Tomas and his co-founders, there was no doubt about investing,” said Sequeira Founder and Managing Director of defy.vc Neil Sequeira. “The demand for intelligent, multi-model routing is enormous. We are quite confident that routing will become a major—if not the major—linchpin of all value in the AI ecosystem.”
The company said, that with Not Diamond, engineering teams of all scales can improve their LLM outputs while reducing costs and latency and avoiding vendor lock-in.
