Zoho to Develop Custom Large Language Models with Nvidia Partnership
In a significant development in the realm of artificial intelligence, Zoho Corporation, a prominent player in the business software sector, has announced a strategic partnership with Nvidia to develop custom large language models (LLMs). This move is set to revolutionise Zoho's AI capabilities and enhance the experience for its extensive client base, which currently exceeds 700,000 customers worldwide.
Zoho's decision to create its own customised LLMs is underpinned by leveraging Nvidia's cutting-edge AI computing platform. Central to this collaboration are Nvidia's NeMo tools and advanced Graphics Processing Units (GPUs), which will be utilised to integrate AI functionalities across Zoho's extensive suite of services. The financial commitment to this AI-focused venture is substantial, with Zoho having already invested $10 million in AI technologies, and plans to double this investment in the following year.
The partnership with Nvidia is strategically designed to augment and diversify Zoho's AI offerings, specifically catering to enterprise-specific requirements. This approach enables Zoho to differentiate itself from the conventional consumer-grade AI tools by facilitating more rapid and informed decision-making processes for businesses. The focus is on developing LLMs and multimodal models capable of processing visual data and incorporating speech-enabled AI tools tailored specifically for business use.
Zoho is currently testing Nvidia's TensorRT-LLM, which has reportedly resulted in a 60% improvement in throughput and a 35% reduction in latency compared to previously utilised open-source frameworks. This upgrade signifies a leap in performance efficiency and responsiveness, crucial for handling diverse AI workloads seamlessly.
The integration of Nvidia’s technology is pivotal for Zoho, providing a robust infrastructure that enables features such as speech-to-text processing. This technological enhancement will be incorporated across Zoho’s comprehensive product lineup, which includes over 100 tools dedicated to various business domains including sales, marketing, customer support, and accounting among others.
One of the distinct advantages of Zoho's approach is its ability to focus on smaller, more specific language models tailored for specific business applications. This ensures that businesses, irrespective of their data scale, can utilise AI to achieve more precise objectives and gain tailored insights that align with their decision-making processes.
Ramprakash Ramamoorthy, Zoho's Director of AI, emphasised the unique value this partnership brings to businesses: "Many LLMs on the market today are designed for consumer use, offering limited value for businesses. At Zoho, our mission is to develop LLMs tailored specifically for a wide range of business use cases. Owning our entire tech stack, with products spanning various business functions, allows us to integrate the essential element that makes AI truly effective: context."
Overall, this partnership between Zoho and Nvidia represents a significant advancement in AI integration within business software, offering tailor-made solutions that promise to enhance operational efficiencies and decision-making capabilities across a myriad of enterprises.
Source: Noah Wire Services