Intel and Hercules develop an innovative solution to address GenAI compute demand
PR: Litera and ZERO Systems partner to deliver new mobile metadata manager to law firms
June 14, 2023
Lack of cross-jurisdiction billing costing millions
September 25, 2023An innovative solution developed by Hercules and Intel addresses the shortage of GPUs and their high costs, to drive adoption of generative AI at scale.
Major GPU Shortage
In a world that is increasingly dependent on artificial intelligence (AI), demand for specialized computer chips like graphics processing units (GPU) is soaring. These chips are typically used for training and running generative AI models. A substantial shortage of GPUs, coupled with their soaring costs, is preventing widespread adoption of advanced AI solutions at scale. During a recent off-the-record meeting, Sam Altman reportedly admitted that the company is struggling to make improvements to ChatGPT due to lack of specialized chips essential for training and running AI software. Amazon, Microsoft, and Google have expressed similar concerns.
Hercules & Intel Collaborate
Enter an innovative solution developed through a collaboration between Hercules and Intel – two leading companies committed to bringing the power of generative AI to enterprises at scale. The solution, which overcomes the chip shortage issue, has been successfully deployed at scale at Ropers Majeski, an international law firm. This has been made possible by utilizing the unique capabilities of Hercules, the company’s unique AI engine, and Intel’s 4th Gen Intel Xeon scalable processors.
Real Business Impact
Ropers Majeski, an international law firm, realized its need to automate critical business tasks to get ahead of the competition. These include document and email filing, information retrieval, and report creation across their global fleet of offices. These tasks were inherently manual, resulting in inaccuracies and time spent on non-billable work. The firm was looking for an AI system that could not only ensure regulatory compliance, but one that would also prevent exposure of sensitive data to external systems.
"Productivity of our knowledge workers has gone up 18.5% after deploying Hercules’ generative AI application. Hercules gives us the ultimate peace of mind with an AI solution that is robust, secure, and dependable. The impact on our business has already been significant,” says Maks Agamir, Director of Information Technology of Ropers Majeski.
The solution was to deploy a generative AI application developed by Hercules and powered by Intel’s 4th Gen Intel Xeon scalable processors. Since Ropers Majeski started using the AI application, the law firm has been saving an average of 75 minutes per user per day.
"We are excited about our collaboration with Hercules, under the Intel Disruptor Program, in bringing strong value to the end customer,” says Arijit Bandyopadhyay, Chief Technology Officer of Enterprise Analytics & AI at Intel.
Unique Capabilities
Hercules has unique capabilities that enable training and inference of high-precision AI applications for data-heavy business processes using the central processing unit (CPU) – a far cheaper and more prevalent chip. The company was recently recognized as a 2022 Gartner Cool Vendor in data-centric AI for its industry-leading data transformation capabilities.
“The increasing demand for AI computing has become even more critical, and the industry has already encountered significant challenges including soaring costs. In response to this issue, Hercules has collaborated with Intel to offer its customers robust and cost-effective computational power. This partnership enables companies to stay ahead in the AI race and enhance the capabilities of their knowledge workers by deploying effective AI applications,” says Alex Babin, Co-founder and CEO of Hercules.
Besides the Intel-powered state-of-the-art LLMs developed by Hercules, the solution also leverages Activeloop’s secure, enterprise-grade storage with advanced role-based access controls. The solution surpasses the law firm's stringent data security standards, while delivering significant efficiency savings. It provides a powerful, enterprise-grade generative AI application that is dependable, secure, and cost efficient.
Template for Future
The strategic collaboration between Hercules and Intel exemplifies how unity amongst industry trailblazers is vital to driving the generative AI revolution, shattering barriers, and ushering in an era of unprecedented technological advancement for enterprises where they reinvent their critical business processes.
Welcome to a future where human potential converges with the infinite power of generative AI, enabled by a powerful collaboration between technology leaders!
About Hercules
Hercules is a generative AI company that brings the power of large language models (LLM) inside the security perimeter of enterprises.
Our AI applications augment knowledge workers, resulting in higher revenue, improved profitability, and enhanced worker satisfaction.