Friday, April 4, 2025

Top 5 This Week

Related News

Neuchips partners with Vecow and GSH to accelerate proprietary data processing with Offline Gen AI

By using Neuchips’ Viper series cards, the collaboration also offers energy efficiency and offline LLMs to provide enterprises with maximum data protection and security.

TAIPEI , March, 2025 /PRNewswire/: Ahead of Embedded World 2025,  Neuchips , a leading provider of application-specific integrated circuits (ASICs) for artificial intelligence (AI), announces a collaboration with ShareGuru from Vecow and Golden Smart Home (GSH) Technology Corp. The partnership aims to revolutionize SQL data processing through a private, secure, and energy-efficient AI solution that delivers real-time insights from enterprise databases via natural language queries.

Visit Neuchips and Vecow in Hall 3, Booth #3-449 at Embedded World 2025 (March 11-13, Nuremberg, Germany).

“Our collaboration with Vecow and GSH represents the future of industrial AI deployment,” said Ken Lau , Managing Director of Neuchips. “At Embedded World 2025, visitors to the Vecow booth will experience how the unique capabilities of our Viper AI accelerator card – including support for 12B parameter models at just 45W power consumption – complement Vecow’s robust industrial edge AI computing systems and GSH’s ShareGuru SLM solutions. This powerful combination enables secure and efficient AI processing of proprietary data that meets the demanding requirements of modern industrial environments. We are proud to partner with Vecow to bring this generative AI innovation into the realm of enterprise-focused applications.”

“As generative AI applications grow in the field, the demand for multimodal large language models (LLMs) is increasing rapidly,” said Joseph Huang , Executive Vice President at Vecow. “As an AI computing solutions provider, Vecow is working with Neuchips to develop innovative RAG-based LLM solutions that enable users to access the latest data without training models, thus achieving more relevant and high-quality results. This is essential for our customers who are looking for a cost-effective, compact and power-efficient AI workstation that outperforms traditional cloud-based GPU solutions.”

Joining forces for the ultimate AI-driven data processing solution

As database complexity increases and SQL skills remain in short supply, organizations are experiencing significant delays in extracting important insights from data. However, online AI models cannot be used due to the lack of protection of proprietary data.

To solve these problems for enterprises across all industries, the breakthrough solution leverages the Vecow ECX-3100 RAG Edge AI Inference Workstation, a RAG-enabled (Retrieval-Augmented Generation) LLM computing platform. It runs GSH’s ShareGuru QA 2.0 solution, which is based on the ShareGuru SLM platform and uses a single LLM card from Neuchips – the Viper Series Gen-AI card .

In combination, the solution enables the use of human language to create SQL queries, making them more accessible and efficient while reducing the cost of SQL experts. It also has the following benefits:

  • Maximum privacy and security : Neuchips offline card runs the ShareGuru solution and platform locally
  • High accuracy: Through AI power query validation
  • High power efficiency: The Viper series of new chips offers 45 W power efficiency with a model with 12 billion parameters

AI accelerator card of the Viper series from Neuchips

Unveiled at COMPUTEX 2024, the Viper series offloads more than 90% of the resources required for generative AI from the CPU to realize the full potential of LLMs and stands out in the market with:

  • Additional 32 GB storage capacity
  • Native support of the BF16 Structured Language Model
  • AI accelerator chip Raptor Gen from Neuchips , presented at CES 2024

Looking ahead to 2026, Neuchips plans to focus on low-power, multi-modal ASICs to further increase performance.

Information about new chips

Neuchips is at the forefront of AI ASIC solutions, pioneering the development of dedicated hardware for DLRM and LLM. With our dedicated team of experts, commitment to innovation, and strong presence in industry organizations, we are ready to shape the future of AI hardware and usher in a new era of efficiency and performance.

For more information, visit: http://www.neuchips.ai/

Also read: Viksit Workforce for a Viksit Bharat

Do Follow: The Mainstream formerly known as CIO News LinkedIn Account | The Mainstream formerly known as CIO News Facebook | The Mainstream formerly known as CIO News Youtube | The Mainstream formerly known as CIO News Twitter

About us:

The Mainstream formerly known as CIO News is a premier platform dedicated to delivering latest news, updates, and insights from the tech industry. With its strong foundation of intellectual property and thought leadership, the platform is well-positioned to stay ahead of the curve and lead conversations about how technology shapes our world. From its early days as CIO News to its rebranding as The Mainstream on November 28, 2024, it has been expanding its global reach, targeting key markets in the Middle East & Africa, ASEAN, the USA, and the UK. The Mainstream is a vision to put technology at the center of every conversation, inspiring professionals and organizations to embrace the future of tech.

Popular Articles