top of page

Kneron has launched a new AI chip capable of running LLMs partially or fully offline

Updated: Apr 9, 2024

A new AI chip has been launched with more efficient capabilities, allowing the use of #llms partially or fully offline. Here's what you need to know:

Kneron KL730 AI Chip
Image credit: The Verge

1. Kneron has launched its new auto-grade KL730 Neural Processing Unit (NPU) chip, aimed at revolutionizing edge AI technology.


2. Backed by Qualcomm, the KL730 features an integrated Image Signal Processor (ISP) and is designed to provide secure and energy-efficient AI capabilities across various applications like smart home devices, enterprise-edge servers, and driving assistance systems.


3. The KL730 chip is unique in its focus on energy-efficient and secure AI, offering a peripheral interface that supports multiple digital signals like images, videos, audio, and millimeter waves.


4. One of the key challenges that the KL730 addresses is the high energy cost often associated with AI technology. The chip achieves 3-4 times better energy efficiency compared to its predecessors.


5. Compared to other major competitors in the field, the KL730 claims to be up to 2x more energy-efficient, making it a highly competitive product.


6. Albert Liu, the Founder and CEO of Kneron, emphasized that the KL730's architecture is built specifically for AI and significantly differs from existing technologies like GPUs, positioning it as a game-changer for edge AI.


7. The KL730 supports transformer neural networks and has the compute power to handle lightweight GPT language models like nanoGPT, extending its applications further.


8. With Kneo, Kneron's proprietary edge AI network, the KL730 allows for increased data privacy by enabling AI operations on edge devices, rather than relying on cloud connectivity.


9. The chip has promising implications across industries, including bolstered security that enables greater collaboration between devices while maintaining data privacy.


10. Kneron has already attracted interest from major companies in various sectors, such as Toyota and Quanta, and sample chips of the KL730 are expected to be available soon.

Comments


bottom of page