CEVA, Inc. has unveiled NeuPro, an artificial intelligence (AI) processor family for deep learning inference at the edge. The family extends the use of AI beyond machine vision to edge-based applications including natural language processing, real-time translation, authentication, workflow management, and many other learning-based applications.
The NeuPro family comprises four AI processors offering different levels of parallel processing:
- NP500 is the smallest processor, including 512 MAC units and targeting IoT, wearables and cameras
- NP1000 includes 1024 MAC units and targets mid-range smartphones, ADAS, industrial applications and AR/VR headsets
- NP2000 includes 2048 MAC units and targets high-end smartphones, surveillance, robots and drones
- NP4000 includes 4096 MAC units for high-performance edge processing in enterprise surveillance and autonomous driving
Each processor consists of the NeuPro engine and the NeuPro VPU. The NeuPro engine includes the hardwired implementation of neural network layers among which are convolutional, fully-connected, pooling, and activation. The NeuPro VPU is a programmable vector DSP, which handles the CDNN software and provides software-based support for new advances in AI workloads. NeuPro supports both 8-bit and 16-bit neural networks, with an optimized decision made in real time to deliver the best tradeoff between precision and performance. The MAC units achieve better than 90% utilization when running and the overall processor design reduces DDR bandwidth substantially, improving power consumption levels.