Bring Your AI to the Edge on a Power Budget

May 20, 2020 Rich Nass

You’ve heard it many times before: AI and machine learning (ML) are moving to the Edge of the IoT. The reasons for such have been discussed numerous times, so I won’t go through it again. Suffice to say, it’s faster and cheaper and provides better performance.

One aspect of this move that is often overlooked is the available power at the Edge. To that end, Microchip Technology is offering a solution that makes it easier to perform those AI/ML functions at the Edge. As part of the company’s Smart Embedded Vision initiative, Microchip is making it easier for software developers to implement their algorithms in its PolarFire FPGAs.

One element of this initiative, the VectorBlox Accelerator SDK, helps developers maximize the FPGAs in low-power, flexible overlay-based neural network applications. With the SDK, developers can write their code in C/C++. The key here is that you don’t have to be an expert in FPGA design. Models can be executed in TensorFlow and the open neural network exchange (ONNX) format. The latter supports many popular frameworks, including Caffe2, MXNet, PyTorch, and MATLAB. In addition, the SDK works with Linux and Windows.

A bit-accurate simulator lets the developer validate the accuracy of the hardware while in the software environment. The neural network IP included with the kit supports the ability to load different network models at run time.

Back to the devices. According to Microchip, the PolarFire FPGAs can potentially deliver up to 50% less power than competitive devices, while offering higher performance (up to 1.5 TOPS). The FPGA IP is available in various sizes to match the performance, power, and package size needed for the application. At the low end, they can be as small as 11 by 11 mm. The VectorBlox Accelerator SDK should be available sometime in the third quarter of this year. The FPGAs are already in production.

About the Author

Rich Nass

Richard Nass is the Executive Vice-President of OpenSystems Media. His key responsibilities include setting the direction for all aspects of OpenSystems Media’s Embedded and IoT product portfolios, including web sites, e-newsletters, print and digital magazines, and various other digital and print activities. He was instrumental in developing the company's on-line educational portal, Embedded University. Previously, Nass was the Brand Director for UBM’s award-winning Design News property. Prior to that, he led the content team for UBM Canon’s Medical Devices Group, as well all custom properties and events in the U.S., Europe, and Asia. Nass has been in the engineering OEM industry for more than 25 years. In prior stints, he led the Content Team at EE Times, handling the Embedded and Custom groups and the TechOnline DesignLine network of design engineering web sites. Nass holds a BSEE degree from the New Jersey Institute of Technology.

Follow on Twitter Follow on Linkedin Visit Website More Content by Rich Nass
Previous Article
Lattice sensAI 3.0 Halves Power Consumption, Doubles Performance on CrossLink-NX FPGAs

Updates to the popular AI edge inferencing software stack focus on the company's latest family of low-power...

Next Article
MCUs are Changing the Face Recognition Game
MCUs are Changing the Face Recognition Game

Contrary to what you might expect, bringing facial recognition capabilities to computers doesn’t require hi...