NXP Debuts i.MX Applications Processor with Neural Processing Unit for Advanced Machine Learning

By Tiera Oliver

Associate Editor

Embedded Computing Design

January 07, 2020

The new i.MX 8M Plus heterogeneous application processor with dedicated neural network accelerator, independent real-time sub-system, dual camera ISP, high-performance DSP and GPU for edge application

NXP Semiconductors expanded its EdgeVerse portfolio with the i.MX 8M Plus application processor, the first i.MX family to integrate a dedicated Neural Processing Unit (NPU) for advanced machine learning inference at the industrial and IoT (Internet-of-Things) edge.

The i.MX 8M Plus combines NPU delivering 2.3 TOPS (Tera Operations Per Second) with a Quad-core Arm Cortex-A53 sub-system running at up to 2GHz, an independent real-time sub-system with an 800MHz Cortex-M7, a 800 MHz audio DSP for voice and natural language processing, dual camera Image Signal Processors (ISP), and a 3D GPU. With the combination of Cortex-A53 cores and NPU, edge devices will be able to make intelligent decisions locally by learning and inferring inputs with little or no human intervention. The range of applications made possible with the i.MX 8M Plus spans people and object recognition for public safety, industrial machine vision, robotics, hand gesture, and emotion detection with natural language processing for seamless human-to-device interaction.

Edge Devices with Immersive Multi-media

Built in advanced 14nm LPC FinFET process technology, the NXP i.MX 8M Plus can execute multiple, neural networks simultaneously, such as multi-object identification, speech recognition of 40,000+ English words, and medical imaging. The NPU is capable of processing Mobilenet, a popular image classification network at over 500 images per second.

Developers can off-load machine learning inference functions to the NPU, allowing the Cortex-A and Cortex-M cores, DSP, and GPUs to execute other system-level or user applications tasks. The vision pipeline is anchored by dual integrated ISPs that support two high-definition cameras for real-time stereo vision or a single 12 MPixel resolution camera and includes High Dynamic Range (HDR) and fisheye lens correction. These features enable real-time image processing applications such as surveillance, smart retail applications, robot vision, and home health monitors.

To enable voice applications, the i.MX 8M Plus integrates a HiFi 4 DSP that enhances natural language processing with pre- and post-processing of voice streams. The powerful Cortex-M7 domain can be used to run real-time response systems while the applications processor domain executes complex non-real-time applications to reduce the overall system-level power consumption by turning off the application processor domain while keeping only the Cortex-M domain alive for wake word detection. The i.MX 8M Plus extends advanced multimedia, and video processing with a system that can compress multiple video feeds using the H.265 or H.264 HD video encoder and decoder for cloud streaming or local storage and a rich user experience enabled by 3D/2D graphics, and Immersiv3D audio with Dolby Atmos and DTS:X.

Elevating Intelligence for Industrial IoT
The i.MX 8M Plus advances industrial productivity and automation with machines that can inspect, measure, precisely identify objects, and enable predictive maintenance by accurately detecting anomalies in machine operation. In addition, the factory human-machine interfaces can be made more intuitive and secure by combining accurate face recognition with voice/command recognition and even gesture recognition. Supporting Industry 4.0 IT/OT convergence, the i.MX 8M Plus integrates Gigabit Ethernet with Time-Sensitive Networking (TSN), which combined with Arm Cortex M7 real-time processing provides deterministic wired network connectivity and processing.

To meet quality and reliability standards required for industrial applications, the i.MX 8M Plus features Error Correction Code (ECC) for internal memories and the DDR interface. The family is expected to be qualified to meet the stringent industrial temperature range (-40C to 105C ambient), power-on profile (100 percent power-on), and is planned to be part of NXP's industry-best longevity commitment (15 years).

Technical Specifications
• Computation cores: Quad-core Arm Cortex-A53 up to 2.0GHz and Cortex-M7 up to 800MHz
• Machine Learning: Neural Processing Unit (NPU) up to 2.3 TOPS
• Audio and Voice processing: low-power Tensilica HiFi4 DSP running at 800 MHz
• Dual Image Signal Processors (ISP): Resolution up to 12MP, 2x MIPI-CSI camera interfaces
• Video Processing: 1080p Video Encode/Decode including H.265 and H.264
• GPU: 3D/2D Graphics supporting OpenGL ES 3.1, Vulkan, Open CL 1.2 FP and OpenVG™ 1.1
• Memory support: Error Correction Code (ECC) on internal memories and DDR bus, 32/16-bit DDR3L, DDR4, LPDDR4 up to 4.0GT/s
• Multiple audio interfaces: TDM, DSD512, S/PDIF, PDM mic input, eARC, and ASRC.
• Display: HDMI 2.0b Tx, MIPI DSI, LVDS (4/8-lane) Tx
• Wired connectivity: 2x Gigabit Ethernet with AVB, IEEE 1588, EEE and 1x with TSN, 2x CAN-FD, 2x USB 3.0/2.0 OTG with PHY type C and PCIe Gen3
• Power Management Solution by NXP system PMIC (PCA9450C), tailor-made and optimized for the i.MX 8M Plus applications processor.

Product Availability and Demonstration
The company is showcasing its i.MX applications processor families at CES 2020 in its booth, CP-18, in Las Vegas between January 8-11.

For more information, please visit: www.nxp.com

Tiera Oliver, Associate Editor for Embedded Computing Design, is responsible for web content edits, product news, and constructing stories. She also assists with newsletter updates as well as contributing and editing content for ECD podcasts and the ECD YouTube channel. Before working at ECD, Tiera graduated from Northern Arizona University where she received her B.S. in journalism and political science and worked as a news reporter for the university’s student led newspaper, The Lumberjack.

More from Tiera