NVIDIA EGX Targets 5G AI & IoT Sensor Edge Data Processing

October 22, 2019 Brandon Lewis

NVIDIA has released EGX, a 5G-enabled edge network infrastructure platform based on NVIDIA CUDA Tensor Core GPUs, 200 Gbps Mellanox SmartNICs, and the CUDA-X software stack. Designed for high-performance AI and IoT workload processing, scalable EGX platforms are powered by NVIDIA compute platforms ranging from Jetson Nano modules to NGC-Ready Edge Servers. This delivers up to 240 TOPS of compute capability via Tensor Cores, as much as 15 TFLOPS via CUDA GPUs, and 12 GigaRays per second of graphics performance. This horsepower allows EGX systems to compute up to 140 concurrent H.265 video streams.

Additional EGX platform features include a secure boot root of trust, cryptographic acceleration of IPsec and TLS protocols, and remote NVMe storage capabilities over TCP or RDMA.

Meanwhile, the company has partnered with Ericsson to transform EGX into telco-grade, software-defined 5G edge networking platforms. As part of the collaboration NVIDIA has integrated support for the Aerial SDK into the EGX software stack, which allows carriers to build virtualized 5G radio access networks. The cloud-native EGX software stack also supports Red Hat’s OpenShift for Kubernetes container orchestration.

To showcase the ultra-low-latency 5G and multi-modal sensor processing capabilities of EGX, NVIDIA also announced the Metropolis IoT and Jarvis development tools. Based on the DeepStraem SDK, Metropolis IoT is an application framework that pipes camera data over Ethernet into EGX servers, then passes them through neural networks running within Kubernetes containers. The data can then be moved into graphics engines for labeling, etc., and further transmitted into the Microsoft Azure cloud for further analytics processing.

The Jarvis SDK is a multi-modal AI framework that integrates multiple pre-trained models for speech recognition, natural language processing, computer vision, and pose classification for contextual interactions with human operators without the need for wake words or queues.

Enhancements to the Isaac SDK are also supported.

More than 100 companies are already involved in the EGX ecosystem, including Samsung, Walmart, Microsoft, Dell, VMWare, and others.

Fore more information on EGX hardware and software, visit www.nvidia.com/en-us/data-center/products/egx-edge-computing/.

About the Author

Brandon Lewis

Brandon Lewis, Editor-in-Chief of Embedded Computing Design, is responsible for guiding the property's content strategy, editorial direction, and engineering community engagement, which includes IoT Design, Automotive Embedded Systems, the Power Page, Industrial AI & Machine Learning, and other publications. As an experienced technical journalist, editor, and reporter with an aptitude for identifying key technologies, products, and market trends in the embedded technology sector, he enjoys covering topics that range from development kits and tools to cyber security and technology business models. Brandon received a BA in English Literature from Arizona State University, where he graduated cum laude. He can be reached by email at brandon.lewis@opensysmedia.com.

Follow on Twitter Follow on Linkedin Visit Website More Content by Brandon Lewis
Previous Article
OmniVision Releases Smallest Image Sensor and Miniature Camera Module for Disposable Medical Applications
OmniVision Releases Smallest Image Sensor and Miniature Camera Module for Disposable Medical Applications

Smallest image sensor provides high quality images from smallest parts of anatomy, for brain, ophthalmic, E...

Next Article
UltraSoC Develops Embedded Hardware-Based Cybersecurity Products

Security solution rewrites transactions that breach security protocol.