Orin NX Ampere GPU Architecture Delivers 100 TOPS of AI Performance

While its history dates back to the 1950s, artificial intelligence (AI) has evolved significantly in recent years. With a combination of AI and machine learning, many processes can now be completed quickly and to a high standard. This includes everything from business tasks such as analysing and deciphering large amounts of data to producing professional standard artwork in a matter of seconds.

Yet for AI to perform at the standard required (particularly as it continuallygrows and evolves), it needs the right technology to support its ambitions. One such piece of technology is the NVIDIA Jetson Orin NX.

What is the NVIDIA Jetson Orin NX?

For the uninitiated, the NVIDIA Jetson Orin NX is a module built with AI capabilities that are unmatched for low-power, smaller autonomous machines, embedded applications, and robots. As a result, it is a great addition to products such as handheld devices and drones.

Extending on from the standard NVIDIA Jetson edge AI expansion that was released in 2022, the latest Orin NX variant takes performance levels to the next level. Even though it is recognised as the smallest Jetson form factor, it manages to pack in 100 TOPS (Trillion Operations per Second) of AI performance. The power can also be configured ranging from 10 W up to 25 W.

All of this means it outshines all of its predecessors. Developers can enjoy 3x the performance compared to NVIDIA’S Jetson AGX Xavier, while this goes up to 5x when matched against the NVIDIA Jetson Xavier NX.

How the NVIDIA Jetson Orin NX is Changing the Business World

Manufacturing, agriculture, retail, logistics, life sciences, and healthcare are just some of the industries already using this powerful module. More and more bespoke computer systems are being created with the Jetson Orin NX included. When combined with industrial-grade components, it delivers a highly advanced AI computer in a deceptively power-efficient and compact package.

Another reason why the Jetson Orin NX module is so powerful and versatile is that it supports various AI application pipelines. This includes those with NVIDIA Ampere architecture GPU, fast memory bandwidth, high-speed I/O, and next-gen deep learning and vision accelerators. The result isthat you can develop solutions that incorporate even the most complex and largest AI models with 3D perception, multi-sensor fusion, and natural language understanding.

NVIDIA Jetson Orin NX and the Future

Even with all of these positives going for it, the Jetson Orin NX still hasn’t realised its full potential. Following further software optimisations in the future, this module will deliver even greater performance levels.

Due to its support for sparsity, the Jetson Orin NX can also be supported for even greater performance. It is possible to utilise fine-grained structured sparsity for deep learning networks. This allows Tensor Core operations to benefit from a throughput increase.

As AI technology continues to grow and revolutionise the business world, the importance of modules such as the Jetson Orin NX will become all the more apparent.