NVIDIA Introduces Jetson Orin Nano Super
A huge upgrade for edge AI hardware.
Created on December 18|Last edited on December 18
Comment
NVIDIA has announced a significant upgrade to its Jetson Orin Nano Developer Kit, with the Jetson Orin Nano Super Developer Kit. The refreshed device delivers a remarkable performance boost of up to 1.7x at a reduced price of $249, making it a game-changer for generative AI, robotics, and multimodal applications.
Performance Enhancements
The Jetson Orin Nano Super Developer Kit introduces significant improvements while maintaining the same hardware architecture. Key upgrades include:
- 1.7x higher generative AI performance, enabling better support for LLMs, VLMs, and ViTs.
- 67 Sparse TOPs, up from the previous 40 Sparse TOPs.
- 102 GB/s memory bandwidth, increased from 65 GB/s.
- 1.7 GHz CPU clock speed, up from 1.5 GHz.
These advancements allow developers to experience improved generative AI model performance and deploy emerging Transformer-based models on an affordable platform.
Generative AI Development Capabilities
The enhanced capabilities of the Jetson Orin Nano Super Developer Kit make it ideal for handling popular models like Llama-3.1-8B and smaller, edge-optimized models. The device supports frameworks such as HuggingFace Transformers, NVIDIA TensorRT-LLM, and others, providing seamless integration across platforms.
Performance benchmarks reveal substantial gains:
- LLMs such as Llama 3.2 (3B) achieve a 1.55x improvement.
- VLMs like InternVL-2.5 (4B) show a 2.04x boost.
- ViTs such as clip-vit-base-patch16 experience up to 1.69x acceleration.
Applications and Use Cases
The Jetson Orin Nano Super Developer Kit supports a wide range of generative AI applications. From AI-powered robotics using Hugging Face’s LeRobot to generative AI chatbots with Ollama, the platform enables developers to create cutting-edge solutions. NVIDIA also offers a library of tutorials through the Jetson AI Lab, facilitating exploration of advanced AI technologies optimized for edge deployment.
Conclusion
With its affordability, robust performance, and accessibility, the NVIDIA Jetson Orin Nano Super Developer Kit democratizes generative AI development. It empowers developers to innovate across domains, from robotics to edge computing, with a powerful yet cost-effective platform.
Add a comment