Generative AI on NVIDIA Jetson Orin, Jetpack 6 SDK to support multiple OSes
NVIDIA has had several announcements at ROSCon 2023 related to robotics & embedded with highlights including generative AI on the NVIDIA Jetson Orin module and the Jetpack 6 SDK will be released next month (November 2023) with supports for Ubuntu as usual, but also other operating systems and platforms such as Debian, Yocto, Wind River, Redhawk RTOS, and Balena. Generative AI on NVIDIA Jetson Orin There’s been a lot of hype in the last year about generative AI thanks to services such as ChatGPT, Google Bard, or Microsoft Bing Chat. But those rely on closed-source software that runs on powerful servers in the cloud. As we noted in our article about the “AI in a box” offline LLM solution there are some open-source projects such as Whisper speech-to-text model and Llama2 language models that could be run on embedded hardware at the edge, but as noted by some readers platforms […]