NVIDIA TAO Transfer Learning Toolkit (TLT) 3.0 released with pre-trained models

NVIDIA first introduced the TAO (Train, Adapt and Optimize) framework to eases AI model training on NVIDIA GPU’s as well as NVIDIA Jetson embedded platforms last April during GTC 2021.

The company has now announced the release of the third version of the TAO Transfer Learning Toolkit (TLT 3.0) together with some new pre-trained models at CVPR 2021 (2021 Conference on Computer Vision and Pattern Recognition).

NVIDIA TAO Transfer Learning Toolkit

The newly released pre-trained models are applicable to computer vision and conversational AI, and NVIDIA claims the release provides a set of powerful productivity features that boost AI development by up to 10 times.

Highlights of TAO Transfer Learning Toolkit 3.0

  • Various computer vision pre-trained models for
    • Computer vision:
        • Body Pose estimation model that supports real-time inference on edge with 9x faster inference performance than the OpenPose model.
        • Emotion recognition
        • Facial landmark
        • License plate detection and recognition
        • Heart rate estimation
        • Gesture recognition
        • Gaze estimation
        • People segmentation via PeopleSemSegNet, a semantic segmentation network for people detection.

      tlt3 pose estimation
      Pose estimation

    • Automatic Speech Recognition (ASR) and Natural Language Processing (NLP) models with inference samples for:
      • CitriNet Speech to Text model trained on various proprietary domain-specific and open-source datasets.
      • Named Entity Recognition (NER)
      • Question/Answering using a new Megatron Uncased model
      • Punctuation
      • Text classification
  • Training support on AWS, GCP, and Azure.
  • Out-of-the-box deployment on NVIDIA Triton and DeepStream SDK for vision AI, and Jarvis for conversational AI.

If you’d like to get started you can download the latest Transfer Learning Toolkit 3.0 and access developer resources on NVIDIA developer website.

The 2D pose estimation demo above was performed with TAO Transfer Learning Toolkit 3.0 on a Jetson board. If you’d like to reproduce the demo yourself you can check the instructions on NVIDIA developer blog.

Share this:

Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress

ROCK Pi 4C Plus
Subscribe
Notify of
guest
The comment form collects your name, email and content to allow us keep track of the comments placed on the website. Please read and accept our website Terms and Privacy Policy to post a comment.
1 Comment
oldest
newest
Khadas VIM4 SBC