FEATUREDNewsTechnology

Nvidia unveils RTX AI Broadcast

Streamers have to resort to some expensive gears to get some flashy effects like separating their own image from the background and attaching them to the video through greenscreen and chromakey. (For explanation, this seems like a job for sperate insight article).

Further people tend to apply various filters to their stream which is resource-intensive.

Nvidia gives its gamers who are using RTX GPUs to do all these and more and that too in real time. Not to mention, no extra hardware is required.

Nvidia will use its Tensor core inside RTX GPUs which will in real time use AI for below:

  1. Chromakey: Separate body/face from the background which can be applied in real-time without greenscreen.
  2. Augmented Reality: AI can detect faces, track facial features such as eyes and mouth, and even model the surface of a face, enabling real-time augmented reality effects using a standard web camera. 
  3. Filters: To apply various filters in real-time using AI technique called style transfer to transform the look and feel of a webcam feed based on the style of another image.

The SDK is integrated with discord, twitch and Elgato. The video demo is attached below.

Abhishek

Abhishek

Abhishek is a Finance Professional and has worked in multiple MNCs. However, he is also an avid tech reader and tinkerer with over 20 years of experience. His passions include 3D animation and drawing Illustrations. His creations can be viewed at www.artstation.com/abhifx