Nvidia’s AI-Generated Toy Jensen Sings Jingle Bells to Raise Your Spirits

Posted on

Nvidia has launched a festive video that includes a cute bobble head avatar of CEO Jensen Huang singing Jingle Bells. The normal Christmas music has been jazzed-up 50s crooner model with some cool finger snapping motion from the leather-based jacket draped ‘Toy Jensen. This enjoyable video showcases cool applied sciences and spreads just a little vacation cheer.

The video launch isn’t only a method to say completely happy holidays to Nvidia followers, it additionally demonstrates (opens in new tab) the talents of the Nvidia Omniverse Avatar Cloud Engine, or ACE, platform. The efficiency took “simply hours,” to render and demonstrates lifelike facial expressions and physique actions alongside voice conversion expertise which mapped Jensen’s tone to the efficiency of a professional singer – this isn’t an precise recording of Jensen’s singing voice.

Breaking down the video parts, the Nvidia growth group used a lately developed mannequin to map Jensen Huang’s voice tone onto an expert vocalist’s Jingle Bells singing pattern. The musical notes from the skilled singing had been utilized to the digital voice of Toy Jensen to make the avatar sing the proper notes and rhythm. It’s notable that the musical association for this efficiency wasn’t AI-generated, however was put collectively by Jochem van der Saag, a composer and producer who has labored with Michael Bublé and David Foster.

(Picture credit score: Nvidia)

Subsequent, Omniverse Audio2Face (opens in new tab) and Audio2Gesture (opens in new tab) applied sciences had been leveraged to generate lifelike facial expressions and gestures to match the Toy Jensen avatar’s animated musical efficiency. For a fuller X-Issue expertise present model efficiency, we expect Nvidia should develop some new Audio2Walk-down-steps expertise.

Supply hyperlink

Leave a Reply

Your email address will not be published. Required fields are marked *