Nvidia has launched a festive video that includes a cute bobble head avatar of CEO Jensen Huang singing Jingle Bells. The normal Christmas music has been jazzed-up 50s crooner model with some cool finger snapping motion from the leather-based jacket draped ‘Toy Jensen. This enjoyable video showcases cool applied sciences and spreads just a little vacation cheer.
The video launch isn’t only a method to say completely happy holidays to Nvidia followers, it additionally demonstrates (opens in new tab) the talents of the Nvidia Omniverse Avatar Cloud Engine, or ACE, platform. The efficiency took “simply hours,” to render and demonstrates lifelike facial expressions and physique actions alongside voice conversion expertise which mapped Jensen’s tone to the efficiency of a professional singer – this isn’t an precise recording of Jensen’s singing voice.
Breaking down the video parts, the Nvidia growth group used a lately developed mannequin to map Jensen Huang’s voice tone onto an expert vocalist’s Jingle Bells singing pattern. The musical notes from the skilled singing had been utilized to the digital voice of Toy Jensen to make the avatar sing the proper notes and rhythm. It’s notable that the musical association for this efficiency wasn’t AI-generated, however was put collectively by Jochem van der Saag, a composer and producer who has labored with Michael Bublé and David Foster.
Subsequent, Omniverse Audio2Face (opens in new tab) and Audio2Gesture (opens in new tab) applied sciences had been leveraged to generate lifelike facial expressions and gestures to match the Toy Jensen avatar’s animated musical efficiency. For a fuller X-Issue expertise present model efficiency, we expect Nvidia should develop some new Audio2Walk-down-steps expertise.
Placing the above video into some perspective, Jensen Huang hit the headlines in November when he was visiting Taipei and video-bombed a singing duo. Throughout a Taiwan Esports carnival occasion he managed to squeeze between Lah Yileh Lee and Xinting Lee throughout a efficiency of Woman Gaga’s “All the time Keep in mind Us This Means.” The efficiency went viral, however Huang insists he’s too shy to report a real-person rendition of Jingle Bells, so tasked his engineers with readying the Toy Jensen efficiency, embedded high.
Nvidia says that the Omniverse ACE platform can be obtainable quickly for early entry companions. It doesn’t say whether or not the discharge will embrace a Toy Jensen to play with.