Whereas lots of people have been having enjoyable chatting with OpenAI’s ChatGPT, one Stanford scholar has discovered a brand new use for the big language mannequin: interacting with others within the real-world.
Laptop science and electrical engineering scholar Bryan Hau-Ping Chiang has made ChatGPT transportable and interactive because of open supply Monocle AR {hardware} and OpenAI’s Whisper computerized speech recognition (ASR). A smartphone is presently used inside the setup, too. These mixed applied sciences have been given the catchy title rizzGPT (“Rizz” is slang for “charisma”) by Chiang. Guided in real-time, Chaing has used the AI chat assistant throughout occasions reminiscent of a mock job interview, an opportunity assembly with a pal, and selecting one of the best dishes at a brand new restaurant.
In a information to rizzGPT, shared on Twitter, Chiang describes the system as the beginning of “a brand new period of ambient computing enabled by AR + AI, the place everybody has their very own private assistant out there 24/7.” Extra briefly, and humorously, rizzGPT can be utilized throughout life occasions like awkward dates and job interviews, offering “real-time Charisma as a Service (CaaS),” quips the Stanford scholar.
say goodbye to awkward dates and job interviews ☹️we made rizzGPT — real-time Charisma as a Service (CaaS)it listens to your dialog and tells you precisely what to say subsequent 😱constructed utilizing GPT-4, Whisper and the Monocle AR glasseswith @C51Alix @varunshenoy_ pic.twitter.com/HycQGGXT6NMarch 26, 2023
An amazing instance of rizzGPT in motion is supplied by the Tweet embedded above. Within the video an AI-enhanced Chiang aces a set of interview questions, utilizing the discrete Monocle AR gadget clipped to the body of his glasses. The built-in show of the Monocle feeds him an autocue of AI-perfected solutions direct from ChatGPT.
One other private interactive situational use of the rizzGPT system is supplied when Chiang bumps right into a pal. The AI has realized who his pals are, skilled utilizing images, and may acknowledge them. The related Monocle wearer is ready to conjure up related conversations based mostly on smartphone messages exchanged with any specific pal. This might simply be deployed on “awkward dates”, so wearers can autopilot a superb dialog. That being mentioned, others round you is probably not so thrilled to see you sporting glasses that scan their face and inform you what to say. There are some echoes of Google Glass right here.
Another compelling instance of AI brokers mixed with Monocle AR is for offering menu recommendation at a restaurant. On this Tweeted video you may see that the AI reads the menu (silently) for Chiang, and when verbally quizzed offers some spoken recommendation based mostly on what it is aware of of his meals likes and dislikes – and dietary values. The Stanford scholar additionally leverages related companies for speech transcription, TTS, and OCR on this real-world AI utility.
In case you can consider another enjoyable use circumstances for rizzGPT, Chiang is asking for DMs, so don’t be shy to ship solutions.