Last year, I created a real-time, AI-driven MetaHuman NPC conversation system using Unreal Engine 5, Arduino, and Convai—an experiment in interactive storytelling and physical-digital talking with my metahuman.
~I built a fully interactive chatbot MetaHuman powered by live voice input with the amazing Convai Plug in. The character lived inside a standalone build packaged Unreal scene and responded in real-time using AI-generated dialogue via the Convai plugin.
~ Input was captured through a microphone and processed with Arduino, acting as the physical interface—making the MetaHuman feel alive in the room!!!!!
~The setup included C++ custom logic, Blueprints, and full integration between microcontrollers and Unreal’s NPC framework.
~ The project was successfully cooked and shipped as a standalone interactive app—connecting voice, AI, and physical computing in one immersive experience.
!Guess what I’ve built today—after a year of research and experimentation with MetaHumans, robotics, and Unreal Engine!
This is just a small glimpse of what I’m preparing behind the scenes…
~ Drop a comment if you’d like a tutorial on this setup! .~~~~~~~