A.I.Y.A : Automatic Inferential Yielding Agent

The paper introduces AIYA: Automatic Inferential Yielding Agent , which is a 3D agent designed for an interactive and embodied intelligence in a virtual environment. Unlike the conventional agents limited to text-based interaction, A.I.Y.A transforms the world of conventional conversational agents into a 3-Dimensional Simulation integrating perception and reasoning to introduce a seamless 3D companion. A.I.Y.A combines a modular pipeline which allows a real-time spoken interaction with the users, demonstrating the capability to listen, understand, and respond in a natural language while operating in a simulation. The paper describes the architecture of A.I.Y.A and its capabilities across interactive tasks and discusses its potential involving other tasks such as navigation, object manipulation and real time assistance.