Leaked video appears to show Sony director conversing with an AI Aloy prototype – GamesIndustry.biz

🔍 Summary:

PlayStation is exploring the integration of AI with characters from its major franchises, as revealed in a leaked video featuring Sharwin Raghoebardajal, PlayStation’s director of software engineering. In the video, which was initially shared with The Verge but later removed due to a copyright claim by Sony, Raghoebardajal is seen interacting with an AI prototype of Aloy, a character from the game Horizon Forbidden West. He demonstrates how the AI Aloy can provide players with lore and background information on request, showcasing advanced features like voice interaction and synchronized facial expressions, although the voice used does not match the original Aloy’s.

The AI technology behind this prototype includes OpenAI’s Whisper for speech-to-text, GPT-4 and Llama 3 for communication and decision-making, and Sony’s proprietary technologies for audio-to-facial animation and Emotional Voice Synthesis. Despite running on a PC during the demo, Sony is optimistic about the potential to operate this technology on PS5 consoles with minimal impact on performance. This development comes amidst concerns from voice actors, such as those from Apex Legends, about the use of their voices to train AI systems.

📌 Source: https://www.gamesindustry.biz/leaked-video-appears-to-show-sony-director-conversing-with-an-ai-aloy-prototype