How Gran Turismo's 'Sophy' Actually Works | AI and Games

Support AI and Games on Patreon:
http://www.patreon.com/ai_and_games
--

'GT Sophy' made a splash in early 2022 as it was declared to be a new type of AI racer for Gran Turismo that could leave many a professional player in the dust. It's time to find out how it works, and the story of where it comes from.

--

A written version of this episode is available at:
http://www.aiandgames.com/2022/08/01/gran-turismo-sophy

If you're keen to find out more, here are all the research materials used for this episode:

"Neural Networks Overtake Humans in Gran Turismo Racing Game"
https://www.nature.com/articles/d41586-022-00304-2

"Outracing Champion Gran Turismo Drivers with Deep Reinforcement Learning"
https://www.nature.com/articles/s41586-021-04357-7

"Superhuman Performance in Gran Turismo Sport using Deep Reinforcement Learning"
https://rpg.ifi.uzh.ch/docs/RAL21_Fuchs.pdf

"Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learning"
https://rpg.ifi.uzh.ch/docs/ICRA21_Yunlong.pdf

The Sony AI YouTube Channel
https://www.youtube.com/channel/UC-eJUbUU5AVi_tp75XFnDIQ

The Gran Turismo TV YouTube Channel
https://www.youtube.com/c/GRANTURISMOTV

The Gran Turismo Sophy Website
https://www.gran-turismo.com/us/gran-turismo-sophy/

Footage of Tesla AI Driving by 'Whole Mars Catalog'
https://www.youtube.com/watch?v=_ZYEjYnmPlA

--

Video Chapters:
[00:00] Intro
[01:23] Sony AI
[05:02] The Goal of Sophy
[09:30] Sophy's 'Brain'
[15:59] Learning to Race
[19:23] Rewarding Good Racing
[23:44] Training a Champion
[30:34] Open Challenges
[31:38] Credits

Music in this episode is by TeknoAxe:
http://www.teknoaxe.com

--
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. It's supported through and wouldn't be possible without the wonderful people who support it via Patreon and YouTube memberships.

http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join

--
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames

Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames

Join our Discord Community:
bit.ly/AIandGamesDiscord