Ai Gaming Agent banner
FareedKhan-dev FareedKhan-dev

Ai Gaming Agent

AI community

Description

A step by step implementation of building an AI agent that plays 3d shooting game

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

AI Agent that plays 3D shooting game

[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/release/python-3100/) [![Together AI](https://img.shields.io/badge/Together%20AI-API-green)](https://www.together.ai/) [![DeepSeek V3](https://img.shields.io/badge/DeepSeek-4D6BFF?logo=https%3A%2F%2Fstatic.cdnlogo.com%2Flogos%2Fd%2F9%2Fdeepseek-icon.svg&logoColor=white&style=flat)](https://deepseek.com) [![Mistral AI](https://img.shields.io/badge/Mistral_AI-FF7B00?logo=mistral-ai&logoColor=white&style=flat)](https://mistral.ai) [![OpenAI](https://img.shields.io/badge/OpenAI-API-lightgrey)](https://openai.com/) [![Medium](https://img.shields.io/badge/Medium-Blog-black?logo=medium)](https://medium.com/@fareedkhandev/creating-an-ai-agent-that-play-first-person-shooting-game-c4996168ed65)

AI agents are now also becoming part of games. The way they interact with the environment, take actions, and make decisions all depends on proper thinking and proper usage of LLMs/multimodals. So, to learn how AI agents work in a gaming environment:

  1. First, we are going to create a first-person 3D action shooting game using the Python Ursina engine.
  2. Then we will create a multi-AI agent based on sub-agents using LLM multimodals, like DeepSeek V3 for text and Mistral 3.1 for vision capability, combined together to form a powerful multi-agent system that will play the game for us and win it.

Take a look at how our AI agent (DeepSeek + Mistral) is playing our own 3D action game, failing at the first attempt but winning after the second attempt.

![First attempt of our agent](https://cdn-images-1.medium.com/max/1000/1*zjZsufaKtzWsQB3akPT31Q.gif)

![Second attempt - Win](https://cdn-images-1.medium.com/max/1000/1*IEzL4iagGcolKSSNB_PiYA.gif)

We will code everything from scratch, all the way from building the 3D game engine to creating the AI agent using an LLM and a vision-language model.