JinwangMok

Omniverse Agent Studio — AI skill for Claude Code

AI community

Web-based Agentic AI editor for NVIDIA Isaac Sim — OpenUSD + Blender + Claude tool-use via MCP.

How to install Omniverse Agent Studio

This entry records only its repository, not the path inside it, so there is no exact command to give. Open JinwangMok/omniverse-agent-studio and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Omniverse Agent Studio does

Web-based Agentic AI editor for NVIDIA Isaac Sim — OpenUSD + Blender + Claude tool-use via MCP.

Alternatives in AI

Cursor Talk To Figma MCP — TalkToFigma: MCP integration between AI Agent (Cursor, Claude Code, Codex) and Figma, allowing Agentic AI to c 7k ★
Matlab MCP Server — Run MATLAB® using AI applications with the official MATLAB MCP Server from MathWorks® 1.4k ★
Meshgen — Use AI Agents directly in Blender 914 ★

README

Omniverse Agent Studio

A **web-based Agentic AI editor** for NVIDIA Isaac Sim. Chat with an LLM in your browser and watch it edit an OpenUSD scene live — while Isaac Sim streams the viewport via WebRTC, Blender round-trips assets via USD, and the agent drives both through MCP tools.

 ┌────────────────────────────────────────────────────────────────────────┐
 │                          Your web browser                              │
 │   ┌──────────────┐   ┌────────────────────┐   ┌─────────────────────┐  │
 │   │ Scene graph  │   │   Isaac Sim stream │   │   Chat with agent   │  │
 │   │  /World      │   │  ┌──────────────┐  │   │ > add a red cube    │  │
 │   │   ├ Ground   │   │  │   (WebRTC)   │  │   │ > export to USD     │  │
 │   │   └ Robot    │   │  └──────────────┘  │   │                     │  │
 │   └──────┬───────┘   └─────────┬──────────┘   └──────────┬──────────┘  │
 └──────────┼─────────────────────┼─────────────────────────┼─────────────┘
            │                     │                         │
            ▼ HTTP                ▼ WebRTC 49100/47998      ▼ SSE
       ┌─────────────────────────────────────────────────────────────┐
       │                   Agent (FastAPI + Claude)                  │
       │             invokes MCP tools via streamable-http           │
       └──┬───────────────────────────┬──────────────────────┬───────┘
          │                           │                      │
    ┌─────▼──────────┐        ┌───────▼────────┐     ┌───────▼────────┐
    │  usd-mcp :8001 │        │ blender-mcp    │     │   Isaac Sim    │
    │  (13 tools on  │        │ :8002 (11      │     │   runheadless  │
    │   usd-core)    │        │  tools via     │     │   --livestream │
    │                │        │  socket bridge │     │                │
    └───────┬────────┘        └────┬───────────┘     └────────┬───────┘
            │                      │                          │
            └──────────────────────┼─────────────────