Magic and Algorithms: Training Combat AI in 'Roco Kingdom'

Tuesday, August 25, 2026 3:15 PM to 4:15 PM · 1 hr. (Europe/Berlin)
Stage 2 - Confex Level 1
Talk
~All~AIAI in GameplayGame Design

Information

Discover how 'Roco Kingdom' utilizes Deep Reinforcement Learning to overcome the limits of traditional behavior trees in complex turn-based RPGs. This session unpacks a production-proven AI pipeline - powering billions of matches - featuring LLM semantic clustering for skill generalization, dual-stream encoding for imperfect information handling, and stylized training for highly adaptive, strategic PvE encounters.
Topics
~All~AIAI in GameplayGame Design
Track
AI in Gameplay
Session Type
Talk
Target Audiences
Game AI engineers and lead programmers, machine learning and reinforcement learning practitioners, and game designers focused on AI-driven combat.
Experience Level
Intermediate
Key Take Aways
1. How to design a multi-layer nested hierarchical set encoding architecture for complex turn-based strategy games to efficiently process variable-length state data. 2. LLM Semantic Clustering Pipeline Practice: Utilizing Large Language Models to transform skill texts into semantic embeddings and cluster them, achieving zero-annotation generalization for skills in new version updates. 3. Imperfect Information Game Modeling and Dual-Stream Historical Encoding: Combining the dual sequences of skill operations and deployments to enhance the AI's "memory" and "anticipation" capabilities. 4. Reward Engineering for Unique Game Mechanics: How to design targeted reward guidance strategies for exclusive game mechanics such as weather teams and resonance ritual, allowing a single architecture to cover hundreds of scenarios. 4. Industrial-Grade Practices from Training to Deployment: Covering CFR (Counterfactual Regret Minimization) lineup pool management, distributed training, and lightweight deployment. The system has already successfully supported billions of online matches.
Available to Ticket Type(s)
  • gcdev Student Pass
    • gcdev Content Pass
      • gcdev Trade Pass
        • gcdev Press Pass
          • gcdev Speaker Pass
            • gcdev VIP Pass

              Join the event!

              See all the content and easy-to-use features by logging in or registering!