#ppo

PAPPO is a patch-aware reinforcement learning algorithm and experimental RL framework for tool-using coding agents. It provides turn-level credit assignment, PPO training utilities, rollout extraction, critic baselines, benchmark runners, and reproducible evaluation pipelines for repository repair tasks.

PPO agent trained from scratch to play a VizDoom deathmatch from raw pixels, with a convolutional actor-critic and shaped rewards.