Inspired by u/Gold-Deal8281's post, I decided to see if Opus 5.5 could build a JAX based env for "Getting over it" with enough parity to transfer to the real game. 2.5ish days, ~13ish GPU hrs on a 3090, and 1.32B steps, and 1B tokens later, the agent wins ~85% of its rounds.
retained text
https://reddit.com/link/1xfph4w/video/x10yzg7qbrxh1/player I've done this with a few games now (brotato, cuphead, and kingdomino) with a lot of success! With 10 parallel copies of the game running, I was getting \~6k steps/s which is around 200x real time but not fast enough. Since I would never consider reverse engineering the game and engine in order to make a JAX env, I leaned on Opus 5.5 to do the dirty work. Given the task of enough parity to train an agent that performs well in the real game, it got to \~50k steps/s and 1600x real time. With about 11hrs of training on a few specialist policies, I was able to get this winning policy. Edit: oops did this late at night from my phone but meant to plug the original post [here](https://www.reddit.com/r/reinforcementlearning/comments/1xdfl7d/getting_over_it_using_drl/) and my PR to their repo [here](https://github.com/miwate/getting-over-it-rl/pull/4).
document fetched 2026-10-27 00:40 · canonical https://reddit.com/r/reinforcementlearning/comments/1xfph4w/inspired_by_ugolddeal8281s_post_i_decided_to_see