I've stuck the fly brain in front of PCSX2, given it a tiny PS controller & hooked up its dopamine readout. It can play any PS2 game. I'm currently working on developing a quasi universal trainer. This is the Flystation 2.
retained text
So this is incredibly stupid and has no real world value but I'm using it to learn about SNN's - more info on what's happening is on my [social](https://x.com/RoyalCities/status/2099156575348768793?s=20) but the long and short of it is I did some visual cue tests using Mr. Mosquito as the first test bed to find movement related-ish neurons and used those as the left stick control surface - then I did some tests using moving forward movement images to capture good candidates to hook forward movement into it and did the reverse for backward flight / stopping. I'm currently running visual cue tests to help prep something like a universal controller so it can be trained directly off of ideally any PS2 game. Those tests though are why it just does better in the 2nd clip and actually stops before hitting that first wall. The network sees it and issues a stop command. Then it does go right into the coffee table but it's still much better than say...the resident evil clip where it has no idea what it's doing and is instead just trying to tackle its way for movement. But yeah, I'm now tackling a universal trainer but its actually difficult af to design one because my choices are either poke around in every individual games ram and use that to grab reward functions, OR set up some sort of visual reward function system where it actually learns off of what it's seeing. That second one is probably where Ill end up depending on my testing rn. I usually train latent diffusion audio networks but yeah this has been an interesting side quest.
document fetched 2026-09-14 00:28 · canonical https://reddit.com/r/singularity/comments/1wfcyo7/ive_stuck_the_fly_brain_in_front_of_pcsx2_given