You can now use your Sony headphones as a free real-time head tracker for race and flight simulators on PC, several hundred games already supported — enthusiast creates open-source app that translates live sensor data into in-game camera controls
retained text
You can now use your Sony headphones as a free real-time head tracker for race and flight simulators on PC, several hundred games already supported — enthusiast creates open-source app that translates live sensor data into in-game camera controls A new level of immersion for free. Sony makes some of the best headphones on the market, and some of their recent models even include a myriad of sensors for spatial audio. These are standard gyroscopes and accelerometers capable of precise tracking, so why keep them limited to just audio features? That's exactly what developer Nicholas Slattery has done with his new project called "Sony Head Tracker" — it's an app that turns your Sony headphones and earbuds into a real-time head tracker for PC games. I made Sony headphones work as a free head tracker for 200+ PC games from r/pcmasterrace The app essentially acts as a bridge between the hardware and the software, which is OpenTrack. Sony baked the Android Head Tracker protocol into its headphones' firmware, which is what enabled spatial audio to expand the soundstage on supported devices. This data is ignored by Windows, but Slattery figured out a way to tap into the protocol and read everything it's capturing. That includes rotation vectors, gyroscope fields, and Euler Angles (live calculation of yaw, pitch, and roll). The raw data packets are then packaged into a UDP stream that the OpenTrack software can read and understand. OpenTrack supports over 200 PC games and usually works with phones, webcams, and specialized eye or IR trackers, but Slattery's app opens it to an entirely new and ingenious set of devices. Currently, Sony's WH/WF-1000XM6, WH/WF-1000XM5, and Sony ULT WEAR (WH-ULT900N) are officially compatible. Older models like the WH-1000XM4 or XM3 won't work because they lack the hardware (sensors) required for the head tracking. Apple's AirPods, which popularized Spatial Audio, use the company's proprietary protocol that doesn't open itself up on any device, as you'd expect, so they're also ruled out. Once everything is set up, you just wear your Sony headphones and the in-camera will respond to your head movements, turning around with you. If you look to the side or glance up, the camera will peep there as well, as if you were wearing a VR headset. But keep in mind that this is not a VR replacement as the screen in front of you is still stationary. Regardless, this unlocks another level of immersion for race and flight sims. The creator has tested the app to work flawlessly with Microsoft Flight Simulator, Elite Dangerous, and Assetto Corsa already. For those of us not rocking elaborate multi-monitor configs, something like this can serve as a middle ground between a true 6DoF setup and a simple helmet cam in-game, all for free. Sony Head Tracker is also open-source, so we only expect it to improve over time and expand its compatibility. Follow Tom's Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds. Get Tom's Hardware's best news and in-depth reviews, straight to your inbox. Hassam Nasir is a die-hard hardware enthusiast with years of experience as a tech editor and writer, focusing on detailed CPU comparisons and general hardware news. When he’s not working, you’ll find him bending tubes for his ever-evolving custom water-loop gaming rig or benchmarking the latest CPUs and GPUs just for fun. - bit_user I'm surprised they get enough accuracy with just compass and accelerometers. I guess it doesn't have quite the same accuracy requirement as VR, since that usually requires multiple cameras to fine-tune the tracking produced by the IMS.Reply BTW, I'm into year 6, with my XM3 headphones! The darn things just keep working, despite thousands of hours' use. I haven't even replaced the battery, yet! The earpads are quite worn down (I have replacements I was going to install when the battery needs replacing). The only bad thing about that is they're Bluetooth 4 headphones, whereas BT 5 doubled the data rate. So, I really ought to upgrade, but it's just too hard to ditch something that works almost perfectly for my needs. - MosephV Replybit_user said:I'm surprised they get enough accuracy with just compass and accelerometers. I guess it doesn't have quite the same accuracy requirement as VR, since that usually requires multiple cameras to fine-tune the tracking produced by the IMS. BTW, I'm into year 6, with my XM3 headphones! The darn things just keep working, despite thousands of hours' use. I haven't even replaced the battery, yet! The earpads are quite worn down (I have replacements I was going to install when the battery needs replacing). The only bad thing about that is they're Bluetooth 4 headphones, whereas BT 5 doubled the data rate. So, I really ought to upgrade, but it's just too hard to ditch something that works almost perfectly for my need I'm still rocking my XM3's as well. They won't die! I hope their newer models have the same longevity for when the time eventually comes.bit_user said:I'm surprised they get enough accuracy with just compass and accelerometers. I guess it doesn't have quite the same accuracy requirement as VR, since that usually requires multiple cameras to fine-tune the tracking produced by the IMS. BTW, I'm into year 6, with my XM3 headphones! The darn things just keep working, despite thousands of hours' use. I haven't even replaced the battery, yet! The earpads are quite worn down (I have replacements I was going to install when the battery needs replacing). The only bad thing about that is they're Bluetooth 4 headphones, whereas BT 5 doubled the data rate. So, I really ought to upgrade, but it's just too hard to ditch something that works almost perfectly for my needs. - bit_user Reply A couple years ago, I thought about upgrading and looked at the Amazon customer reviews of the XM5's. They seemed significantly worse than the XM4 (which seemed roughly on par with the XM3). For me, I think the XM6 would be the next step (but I haven't looked at them in the same detail).MosephV said:I'm still rocking my XM3's as well. They won't die! I hope their newer models have the same longevity for when the time eventually comes. - gaspoweredcat A feature they clearly lifted from audeze after PlayStation bought them, this was on the mobius back in like 2019Reply
document fetched 2026-07-07 09:37 · canonical https://tomshardware.com/video-games/pc-gaming/you-can-now-use-your-sony-headphones-as-a-real-time-head-tracker-for-race-and-flight-simulators-on-pc-several-hundred-games-already-supported-enthusiast-creates-open-source-app-that-translates-live-sensor-data-into-in-game-camera-controls