← sources

Cooking photoreal simulations using augmentable Gaussian Splats

source: reddit (reddit:robotics)published 2026-11-10 16:33ingested 2026-11-11 02:41

retained text

So, after getting tired of training and testing robot policies on animated simulations which never translated well on real hardware, we decided its time to build photo-real simulation environment without waiting the tech giants to make it happen.

The best approach we've found is to build high quality Gaussian Splats of real sites (this is from our office) and make it augmentable, and relightable. 

We're combining Splats and Meshes in Physics environment to build a realistics version of real places:

\- which looks as real as the real world,   
\- gives us the same physics currently possible in any mesh environment  
\- and allow us to create 100s of variations of the same environment for domain variations.

We've built a pipeline after 100s of iterations, which converts an iphone scan of the site, to a SPLAT + meshes, and lets you choose the assets you want manipulatable with robots. It then builds the detailed assets based on supposed relaistic behaviours of that asset, by breaking it down into units and places that asset into the same position in the SPLAT for robot manipulation.

We're using Mujoco Warp for physics and renderring the SPLATs inside mujoco. Robot used is Franka Panda.

  
Happy to share more details and our stack with others who need this and open to learn how others are solving this for their robots.

document fetched 2026-11-11 00:38 · canonical https://reddit.com/r/robotics/comments/1xsrir1/cooking_photoreal_simulations_using_augmentable