← sources

Hyperparameters fine tuning for MARL comparative study [D]

source: reddit (reddit:MachineLearning)published 2026-08-24 21:10ingested 2026-08-25 07:38

retained text

<!-- SC_OFF --><div class="md"><p>hello everyone. I'm training PPO variants on different multi-agent tasks from the <a href="https://github.com/proroklab/VectorizedMultiAgentSimulator">VMAS</a> library (Independent PPO / Graph PPO and such, see HetGPPO by Bettini et al.). </p> <p>I noticed that for every architecture/scenario couple, the optimal hyperparameters sometimes tend to vary (learning rate, entropy coefficient, KL coefficient, SGD batch size, etc). </p> <p>do I need - methodologically speaking - to unify the hyperparameters of all models in order to make a fair and correct comparison of architectures later on?</p> <p>note: sometimes unifying these HP leads to some non converging models.</p> <p>note 2 : my objective is to test these models' robustness under adversarial attack in test-time (frozen models).</p> <p>thank you in advance.</p> </div><!-- SC_ON --> &#32; submitted by &#32; <a href="https://www.reddit.com/user/ham_bam0"> /u/ham_bam0 </a> <br /> <span><a href="https://www.reddit.com/r/MachineLearning/comments/1vxfmms/hyperparameters_fine_tuning_for_marl_comparative/">[link]</a></span> &#32; <span><a href="https://www.reddit.com/r/MachineLearning/comments/1vxfmms/hyperparameters_fine_tuning_for_marl_comparative/">[comments]</a></span>

document fetched 2026-08-25 08:19 · canonical https://reddit.com/r/MachineLearning/comments/1vxfmms/hyperparameters_fine_tuning_for_marl_comparative