← sources

Study Notes on Transformers and Hamiltonian Monte Carlo [P]

source: reddit (reddit:MachineLearning)published 2026-10-23 14:20ingested 2026-10-24 10:58

retained text

I’m sharing my study notes in case they might be useful to someone else.

The Transformer notes are mostly based on the original architecture described in *Attention Is All You Need*.

[https://doi.org/10.5281/zenodo.22031925](https://doi.org/10.5281/zenodo.22031925)

I’ve also written notes on Hamiltonian Monte Carlo (HMC).

[https://doi.org/10.5281/zenodo.21841086](https://doi.org/10.5281/zenodo.21841086)

I’d appreciate any feedback on the notes, including corrections, suggestions for improvement, or topics you think I should add.

document fetched 2026-10-24 10:30 · canonical https://reddit.com/r/MachineLearning/comments/1xdfeki/study_notes_on_transformers_and_hamiltonian_monte