# Stack Overflow [pytorch]: Decoder-only Transformer has decreasing validation loss but generates repetitive or incoherent text — retained record

> Retained stackexchange record from stackexchange.

Canonical: https://highsignal.app/data/records/09909a09c394cb09

[← sources](https://highsignal.app/data)


source: [stackexchange](https://highsignal.app/data/stackexchange) published 2026-08-19 16:55 ingested 2026-08-21 06:33

[original source ↗](https://stackoverflow.com/questions/79996587/decoder-only-transformer-has-decreasing-validation-loss-but-generates-repetitive)

## retained text



```
Score: 1 | Answers: 0 | Views: 58
Tags: python, deep-learning, pytorch, pytorch-dataloader
Decoder-only Transformer has decreasing validation loss but generates repetitive or incoherent text
```



document fetched 2026-08-25 08:00
