GPT-based Transformer model implemented from scratch for educational purposes and trained on a small textual corpus of Shakespeare's works.
Tiny Shakespeare dataset: https://raw.githubusercontent.com/karpathy/char-rnn/master/data/tinyshakespeare/input.txt