LLM / 2026
Transformer from scratch
Built the Transformer architecture entirely from scratch, including Multi-Head Attention, positional encoding, encoder-decoder attention, feed-forward networks, masking, residual connections, layer normalization, and a custom Byte Pair Encoding (BPE) tokenizer. The project also implements greedy autoregressive decoding and an end-to-end training pipeline for English-German machine translation.
Key Features
- High efficiency memory allocation algorithms
- Seamless platform portability layers
- Comprehensive test coverage (98% unit benchmarks)
- Modular JSON configuration setup