LSTM is dead. Long Live Transformers!
Seattle Applied Deep Learning · 4 HN recommendations
Video Q&A
Ask AI to explain this scene or summarize the whole video. When an answer includes timestamps, select one to jump to that moment.
Try asking: What is the speaker explaining here?
Google sign-in is required. Review the maximum credit cost before confirming.
Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.
Why HN recommends it: Recommended as a clear explanation of why RNNs fall short and how transformers solve it.
“has gotten tons of compliments and keeps people watching year after year” Read on HN ↗