ResNet Strikes Back! | Patches Are All You Need? | Papers Explained
❤️ Become The AI Epiphany
Patreon ❤️ ►
👨👩👧👦 JOIN OUR DISCORD COMMUNITY:
Discord ►
📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER:
Substack ►
In this video I cover 2 recent papers:
* ResNet strikes back: An improved training procedure in timm
* Patches Are All You Need?
The ResNet paper proposes a novel training procedure and boosts ResNet-50 top-1 accuracy to over 80%!
The “Patches Are All You Need“ paper shows that the template (using patch embeddings isotropic model) may be playing a more important role than the transformer block itself.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ ResNet paper:
✅ All You Need paper:
✅ timm lib:
✅ My transformer implementation:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00 Intro
00:50 Paper 1: high
5 views
5
0
3 years ago 00:24:57 5
ResNet Strikes Back! | Patches Are All You Need? | Papers Explained