From Attention in Transformers to Dynamic Routing in Capsule Nets

In this post, we go through the main building blocks of transformers and capsule networks and try to draw a connection between different components of these two models. Our main goal here is to understand if these models are inherently different and if not, how they relate.

For more details, visit the source.