234. Dot Product in Attention
medium
In attention mechanisms, query Q and key K vectors are compared using the dot product. What does a large positive dot product between a query and a key indicate?
In attention mechanisms, query Q and key K vectors are compared using the dot product. What does a large positive dot product between a query and a key indicate?