You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Intuitively,using cnn for position encoding does have effect!but As we all know, convolutional neural networks are limited by the receptive field,The result is that the position encoding only computed with a small local neighborhoods