The authors report that positional encoding fits on-axis 2D sinusoids well but performs worse at off-axis angles, whereas isotropic Gaussian RFF performs similarly well across angles. A separate visual inference from the plotted curves is that positional encoding is better than Gaussian at the on-axis angles, so this is not an unconditional Gaussian advantage. · CiteArk
Not assessedPlan blockedFindingpositional-angular-bias
The authors report that positional encoding fits on-axis 2D sinusoids well but performs worse at off-axis angles, whereas isotropic Gaussian RFF performs similarly well across angles. A separate visual inference from the plotted curves is that positional encoding is better than Gaussian at the on-axis angles, so this is not an unconditional Gaussian advantage.
Source: paper:§A.5 p. 14; Figure 11 and caption p. 15
Reported and observed measurements
No structured measurement is attached to this Claim.
Assessments (0)
No immutable Assessment has been published for this Claim yet.
