[R] P.R.I.M.E C-19: Solving Gradient Explosion on Circular Manifolds (Ring Buffers) using Fractional Kernels
HI! I’ve been building a recurrent memory architecture that navigates a continuous 1D ring (pointer on a circular manifold), and hit a failure mode I think DNC / Pointer Network folks will recognize. How to imagine what im talking about: Problem: the “rubber wall” at the wrap seam If the pointer mixes across the boundary (e.g., N−1 → 0), linear interpolation makes the optimizer see a huge jump instead of a tiny step. The result is either frozen […]