Submitted:
01 October 2026
Posted:
05 October 2026
You are already at the latest version
Abstract
Gradient clipping is widely used to control large updates in optimization, while finite-step gradient descent develops period-two oscillations near the edge of linear stability. Recent work has analysed these oscillations via smooth flip bifurcation theory and higher-order stability criteria, whereas piecewise-smooth bifurcation theory describes generic interactions between period-doubling and switching boundaries. It remains unclear how a smooth gradient-descent oscillation first interacts with the switching surface generated endogenously by radial gradient clipping, and what dynamical structure emerges after this contact. For the finite-dimensional clipped gradient map \(F_{\eta,c}(x) = x - \eta \, \mathcal{C}_c^\diamond(\nabla V(x))\), we analyse this transition near a nondegenerate strict local minimum with a simple maximal Hessian eigenvalue. Clipping is locally inactive near the minimum, so the fixed-point stability threshold and the local flip bifurcation coincide with those of ordinary gradient descent. Under a supercritical flip condition, the stable period-two branch reaches the clipping boundary at \[ \eta_{\mathrm{sc}}(c) = \eta_f + K_\diamond c^2 + O(c^4) \] with \(\eta_f = 2/\lambda_*\), where \[ K_\diamond = \Gamma_*/(3\lambda_*^4 \|v_*\|_\diamond^2) \] is determined explicitly by derivatives of the potential up to fourth order and by the clipping norm. Beyond the separation law, the gradient structure yields rigidity absent from generic switching maps: the two points of every smooth period-two orbit have opposite gradients and hence reach a radial clipping boundary simultaneously; mixed smooth--clipped period-two itineraries are impossible; and every fully clipped period-two orbit has an exact unit Floquet multiplier and is therefore nonhyperbolic. A solvable planar model realizes the full transition from a stable smooth two-cycle to a neutral family of fully clipped period-two cycles.
Keywords:
gradient maps
; gradient clipping bifurcation
; period-doubling bifurcation
; piecewise-smooth dynamical systems
; switching hypersurfaces
; border collision
; periodic orbits
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.