Continuous gauge symmetries are usually introduced through Lie groups acting on quantum fields. In this paper we show that the algebraic structure associated with non-abelian gauge symmetry already arises naturally inside the complex group algebra of a finite non-abelian group. The dihedral group D4, the symmetry group of the square, is used as an explicit example. The complex group algebra C[D4] decomposes into irreducible matrix blocks under the Artin–Wedderburn theorem. While the character table describes only the subspace of class functions, the full group algebra contains additional intra-class directions invisible to the character table. For D4 these directions form a three-dimensional subspace which, after elementary normalization, satisfies the Pauli algebra and generates continuous SU(2) transformations inside the two-dimensional irreducible block. The construction is carried out explicitly using only the multiplication table of D4. The continuity of the complex coefficients allows continuous rotations to arise through exponentials of finite group algebra elements, without requiring the underlying symmetry group itself to be continuous. The mechanism generalizes to any finite group possessing higher-dimensional irreducible representations, where the associated matrix blocks naturally support the corresponding su(N) Lie-algebra structures.