The partial discharge (PD) event in high voltage insulation releases energy, exerts mechanical pressure, and generates elastic waves. Detecting and locating these PD events through short-duration acoustic pulses is well-established, particularly in gas-insulated systems and oil-insulated transformers. However, its full potential remains untapped in solid insulation systems, where the propagation capability of acoustic pulse and the acoustic reflections pose fundamental challenges to the Acoustic Emission (AE) detection technique. This study investigates the influence of reflections and multiple paths on the propagating acoustic pulse in polymeric insulating materials using a finite element method (FEM) in COMSOL. It was observed that the reflections from the boundary influence the propagating pulse's shape, peak magnitude, and arrival time. An analytical MATLAB model further quantifies the impact of multiple propagation paths on the shape, magnitude, and arrival time of the pulse travelling in a cylinder. Additionally, a Perfect Matched Layer (PML) was implemented in the COMSOL model to eliminate reflections from the boundary, and it revealed that the acoustic pulse magnitude decreases with distance following the inverse square law. In essence, the models aid in measuring how reflections contribute to the observed signals, facilitating the precise identification of the source of the PD event in the tested system.