For concrete structures exposed to offshore areas, chloride ion erosion is one of the main factors affecting the durability. It is crucial to evaluate chloride ion permeability resistance of concrete structures. In this article, a finite element simulation of the chloride ion diffusion process in concrete is conducted. A mass diffusion finite element model based on random aggregate approach is established to investigate the influence of aggregate, interface transition zone, and micro-cracks on chloride ion diffusion coefficients in concrete. The results show that the mass diffusion finite element analysis based on the exponential function model and power function model can effectively simulate the chloride ion diffusion process in concrete. In addition, the data reveal that coarse aggregate is the most important factor affecting chloride ion diffusivity in concrete. However, the interface transition zone significantly accelerates chloride ion diffusion in concrete. Moreover, this acceleration effect exceeds the barrier effect of aggregate.