The research on the influencing factors of recreational fishery is an important reference index for local decision-makers, and its actual feedback lacks field consideration. By deeply analyzing the intrinsic relationship between the current situation of recreational fisheries and the needs of tourists, we can accurately understand the needs and preferences of tourists and obtain real quality feedback on products or services. Focusing on the recreational fishery in Xiangshan County, this study used Exploratory Factor Analysis to evaluate and analyze the sustainable impact factors of five recreational fisheries, including resources, infrastructure, service quality, fishing culture and recreational fishery activities, by constructing the framework of "environment + industry + culture", and found that infrastructure and natural environment had the greatest impact. Based on this, the construction of demonstration areas, reasonable planning of infrastructure, the development of fishery cultural activities, the importance of safety production and other countermeasures and suggestions, emphasizing the development of characteristic products, the improvement of service quality, the strengthening of ecological protection and resource management, so as to achieve the sustainable development of recreational fishery in Xiangshan County, and promote the upgrading of fishery industry and the inheritance of fishery culture.