In the dynamic and complex environment of industrial control rooms, operators are often inundated with a multitude of tasks and alerts, which can lead to an overwhelming situation known as task overload. This state can precipitate decision fatigue and a heavier reliance on cognitive biases, potentially compromising the decision-making process. To mitigate such risks, the implementation of decision support systems becomes crucial. These systems are designed to assist operators in making swift and well-informed decisions, particularly when they sense their own judgment may be faltering. Our research introduces an AI-based framework that leverages dynamic influence diagrams and reinforcement learning to construct an effective decision support system. The cornerstone of this framework is the creation of a robust, interpretable, and efficient tool that supports control room operators during critical process disturbances. By integrating expert knowledge, the dynamic influence diagram forms a comprehensive model that captures the uncertainties inherent in complex industrial processes. It is adept at anomaly detection and recommending optimal actions. Moreover, this model is enhanced through a strategic partnership with reinforcement learning algorithms, which fine-tune the recommendations to be more context-specific and precise. The ultimate goal of our framework is to provide operators with a live, reliable decision support system that can significantly improve their response during process upsets. This paper outlines the development of our AI framework and its application within a simulated control room environment. Our findings indicate that the use of decision support systems can lead to improved operator performance and reduced cognitive workload. However, it also reveals a trade-off with situation awareness, which tends to diminish as operators may become overly reliant on the system’s guidance. Trust emerges as a critical factor in the adoption and effectiveness of decision support systems. Our research underscores the importance of balancing the benefits of decision support with the need for maintaining operator engagement and comprehension during process operations.