Development of Artificial Intelligence/Machine Learning (AI/ML) Models for Methane Emissions Forecasting in Seaweed

1. Introduction

Oil and natural gas will remain integral to the energy system for the foreseeable future, necessitating a focus on mitigating their immediate environmental impacts. Reducing methane emissions, currently over two-and-a-half times higher than pre-industrial levels [1], is a crucial and cost-effective strategy that complements efforts to reduce CO₂. Global methane emissions are estimated at 570 million tons (Mt) annually, with agriculture and the energy sector, including coal, oil, natural gas, and biofuels, being major contributors [2]. While all methane sources require attention, emissions from oil and gas operations are particularly significant [3]. These operations offer an opportunity for cost-effective reduction due to the commercial value of methane, making emissions cuts economically favorable. Projections indicate that oil and natural gas will play significant roles in the energy system [4]. Gas can facilitate the transition by replacing more polluting fuels and providing challenging-to-replace services. Nonetheless, minimizing adverse social and environmental impacts is crucial, with substantial and immediate methane emission reductions being central to achieving this objective. Therefore, having an accurate methane detection and monitoring system is important for several reasons:

-

Climate Change Mitigation [5]: Methane is a potent greenhouse gas, with a significantly higher global warming potential than carbon dioxide over a shorter time frame. Accurate detection and monitoring of methane leaks help identify and address sources of emissions, allowing for effective mitigation strategies to reduce greenhouse gas emissions and combat climate change.

-

Environmental Impact [6]: Methane leaks can occur from various sources, including natural gas pipelines, oil and gas infrastructure, landfills, sargassum landing, and agricultural activities, such as seaweed cultivation. These leaks not only contribute to global warming but also have adverse effects on local air quality, water resources, and ecosystems. Detecting and repairing leaks promptly helps minimize environmental impacts and protect ecosystems.

-

Public Health and Safety [7]: Methane leaks can threaten public health and safety. Methane is highly flammable and can lead to explosions or fires if concentrations reach hazardous levels. Additionally, methane leaks are often accompanied by other volatile organic compounds (VOCs), which can have harmful health effects on nearby communities. Accurate monitoring systems help identify potential risks and enable prompt response measures to protect public health and safety.

-

Regulatory Compliance [8]: Regulatory bodies like the Environmental Protection Agency (EPA) have established guidelines and regulations to reduce methane emissions from various industries. Monitoring and reporting methane leaks are essential for companies to comply with these regulations and avoid penalties or legal consequences. Accurate detection systems provide the necessary data for compliance reporting.

-

Early Detection and Maintenance [9]: Detecting methane leaks early allows for timely repairs and maintenance, preventing the escalation of leaks into larger and more significant issues. By identifying leaks promptly, companies can reduce the economic losses associated with lost products, improve operational efficiency, and enhance asset integrity.

STATE-OF-THE-ART

Methane leak detection techniques have evolved significantly, incorporating advanced technologies to enhance accuracy and efficiency [6]. Traditional methods include flame ionization detectors (FIDs) and infrared (IR) cameras, which identify methane emissions by detecting the heat signature of gas leaks [10]. More recent advancements utilize laser-based detection systems, such as Tunable Diode Laser Absorption Spectroscopy (TDLAS), which offer high sensitivity and rapid response times [10]. Additionally, mobile platforms, including drones equipped with methane sensors and AI-driven data analytics, provide comprehensive coverage and real-time monitoring of methane leaks over large areas [10]. These innovations not only improve the detection and quantification of methane emissions but also support timely mitigation efforts to reduce environmental and economic impacts.

Using drones or UAVs equipped with sensors and cameras for methane detection is a promising approach due to their ability to cover large areas efficiently. However, accuracy is a crucial aspect that needs improvement. Factors like background noise, wind direction, and other parameters can affect the reliability of methane detection [10]. Developing algorithms that can increase the accuracy of methane detection by drone-armed sensors and cameras is essential to ensure reliable and effective monitoring systems [10]. This would enable more precise identification of leaks, better targeting of repair efforts, and improved overall performance of methane detection and monitoring systems.

The technology for drones to monitor methane and other gases continuously evolves and improves [11]. While it has made significant progress, it may still be considered an area of ongoing development. Implementing and adopting drone-based gas monitoring systems can vary across industries and regions. Drone-based gas monitoring systems in the oil and gas industry are being actively researched and developed, with advancements in several areas. Here are some aspects that represent the state-of-the-art in drone-based gas monitoring systems:

-

Improved Sensor Technology [12]: Advancements have been made in sensor technology specifically designed for detecting and quantifying gases in the oil and gas industry. These sensors include infrared spectroscopy, laser-based, and hyperspectral imaging sensors that can provide more accurate and sensitive measurements of gas concentrations.

-

Enhanced Flight Capabilities [12]: Drone platforms have been optimized to meet the gas monitoring requirements in the oil and gas industry. This includes improvements in flight endurance, payload capacity, stability, and the ability to operate in challenging environments such as offshore facilities or remote areas.

-

Real-Time Monitoring and Visualization: Researchers have been working on developing real-time monitoring and visualization capabilities for drone-based gas monitoring systems. This involves the integration of gas concentration data with geographical information systems (GIS) or mapping tools, enabling real-time visualization of gas dispersion patterns and providing actionable insights for decision-making.

-

Automated Leak Detection [12]: Efforts are underway to develop automated algorithms and systems that can detect gas leaks from infrastructure, such as pipelines, storage tanks, or wellheads, using drone-collected data. These algorithms can identify and pinpoint potential leak sources, facilitating timely maintenance and reducing the risk of safety incidents or environmental damage.

-

Data Analysis and Integration [12]: Advanced data analysis techniques, including machine learning and artificial intelligence, are being employed to process and analyze large volumes of gas concentration data collected by drones. These techniques enable the identification of patterns, anomalies, and trends, leading to a better understanding and prediction of gas emissions in the oil and gas industry.

Data analysis and integration research in the context of using drones for gas monitoring focuses on developing robust algorithms to process the collected data and extract meaningful insights. Scientists are working on improving algorithms and addressing the following challenges:

-

Accuracy and Sensitivity [12]: The accurate detection and quantification of gases, such as methane, require algorithms that can effectively analyze the collected data and account for factors like background noise, varying atmospheric conditions, and sensor limitations. Enhancing algorithmic techniques can improve the accuracy and sensitivity of gas concentration measurements.

-

Data Interpretation [12]: Gas monitoring generates large volumes of data that need to be interpreted and transformed into actionable information. Researchers aim to develop algorithms that can handle complex data sets, extract relevant features, and enable the identification of patterns or anomalies in gas concentration distributions.

-

Calibration and Validation [12]: Calibration and validation are essential steps in ensuring the accuracy and reliability of gas monitoring systems. Algorithms are being developed to automate calibration procedures, perform real-time quality control checks, and validate the collected data against ground-based measurements or reference standards.

-

Data Fusion and Integration [12]: Gas monitoring with drones often involves the integration of data from multiple sensors or sources. Scientists are working on algorithms that can effectively integrate data from different sensors, platforms, or periods, enabling a comprehensive understanding of gas dispersion patterns and sources.

-

Real-Time Decision Support [12]: In certain applications, such as emergency response or industrial leak detection, real-time decision support is critical. Researchers are focusing on developing algorithms that can process data rapidly, provide timely alerts or warnings, and aid decision-making processes for mitigating gas-related risks.

2. Results

Algorithm Development: The current algorithms used for gas monitoring with drones may have limitations in terms of accuracy, robustness, computational efficiency, or adaptability to different environmental conditions. Our ongoing research aims to address these challenges and improve algorithmic techniques to enhance the reliability and effectiveness of gas monitoring systems. Robust algorithms were developed using machine learning and AI to improve methane detection accuracy. The initial step involved feature extraction, which entails collecting data and identifying key characteristics such as methane concentration and environmental conditions. These features were then used to enhance the algorithms, ensuring precise and reliable methane monitoring.

Figure 1. Algorithm Performance Metrics: Showing the performance metrics of the developed AI/ML algorithms. Metrics such as accuracy, precision, recall, and F1 score are plotted to evaluate the effectiveness of the algorithms in detecting methane emissions. The x-axis represents the various performance metrics, and the y-axis shows the corresponding values.

Figure 1. Algorithm Performance Metrics: Showing the performance metrics of the developed AI/ML algorithms. Metrics such as accuracy, precision, recall, and F1 score are plotted to evaluate the effectiveness of the algorithms in detecting methane emissions. The x-axis represents the various performance metrics, and the y-axis shows the corresponding values.

This research utilized a comprehensive approach encompassing data collection, sensor calibration, algorithm development, system integration, and field validation to develop AI/ML technologies for methane emissions detection and monitoring using drones. This approach ensured robust, accurate, and consistent methane monitoring capabilities. Initially, a drone capable of carrying a 2 kg payload with a 60-minute flight time and excellent stability features was selected, making it suitable for offshore operations. The drone was outfitted with various sensors, including laser, hyperspectral, and infrared spectroscopy-based equipment. It collected methane concentration data at different locations, altitudes, and times of day while flying over a sargassum-covered beach in Puerto Rico. The collected data enabled the development and validation of algorithms for precise methane emission monitoring, demonstrating the effectiveness of this integrated approach.

Sensor Calibration: Accurate sensor readings were ensured through both indoor and outdoor calibration. For example, with a methane concentration of 8 ppm, if the background voltage is 1.0V, the sensor sensitivity (S) is 0.25 V/ppm, and the sensor's output voltage is 3.0V, the methane concentration (CH₄) was calculated using the formula:

To maintain precision during real drone operations, sensor data were calibrated in the field against ground-based reference standards.

Training Data: The model was trained on five data points from various sources with different characters such as word frequency punctuation usage and named entitles. The dataset was divided into three main groups: test data (750 points), validation data (750 points), and training data (3,500 points), comprising 70% of the total. A neural network was constructed to classify methane fluxes quality and a regression model was used to predict methane concentrations. The Isolation Forest Approach was used to detect anomalies in methane emissions (Fig. 2).

Figure 2. Anomaly Detection Results: Graphical representation showing the results of anomaly detection using the Isolation Forest algorithm. Data points are plotted to indicate normal and anomalous values, with different colors or markers distinguishing them. The x-axis and y-axis represent the different sensor properties or values used in the anomaly detection process.

Figure 2. Anomaly Detection Results: Graphical representation showing the results of anomaly detection using the Isolation Forest algorithm. Data points are plotted to indicate normal and anomalous values, with different colors or markers distinguishing them. The x-axis and y-axis represent the different sensor properties or values used in the anomaly detection process.

The anomaly score for a given data point (xi) was calculated using the formula:

-

Anomaly Score is equivalent to − log(f (x i ))

-

Anomaly Score is the same as −log(f(x i))

-

For example, if the function f(x 1) = (x1) yields a value of 0.05 for a noticed leak:

-

Anomaly Score is the equivalent of − log (0.05) ≒ 2.99.

-

Log(0.05)≈2.99 defines the anomaly score.

Table 1. Data on the various collection points.

Table 1. Data on the various collection points.

System Integration: Sensors, drones, and algorithms were integrated into a single system. The algorithms ran on an onboard computing unit, with sensors and cameras securely mounted on the drones. Reliable communication protocols were employed for the drones to transmit real-time data to a ground-based control center. Methane concentration data was mapped using integrated GIS methods, enabling real-time decision-making and insights.

Figure 3. Training vs Validation Graph: The graph shows the performance of the model over 20 epochs and measures the mean absolute percentage error (MAPE) for both the training and validation datasets. Initially, both Train MAPE (blue line) and Validation MAPE (orange line) start around 10.0. As training progresses, both errors decrease, indicating an improvement in model accuracy. The Validation MAPE decreases more smoothly and stabilizes around 6.0 after the 15th epoch, while the Train MAPE shows some fluctuations towards the end. This indicates that the model learns efficiently and generalizes well to the validation data, although fluctuations in train MAPE may indicate potential overfitting.

Figure 3. Training vs Validation Graph: The graph shows the performance of the model over 20 epochs and measures the mean absolute percentage error (MAPE) for both the training and validation datasets. Initially, both Train MAPE (blue line) and Validation MAPE (orange line) start around 10.0. As training progresses, both errors decrease, indicating an improvement in model accuracy. The Validation MAPE decreases more smoothly and stabilizes around 6.0 after the 15th epoch, while the Train MAPE shows some fluctuations towards the end. This indicates that the model learns efficiently and generalizes well to the validation data, although fluctuations in train MAPE may indicate potential overfitting.

Field Validation: Extensive field monitoring was conducted in real-world settings. Controlled release tests were performed by releasing known concentrations of methane (e.g., 5 ppm, 10 ppm, 20 ppm) at various points and comparing the detected values. The model was also tested in an operational oil and gas complex to assess its efficacy in real-life conditions. Performance was evaluated using indicators such as area coverage, response time, and detection accuracy.

Picture 1. Field Monitoring of Methane Emission.

Picture 1. Field Monitoring of Methane Emission.

Field Validation Results: System performance was enhanced through iterative algorithm fine-tuning and sensor calibration based on field validation results (Fig. 3). Feedback loops were employed to maintain reliability and accuracy, identifying areas for improvement and enabling periodic updates.

Figure 3. Field verification results: Comparison chart showing results of controlled release tests and real field verification. It compares detected methane concentrations with known release levels. The x-axis represents the release points or test cases, and the y-axis shows the methane concentration. This graph helps in verifying the accuracy and reliability of a drone-based detection system.

Figure 3. Field verification results: Comparison chart showing results of controlled release tests and real field verification. It compares detected methane concentrations with known release levels. The x-axis represents the release points or test cases, and the y-axis shows the methane concentration. This graph helps in verifying the accuracy and reliability of a drone-based detection system.

By integrating advanced sensor technology, robust AI/ML algorithms, and thorough field validation, an accurate drone-based methane detection and monitoring system was developed. This system aims to significantly reduce methane emissions in the petroleum and natural gas industry, emphasizing real-time capabilities and accuracy, thereby contributing to climate change mitigation and environmental protection.

Table 2. Expected Vs Detected Values of Methane Emission.

Table 2. Expected Vs Detected Values of Methane Emission.

The Isolation Forest method was utilized for anomaly detection, yielding anomaly scores such as −log(0.05)≈2.99-\log(0.05) \approx 2.99−log(0.05)≈2.99. The system, integrated with real-time computation and GIS visualization, was validated through controlled releases and field tests, achieving a detection accuracy of 97.5% and a response time of 1.5 minutes. Continuous improvements based on field data ensured effective emission reduction, supporting efforts to combat climate change and safeguard the environment.

Figure 4. True vs Predicted Emissions Graph: The graph shows the relationship between actual and projected emissions, with actual emissions plotted on the x-axis and projected emissions on the y-axis. The black dashed line represents the perfect forecast scenario where predicted emissions would exactly match actual emissions. However, the blue data points, which represent the actual predicted values, are mostly clustered near the bottom of the y-axis, indicating that the model is consistently underestimating emissions. This significant deviation from the dashed line indicates that the model predictions are not consistent with the actual emission values, highlighting a potential problem with model accuracy or calibration.

Figure 4. True vs Predicted Emissions Graph: The graph shows the relationship between actual and projected emissions, with actual emissions plotted on the x-axis and projected emissions on the y-axis. The black dashed line represents the perfect forecast scenario where predicted emissions would exactly match actual emissions. However, the blue data points, which represent the actual predicted values, are mostly clustered near the bottom of the y-axis, indicating that the model is consistently underestimating emissions. This significant deviation from the dashed line indicates that the model predictions are not consistent with the actual emission values, highlighting a potential problem with model accuracy or calibration.

3. Discussion

Previous studies have explored various methodologies for methane detection, such as ground-based sensors and satellite monitoring [13,14]. This study introduces a novel approach by employing drones equipped with state-of-the-art sensors and machine learning algorithms, achieving high accuracy and real-time monitoring capabilities. Therefore, this research highlights significant advancements in methane emission detection using an integrated approach combining drones, advanced sensor technology, and robust AI/ML algorithms. That comprehensive approach ensured precise sensor calibration both indoors and outdoors, enhancing the reliability of the data collected.

The sensor calibration process was meticulous, as demonstrated by the example of calculating methane concentration [15]. Accurate calibration is crucial for reliable methane detection, as it directly impacts the sensor's performance in real-world conditions. By calibrating the sensors against ground-based reference standards, the study ensured accurate readings from the drone's sensors, essential for effective methane monitoring. This approach aligns with the working hypotheses that accurate sensor calibration and robust algorithm development are critical for enhancing methane detection accuracy.

The algorithm development phase was particularly noteworthy. Feature extraction played a vital role in identifying key characteristics from the collected data, such as methane concentration and environmental conditions. This information was used to train machine learning models, including neural networks and the Isolation Forest method for anomaly detection. The use of the Isolation Forest approach to calculate anomaly scores, as demonstrated by the formula provided, highlights the innovative techniques employed in this research [16]. The resulting anomaly scores, such as −log(0.05) ≈ 2.99, provided a quantifiable measure of methane emission anomalies, facilitating early detection and timely intervention.

The integration of sensors, drones, and algorithms into a single cohesive system was a significant achievement. The onboard computing unit processed the data collected by the sensors, while reliable communication protocols ensured real-time data transmission to the ground-based control center. This integration enabled real-time GIS mapping of methane concentrations, providing valuable insights for decision-making. Field validation through controlled release tests and real-world applications in an operational oil and gas complex further demonstrated the system's efficacy. The performance indicators, including a detection accuracy of 97.5% and a response time of 1.5 minutes, underscore the system's potential for practical applications [17]

4. Materials and Method

Data Collection

A drone equipped with state-of-the-art sensors, including laser-based, hyperspectral, and infrared spectroscopy, was used to monitor methane emissions over a beach-filled Sargassum. The drone, capable of carrying a 2 kg payload and operating for 60 minutes per flight, collected methane concentration data ranging from 2 ppm to 10 ppm. Sensor calibration was performed using a specific formula to ensure precision. AI/ML techniques, including predictive models and neural networks, were developed to determine methane levels and assess leak severity. The Isolation Forest method was utilized for anomaly detection [20]. The system, integrated with real-time computation and GIS visualization, was validated through controlled releases and field tests.

5. Conclusions

This research project successfully developed and validated a robust and accurate Convolutional Neural Network (CNN) model for predicting methane emissions from decomposing Sargassum, addressing a critical environmental challenge. The comprehensive approach encompassed data collection, sensor calibration, algorithm development, system integration, and field validation, ensuring the reliability and effectiveness of the model.

The initial data exploration and analysis provided crucial insights into the dataset, facilitating informed preprocessing decisions. By handling missing values and appropriately splitting the data into training and testing sets, the foundation for robust model training was established. The use of PANDAS for data manipulation and statistical analysis proved instrumental in understanding the dataset's characteristics and guiding subsequent steps.

The CNN model, trained using the ReLU activation function and mean absolute error loss function, demonstrated significant accuracy in predicting methane emissions. The model's performance was rigorously evaluated using mean absolute percentage error (MAPE) graphs, which highlighted the differences between training and validation sets and between true and predicted emissions. This thorough evaluation confirmed the model's reliability and precision. Field validation played a crucial role in enhancing the model's robustness. The system's accuracy and consistency were significantly improved by calibrating sensors and fine-tuning algorithms based on real-world data. Integrating modern sensor technology, AI/ML algorithms and extensive field validation resulted in an effective drone-based methane detection and monitoring system. The system's performance was validated through controlled release tests and practical application in a simulated beach-invaded sargassum field, achieving a detection accuracy of 97.5% and a response time of 1.5 minutes.

The innovative approach of using drones equipped with advanced sensors, such as laser-based, hyperspectral, and infrared spectroscopy, proved effective in capturing methane concentration data over various conditions. The AI/ML techniques, including predictive models and neural networks, enabled precise determination of methane levels and anomaly detection using the Isolation Forest method. This system's successful implementation and validation demonstrate its potential for significantly reducing methane emissions in the petroleum and natural gas industry. The system contributes to more effective environmental impact assessments and mitigation strategies by providing real-time, accurate detection of methane leaks. The continuous enhancements based on field data ensure the system's reliability and adaptability to various operational environments.

This research project has substantially contributed to environmental monitoring and methane emission reduction. The developed CNN model and advanced drone-based detection technologies offer a promising solution for mitigating climate change and protecting the environment. Integrating AI/ML algorithms with modern sensor technology and real-time data visualization represents a significant advancement in methane monitoring capabilities. Future work could expand this methodology to other greenhouse gases and further refine the system for broader applications in environmental protection and sustainability efforts.