Deep reinforcement learning is one of the research hotspots in artificial intelligence and has been successfully applied in many research areas, however, the low training efficiency and high demand for samples are problems that limit the application To address these problems, a hierarchical episodic control model extending episodic memory to the domain of hierarchical reinforcement learning is proposed in this paper. The model is theoretically justified and employs a hierarchical implicit memory planning approach for counterfactual trajectory value estimation. Starting from the final step and recursively moving back along the trajectory, a hidden plan is formed within the episodic memory. Experience is aggregated both along trajectories and across trajectories, and the model is updated using a multi-headed backpropagation similar to bootstrapped neural networks. This model extends the parameterized episodic memory framework to the realm of hierarchical reinforcement learning and is theoretically analyzed to demonstrate its convergence and effectiveness. Experiments conducted in Four Room, Mujoco, and UE4-based active tracking , highlight that the hierarchical episodic control model effectively enhances training efficiency. It demonstrates notable improvements in both low-dimensional and high-dimensional environments, even in cases of sparse rewards.

During the COVID-19 lockdown in Wuhan, transportation, industrial production and other human activities declined significantly, as did the NO2 concentration. In order to assess the relative contributions of different factors to reductions of air pollutants, sensitivity experiments were implemented by random forest (RF) model, with the comparison of contributions of meteorology, road traffic, and emission sources between different periods. Besides, an emulator was operated to suggest an appropriate limit for control of transportation. The RF models showed different mechanisms for air pollutants. Within-city Migration index (WMI) was more important in the normal, pre-lockdown and post-pandemic model while Out-Migration Index (OMI) was emphasized in the lockdown model. In the COVID-19 lockdown period, 73.3% of the reduction can be attributed to the decreased road traffic, showing massive impact of road traffic on the air quality. In the post-pandemic period, meteorology controlled about 42.2% of the decrease and emissions from industry and household controlled 40.0% while road traffic only contributed to 17.8%. It was suggested that priority of restriction should be given to road traffic within the city. A limit of less than 40% on the control of the road traffic can get a better effect, especially for cities with severe traffic pollution.

The bilateral trade relationship between PRC and ASEAN is close. As early as 2012, China has been the largest trading partner of ASEAN, and ASEAN has also taken the place of the United States as PRC’s second largest trading partner in 2019.This paper uses the theory of ecological population evolution, selects the total import and export volume of PRC and the ten ASEAN countries from 2000 to 2019 as the data sample, studies the bilateral trade relations between PRC and the ten ASEAN countries, analyzes the competition and symbiotic relationship of bilateral trade between PRC and the ten ASEAN countries and the possibility of trade friction according to the results, and proposes corresponding improvement strategies. According to the results of the population evolution competition model, China has a competitive relationship with Indonesia, Malaysia, the Philippines, Singapore and Thailand, which is most likely to cause trade friction. China has a biased relationship with Brunei, Cambodia, Laos, Myanmar and Vietnam, which is more likely to cause trade friction. On this basis, in order to further strengthen the trade relations between PRC and the ten ASEAN countries, this paper puts forward policy suggestions on improving infrastructure, strengthening independent innovation, seeking cooperation fields and actively investing abroad.

(1) Background: ganoderic acids (GAs) are specific triterpenes of Ganoderma lucidum. The HPLC fingerprint profile of GAs of the fruiting body has been well-known, but the mycelial fingerprinting remains unclear. (2) Methods: the ethanol extract of the mycelium of G. lucidum (YK-01) was further purified by preparative HPLC. The HPLC spectra for four strains of G. lucidum and one strain of G. formosanum (purple lingzhi) were investigated. (3) Results: nineteen lanostane triterpenes, including five new triterpenes, GA-TP (1), ganodermic acid Jc (GmA-Jc) (2), GmA-Jd (3), GA-TQ1 (4), and ganoderal B1 (5), and fourteen known triterpenes 6-19 were isolated from the ethanol extract. A green chemical HPLC analytical method was developed by using ethanol and acetic acid as mobile phase. These triterpenes comprise of a unique HPLC triterpenoid spectral pattern of G. lucidum mycelium. All four G. lucidum strains showed the same HPLC spectral pattern, whereas G. formosanum displayed a different pattern. Quantitation methods for ganoderic acid T (10) and S (12) were also validated. (4) Conclusions: the triterpenoid HPLC analytical method can be used to identify G. lucidum species, and to determine the contents of GA-T and GA-S.

Dams have made great contributions to human society, facilitating flood control, power generation, shipping, agriculture and industry. However, the construction of dams greatly impacts downstream ecological environments and nearby marine areas. To summarize these impacts, this review used recent research to comprehensively analyze how dam construction has affected river hydrology, geomorphology, and ecosystem of downstream reaches globally. Effects of dams on ecosystems occur through reduced river flow, reduced sediment flux, altered water temperature, changed estuary delta, altered composition and distribution of nutrients, altered structure and distribution of phytoplankton populations, caused habitat fragmentation, and blocked migration routes in river sections and adjacent seas. Besides, exploring new reservoir management strategies (including targeted control of dam storage and flushing sediment operations), banning fishing activities, and removing unnecessary dams (obsolete or small dams) are becoming crucial tools for ecosystem restoration.

Developing advanced carbon materials by utilizing biomass waste has attracted much attention. Herein, a N-doped carbon material (RSM-0.33-550) was prepared by directly pyrolyzing reed straw and melamine. The as-prepared RSM-0.33-550 possessed a N content of 6.02% and a specific surface area of 547.1 m2 g-1. As the anode for supercapacitors (SCs), in 6 M KOH, such RSM-0.33-550 exhibited a capacitance of 202.8 F g-1 at a current density of 1 A g-1. At a high current density of 20 A g-1, it still remained a capacitance of 158 F g-1. Notably, it delivered an excellent stability with capacity retention of 96.3% at 20 A g-1 after 5000 cycles. This work not only offer a new electrode material for SCs, but also gives a new insight for rationally utilizing the biomass waste for energy storage.

Cadmium (Cd) contamination in rice grains is posing a significant threat to global food security. To restrict the transport of Cd in the soil-rice system, an efficient way is to use the ionomics strate-gy. Since calcium (Ca) and Cd have similar ionic radii, their uptake and translocation may be linked in multiple aspects in rice. However, the underlying antagonistic mechanisms are still not fully understood. Therefore, we first summarized the current knowledge on the physiological and molecular footprints of Cd translocation in plants and then explored the potential antagonistic points between Ca and Cd in rice, including exchange adsorption on roots, plant cell wall compo-sition, co-transporter gene expression, and transpiration inhibition. This review provides sugges-tions for the Ca/Cd interacting study in rice and introduces the ionomics research to better control the accumulation of Cd in plants.

Abstract: This study aims to set up a system to evaluate nursing competencies in disaster preparedness for undergraduates and influencing factors in China. The evaluation system was established by using the modified Delphi. There were 3 phases in this study: 1) an environmental scan; 2) setting framework; 3) adjusting indicators based on the modified Delphi. The questionnaire for these undergraduates lied in their basic information and assessment of nursing competencies in disaster preparedness. Based on the survey, the average score of nursing competencies in disaster preparedness for undergraduate nursing students surveyed was 3.10 (out of 5). In addition, gender, grade, inhabitation, and disaster drills of the students were four factors affecting nursing competencies of undergraduates. This study indicates that the present nursing competencies in disaster preparedness for undergraduates are weak, and it is essential to strengthen nursing education in disaster preparedness for undergraduates.

Although agricultural crops production systems in subtropical plateau regions currently pose high environmental risks, especially in developing countries, their environmental impacts and emission-reduction potentials remain unclear, and the development potential of such systems is likely huge. We conducted a case study in Yunnan Province, China, to quantify the environmental impacts from crop production during 2002–2021. The life cycle assessment method was employed to identify factors driving the environmental impacts, and potential mitigation strategies were proposed. The yield and total nutrient input of grain crops in Yunnan Province increased over the 20-year period, and environmental footprint of crops production in Yunnan Province was higher than that of other regions. Average annual mean greenhouse gas (GHG) emissions and soil acidification potentials (AP) and water eutrophication potentials (EP) of crops production during 2002–2021 were 732 kg CO2-eq·Mg-1, 15.8 kg SO2-eq·Mg-1, and 2.7 kg PO4-eq Mg-1, respectively. GHG emissions from g crops mainly originated from applying agricultural materials during the crop life cycle. There was a significant correlation between surplus nitrogen and environmental impacts. Scenario testing showed that through crop sowing, nutrient regulation, and crop management, the crop yield could be increased and environmental costs could be reduced. The greatest reductions were found in wheat production: 53.1%, 67.9%, and 67.7% for GHG emissions, AP, and EP, respectively. Adopting comprehensive agricultural management measures could reduce the negative impact of crops production on the environment in subtropical plateau areas and achieve sustainable agricultural development.

The corrosion inhibition performance of pyridine derivatives (4-methylpyridine and its quaternary ammonium salts) and sulfur-containing compounds (thiourea and mercaptoethanol) with different molar ratios on carbon steel in CO2-saturated 3.5 wt.% NaCl solution was investigated by weight loss, potentiodynamic polarization, electrochemical impedance spectroscopy and scanning electron microscopy. The synergistic corrosion inhibition mechanism of mixed inhibitors was elucidated by the theoretical calculation and simulation. The molecule of pyridine derivatives compound with larger volume has the priority to adsorb on the metal surface, while the molecules of sulfur-containing compounds with smaller volume fill in vacancies. A dense adsorption film would be formed when 4-PQ and sulfur-containing compounds are added at a proper mole ratio.

Over the last several decades, China has continuously introduced Duroc boars and used them as breeding boars. Although this crossbreeding method has increased pork production, it has affected pork quality. Nowadays, one of the primary goals of industrial breeding and production systems is to enhance the quality of meat. This research adds to our understanding of the molecular mechanisms that control the quality of pork and may be used as a guide for future efforts to enhance meat quality. We investigated the genetic mechanisms of cross-breeding for meat quality improvement by combining transcriptome and metabolome analysis, using Chinese native Jiaxing black (JXB) pigs and crossbred Duroc × Duroc × Berkshire × JXB (DDBJ) pigs. In the longissimus Dorsi muscle, the content of inosinic acid, polyunsaturated fatty acid, and amino acids was considerably higher in JXB pigs in contrast with that of DDBJ pigs, whereas DDBJ pigs have remarkably greater levels of polyunsaturated fatty acids than JXB pigs. Differentially expressed genes (DEGs) and differential metabolites were identified using transcriptomic and metabolomic KEGG enrichment analyses. Differential metabolites mainly include amino acids, fatty acids, phospholipids. In addition, we found several DEGs that may explain differences in meat quality between the two pig types, including genes associated with lipid metabolism (e.g., DGKA, LIPG, and LPINI), fatty acid metabolism (e.g., ELOVL5, ELOVL4, and ACAT2), and amino acid metabolism (e.g., SLC7A2, SLC7A4). Combined with the DEGS-enriched signaling pathways, the regulatory mechanisms related to amino acids, fatty acids, and phospholipids were mapped. The abundant metabolic pathways and DEGs may provide insight into the specific molecular mechanism that regulates meat quality. Optimizing the composition of fatty acids, phospholipids, amino acids, and other compounds in pork is conducive to improving meat quality. Overall, these findings will give useful information and further groundwork for enhancing the meat quality that may be achieved via hybrid breeding.

As an important organelle in eukaryotic cells, Golgi apparatus is responsible for processing and transporting proteins and lipids in cells. Precise monitoring the status of Golgi apparatus by targeting fluorescence imaging technology is of enormous importance but remains an attractive yet dramatically challenging task. In this study, we report the construction of the first Golgi apparatus targeted sensor with bright near-infrared fluorescence, termed as Golgi-Pdots. As a start point of our investigation, hydrophobic CDs with bright NIR fluorescence at 674 nm (fluorescence quantum yield : 12.18%), narrow emission band of 23 nm, and excellent stability were facilely prepared from Magnolia Denudata flowers through an ultrasonic method. Incorporating the CDs into a polymer matrix modified with Golgi-targeting molecules can produce the water-soluble Golgi-Pdots, which showed high colloidal stability and similar optical properties as compared to CDs. Further studies revealed that the Golgi-Pdots showed good biocompatibility and Golgi-targeting ability. Based on these fascinating properties, Golgi-Pdots have been successfully used for long term bioimaging of Golgi apparatus inside live cells.

This study investigated the roles of low-molecular-weight fucoidan (LMWF) in enhancing the anti-cancer effects of fluoropyrimidine-based chemotherapy. HCT116 and Caco-2 cells were treated with LMWF and 5-FU. Cell viability, cell cycle, apoptosis, and migration were analyzed in both cell types. Potential mechanisms underlying how LMWF enhances the anti-cancer effects of fluoropyrimidine-based chemotherapy were also explored. The cell viability of HCT116 and Caco-2 cells was significantly reduced after treatment with a LMWF-5-FU combination. In HCT116 cells, LMWF enhanced the suppressive effects of 5-FU on cell viability through the 1) induction of cell cycle arrest in the S phase and 2) late apoptosis mediated by the Jun-N-terminal kinase (JNK) signaling pathway. In Caco-2 cells, LMWF enhanced the suppressive effects of 5-FU on cell viability through both c-mesenchymal–epithelial transition (MET)/ Kirsten Rat Sarcoma virus (KRAS)/ extracellular signal-regulated kinase (ERK) and c-MET/ phosphatidyl-inositol 3-kinases (PI3K)/ protein kinase B (AKT) signaling pathways. Moreover, LMWF enhanced the suppressive effects of 5-FU on tumor cell migration through the c-MET/ matrix metalloproteinase (MMP)-2 signaling pathway in both HCT116 and Caco-2 cells. Our results demonstrated that LMWF is a potential complementary therapy for enhancing the efficacies of fluoropyrimidine-based chemotherapy in colorectal cancers (CRCs) with the wild-type or mutated KRAS gene through different mechanisms. However, in vivo studies and in clinical trials are required to validate the results of the present study.

Background: This retrospective study evaluates the survival effects of metronomic maintenance therapy with fluoropyrimidine in patients with stage III colorectal cancer (CRC) according to epidermal growth factor receptor (EGFR) expression. Methods: We enrolled 197 patients with stage III CRC who had undergone radical resection and FOLFOX regimen adjuvant chemotherapy. The clinicopathological features and effects of metronomic maintenance therapy on survival according to treatment group and EGFR expression were analyzed. By conducting an in vitro cell line study and in vivo study through knockdout of EGFR gene, we analyzed the capacities of cell proliferation and migration. Results: Postoperative relapse and mortality were significantly more common in the FOLFOX group. Metronomic maintenance therapy was a significantly independent predictive factor of postoperative relapse and mortality, as well as a prognostic factor of disease-free survival and overall survival. The significant differences of survival between the two groups were only observed in patients with positive EGFR expression. Conclusions: The present study suggested EGFR expression as the prognostic factor in patients with stage III CRC receiving metronomic maintenance therapy. By analyzing EGFR expression, we can identify the potential candidates with optimal survival benefit from metronomic maintenance therapy in patients with stage III CRC.

Background: This retrospective study evaluate the survival effects of metronomic maintenance therapy with fluoropyrimidine in patients with stage III colorectal cancer (CRC) according to epidermal growth factor receptor (EGFR) expression. Methods: We enrolled 197 patients with stage III CRC who had undergone radical resection and FOLFOX regimen adjuvant chemotherapy. The clinicopathological features and effects of metronomic maintenance therapy on survival according to treatment group and EGFR expression were analyzed. By conducting an in vitro cell line study and in vivo study through knockdout of EGFR gene, we analyzed the capacities of cell proliferation and migration. Results: Postoperative relapse and mortality were significantly more common in the FOLFOX group. Metronomic maintenance therapy was a significantly independent predictive factor of postoperative relapse and mortality, as well as a prognostic factor of disease-free survival and overall survival. We also demonstrated that EGFR-knockout Caco2 cells are more sensitive to the inhibition effect of fluoropyrimidine than the control those. Conclusions: The present study suggested EGFR expression as the prognostic factor in patients with stage III CRC receiving metronomic maintenance therapy. By analyzing EGFR expression and treatment strategies, we can identify the potential candidates with optimal survival benefit from metronomic maintenance therapy in patients with stage III CRC.

Three new polyketides (penidihydrocitrinins A–C, 1–3) and 14 known compounds (4–17) were isolated from the deep-sea-derived Penicillium citrinum W17. Their structures were elucidated by comprehensive analyses of 1D and 2D NMR, HRESIMS, and ECD calculations. Compounds 1–17 were evaluated for their anti-inflammatory and anti-osteoporotic bioactivities. All isolates exhibited significant inhibitory effects on microglial activation in LPS-stimulated BV-2 cells in a dose-response manner. Notably, compound 14 displayed the strongest effect with the IC50 value of 4.7 µM. Moreover, compounds 6, 7, and 8 not only suppressed osteoclastogenesis, but also promoted osteoblast mineralization.

Shear dynamics simulation under extreme pressure was used to optimise the composition of ester-based lubricant base oil and extreme pressure additives. As a result, the ester-based lubricant in the weak-gel drilling fluid achieves reduction and increases the efficiency in drilling construction, and the field operation efficiency improves. The results of base oil lubrication simulation show that three base oils, namely, methyl oleate, ethyl oleate and butyl oleate, can be stably adsorbed on the surface layer of the shear surface. Methyl oleate has the lowest system temperature after shear stabilisation and has a high load-bearing capacity. The shear stress of methyl oleate decreases by changing the initial shear temperature and speed. It increases by 6.36 MPa when the speed increases from 10 m/s to 30 m/s. At this time, the shear stress of butyl oleate increases by 10.11 MPa. The results of the four-ball friction experiments show that the radius of the abrasion spot of methyl oleate is 179.83 μm, which is smaller than that of the other two base oils. Moreover, the friction coefficient of methyl oleate is 0.0018, which is approximately 1/3 of that of butyl oleate. Methyl oleate has better lubrication efficiency. The shear simulation results are consistent with the experimental results. The simulation can be used for the molecular design of lubricant materials. The oleic acid amide–containing amine group and the glyceride oleic–containing hydroxyl group were selected as the extreme pressure functional components for shear simulation. Results show that the shear stress of oleic acid amide is much lower than that of oleic acid glyceride when the initial shear temperature and speed change. The extreme pressure lubrication component–containing amine group is better than the extreme pressure lubrication material–containing hydroxyl group. The effects of different oleamide contents in the two-component mixtures on the lubricating properties were investigated through shear simulation, with methyl oleate as the base oil and oleamide as the extreme pressure functional component. The simulation results show that the lubricant has the optimal shear stress when 10% oleamide is added to the lubricant. The base properties of the lubricant were tested using a mixture of 90% methyl oleate and 10% oleamide, formulated as a lubricant. Results show that the friction coefficient can be reduced to 0.03 when 0.5% of the lubricant is added to the base mud. Moreover, the lubricant film formed shows high strength. Then, 1% lubricant was added to the weak-gel drilling fluid to evaluate the effect of the lubricant on the gel structure of the drilling fluid. Results show that adding lubricant does not affect the rheological properties of the drilling fluid. The gel structure of the system also remains stable even after 7 days of continuous ageing. The results of the field experiments in Hua3-01 well show that adding 1% ester-based lubricant to the field drilling fluid reduces the drilling friction by 33%. Thus, the efficiency of directional side drilling can be effectively improved, complicated accidents, such as poor starting and stopping of drilling and stuck jamming, can be avoided, and the goals of reducing quantity and increasing efficiency can be completed.