Early childhood is important for future cognitive and educational outcomes. Programs overcoming barriers to engagement in early education for Indigenous children must address family cultural needs and target developmental delays. This systematic review identifies culturally adapted programs to improve cognitive, emotional and developmental delays among young children, in response to an identified priority of a remote Indigenous community. Five databases (the Cochrane Library, Embase, Medline, Scopus and CINAHL) were searched for English language papers in January 2018. Study quality was assessed and findings analysed thematically. Findings were presented to the community at an event with key stakeholders, to determine their inclusion and face validity. Seven relevant studies, published between 1997-2013, were identified by the researchers and each study was supported by the community for inclusion. Two studies focused on Native American children and five studies included children from non-Indigenous disadvantaged backgrounds. Findings were reported narratively across four themes: Storytelling to improve educational outcomes; Family involvement improved development; Culturally adapted Cognitive Behavioral Therapy to reduce trauma; Rewards-based teaching to improve child attention. Limited published research on culturally adapted and safe interventions for children with cognitive, emotional and developmental delay exists but these four themes from seven studies identify useful components.

Brain-stimulation reward, also known as intracranial self-stimulation (ICSS), is a commonly used procedure for studying brain reward function and drug reward. In electrical ICSS, an electrode is surgically implanted into the medial forebrain bundle in the lateral hypothalamus or the ventral tegmental area in the midbrain. Operant lever responding leads to the delivery of electrical pulse stimulation. The alteration in the stimulation frequency-lever response curve is used to evaluate the impact of pharmacological agents on brain reward function. If a test drug induces a leftward or upward shift in the ICSS response curve, it implies a reward-enhancing or abuse-like effect. Conversely, if a drug causes a rightward or downward shift in the functional response curve, it suggests a reward-attenuating or aversive effect. A significant drawback of electrical ICSS is the lack of cellular selectivity in understanding the neural substrates underlying drug reward versus aversion. Excitingly, recent advancements in optical ICSS (oICSS) have facilitated the development of at least three cell type-specific oICSS models – dopamine-, glutamate-, and GABA-dependent oICSS. In these new models, a comparable frequency-rate response curve has been established and employed to study the substrate-specific mechanisms underlying brain reward function and a drug's rewarding versus aversive effects. In this review article, we summarize recent progress in this exciting research area. The findings in these new behavioral models have not only increased our understanding of the neural mechanisms underlying drug reward and addiction but have also introduced a novel experimental approach in preclinical medication development for treating substance use disorders.

Machine learning offers advanced tools for efficient management of radio resources in modern wireless networks. In this study, we leverage a multi-agent deep reinforcement learning (DRL) approach, specifically the Parameterized Deep Q-Network (DQN), to address the challenging problem of power allocation and user association in massive multiple-input multiple-output (M-MIMO) communication networks. Our approach tackles a multi-objective optimization problem aiming to maximize network utility while meeting stringent quality of service requirements in M-MIMO networks. To address the non-convex and nonlinear nature of this problem, we introduce a novel multi-agent DQN framework. This framework defines a large action space, state space, and reward functions, enabling us to learn a near-optimal policy. Simulation results demonstrate the superiority of our Parameterized Deep DQN (PD-DQN) approach when compared to traditional DQN and RL methods. Specifically, we show that our approach outperforms traditional DQN methods in terms of convergence speed and final performance. Additionally, our approach shows 72.2 % and 108.5 % improvement over DQN methods and RL method respectively in handling large-scale multi-agent problems in M-MIMO networks.

Here we present a blockchain-backed token recognition system to reward the contributions that academics make to the scientific ecosystem. Recognition is important in science but current methods, systems and incentives are limited. Specifically, the traditional focus on narrow publication metrics means diverse contributions are not captured, while bias toward senior, established scientists is common. To tackle this challenge, we explore the potential of harnessing blockchain’s collaborative, decentralised and trust-brokering properties to develop a token reward system for use by research funders. Academics would be awarded tokens for undertaking common but vital tasks such as peer review, sitting on funding committees and submitting reports. These tokens would not be tradable or specifically monetisable but would serve as a validated record of scientific contribution. They would have value in professional recruitment and job placement, support grant and award applications, and inform performance appraisals and file reviews. Coordination and cooperation across multiple funding agencies in developing the platform would provide an opportunity to aggregate and standardise recognition, given academics often work with several funders. This system’s goals are to expand recognition metrics, promote efficiencies, improve the robustness of professional assessments and enable cross-funder collaboration, thereby optimising research processes and practices in a decentralised and democratised manner.

Animal-focused research has been crucial for scientific advancement however, in this matter, rodents are still taking a starring role. Coming out from merely being supportive of evidence found in rodents, the use of fish models has slowly taken a more central role and expanded its overall contributions in areas such as social sciences, evolution, physiology, and recently in translational medical research. In neurosciences, zebrafish has been widely adopted, contributing to our understanding of the genetic control of brain processes, and the effects of pharmacological manipulations. However, discussion continues regarding the paradox of function versus structure, when fish and mammals are compared, and on the potentially evolutionarily conserved nature of behaviour across fish species. From the behavioural stand point we explored aversive/stress and social behaviour in selected fish models, and refer to the extensive contributions of stress and monoaminergic systems. We suggest that, in spite of marked neuroanatomical differences between fish and mammals, stress and sociality are conserved at the behavioural and molecular levels. We also suggest that stress and sociality are mediated by monoamines in predictable and non-trivial ways, and that monoamines could “bridge” the relationship between stress and social behaviour. To reconcile the level of divergence with the level of similarity, we need neuroanatomical, pharmacological, behavioural, and ecological studies conducted in the laboratory and in nature. These areas need to add to each other to enhance our understanding of fish behaviour and ultimately how this all may translate to better model systems for translational studies.

Social interaction is essential for life and is impaired in many psychiatric disorders like schizophrenia, au-tism, depression and major anxiety disorder. Monoamine transmission plays a key role in social behavior and both genetic and epigenetic modifications of dopamine and noradrenaline neurotransmission-related genes can affect the levels of social interaction. Since heterozygous individuals for a specific genetic trait possess only one mutant allele of that trait, in order to better evaluate the role of the interaction between genetics and epigenetics in unmasking latent genetically-determined predispositions, our interest has focused on studying the interplay between genetics and epigenetics influences on social behavior in male rats obtained by two different breeding schemes: a first group by breeding of knock-out (KO) male rats with wild-type (WT) female dams (homogeneous heterozygous offspring, termed MAT-HET), and a second group of heterozygous DAT male offspring by breeding of KO male and DAT-heterozygous female subjects (to obtain comparable control pups, termed MIX-HET). Their social behavior was then assessed by partner preference, social preference and elicited preference tests. In the first test MIX-HET and MAT-HET male mice had choice between two WT females one in estrous and the other not in estrous. In the second test they met either a MIX-HET or a WT male rodent. Also, the expression of the noradrenaline transporter (NET) was assessed in the prefrontal cortex, hippocampus and hypothalamus of MAT, MIX and WTs by immunofluorescence in order to estimate its involvement in the expression of social behavior. Our results show that MIX-HET focal rodents tend to have an asocial behavior when in contact with a female in estrous, and their behavior is similar to when the stimulus is a MIX-HET male. MAT-HET male rodents, instead, tend to be very attracted by the female in estrous, but they ignore the MIX-HET stimulus. MIX-HET progeny showed a lower expression of noradrenaline transporter in both hypothalamus and hippocampus with respect to MAT-HET rats, whereas MAT-HET rats displayed increased noradrenaline transporter immunofluorescence in the hypothalamus and in the hippocampus with respect to WT rats, while no difference was observed in the prefrontal cortex. Therefore we can hypothesize that the differences observed between the two heterozygous groups may be attributable to an epigenetic factor: the different maternal care received. These data can open new perspectives towards increased the preclinical knowledge about autism and bipolar disorder.

The metaphor of being touched by music is widespread and almost universal. The tactile experience, moreover, has received growing interest in recent years. There is, however, a need to go beyond a mere metaphorical use of the term, by positioning the tactile experience within the broader frame of embodied cognition and the experiential turn in cognitive science. This article explores the possible contribution of a science of touch by defining music as a vibrational art that impinges upon the body and the senses. It takes as a starting point the clinical findings on the psychological and physiological value of tender touch with a special focus on the method of kangaroo mother care, which is a method for holding the baby against the chest of the mother, skin-to-skin. It is seen as one of the most basic affiliative bonding with stimuli that elicit reward. Via an extensive review of the research literature, it is questioned to what extent this rationale can be translated to the realm of music. There are, in fact, many analogies, but a comprehensive theoretical framework is still lacking. This article aims at providing at least some preparatory groundwork to fuel more theorizing about listening and its relation to the sense of touch.

Autism spectrum disorder (ASD) is a heterogeneous neuropsychiatric problem with a few core symptoms: weaknesses in social behavior, verbal impairments, repetitive behavior and restricted interests. Beyond the core symptoms, autism has strong association with other disorders such as intellectual disability, epilepsy, schizophrenia among many others. This paper outlines a theory of ASD with capacity to connect heterogeneous ‘core’ symptoms, medical and psychiatric comorbidities as well as other etiological theories of autism in a unifying cognitive framework rooted in neuroscience and genetics. Cognition is embedded into an ever-developing structure modified by experiences, including the outcomes of environment influencing behaviors. We introduce the hypothesis that autism is caused by deficits in component-based cognition and the internal learning reinforcing machinery. Specifically, we outline our Cartesian Factor forming autoencoder like model that supports cognition by breaking combinatorial explosion and discuss the cognitive and neural processes behind our model. The high dimensionality of sensory information poses serious problems, since the brain can handle only 7±2 relevant variables at a time making processes, such as the extraction and encoding of the relevant variables and their efficient manipulation critical. These processes are influenced by previous experiences and the internal reward system. In addition, large delays of distributed information processing should be counteracted by learned predictive models to synchronize sensory, proprioceptive, and cognitive signals and have timely and accurate model-based actions. Impairments in any of these aspects may disrupt learning and execution. Combinations of small impairments may allow the solving of low complexity tasks but may become visible if learned variables and the related metric are improper and imprecise, respectively, especially if their number is large. We claim that social interactions are amongst the most challenging cognitive tasks in terms of the number of variables involved. In turn, they are highly susceptible to combinations of small impairments. We consider impairments as the basic colors of autism, whereas the combinations of diverse impairments make the palette of autism. In turn, social processes can be spoiled in many ways and can lead to diverse comorbidities.

Changes in food preferences after bariatric surgery may alter its effectiveness as a treatment for obesity. We aimed to compare food reward for a comprehensive variety of food categories between patients who received a sleeve gastrectomy (SG) or a Roux-en-Y gastric bypass (RYGB) and to explore whether food reward differs according to weight loss. In this cross-sectional exploratory study, food reward was assessed using the Leeds Food Preference Questionnaire (LFPQ). We assessed liking and wanting of eleven food categories. Comparisons were done regarding type of surgery and Total Weight Loss (TWL; based on tercile distribution). Fifty-six patients (30 SG and 26 RYGB) were included (women: 70%; age: 44.0 (11.1) y). Regarding the type of surgery, scores were not significantly different between SG and RYGB, except for ‘non-dairy products – without color’ explicit liking (p = 0.04). Regarding TWL outcomes, explicit liking, explicit wanting and implicit wanting, scores were significantly higher for Good responders than Low responders for ‘No meat – High fat’ (post-hoc corrected p-value: 0.04, 0.03 and 0.04, respectively). Together, our results failed to identify major differences in liking and wanting regarding the type of surgery and tended to indicate that higher weight loss might be related to a higher reward for high protein-content food. Rather to focus only on palatable foods, future studies should also consider a broader range of food items, including protein reward.

Scientists observe, discover, justify and eventually share their findings with the scientific community. Dissemination is an integral aspect of scientific discovery since discoveries which go unnoticed have no or little impact on science. Today, peer-review is part of this process of scientific dissemination as it contributes proactively to the quality of a scientific article. As the numbers of scientific journals and scientific articles published therein are increasing steady, processes such as the single-blind or double-blind peer review are facing a near collapse situation. In fact, these traditional forms of reviewing have reached their limits and, because of this, are also increasingly considered as unfair, sloppy, superficial and even biased. In this manuscript we propose forms of Post Publication Public Peer Review (P4R) as valuable alternatives to the traditional blind peer review system. We describe how the journal Sci has explored such an approach and provide first empirical evidence of the benefits and also challenges such a P4R approach is facing.

Abstract: Cardiovascular Disease (CVD) is the most prevalent disease worldwide, which has been linked to work stress because of poor job design as explained by the Job Demand-Control (JDC) and the Effort-Reward Imbalance (ERI) models. In this paper we explore for the first time relative impact of a specific aspect of organisational climate, Psychosocial Safety Climate (PSC), on any CVD including angina, myocardial infarction, hypertension, and stroke. We used two waves of interview data from Australia, with an average lag of 5 years (excluding baseline CVD, final n = 1223). Logistic regression was conducted to estimate the prospective associations between PSC at baseline on incident CVD at follow-up. It was found that participants in low PSC environments were 59% more likely to develop new CVD than those in high PSC environments. Logistic regression showed that PSC at baseline predicts lower CVD risk at follow-up (OR = 0.98, 95% CI 0.96-1.00), and this risk remained unchanged even after joint adjustment for measures of ERI and JDC. These results suggest that PSC is an independent risk factor for CVD in Australia. Beyond job design this study implicates organisational climate and prevailing management values regarding worker psychological health as the genesis of CVD.

When “hijacked” by compulsive behaviors that affect the reward and stress centers of the brain, functional changes in dopamine circuitry occur as the consequence of pathological brain adaptation. As a brain explanans for mental health, with a central functional role in behavioral regulation from healthy reward seeking to pathological adaptation to stress in response to adversity, we may use dopamine regulation in interaction with other brain mechanisms, as discussed herein, to gather a deeper insight into environmentally triggered mental health changes to understand, for example, specific behavioral changes observed during and after the COVID-19 pandemic. Pandemic-related adversities, the stresses they engendered, and the long lockdown periods where people had to rely on digital tools to get feed-back rewards via the internet can be seen as the major triggers of changes in motivation and reward seeking behavior worldwide. The pathological adaptation of dopamine-mediated reward circuitry in the brain offers a highly plausible explanation why, when pushed by fate and circumstance into a physiological brain state of anti-reward, human behavior and mental health changes almost inevitably depending on individual vulnerability to stress. A unified conceptual account that places dopamine function at the centre of the current global mental health context is proposed.

There is clinical concern about the combined use of alcohol and opiates. Several lines of evidence support an interaction between alcohol and the endogenous opioid system. Thus, we hypothesized that ethanol by causing the release of opioid peptides may sensitize the system to the action of exogenous opioids such as morphine. In this study, using the place conditioning paradigm as an animal model of reward, we determined whether a morphine challenge would alter the pre-established preference induced by ethanol conditioning in mice, and whether this response was mediated by the mu opioid receptor (MOP). Given that ethanol exposure stimulates the release of opioid peptides, we also assessed the role of beta-endorphin (β-END) and enkephalins (ENKs) in this response. Mice lacking MOP, β-END and/ or ENKs as well as their respective wild-type controls were tested for baseline place preference on day 1, conditioned with ethanol (2 g/kg) versus saline on days 2 to 4 and then tested under a drug-free state for postconditioning place preference on day 5. On day 8, mice received a single injection of morphine (5 mg/kg) and were tested for place preference. On each test day, mice were placed in the central neutral chamber and allowed to freely explore the conditioning chambers. The amount of time that mice spent in each chamber was recorded. We found that a challenge dose of morphine given on day 8 enhanced the CPP response in mice previously conditioned with ethanol. This response was abolished in MOP null mice, confirming the role of MOP in this response. Although this enhanced response was not altered in mice lacking either β-end or ENKs compared to their wild-type littermates/controls, it was completely blunted in mice lacking both β-end and enkephalins. Together, these results suggest that these opioid peptides jointly mediate the crosstalk between the rewarding actions of morphine and ethanol.

Syncope and presyncope occurring during work can affect safety and impair occupational performance. Few data are available regarding the prevalence of these events among workers. The possible role of sleep quality, mental stress and metabolic disorders in promoting syncope, presyncope and falls in workers is unknown. In the present study, 741 workers (male 35.4%; mean age 47±11 years), employed in different companies, underwent clinical evaluation and blood tests and completed questionnaires to assess sleep quality, occupational distress and mental disorders. The occurrence of syncope, presyncope and unexplained falls during their working life was assessed by an ad hoc interview. The prevalence of syncope, presyncope and falls of unknown origin was 13.9%, 27.0%, and 10.3%, respectively. The occurrence of syncope was associated with an increased risk of occupational distress (adjusted Odds Ratio aOR: 1.62, Confidence Intervals at 95%: 1.05-2.52), low sleep quality (aOR: 1.79 CI 95%: 1.16-2.77) and poor mental health (aOR: 2.43 CI 95%: 1.52-3.87). Presyncope was strongly associated with occupational distress (aOR: 1.77 CI 95%: 1.25-2.49), low sleep quality (aOR: 2.95 CI 95%: 2.08-4.18) and poor mental health (aOR: 2.61 CI 95%: 1.78-3.84), while no significant relationship was found between syncope or presyncope and metabolic syndrome. These results suggest that occupational health promotion interventions aimed at improving sleep quality, reducing stressors and increasing worker resilience might reduce syncope and presyncope events in the working population.

Wind power is one of the most important sources of renewable energy available today. A large part of the wind energy cost is due to the cost of maintaining wind power equipment. When a wind turbine component fails to function, it might need to be replaced under the less than ideal circumstances. This is known as corrective maintenance. To minimize unnecessary costs, a more active maintenance policy based on the life expectancy of the key components is preferred. Optimal scheduling of preventive maintenance activities requires advanced mathematical modeling. In this paper, an optimal preventive maintenance algorithm is designed using the renewal-reward theorem. In the multi-component setting, our approach involves a new idea of virtual maintenance which allows us to treat each replacement event as a renewal event even if some components are not replaced by new ones. The proposed optimization algorithm is applied to a four-component model of a wind turbine and the optimal maintenance plans are computed for various initial conditions. The modeling results showed clearly the benefit of PM planning compared to pure CM strategy (about 30% lower maintenance cost).

Directed movement towards a target requires spatial working memory, including processing of sensory inputs and motivational drive. In a stimulus-driven, operant conditioning paradigm designed to train zebrafish, we present a pulse of light via LED’s and/or sounds via an underwater transducer. A webcam placed below a glass tank records fish swimming behavior. During operant conditioning, a fish must interrupt an infrared beam at one location to obtain a small food reward at the same or different location. A timing-gated interrupt activates robotic-arm and feeder stepper motors via custom software controlling a microprocessor (Arduino). “Ardulink”, a JAVA facility, implements Arduino-computer communication protocols. In this way, full automation of stimulus-conditioned directional swimming is achieved. Precise multi­day scheduling of training, including timing, location and intensity of stimulus parameters, and feeder control is accomplished via a user-friendly interface. Our training paradigm permits tracking of learning by monitoring, turning, location, response times and directional swimming of individual fish. This facilitates comparison of performance within and across a cohort of animals. We demonstrate the ability to train and test zebrafish using visual and auditory stimuli. Current methods used for associative conditioning often involve human intervention, which is labor intensive, stressful to animals, and introduces noise in the data. Our relatively simple yet flexible paradigm requires a simple apparatus and minimal human intervention. Our scheduling and control software and apparatus (NemoTrainer) can be used to screen neurologic drugs and test the effects of CRISPR­-based and optogenetic modification of neural circuits on sensation, locomotion, learning and memory.

Deep reinforcement learning (DRL) has achieved significant results in many Machine Learning (ML) benchmarks. In this short survey we provide an overview of DRL applied to trading on financial markets, including a short meta-analysis using Google Scholar, with an emphasis on using hierarchy for dividing the problem space as well as using model-based RL to learn a world model of the trading environment which can be used for prediction. In addition, multiple risk measures are defined and discussed, which not only provide a way of quantifying the performance of various algorithms, but they can also act as (dense) reward-shaping mechanisms for the agent. We discuss in detail the various state representations used for financial markets, which we consider critical for the success and efficiency of such DRL agents. The market in focus for this survey is the cryptocurrency market.

Background: Physical and mental health of corporate employees is equally important, especially in international salespeople in the in vitro diagnostic (IVD) medical device industry. The rapid growth of the IVD market is driven by the increasing prevalence of chronic and infectious diseases. This study aims to identify the association of socio-demographic, occupational, organizational, and psychosocial factors with mental health outcomes for depression, anxiety, and somatic symptoms in Chinese IVD international salespeople. Methods: The study was a cross-sectional survey of ISs in IVD companies officially registered in China. An online survey was designed to collect data through email contact with IVD companies and social media between August 2022 and March 2023. Measured factors included effort-reward imbalance (ERI), health-promoting leadership (HPL), health climate (HC), inner strength (IS), and perceived social support (PSS). Mental health outcomes assessed using the Core Symptom Index (CSI) were depression, anxiety, and somatic symptoms. Results: A total of 244 salespeople responded to the survey. CSI scores indicated that 18.4% (n = 45) and 10.2% (n = 25) of the respondents had symptoms of major depression and anxiety, respectively. ERI was positively correlated, while the IS and PSS were negatively correlated with major depression, anxiety, and somatic symptoms (p < .01). Health climate was negatively correlated with major depression (p < .05). Education background was associated with somatic symptoms (p < .05). ERI, IS, and gender were significant predictors of major depression, anxiety, and somatic symptoms (p < .05). Conclusion: The prevalence of depression and anxiety in China’s IVD international salespeople was considered low compared with prevalence in Chinese populations during COVID-19, but higher than those before the pandemic. Effort–reward imbalance, inner strength, and gender were significant factors in major depression, anxiety, and somatic symptoms among IVD international salespeople.