Preprint
Review

This version is not peer-reviewed.

Computational Approaches to Cyber-Syndrome: A Scoping Review with Considerations for Adolescent Mental Health

A peer-reviewed version of this preprint was published in:
Adolescents 2026, 6(5), 84. https://doi.org/10.3390/adolescents6050084

Submitted:

02 September 2026

Posted:

03 September 2026

You are already at the latest version

Abstract
Cyber-Syndrome denotes the physical, social, and thinking disorders arising from problematic cyberspace interactions, with its thinking dimension encompassing cognitive deficits (e.g., attentional impairment, executive dysfunction) and affective disturbances (e.g., mood disorders, emotional dysregulation). Conventional assessment approaches, relying primarily on self-report questionnaires and laboratory-based tasks, are unable to capture the rapid, context-dependent fluctuations of mental states in real-world digital environments. Leveraging advances in computational psychiatry, affective computing, and machine learning, this paper presents a scoping review of computational approaches for inferring cognitive and affective states of Cyber-Syndrome from digital behavior. It situates Cyber-Syndrome within the Cyber-Physical-Social-Thinking (CPST) space framework, reviews the principal data sources, and covers the computational methods used to analyze them. It then synthesizes evidence from adolescent studies and examines the research institutions and open-source platforms that have driven methodological progress in the field. Finally, it discusses key challenges and outlines future directions essential for clinical translation and real-world deployment, particularly in adolescent mental health.
Keywords: 
;  ;  ;  ;  

1. Introduction

The digital revolution is changing human lifestyles, shifting traditional activities such as living, working, socializing, and entertaining into virtual cyberspace [1]. This excessive and problematic online interaction profoundly affects people’s thinking space, particularly their cognitive and affective states. In 2018, Ning et al. proposed the concept of Cyber-Syndrome that captures the holistic impact of cyberspace on human well-being, of which the thinking dimension particularly includes cognitive deficits (e.g., attention deficits, executive dysfunction, memory impairment) and affective disturbances (e.g., mood disorders, emotional dysregulation, and stress-related issues) [2,3,4,5,6].
Adolescents represent a uniquely vulnerable population for the Cyber-Syndrome, given their ubiquitous digital involvement and ongoing neurocognitive development. The World Health Organization estimates that one in seven adolescents globally experiences mental health conditions, with digital behavior emerging as both a contributing factor and a potential window for early detection [7]. Moreover, the consequences of Cyber-Syndrome during adolescence may be more severe and lasting than in adulthood, as maladaptive cognitive and emotional habits formed during this critical window can become entrenched, increasing lifetime risk for mood disorders, attentional problems, and impaired metacognitive development.
Traditional approaches to assessing the cognitive and affective manifestations of Cyber-Syndrome have largely relied on self-report instruments (e.g., Beck Depression Inventory, State-Trait Anxiety Inventory) and laboratory-based cognitive tasks [8]. Although such tools have yielded valuable insights, they are inherently limited by subjective recall, static measurement, and coarse temporal resolution, failing to capture the dynamic, context-dependent nature of real-world mental states [9,10]. In parallel, digital traces generated through daily online activities including linguistic content, interaction patterns, and neurophysiological signals, have emerged as rich and ecologically valid sources for inferring mental states [11,12,13,14]. Using advanced computational methods to analyze these digital data has demonstrated considerable promise in achieving an objective, continuous, and multi-faceted mental state assessment [15,16].
Despite growing interest, the field lacks a synthesis that maps computational approaches for assessing the cognitive and affective dimensions of Cyber-Syndrome through digital behavior analysis. To address this gap, this paper presents a scoping review that charts the conceptual landscape, data sources, computational methods, and adolescent evidence base in this field, identifies gaps and open challenges, and offers guidance for clinical translation. The main contributions are as follows:
  • Provide a systematic conceptual framework positioning cognitive and affective manifestations of Cyber-Syndrome within the broader CPST space paradigm, clarifying the theoretical underpinnings of computational mental state inference.
  • Review state-of-the-art data sources and features for capturing cognitive and affective states, and examine computational methods ranging from Natural Language Processing (NLP) to Large Language Models (LLMs) for mental state inference.
  • Synthesize current evidence and considerations for adolescent populations, and analyze critical challenges as well as future directions for advancing clinical translation and real-world deployment.
The remainder of this paper is organized as follows. Section 2 describes the search strategy and study selection process. Section 3 introduces the conceptual foundations of Cyber-Syndrome within the CPST space framework. Section 4 surveys the data sources and features used for mental state inference, organized into a modality-based taxonomy. Section 5 reviews the computational methods, ranging from text-based analysis and multimodal learning to cognitive computational modeling, temporal state modeling, and personalized modeling. Section 6 analyzes empirical evidence and considerations for adolescent populations. Section 7 examines the digital phenotyping platforms and research institutions driving the field, and Section 8 discusses critical challenges and future directions. Section 9 concludes the work.

2. Search Strategy and Scope

The literature search was conducted in May 2026 across five electronic databases: IEEE Xplore, PubMed, ACM Digital Library, Scopus, and Google Scholar. Search terms combined the constructs of “Cyber-Syndrome” and related digital-health concepts with computational terms (e.g., “digital behavior” AND “mental state assessment”; “affective computing” AND “cognitive impairment”; “machine learning” AND “computational psychiatry”), adapted to each database’s syntax. The search was limited to peer-reviewed journal articles and conference papers published in English within the last ten years. Foundational theoretical and methodological works outside this window were included where required for conceptual grounding.
Studies were included if they (a) proposed or validated computational methods for inferring cognitive or affective states from digital behavioral data, (b) addressed mental health outcomes relevant to the thinking-space dimension of Cyber-Syndrome, or (c) provided theoretical frameworks or systematic reviews connecting digital behavior to mental state assessment. Studies focused exclusively on physical health outcomes, non-digital assessment methods, or purely biological markers without behavioral correlates were excluded.
After removing duplicates, title and abstract screening yielded 412 potentially relevant records. Following full-text assessment, 259 primary studies, methodological papers, and theoretical frameworks were retained in the final scoping corpus, of which 45 specifically targeted adolescent populations. Screening was performed independently by two reviewers, with disagreements resolved by discussion or a third reviewer. Notably, we did not restrict our literature search to the adolescent population. Because the data sources and computational methods reviewed in this paper are, in principle, applicable across age groups, keeping the search unrestricted enabled us to capture the latest advances in the broader field of computational mental state inference. Studies specifically targeting adolescents were subsequently identified and analyzed as a dedicated subset, as discussed in Section 6.

4. Data Sources and Features

Computational assessment of cognitive and affective states draws upon multiple data sources, each capturing different aspects of mental functioning [11,12]. Table 2 provides a comprehensive taxonomy organized by modality and psychological relevance.

4.1. Linguistic Markers

Natural language provides evidence for both cognitive and affective processes [13,29]. Digital communication via social media posts, messages, search queries, and typed content generates vast amounts of linguistic data that can be analyzed for cognitive and affective features. We organize linguistic markers along a continuum from surface-level form (lexical and stylistic features) to affective content (sentiment and emotion analysis) and finally to deep cognitive processes (reasoning styles, metacognition, and reality monitoring), moving from what is readily observable to what requires higher-level semantic and pragmatic inference.

4.1.1. Lexical and Stylistic Features

The words individuals choose consciously or unconsciously reflect their cognitive and emotional states. Among the various levels of linguistic analysis, lexical and stylistic features are the most directly accessible and interpretable. These features capture both what people say (vocabulary content) and how they say it (syntactic and typographical style), providing complementary perspectives on underlying psychological states.
Lexical features include word count, vocabulary diversity, part-of-speech distributions, and frequency of function words (e.g., pronouns, prepositions, articles). Stylistic features encompass sentence length, clause complexity, punctuation usage (e.g., exclamation marks, ellipses), and non-standard typography (e.g., capitalization, repeated letters). Relevant research has shown that ellipsis usage reflects speakers’ tendency to optimize processing efficiency by omitting redundant information, serving as a marker of cognitive load and discourse management [42]. Similarly, emoji and emoticon usage provide nonverbal affective cues that can clarify or amplify emotional tone [43]. Dubé et al. found a positive correlation between emotional intelligence and the frequency of emoji usage, indicating that the effectiveness of emojis as nonverbal emotional cues is consistent across different social situations [44].
While classic frameworks such as the Linguistic Inquiry and Word Count (LIWC) offer theory-driven dictionaries that map word usage onto psychological constructs, these lexical markers represent only the first step in linguistic analysis [45,46,47]. More nuanced interpretations of cognitive and affective states require dedicated methods for sentiment and reasoning styles, which we discuss in the following subsections.

4.1.2. Sentiment and Emotion Analysis

Sentiment and emotion analysis directly target the valence and categorical nature of emotional expression, providing a structured approach to mapping affective states from digital footprints [48]. Unlike LIWC’s simple counting of emotion-related words (e.g., “sad”, “happy”), modern sentiment analysis infers context-dependent emotional tone, offering complementary insights into mental health states.
Traditional approaches rely on sentiment lexicons such as SentiWordNet or VADER [49], while modern methods leverage supervised machine learning and transformer-based architectures to achieve higher accuracy in context-dependent sentiment detection [50,51,52]. For example, Zogan et al. developed a hybrid deep learning model that integrates multi-aspect features for explainable depression detection, demonstrating that specific emotion categories such as sadness and anger serve as strong indicators of mental health conditions [53]. Recent advances in transformer-based models, including BERT, RoBERTa, and LLMs, have substantially improved the accuracy and granularity of sentiment and emotion analysis from social media text [54,55,56]. These models capture contextual nuances and implicit emotional cues, and achieve state-of-the-art performance in mental health prediction tasks [13,57,58].

4.1.3. Cognitive Process Markers

Cognitive process markers tap into how a person thinks, which is closely linked to psychological well-being and psychopathology [59]. One key area is the identification of cognitive distortions, including catastrophizing (exaggerating potential negative outcomes), overgeneralization (drawing broad conclusions from a single event), and black-and-white thinking (viewing situations in extreme, all-or-nothing terms) [60]. Computational approaches have increasingly automated the detection of such distortions in text, enabling scalable assessment of maladaptive thinking patterns in naturalistic settings. For instance, dictionary-based methods and fine-tuned LLMs have been used to identify cognitive distortions in social media posts, with studies showing that elevated rates of absolutist and catastrophic language correlate with depression and anxiety severity [61].
Languages also reflect broader reasoning styles, particularly the distinction between analytic and intuitive thinking [62]. Metacognitive markers further extend this analysis by capturing expressions of self-awareness, insight, and reflection that are often impaired in psychiatric conditions [26]. Computational studies have linked reduced metacognitive language in clinical text and social media to poorer insight and diminished reflective functioning in psychiatric populations. Similarly, reality monitoring can be inferred from linguistic features such as perceptual detail, source attributions, and consistency in narrative accounts [27]. Impairments in reality monitoring, commonly observed in schizophrenia and dissociative conditions, provide a promising target for automated language-based assessment.

4.2. Interaction Dynamics

Human-device interactions offer continuous, implicit measures of cognitive and affective states [19,21]. Behavioral traces such as app switching patterns, typing dynamics, touchscreen gestures, and usage duration generate high-resolution temporal data that can be analyzed for markers of attentional control, executive function, emotional regulation, and reward processing.

4.2.1. Keystroke Dynamics

As users interact with digital devices through keyboards or touchscreens, each keystroke generates a sequence of timing events that reflect underlying cognitive processes, motor coordination, and attentional states [63]. Key metrics include typing speed, measured in words per minute or characters per second, which serves as a proxy for processing speed and psychomotor function. For example, the key hold time is associated with fine motor control and may be prolonged under conditions of fatigue or psychomotor retardation. Error rate, typically operationalized as the frequency of backspace or delete usage, provides an indicator of error monitoring and cognitive control. In addition, intra-individual variability across these metrics captures attentional fluctuations and cognitive stability, with increased variability often signaling lapses in sustained attention [64].
Research has demonstrated the performance of keystroke dynamics in detecting a range of mental health conditions and transient cognitive states. Studies show that typing patterns can reliably distinguish individuals with cognitive impairment from healthy controls, with slowed typing speed and prolonged flight time serving as salient markers [65]. Stress has also been found to modulate keystroke behavior, particularly through increased variability and altered flight time patterns [66]. In the context of depression, individuals exhibit characteristic changes in keystroke dynamics, including reduced typing speed, increased hold time, and higher error rates [67]. These findings underscore the potential of keystroke dynamics as an unobtrusive behavioral marker for real-time monitoring of cognitive and affective states.

4.2.2. Mouse and Touch Dynamics

Mouse and touchscreen interactions capture the continuous motor output of users as they navigate digital environments, providing a rich complement to keystroke-based assessments [68]. These interaction modalities generate high-resolution spatiotemporal data that reflect psychomotor function, cognitive conflict, and emotional arousal. For example, movement speed reductions have been associated with psychomotor retardation in depression and fatigue. Movement curvature has been linked to cognitive uncertainty and response conflict, with more curved trajectories emerging during periods of indecision or competing response tendencies [69]. Click or tap pressure, where measurable on pressure-sensitive devices, may index physiological arousal and emotional intensity, with increased force often accompanying heightened affective states [70]. Scroll patterns, including scroll speed and regularity, reflect reading engagement and comprehension, as well as attentional investment in content consumption.
Empirical studies have demonstrated the utility of mouse and touch dynamics in detecting cognitive and affective disturbances. Research has shown that individuals experiencing stress exhibit slower movement speed and increased trajectory curvature during pointing tasks, reflecting the impact of anxiety on motor planning and execution [71]. In clinical populations, impaired fine motor control captured through touchscreen gestures has been linked to executive dysfunction and psychomotor slowing [72]. Furthermore, the combination of mouse dynamics with other behavioral streams, such as click patterns and scrolling behavior, has enabled the identification of cognitive load states and attentional lapses with high temporal resolution.

4.2.3. App-Switching and Multitasking Patterns

App-switching patterns capture the dynamics of task management in real-world digital environments, revealing how individuals allocate attention across competing activities. Switch frequency, or the rate at which users transition between applications, serves as an indicator of attentional stability [19]. Task completion, assessed through whether initiated activities are brought to completion, provides a behavioral measure of goal-directed persistence and executive control. Sequential patterns, or the ordered structure of app transitions, reveal cognitive routines and task hierarchies, while interruption patterns offer insights into the integrity of attentional control mechanisms.
Accumulating evidence links app-switching and multitasking behaviors to cognitive and mental health outcomes. Heavy multi-taskers have been shown to exhibit poorer attentional filtering and increased susceptibility to distraction, suggesting that fragmented digital engagement may both reflect and reinforce attentional vulnerabilities [73]. In clinical samples, individuals with attention-deficit or hyperactivity disorder demonstrate higher app-switching rates and shorter session lengths compared to healthy controls [74]. Moreover, longitudinal analyses of smartphone usage patterns have revealed that increased switching frequency and reduced task completion predict greater symptom severity in depression and anxiety [75]. Specifically, Zhu et al. focused on the association between smartphone multitasking and depressive symptoms among college students in a multi-time point longitudinal cohort, and reported that smartphone multitasking behavior is significantly associated with an increased risk of depression [76]. These behavioral markers, when captured passively and continuously, enable real-time inference of cognitive control states and hold promise for identifying critical transitions in mental health status.

4.3. Temporal Patterns and Rhythms

The temporal patterns and rhythms people engage with digital devices reveal fundamental aspects of circadian function, sleep, and mental state dynamics [77,78]. Temporal features such as usage timing distributions, active and inactive periods, and daily regularity indices generate continuous streams of chronometric data that can be analyzed for markers of circadian rhythm stability, sleep-wake patterns, and the temporal structure of mood and cognitive states.

4.3.1. Circadian Rhythms

The timing of digital interactions provides insights into circadian function and sleep patterns. Activity timing reflects the alignment of an individual’s behavioral rhythm with the endogenous circadian clock. Periods of extended inactivity, particularly overnight, serve as reliable proxies for sleep timing and duration, enabling objective, longitudinal assessment without the need for self-report. Social jetlag, operationalized as the discrepancy in sleep timing between weekdays and weekends, captures the misalignment between biological and social time. Recent works have demonstrated that elevated social jetlag is consistently associated with mood disorders, including depression and bipolar spectrum conditions [79]. Circadian disruption, manifesting as irregular, fragmented, or phase-shifted activity rhythms, represents a transdiagnostic marker of mental health disturbance, with well-documented links to mood instability, cognitive impairment, and diminished well-being [80].
Empirical studies leveraging passively collected smartphone data have demonstrated that circadian rhythm metrics are sensitive to both clinical status and subclinical symptom fluctuations. Individuals with depression exhibit later activity onset, reduced daytime activity, and increased fragmentation of rest–activity cycles compared to healthy controls. In bipolar disorder, circadian disruption often precedes and predicts the onset of mood episodes, suggesting that temporal patterns may serve as early warning signals. Furthermore, the objectivity and continuous nature of passively derived circadian metrics make them particularly valuable for longitudinal monitoring, offering an ecologically valid complement to clinic-based assessments. When integrated with other behavioral and physiological streams, circadian features contribute to a multidimensional characterization of mental health that captures both stable trait-like patterns and dynamic state fluctuations.

4.3.2. Temporal Variability and Complexity

Beyond average patterns of activity timing, the variability and complexity of behavioral rhythms provide critical insights into mental health and cognitive functioning. Day-to-day variability in activity timing, duration, and intensity reflects the stability of daily routines. Individuals with mood disorders, particularly bipolar disorder, exhibit marked fluctuations in activity patterns that mirror their affective instability. Entropy measures, which quantify the predictability or randomness of temporal sequences, offer a sophisticated lens for characterizing behavioral dynamics. Reduced entropy has been observed in depression and anxiety, while increased entropy may characterize manic states [81].
Fractal scaling, which captures long-range temporal correlations in behavioral time series, provides another important dimension of temporal complexity. Healthy physiological and behavioral systems exhibit fractal scaling, characterized by self-similar fluctuations across multiple timescales that balance stability and adaptability. Disruptions in fractal scaling have been documented across a range of mental disorders, including depression, bipolar disorder, and schizophrenia, with deviations toward either excessively rigid or overly random dynamics signaling compromised regulatory capacity [82]. These complexity metrics, derived from passively collected digital behavioral data, offer a powerful approach for quantifying the integrity of self-regulatory systems. When tracked longitudinally, changes in temporal variability and complexity may serve as early indicators of impending mental health deterioration, enabling timely intervention.

4.3.3. Seasonal and Long-Term Patterns

Temporal patterns in digital behavior extend beyond daily and weekly cycles to encompass seasonal and multi-year trajectories, offering insights into the longer-term dynamics of mental health. Seasonal variation in activity timing, sleep patterns, and digital engagement reflects the influence of changing photoperiod and environmental factors on mood and behavior. Reduced activity levels, later sleep onset, and diminished social engagement during winter months are characteristic of seasonal affective disorder, and passive monitoring of digital behaviors can capture these seasonal shifts with high fidelity. For individuals with mood disorders, seasonal patterns may manifest as predictable periods of symptom exacerbation or remission, and identifying these seasonal rhythms can inform personalized treatment planning and preventive interventions.
Long-term trends captured over months or years reveal the trajectory of mental health conditions, including the progression of illness, response to treatment, and risk of relapse. Gradual shifts in activity timing, such as persistent phase delay, may signal the emergence of depressive episodes in vulnerable individuals. Similarly, sustained changes in social interaction patterns, app usage diversity, or communication frequency may reflect evolving clinical status. The accumulation of longitudinal digital behavioral data enables the construction of individualized baselines against which deviations can be detected, supporting a personalized approach to mental health monitoring. When combined with clinical assessments and self-report, these long-term temporal patterns enhance our ability to understand illness trajectories, evaluate intervention effectiveness, and identify critical windows for preventive care.

4.4. Neurophysiological Signals from Wearables

Consumer wearable devices increasingly provide continuous physiological data relevant to mental state inference [36,37]. These devices enable passive, longitudinal monitoring of autonomic nervous system activity and brain function, offering objective biomarkers that complement self-report and behavioral measures.

4.4.1. Heart Rate and Heart Rate Variability

Heart rate and heart rate variability (HRV) are among the most widely studied physiological markers in digital mental health. Average heart rate and beat-to-beat intervals index sympathetic arousal and stress levels, while HRV metrics capture autonomic nervous system balance [83]. Reduced HRV has been consistently associated with cognitive control deficits, particularly in tasks requiring attentional regulation and response inhibition [84]. In the affective domain, low HRV is a robust correlate of anxiety disorders, depression, and emotional dysregulation, suggesting diminished capacity for adaptive self-regulation [85].

4.4.2. Electrodermal Activity

Electrodermal activity (EDA) captures changes in skin conductance driven by sympathetic nervous system activation, providing a sensitive index of arousal and emotional responding [86]. Tonic EDA, measured as baseline skin conductance level, reflects sustained arousal states, while phasic EDA captures event-related fluctuations in response to specific stimuli or cognitive demands [87]. The frequency and amplitude of EDA peaks serve as indicators of acute stress, emotional reactivity, and surprise. In mental health applications, EDA has been used to detect stress responses, panic attacks, and emotional dysregulation episodes, with wearable sensors enabling continuous monitoring in real-world settings.

4.4.3. Electroencephalography

Recent advances in electroencephalography (EEG) devices have made continuous brain activity monitoring increasingly feasible [88]. These lightweight, dry-electrode systems capture key neural oscillatory patterns relevant to cognitive and affective states. For example, Theta activity (4-8 Hz) is associated with cognitive load, sustained attention, and memory encoding processes. Alpha activity (8–12 Hz) reflects cortical inhibition and relaxation states. Beta activity (12-30 Hz) correlates with active concentration, alertness, and motor preparation. Frontal alpha asymmetry, defined as the difference in alpha power between left and right frontal regions, has been extensively studied as a marker of depression risk and trait negative affect [89].

4.4.4. Multi-Sensor Integration

Modern wearable platforms increasingly integrate multiple physiological sensors, enabling multimodal assessment of neurophysiological states [37]. Smartwatches combine photoplethysmography (PPG) for heart rate monitoring, accelerometry for movement detection and EDA sensors. Smart rings offer continuous PPG and accelerometry along with skin temperature measurements, providing robust sleep and circadian monitoring. Multimodal wristbands integrate PPG, EDA, accelerometry, and temperature into a single form factor, supporting simultaneous assessment of cardiovascular, electrodermal, and motor activity. These integrated platforms facilitate the fusion of complementary physiological signals, enabling more robust inference of mental states.

5. Computational Methods

5.1. Mental state inference based on text

As the primary vehicle for individual thought, emotion, and cognitive expression, text data contains rich semantic features and latent psychological cues, serving as an indispensable foundation for precise and non-invasive mental state inference. NLP has emerged as a primary tool for inferring mental states from digital text [15,16].

5.1.1. Traditional Text Representation Methods

Traditional text processing and feature extraction methods have laid an important foundation in research on psychological trait recognition and mental health screening. The following section primarily explores the specific applications, effectiveness, and limitations of lexicon-based methods (e.g., Linguistic Inquiry and Word Count, LIWC), the Bag-of-Words (BoW) model, and Term Frequency-Inverse Document Frequency (TF-IDF) in capturing psychological representations. Lexicon-based methods, particularly the theory-driven LIWC framework, quantify psychological constructs via predefined dictionaries [45]. Recent studies demonstrate that integrating LIWC with topic modeling or specialized lexicons (e.g., cultural or clinical domain-specific dictionaries) effectively uncovers distinct age-specific linguistic patterns [90], and predicts depression severity with high stability [91]. BoW model extracts word frequency vectors for inductive text classification [92,93]. A study demonstrated that combining BoW with classification models can achieve an accuracy of up to 86% in depression recognition [94]. TF-IDF identifies idiosyncratic linguistic markers by evaluating word relevance [95]. Research shows that TF-IDF-based logistic regression effectively identifies depressive symptoms, thereby enhancing the efficiency of mental health screening [96].

5.1.2. Word Embeddings

Word embeddings utilize continuous vectors to represent word semantics [97]. Static methods such as Word2vec and GloVe assign a fixed representation to each word [98,99]. A study on Twitter-based depression detection evaluated three word embeddings (Word2Vec, GloVe, and FastText) across eight machine learning classifiers [100]. It reveals that the proposed GloVe-based stacked ensemble model achieved 97% accuracy, significantly outperforming individual classifiers and traditional BoW approaches. Kunder et al. investigated mental health text classification and evaluated the impact of Word2Vec-based text vectorization coupled with deep learning architectures to detect emotional states such as stress, anxiety, and sadness. The results demonstrated that integrating Word2Vec embeddings significantly enhanced model training efficiency and classification accuracy [101].

5.1.3. Transformer-based contextual embeddings

Transformer-based contextual embeddings (such as BERT, RoBERTa, and ELECTRA) leverage surrounding context to capture nuanced semantic features [54,55], enabling the accurate identification of subtle linguistic markers associated with depression [102]. Recent work has further demonstrated the effectiveness of BERT-based models for social media-based depression detection [13,53]. Specifically, a study focusing on depression detection from social media texts employed BERT and RoBERTa on the Reddit depression dataset hosted on the Kaggle platform, validating the superior performance of deep pre-trained language models in social media depression recognition [103]. Additionally, Salameh et al. leveraged RoBERTa to capture deep contextual semantic features and integrated a Convolutional Neural Network (CNN) for hierarchical feature extraction, achieving an accuracy of 96% on the Reddit depression dataset [104].

5.1.4. LLMs

LLMs such as GPT, LLaMA, and Claude show great promise for text-based mental health detection [57,105]. Leveraging zero/few-shot learning or targeted fine-tuning, these models efficiently infer mental states [56,58]. A study based on 428 emotional diary entries from 91 participants applied LLMs to depression risk detection. The results demonstrated that the fine-tuned GPT-3.5 achieved an accuracy of 90.2%, while the zero-shot GPT-3.5 reached a balanced accuracy of 84.4% [106]. Additionally, LLMs possess excellent generative explainability, providing intuitive natural language explanations that significantly enhance model interpretability and trustworthiness in medical scenarios [13,107]. Another study indicated that fine-tuned large models achieved an accuracy of 96% in depression detection from social media posts, outperforming traditional approaches [58].

5.2. Mental State Inference Based on Multimodal Data

5.2.1. Attention Mechanism

As the core computational module of the Transformer architecture, the self-attention mechanism precisely models global dependencies by dynamically assigning importance weights to each element within a sequence [54,108]. Its derived variants have been widely applied to multimodal modeling across various scenarios (such as text, images, speech, video, and EEG signals), significantly expanding the application boundaries of the model. In multimodal psychological inference, cross-modal attention enables dynamic, directional interactions by allowing one modality to attend to another [109]. To address the prevalent pain points in audio-text multimodal depression detection, a study proposed a text-guided cross-modal feature reconstruction and decomposition framework. This framework achieves the decoupling of shared and private features between audio and text modalities, outperforming the state-of-the-art (SOTA) methods of the same period [110]. A newly proposed synchronous multimodal Transformer can effectively fuse electroencephalogram and clinical interview data, and capture deep inter-modal correlations through bidirectional cross-attention, thus achieving improved accuracy in depression detection [111,112]. Furthermore, hierarchical attention constructs weights across multiple levels to capture multi-scale structural characteristics [113]. Another study integrated three modalities: text, images, and user auxiliary information. Through a dual-layer attention mechanism—operating both intra-modally and inter-modally—the model automatically screens for key depression-related information, achieving a classification accuracy of 92.84% on the test set [114]. In the field of multimodal psychological and affective computing, co-attention mechanism is widely utilized to address feature mismatch issues across heterogeneous data [115]. A study proposed the ViLBERT model, which pre-trains joint image-text representations through an innovative two-stream architecture and co-attention mechanism, successfully transforming cross-modal alignment into a transferable, generalized capability and achieving remarkable success across multiple classic vision-language tasks [116].

5.2.2. Multimodal LLMs

Multimodal LLMs (MLLMs) provide a groundbreaking paradigm for multimodal mental state inference by extending the powerful reasoning and generative capabilities of text-based LLMs to diverse behavioral modalities [117,118,119]. A study proposes MLlm-DR, capable of understanding vocal and visual inputs and supporting interpretable depression diagnosis by integrating a lightweight LLM with a lightweight query module (LQ-former) [120]. To address the limitation that existing learnable queries lack affective semantic constraints, a study proposes the Prototype-as-Prompt framework, which maps audio-visual representations onto a fixed set of multimodal affective prototypes and leverages them as soft prompts to guide LLMs in multimodal emotion analysis [121]. A study proposed the LLaVA model, which connects a vision encoder to a large language model (LLM) and is fine-tuned on machine-generated image-text instruction data, enabling general-purpose visual and language understanding alongside impressive multimodal chat capabilities [122]. A study proposed the BLIP-2 model, which introduces a lightweight Querying Transformer module to successfully bridge a frozen image encoder and a large language model (LLM), enabling general-purpose vision-language understanding and zero-shot image-to-text generation with minimal trainable parameters [123]. A study proposes the Emotion-LLaMA model, which achieves seamless fusion of audio, visual, and textual input information through dedicated encoders designed for affective tasks. Built upon an improved, instruction-tuned LLaMA architecture, the model significantly enhances its capabilities in emotion recognition and emotion reasoning [124].

5.2.3. Contrastive Learning

In multimodal data processing, Contrastive Learning, as a powerful self-supervised representation learning paradigm, plays a core role in bridging the heterogeneity gap between different modalities and achieving cross-modal semantic alignment in the feature space [125]. To address the difficulties in capturing subtle contextual semantic features and the problem of imbalanced class distribution in datasets for the Emotion Recognition in Conversation (ERC) task, a study proposes a prompt-based hybrid supervised contrastive learning model, which outperforms 15 state-of-the-art ERC models on the MELD and IEMOCAP datasets [126]. Another study proposed a cross-modal alignment method based on contrastive learning to transfer emotion-semantic-rich EEG features to easily collected and low-artifact ECG signals, achieving promising performance in emotion recognition [127]. Zhu et al. constructs a graph cognitive modeling framework integrated with contrastive representation learning. Based on student interaction data, this model can accurately complete student behavior classification and clickstream prediction, improving intelligent education systems and reducing the risk of student dropout [128].

5.2.4. Multimodal Fusion Strategies

Multimodal fusion strategies primarily encompass early, late, intermediate, hybrid, and attention-based approaches. Early fusion concatenates raw inputs to preserve source correlations [129], whereas late fusion combines independent model predictions at the output layer to mitigate modality heterogeneity [130]. For deeper interaction, intermediate fusion integrates high-level feature representations within mid-level network layers [131]. One study proposed two audio-text multimodal depression detection neural networks based on early and late fusion strategies, validating the superiority of the early fusion approach in the depression detection task [132]. Additionally, another study systematically compared the performance of three strategies—early, intermediate, and late fusion—and confirmed that intermediate fusion achieved optimal performance when processing multimodal electroencephalogram (EEG) and eye-tracking data [133]. Additionally, hybrid fusion employs multiple fusion points for progressive, multi-stage feature integration [134], while attention-based fusion dynamically scales modality weights according to context to enhance the robustness of psychological state inference [109]. A study focused on the field of multimodal depression detection proposed a hybrid fusion strategy that combines intra-modal early fusion with inter-modal late fusion. A corresponding feature extraction fusion module and an attention-based decision fusion module were designed, enabling accurate prediction of depression severity from audio and video modalities [135].

5.3. Cognitive Computational Modeling

The key advantage of cognitive modeling is explanatory power—identifying which specific cognitive or affective processes are altered [136,137]. Traditionally, cognitive models have been applied to laboratory task data. Recent work extends them to real-world digital behavior [10,136]. For example, users’ social media engagement can be viewed as a reward learning process where likes and comments serve as social rewards that continuously influence individuals’ posting behaviors [138], and users’ choices and switches between different applications essentially reflect ongoing cost-benefit computations occurring in the brain [19]. In addition, the latency of message responses can effectively demonstrate the trade-offs that individuals make between immediate and delayed rewards [139].

5.3.1. Reinforcement Learning

Reinforcement learning (RL) formalizes how individuals learn from rewards and punishments [140]. In the field of computational psychiatry, this model has been widely applied to uncover the underlying mechanisms of various psychiatric disorders [141]. Research indicates that depression is generally characterized by decreased reward learning rates [142], while anxiety disorders are often accompanied by abnormally heightened punishment sensitivity [143], and individuals across multiple psychopathological conditions also exhibit substantial alterations in the exploration-exploitation trade-offs [144]. A study focusing on a systematic review of depression and RL confirmed that RL-related parameters can serve as endophenotypes for depression, providing a novel perspective for pathological analysis [145]. Additionally, a meta-analysis revealed that the pathology of depression is not an abnormality of a single system but rather a synergistic effect of low reward approach sensitivity and high threat avoidance sensitivity [146].

5.3.2. Drift Diffusion Models

Drift Diffusion Models (DDMs) decompose response times into latent decision processes [147] and explain decision mechanisms through four core parameters: drift rate (efficiency of evidence accumulation), boundary separation (the speed-accuracy trade-off), non-decision time (perceptual and motor latency), and starting point (initial bias). These parameters are effectively estimated from naturalistic digital behavior, thereby providing quantitative support for psychological state inference [148]. One review fully elaborates on the core parameters of DDM and systematically summarizes the aberrant patterns of DDM parameters across five brain disorders, confirming that DDM can serve as a quantitative tool for cognitive deficits in decision-making [149]. Another systematic review traces the developmental history, core theoretical framework, and mechanistic basis of key DDM parameters, summarizing its extensive applications across diverse fields and addressing controversies regarding the model’s identifiability and flexibility [150]. Additionally, a study demonstrates that reward positivity is associated with the evidence accumulation efficiency for high-reward options, further validating that DDM can precisely delineate the specific sub-processes through which depression impacts reward-based decision-making [151].

5.4. Temporal State Modeling

Mental states are inherently dynamic, evolving over multiple timescales [77]. Accordingly, analyses based merely on a single timescale tend to obscure the complete profile of psychological dynamics. The construction of Multi-scale models enables researchers to effectively integrate and capture the inherent interactions and feedback mechanisms among different timescales. This approach facilitates a systematic understanding of the full lifecycle of mental state evolution [152].

5.4.1. Vector Autoregressive Model

Vector Autoregression (VAR) models effectively capture complex multivariate temporal dependencies [153], utilizing Granger causality to identify directional behavioral influences and impulse response functions to simulate shock propagation. A study enrolling 56 patients with anxiety disorders employed multilevel vector autoregressive (mlVAR) network analysis to investigate pre- to post-treatment changes in inter-symptom associations. The study confirmed that Cognitive Behavioral Therapy (CBT) significantly reduced symptom network density and severed the pathological concurrent association between negative emotion and avoidance behavior, thereby elucidating the core therapeutic mechanism of CBT for anxiety disorders [154]. A study addressing the core clinical challenge of high comorbidity between anxiety and depression fitted a mlVAR model to analyze the day-to-day dynamic interactions between symptoms. It revealed that the directional predictive effect of depressive symptoms on anxiety symptoms was significantly stronger than the reverse predictive effect of anxiety symptoms on depressive symptoms [155].

5.4.2. Temporal Neural Network Models

Advancements in deep learning offer robust computational frameworks for temporal state modeling, supporting the fine-grained fusion of multimodal sequential data [14,156] and enabling automated, end-to-end extraction of time-varying features from raw data [157]. To capture sequential dynamics, RNN variants like LSTM and BiLSTM are widely used to model text structures and behavioral interaction patterns, effectively securing bidirectional temporal dependencies [19,53,158,159]. Existing studies indicate that BiLSTM networks can be applied to model text sequences from clinical interviews and fused with audio and video modalities to achieve depression detection and severity assessment [160]. Concurrently, LSTM networks can be employed to model the temporal dynamics of social media data, thereby enhancing depression recognition performance by integrating text, images, and posting timestamps [161]. Furthermore, a hybrid CNN-LSTM model has been adopted to model behavioral sequences in videos, enabling the joint recognition of depression and anxiety [162]. Alternatively, Temporal Convolutional Networks (TCNs) serve as an efficient substitute, offering prominent parallelization advantages and interpretable receptive fields for temporal feature extraction [163]. The successful application of TCNs in multimodal emotion recognition demonstrates that TCNs possess inherent advantages in modeling long-range temporal contexts and multi-scale dynamic features [164].

5.4.3. State-space modeling

As mental states are often not directly observable, state-space models are further employed to infer the underlying latent mental states from observable digital behaviors [165]. Among them, Hidden Markov Models (HMMs) are applied to conduct staged modeling for discrete latent states with Markovian transition characteristics [166]. A study confirmed that the total dwell time in the socially active state derived from the model can serve as an objective digital biomarker for social functional impairment in neuropsychiatric disorders [167]. Another study has verified that the HMM integrated with subjective well-being, emotion regulation and coping styles can more effectively predict individuals’ prospective risk of depression [168]. Jiang et al. proposed the Hidden Markov Model with Multivariate Autoregressive observation, which can effectively extract neuronal dynamic features from EEG signals and interpret the pathogenesis of brain disorders from the perspective of state transitions [169].
Kalman filters excel at tracking continuous latent states within linear dynamics. A study applied this method to depression-related Ecological Momentary Assessment (EMA) data, successfully characterizing emotional dynamics, environmental reactivity, and state controllability under depressive conditions [170]. Other studies aim to construct an accurate galvanic skin response detection system that introduces the Kalman filter algorithm for noise reduction to effectively identify and analyze stress levels [171].

5.5. Personalized Modeling

Substantial individual differences in baseline cognitive and affective functioning necessitate personalized approaches [172].

5.5.1. Meta-Learning

The application of meta-learning represents an advanced paradigm in personalized modeling—utilizing a "learning to learn" mechanism to achieve fast adaptation to an individual’s unique affective or cognitive profile [173,174]. A study proposes a novel meta-learning framework that captures generalized emotional feature cues and undergoes customized fine-tuning tailored to individual annotation styles, thereby effectively enabling personalized speech emotion recognition [175]. Another study proposed an integrated multimodal emotion recognition framework augmented with meta-learning, which models the contextual dependencies among audio, video and electroencephalography signals and greatly improves the model’s cross-task adaptability [176]. To address the heterogeneity of neural signals, Chen and Fang et al. proposed a model-agnostic meta-learning algorithm for EEG-based emotion recognition that achieves state-of-the-art cross-subject accuracy through one-shot adaptation, significantly enhancing the generalizability of future affective brain–computer interfaces [177].

5.5.2. Multi-task Learning

The concept of multi-task learning (MTL) approaches personalization by treating the predictive modeling of each unique individual or distinct subpopulation as an independent yet correlated learning task [178,179]. Focusing on personalized text-based emotion recognition in multi-task scenarios, a study proposed a novel personalized deep learning architecture that performs emotion recognition from the user’s own perspective by computing human subjective biases and learning user-specific vector representations [180]. Another study proposed a deep multi-task learning framework that can simultaneously accomplish sentiment analysis and emotion recognition [181]. Zhao et al. proposed a selective feature-sharing multi-task network for facial expression recognition and synthesis, which effectively mitigates task interference and achieves state-of-the-art performance through data augmentation [182].

5.5.3. Transfer learning

Transfer learning provides a highly efficient mechanism for personalized modeling—transferring generalized psychological, behavioral, or physiological representations from a large source population to a data-scarce target individual [183,184]. To address individual differences in cross-subject EEG emotion recognition, a study proposed a hybrid transfer learning strategy (DFF-Net) integrating domain adaptation and few-shot fine-tuning, effectively enhancing recognition accuracy [185]. Another study proposed a multi-source data sentiment analysis framework using a swarm intelligence algorithm to optimize deep transfer learning, effectively enhancing classification accuracy and generalization for diverse emotional categories [186].

5.5.4. Digital Twins

An emerging concept is that of affective digital twins, personalized computational models that simulate an individual’s cognitive and affective processes [187]. This model possesses three major characteristics: continuous updating, counterfactual simulation and privacy protection capabilities. A study systematically proposed the framework of the Digital Cognitive Twin, constructing an adaptive cognitive health ecosystem through multimodal sensor fusion and AI-driven adaptive gamification [188]. Another study proposed digital twin frameworks that construct virtual replicas of patients by integrating multi-dimensional data and artificial intelligence technologies, which can be used for early diagnosis, risk assessment, personalized treatment simulation, and real-time monitoring in mental health care [189]. Ashokbhai et al. proposed a domain-agnostic methodological framework for a Cognitive Digital Twin (CDT) that augments, rather than replaces human decision-making by explicitly modeling cognitive workload and affective state [190].

6. Evidence and Considerations for Adolescent Populations

Adolescence is a critical period for rapid cognitive development and the maturation of emotional regulation mechanisms, making adolescents highly sensitive to changes in the external environment, especially the shift towards digital lifestyles. The data sources and computational methods reviewed in Section 4 and 5 are, in principle, applicable to all age groups. However, applying them to adolescents requires careful adaptation. This section explores how the general computational methods discussed above can be applied to adolescents, referring to the research summarized in the Appendix Table A1.

6.1. Patterns across Adolescent Studies

First, the evidence base spans a wide developmental window, from early adolescence (ages 10-14 in [191,192]) through late adolescence and young adulthood (ages 18-25 in [36,193]). Large-scale general-population cohorts [194,195] coexist with a substantial cluster of university-student samples [39,46,155,196,197,198] and a growing number of smaller clinical and feasibility studies concentrated in the 13-18 age band [191,199,200,201,202,203,204,205,206,207,208,209,210,211]. Second, the table shows a pronounced methodological divide. Questionnaire- and scale-based self-reports dominate the survey-oriented work [39,40,196,200,201,212], while passively sensed smartphone data collected through applications such as AWARE [206], Beiwe [211], EARS [208], and mindLAMP [213] anchor a separate cluster of sensor-based studies [202,203,205,207,209,214,215]. EMA-based affective tracking [155,207,208,216], wearable physiological sensing [193,204,206], keyboard or touchscreen traces [191,210], and speech-based analysis [217] appear in a smaller but growing number of studies, illustrating an ongoing shift toward continuous, multimodal digital phenotyping. Third, the computational methods used in adolescent samples are correspondingly diverse, ranging from classical statistical approaches such as regression, specification curve analysis, and multilevel modeling [9,33,40,191,194,195,200,203,212] to machine learning and deep learning pipelines [218], speech-based architectures [217], multimodal deep learning [199], and personalized modeling strategies [206,207]. Finally, several studies confirm that personalized and idiographic models consistently outperform generalized approaches in adolescent populations, reflecting the high inter-individual variability characteristic of this developmental stage.

6.2. Developmental Specificity

The table also documents that age itself moderates several marker-symptom associations in ways that would be missed in adult-only studies. The relationship between social media use and life satisfaction, for instance, is most strongly negative among younger adolescents and weakens with increasing age [194]. Keystroke and touchscreen features collected from adolescent devices show associations with depressive symptoms measured by the PHQ-9 [210], and linguistic markers derived from mobile communication including the use of first-person singular pronouns predict depression risk in adolescents [209]. Similarly, studies comparing age groups reveal different linguistic patterns in how adolescents and adults express depression [90]. The dynamics of positive and negative affect also vary developmentally: inertia and variability of emotional states follow distinct patterns as a function of clinical depression and depression risk in adolescent samples [216], and reward-processing metrics derived from cognitive models predict child and adolescent depressive outcomes [151]. Beyond symptom associations, adolescent-specific risk pathways are also documented in the table, including the association between problematic smartphone use and anxiety in early adolescents [219] and the mechanisms linking social media and smartphone use to self-harm within clinical adolescent cohorts [220]. These age-related findings caution against the assumption that computational tools developed and validated only in adult populations will transfer to adolescents. Rather, their validity in this age group cannot be presumed without age-stratified revalidation.

7. Platforms and Institutions

The practical implementation of computational methods for mental state inference depends heavily on a robust ecosystem co-constructed by pioneering research institutions and specialized digital phenotyping platforms. These academic centers and software frameworks have fundamentally reshaped the paradigm of psychiatric assessment, transitioning it from a fragmented, subjective self-report modality into a continuous, objective behavioral sensing paradigm with high ecological validity. This transition is realized by leveraging ubiquitous personal digital devices to capture high-fidelity, multimodal digital footprints. These data streams encompass passive hardware sensor logs, naturalistic smartphone interaction patterns, and active cognitive tasks alongside ecological momentary assessment (EMA) data.
To map and synthesize the core forces driving the advancement at the frontier of this field, this section conducts a comprehensive evaluation across two pivotal dimensions: research institutions and collaborative platforms. Table 3 provides a granular technical analysis of mainstream open-source collaborative software platforms, while Table 4 focuses on leading global research laboratories and institutions. The methodologies of these pioneering institutions and the capabilities of open-source platforms complement each other, laying a solid ecological foundation for the paradigm shift in digital psychiatry from an experience-driven to a data-driven approach.
2pt
2pt

8. Challenges and Future Directions

8.1. Measurement Reliability and Mechanistic Modeling

Establishing reliable ground truth for mental states remains a fundamental challenge [245]. Self-reported measures correlate only moderately with clinical assessments and are subject to recall bias — limitations that are especially pronounced in adolescents, whose introspective ability is still developing. Clinical diagnoses impose categorical labels on dimensional phenomena, and digital data timestamps often fail to align with symptom assessments, creating temporal mismatches. While most current research emphasizes prediction over explanation [136], a promising path forward lies in theory-driven computational modeling that estimates parameters of cognitive processes (e.g., reinforcement learning parameters, drift-diffusion rates) from real-world digital behavior [136,137]. This mechanistic approach can bridge behavioral observation and targeted intervention, and is particularly valuable for adolescents, where developmental changes require separating normative maturation from emerging pathology.

8.2. Individual Variability and Personalized Modeling

Digital behavior data contains substantial measurement noise, and dramatic individual differences in baseline usage patterns mean absolute values of digital metrics carry less meaning than deviations from personal norms [172,246]. For adolescents, this challenge is compounded by rapid developmental change, where baselines shift naturally over months. Personalized modeling approaches — including multi-task learning, domain adaptation, and the emerging concept of affective digital twins — offer a path forward by constructing individualized computational models that simulate each person’s cognitive and affective processes [187]. These models continuously update with new data, enable counterfactual simulation of interventions, and can reside on-device for privacy, making them especially suitable for long-term adolescent mental health monitoring.

8.3. Privacy, Consent, and Ethical Safeguards

Mental health data ranks among the most sensitive personal information, and digital footprints can inadvertently reveal intimate psychological details [247,248]. For minors, these concerns are heightened: informed consent requires both parental permission and adolescent assent, and regulatory frameworks such as COPPA and GDPR-K impose additional requirements [249]. Privacy-preserving technologies including federated learning, differential privacy, and on-device processing are essential enabling tools [250,251,252]. These allow model training across decentralized data without raw data sharing, ensuring that analysis remains local with only anonymized summaries transmitted. Future platforms serving adolescent populations must integrate these protections by design, not as an afterthought.

8.4. Algorithmic Fairness and Interpretability

Machine learning models risk perpetuating biases when certain demographic groups — including specific age bands, genders, or cultural contexts — are underrepresented in training data [253,254]. Age itself can be a source of bias: models trained primarily on adult data may misclassify normative adolescent behaviors as pathological [255]. Furthermore, complex deep learning models often function as opaque “black boxes” that provide limited insight into their predictions, a significant barrier to clinical adoption [256,257]. Addressing these challenges requires diverse training datasets, rigorous subgroup validation, and models that are both interpretable and actionable. LLMs offer particular promise here, as they can generate human-readable explanations of their inferences and engage in conversational assessment, enhancing both transparency and trust in clinical settings [13,58,105].

8.5. Multidimensional Integration

No single data source captures the full complexity of mental states, and comprehensive assessment requires integrating across modalities — linguistic, behavioral, temporal, and physiological signals — as well as across the broader CPST dimensions [14,17,18,156]. For adolescents, this means combining digital behavior data with developmental context: social network analysis reveals how peer influence shapes mental health, physiological sensing captures stress responses during school hours, and temporal patterns track sleep and circadian changes that are particularly pronounced during adolescence. The pathway from isolated markers to integrated, real-world assessment tools will require interdisciplinary collaboration among clinicians, data scientists, and developmental researchers, alongside prospective validation in adolescent populations [257].

9. Conclusions

This scoping review maps and synthesizes current knowledge on the computational assessment of the cognitive and affective dimensions of Cyber-Syndrome. It shows that computational approaches support objective, continuous, and ecologically valid inference of mental states from digital behavior, offering a powerful paradigm for assessing the thinking-space dimension of Cyber-Syndrome within the broader CPST framework. For adolescent populations, the reviewed evidence underscores that age-stratified calibration and personalized modeling are essential, because developmental changes shape the associations between digital markers and mental health outcomes. Nevertheless, major challenges must be resolved before clinical translation can succeed. Future work should prioritize theory-driven mechanistic modeling, privacy-preserving technologies, personalized affective digital twins, and multidimensional integration across the CPST framework. Such advances would move computational mental health from prediction toward actionable, ethical, and personalized care.

Appendix A. Summary of Adolescent Mental Health and Digital Behavior Related Studies

2pt
Table A1. Summary of Adolescent Mental Health and Digital Behavior Related Studies
Table A1. Summary of Adolescent Mental Health and Digital Behavior Related Studies
Adolescent Sample Size Age Research Work Data Sources and Features Computational Methods References
Table A1 continued from previous page
Adolescent Sample Size Age Research Work Data Sources and Features Computational Methods References
- - Through a literature review and case studies, this study examines the adverse physiological and psychological effects of screen time on children and adolescents - Literature review and case study  [3]
355,358 adolescents 12-18 years Specification Curve Analysis was employed to rigorously examine the prevailing view that “digital technology use is detrimental to adolescent mental health.” Monitoring the Future, Youth Risk and Behavior Survey and Millennium Cohort Study datasets Specification Curve Analysis  [9]
66 undergraduate students M=20.1, SD=1.5 This study investigates what the utilization of wearable sensors and smartphones can reveal about academic performance, self-reported sleep quality, stress, and mental health status Data were collected via multiple questionnaires, wrist-worn sensors, and a custom-built mobile application developed based on the Funf framework Feature selection and machine learning  [36]
82 adolescents M=19.52, SD=2.17 Utilizing the Experience Sampling Method with real-time tracking multiple times a day, this study evaluated the long-term impact of social networking (Facebook) on users’ mental health Standardized scales and questionnaires Statistical Analysis  [212]
220 adolescents study1:M=24, study 2: 13-18 years This research explored the relationship between “emotional inertia” and mental health problems Standardized scales, daily EMA data, and emotional data coded via the standardized LIFE family behavior coding system Statistical Analysis  [33]
273 undergraduates About 19 years This research explored how social comparison information on social media, taking Facebook as a primary example, influences individual self-esteem Subjective self-report questionnaires completed by participants Statistical Analysis  [39]
332 adolescents - This study explored the underlying mechanisms among social media use, social comparison, and depressive symptoms Subjective self-report questionnaires completed by participants Statistical Analysis  [40]
124 undergraduate students - This study employed the LIWC text analysis tool to verify two classic cognitive theories of depression and uncover latent linguistic markers of implicit self-focus among depression-vulnerable individuals Two types of questionnaire scales and writing task texts LIWC, Statistical Analysis  [46]
172 undergraduate students study 1: M=18.99, SD=1.14, study 2: M=19 This research tested whether individuals with high social anxiety use the internet as a compensatory social medium, and whether such utilization is associated with enhanced well-being Standardized scales Statistical Analysis  [196]
53 medical students - This study introduces a mouse-dynamics-based approach to evaluate students’ stress levels during online exams Collect mouse-related log data via computers Statistical methods, machine learning  [66]
62 undergraduate students - This research investigated whether the internal psychological trait of “social anxiety” projects onto an individual’s social media (Facebook) profile and whether it can be detected by others View participants’ Facebook profile and rate their level of social anxiety -  [197]
85 undergraduate students - This research explored the impact of chronic “media multitasking” on individuals’ foundational visual attentional filtering mechanisms MMI media multitasking questionnaire data and experimental behavioral data recorded using E-Prime Statistical Analysis  [198]
- adolescents groups (13-20 years) The study demonstrates that distinct linguistic patterns and thematic differences exist between adolescents and adults in their expression of depression 25,241 text samples from 15,156 Reddit users with self-reported depression LIWC, topic modeling, and data visualization  [90]
166 adolescents M= 12.33, SD= 1.79 This research examined whether reward positivity (RewP) acts as a neural mediator in the relationship where drift-diffusion model-based metrics of reward processing predict childhood depression Participants completed the 27-item Children’s Depression Inventory. Behavioral task data were collected during the Probabilistic Reward Task, while EEG data were acquired throughout the Doors Task Hierarchical DDM, Statistical Analyses  [151]
147 adolescents M = 15.17, SD = 1.07 This research investigated the relationships of clinical depression and depression risk with the inertia and variability of positive and negative emotions Clinical diagnostic interview data. EMA mood tracking data were collected via questionnaires sent through mobile text messages Multilevel models and ANOVAs  [216]
126 undergraduate students M=22.11, SD=6.09 Employing a network analysis framework, this research explores the temporal interactions between anxiety and depressive symptoms PHQ-9, GAD-Q-IV, EMA data Multilevel vector auto-regression, R package networktools  [155]
69 adolescents 13-16 years This study evaluated the association between problematic smartphone use (PSU) and anxiety Quantitative questionnaire numerical data, qualitative open-ended textual data Thematic Analysis, Statistical Analyses  [219]
600 adolescents 13-25 years This research explores the underlying mechanisms linking social media and smartphone use to self-harm within a clinical adolescent cohort Mobile app recorded data, social media historical data, self-report questionnaires, clinical electronic health records, and interview transcripts Quantitative statistical analysis, NLP, and Braun & Clarke’s standardized thematic analysis method  [220]
201 college students 18-25 years This study developed tools utilizing wearable sensors and mobile phones to capture objective physiological and behavioral measurements for mental health identification Questionnaires, Q-sensors worn on dominant wrists, motion loggers worn on non-dominant wrists for data recording, data collected via dedicated mobile monitoring app, twice-daily electronic diaries -  [193]
67 college students - This research evaluated the prospective validity of mental health symptom prediction models based on the mindLAMP application Objective passive sensor data and active self-report questionnaire data were collected via the mindLAMP mobile application Statistical Analyses  [213]
24 undergraduate students - This study developed the Effortless Assessment of Risk States (EARS) tool for mobile passive sensing data collection - -  [227]
25 undergraduate students M= 18.35, SD= 2.75 This study validated whether objective behavioral metrics from mobile phone passive sensing correlate with stress-related indicators Standardized lab self-report questionnaires, keyboard log text, daily video diary facial, and physical activity data collected through the mobile EARS program Statistical Analyses  [229]
103 secondary school students M = 16.1, SD = 1 By collecting multimodal data, the study developed a deep learning model for predicting mental health risks including insomnia Self-reported well-being updates (active data) and mobile phone sensor data (passive data) collected via the Mindcraft app Machine Learning  [199]
168 adolescents 13-14 years This study collected classroom handwriting sensor data via tablets for early screening of adolescent Internet Gaming Disorder Data collected via the tablet’s built-in on-screen keyboard and touchscreen sensors Multiple regression with bootstrapping and multivariate ANOVA  [191]
430 adolescents 16-19 years This study examined the relationships among adolescent stress, problematic internet use, gaming disorder, and emotion regulation An online survey including the Mobile-Related Experiences Questionnaire, Internet Gaming Disorder Scale-Short Form, Meta-Mood Trait Repair Scale, and Spanish version of the Suicidal Behaviors Questionnaire Descriptive statistics, correlation analysis and path analysis via Stata 17  [200]
231 adolescents 15–19 years This study explored the role of problematic internet use in the association between personality dimensions and internalizing/externalizing problems The Internet Addiction Test, the Adolescent Personality Structure Questionnaire, and the Youth Self Report Moderation analyses  [201]
36 adolescents 12-18 years This study developed and evaluated a mobile application for collecting active and passive digital phenotypes related to adolescents’ emotions and daily behaviors Passive and active digital phenotypes associated with adolescents’ emotions and daily behaviors were collected via a mobile application Statistical Analysis  [202]
84 adolescents 13-21 years This study evaluated the associations between smartphone use contexts and mental health Data collected via baseline survey and personal devices Multivariable logistic regression  [203]
17409 adolescents 10-21 years This study revealed that the association between social media use and life satisfaction was most strongly negative among younger adolescents Understanding Society and Millennium Cohort Study data Statistical Analysis  [194]
4285 adolescents M = 10, SD = 0.6 This study identified developmental trajectories of addictive use of social media, mobile phones, and video games among adolescents The most recent available data from the ABCD Study Statistical Analysis  [192]
11,427 adolescents 10-18 years This study proposed the Symptom Discrepancy Index (SDI) for large-scale automated mood disorder assessment The FACES dataset Statistical analysis and machine learning  [195]
- - This study proposes a joint recognition algorithm based on multi-source data fusion and graph neural networks for adolescent internet addiction and psychological disorders - Multi-task Learning and Neural Networks  [218]
- - This study introduces a speech-based detection framework for capturing subtle emotional patterns in adolescent speech - HuBERT and Mamba  [217]
1260 students - This study proposes an AI-based framework for adolescent mental health assessment from daily digital activity data Data on daily digital behaviors on mobile devices including smartphones and tablets were collected Machine learning  [258]
37 adolescents M = 15.32, SD = 2.06 This study developed a multi-sensor wearable wristband for identifying digital biomarkers of adolescent depression Physiological and behavioral data were collected via a wearable wristband integrated with audio, activity and heart rate sensors Statistical analysis and machine learning  [204]
- - This study proposes an AI-based system for early identification of mental health issues among adolescents - Machine learning  [259]
34 adolescents MDD group: M=15.4, SD=1.4, Healthy group: M=13.8, SD=0.6 This study predicted treatment response for major depressive disorder in adolescents based on objective smartphone data Data reflecting adolescents’ social and behavioral activities were passively collected via a smart healthcare mobile application developed for smartphones Statistical analysis and machine learning  [205]
55 adolescents 12-17 years This study found that personalized models outperformed generalized models for adolescent depression detection Passively sensed data from mobile phones were collected by the AWARE app, while heart rate, sleep and step data were gathered with the Fitbit Inspire HR smart wristband Machine learning and ARIMA  [206]
22 adolescents 13-18 years This study constructed personalized ensemble machine learning models for predicting anger and anxiety in adolescents Subjective self-reported data on adolescents’ negative emotions collected via Ecological Momentary Assessment (EMA) questionnaires; objective passive sensing behavioral data continuously captured by smartphone accelerometer, location and device state sensors Statistical analysis and machine learning  [207]
131 adolescents 15-20 years This study confirmed the feasibility of collecting passive sensor data across a diverse adolescent population Objective data of online digital behaviors and offline physical behaviors collected by smartphone passive sensors; subjective self-report data obtained from adolescents’ mental health self-assessment questionnaires Statistical analysis  [214]
2939 participants 12-24 years This study investigated associations between passively collected smartphone data and mental health indicators among youth Passive smartphone data Statistical analysis  [215]
33 adolescents 12-18 years This study aimed to identify idiographic drivers of dynamic variability in depressive symptoms in adolescents EMA data and smartphone sensor data are collected via the mobile EARS application, while participants’ physical activity, sleep and wake state data are captured by actigraphs LIWC, Graphical VAR model, machine learning  [208]
90 adolescents - This study found that first-person singular pronoun use in mobile communication predicted MDD risk in adolescents Passively collected linguistic text data from smartphones Idiographic multilevel logistic regression  [209]
927 adolescents 13 years This study investigated correlations between typing features from keystroke metadata and mental health symptoms in adolescents Keystroke and touchscreen data are collected via sensors, and depressive symptoms are measured using the Patient Health Questionnaire-9 Regression analysis  [210]
48 adolescents M=15.85, SD=1.37 This study investigated the feasibility of smartphone-based digital phenotyping for long-term monitoring of adolescents with bipolar disorder Passive behavioral data and self-report questionnaire data are collected via the Beiwe digital phenotyping mobile application Statistical analysis  [211]

References

  1. Ning, H.; Ye, X.; Bouras, M.A.; Wei, D.; Daneshmand, M. General cyberspace: Cyberspace and cyber-enabled spaces. IEEE Internet of Things Journal 2018, 5, 1843–1856.
  2. Ning, H.; Dhelim, S.; Bouras, M.A.; Khelloufi, A.; Ullah, A. Cyber-syndrome and its formation, classification, recovery and prevention. IEEE Access 2018, 6, 35501–35511.
  3. Lissak, G. Adverse physiological and psychological effects of screen time on children and adolescents: Literature review and case study. Environmental research 2018, 164, 149–157.
  4. Small, G.W.; Lee, J.; Kaufman, A.; Jalil, J.; Siddarth, P.; Gaddipati, H.; Moody, T.D.; Bookheimer, S.Y. Brain health consequences of digital technology use. Dialogues in clinical neuroscience 2020, 22, 179–187.
  5. Elhai, J.D.; Levine, J.C.; Dvorak, R.D.; Hall, B.J. Fear of missing out, need for touch, anxiety and depression are related to problematic smartphone use. Computers in Human Behavior 2016, 63, 509–516.
  6. Kuss, D.J.; Griffiths, M.D. Social networking sites and addiction: Ten lessons learned. International journal of environmental research and public health 2017, 14, 311.
  7. World Health Organization. Mental health of adolescents, 2021. WHO Fact Sheet. Available online: https://www.who.int/news-room/fact-sheets/detail/adolescent-mental-health (accessed on 1 May 2026).
  8. Potvin, S.; Charbonneau, G.; Juster, R.P.; Purdon, S.; Tourjman, S.V. Self-evaluation and objective assessment of cognition in major depression and attention deficit disorder: Implications for clinical practice. Comprehensive Psychiatry 2016, 70, 53–64.
  9. Orben, A.; Przybylski, A.K. The association between adolescent well-being and digital technology use. Nature human behaviour 2019, 3, 173–182.
  10. Mirea, D.M.; Nook, E.C.; Niv, Y. Cognitive modeling of real-world behavior for understanding mental health. Trends in cognitive sciences 2025.
  11. Insel, T.R. Digital phenotyping: technology for a new science of behavior. Jama 2017, 318, 1215–1216.
  12. Onnela, J.P.; Rauch, S.L. Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology 2016, 41, 1691–1696.
  13. Belcastro, L.; Cantini, R.; Marozzo, F.; Talia, D.; Trunfio, P. Detecting mental disorder on social media: a ChatGPT-augmented explainable approach. Online Social Networks and Media 2025, 48, 100321.
  14. Poria, S.; Cambria, E.; Bajpai, R.; Hussain, A. A review of affective computing: From unimodal analysis to multimodal fusion. Information fusion 2017, 37, 98–125.
  15. Calvo, R.A.; D’Mello, S. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on affective computing 2010, 1, 18–37.
  16. Picard, R.W. Affective computing; MIT press, 2000.
  17. Ning, H.; Liu, H. Cyber-physical-social-thinking space based science and technology framework for the Internet of Things. Science China Information Sciences 2015, 58, 1–19.
  18. Shi, F.; Ning, H.; Chen, L.; Dhelim, S. Cyber-syndrome: Concept, theoretical characterization, and control mechanism. Tsinghua Science and Technology 2023, 29, 721–735.
  19. Montag, C.; Błaszkiewicz, K.; Sariyska, R.; Lachmann, B.; Andone, I.; Trendafilov, B.; Eibes, M.; Markowetz, A. Smartphone usage in the 21st century: who is active on WhatsApp? BMC research notes 2015, 8, 331.
  20. Oulasvirta, A.; Rattenbury, T.; Ma, L.; Raita, E. Habits make smartphone use more pervasive. Personal and Ubiquitous computing 2012, 16, 105–114.
  21. Tossell, C.; Kortum, P.; Shepard, C.; Rahmati, A.; et al. Exploring smartphone addiction: insights from long-term telemetric behavioral measures. International Journal of Interactive Mobile Technologies 2015, 9.
  22. Barr, N.; Pennycook, G.; Stolz, J.A.; Fugelsang, J.A. The brain in your pocket: Evidence that Smartphones are used to supplant thinking. Computers in Human Behavior 2015, 48, 473–480.
  23. Wilmer, H.H.; Sherman, L.E.; Chein, J.M. Smartphones and cognition: A review of research exploring the links between mobile technology habits and cognitive functioning. Frontiers in psychology 2017, 8, 251723.
  24. Sparrow, B.; Liu, J.; Wegner, D.M. Google effects on memory: Cognitive consequences of having information at our fingertips. science 2011, 333, 776–778.
  25. Ward, A.F. People mistake the internet’s knowledge for their own. Proceedings of the National Academy of Sciences 2021, 118, e2105061118.
  26. Fleur, D.S.; Bredeweg, B.; van den Bos, W. Metacognition: ideas and insights from neuro-and educational sciences. npj Science of Learning 2021, 6, 13.
  27. Johnson, M.K.; Hashtroudi, S.; Lindsay, D.S. Source monitoring. Psychological bulletin 1993, 114, 3.
  28. Botvinick, M.M.; Braver, T.S.; Barch, D.M.; Carter, C.S.; Cohen, J.D. Conflict monitoring and cognitive control. Psychological review 2001, 108, 624.
  29. De Choudhury, M.; Gamon, M.; Counts, S.; Horvitz, E. Predicting depression via social media. In Proceedings of the Proceedings of the international AAAI conference on web and social media, 2013, Vol. 7, pp. 128–137.
  30. Schwartz, H.A.; Eichstaedt, J.C.; Kern, M.L.; Dziurzynski, L.; Ramones, S.M.; Agrawal, M.; Shah, A.; Kosinski, M.; Stillwell, D.; Seligman, M.E.; et al. Personality, gender, and age in the language of social media: The open-vocabulary approach. PloS one 2013, 8, e73791.
  31. Kuppens, P.; Verduyn, P. Emotion dynamics. Current opinion in psychology 2017, 17, 22–26.
  32. Gross, J.J. Emotion regulation: Current status and future prospects. Psychological inquiry 2015, 26, 1–26.
  33. Kuppens, P.; Allen, N.B.; Sheeber, L.B. Emotional inertia and psychological maladjustment. Psychological science 2010, 21, 984–991.
  34. Robinson, T.E.; Berridge, K.C. The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain research reviews 1993, 18, 247–291.
  35. Volkow, N.D.; Wang, G.J.; Fowler, J.S.; Tomasi, D.; Telang, F.; Baler, R. Addiction: decreased reward sensitivity and increased expectation sensitivity conspire to overwhelm the brain’s control circuit. Bioessays 2010, 32, 748–755.
  36. Sano, A.; Phillips, A.J.; Amy, Z.Y.; McHill, A.W.; Taylor, S.; Jaques, N.; Czeisler, C.A.; Klerman, E.B.; Picard, R.W. Recognizing academic performance, sleep quality, stress level, and mental health using personality traits, wearable sensors and mobile phones. In Proceedings of the 2015 IEEE 12th international conference on wearable and implantable body sensor networks (BSN). IEEE, 2015, pp. 1–6.
  37. Mohr, D.C.; Zhang, M.; Schueller, S.M. Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annual review of clinical psychology 2017, 13, 23–47.
  38. Kanjo, E.; Kuss, D.J.; Ang, C.S. NotiMind: utilizing responses to smart phone notifications as affective sensors. IEEE access 2017, 5, 22023–22035.
  39. Vogel, E.A.; Rose, J.P.; Roberts, L.R.; Eckles, K. Social comparison, social media, and self-esteem. Psychology of popular media culture 2014, 3, 206.
  40. Steers, M.L.N.; Wickham, R.E.; Acitelli, L.K. Seeing everyone else’s highlight reels: How Facebook usage is linked to depressive symptoms. Journal of Social and Clinical Psychology 2014, 33, 701–731.
  41. Organization, W.H. International Classification of Diseases, Eleventh Revision (ICD-11), 2019. Available online: https://icd.who.int/.
  42. Schäfer, L.; Lemke, R.; Drenhaus, H.; Reich, I. The role of UID for the usage of verb phrase ellipsis: Psycholinguistic evidence from length and context effects. Frontiers in Psychology 2021, 12, 661087.
  43. Erle, T.M.; Schmid, K.; Goslar, S.H.; Martin, J.D. Emojis as social information in digital communication. Emotion 2022, 22, 1529.
  44. Dubé, S.; Gesselman, A.N.; Kaufman, E.M.; Bennett-Brown, M.; Ta-Johnson, V.P.; Garcia, J.R. Beyond words: Relationships between emoji use, attachment style, and emotional intelligence. Plos one 2024, 19, e0308880.
  45. Tausczik, Y.R.; Pennebaker, J.W. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of language and social psychology 2010, 29, 24–54.
  46. Rude, S.; Gortner, E.M.; Pennebaker, J. Language use of depressed and depression-vulnerable college students. Cognition & Emotion 2004, 18, 1121–1133.
  47. Chung, C.; Pennebaker, J. The psychological functions of function words. In Social communication; Psychology Press, 2011; pp. 343–359.
  48. Liu, B. Sentiment analysis and opinion mining 2012.
  49. Hutto, C.; Gilbert, E. Vader: A parsimonious rule-based model for sentiment analysis of social media text. In Proceedings of the Proceedings of the international AAAI conference on web and social media, 2014, Vol. 8, pp. 216–225.
  50. Li, R.; Ding, J.; Ning, H. Biosignal contrastive representation learning for emotion recognition of game users. IEEE Transactions on Games 2024, 17, 308–321.
  51. Li, R.; Ding, J.; Ning, H.; Mao, L. Biosignal Sequence Real-time Prediction for Game Users Based on Features Fusion of Local-Global and Time-Frequency Domain. IEEE Transactions on Games 2025.
  52. Li, R.; Ding, J.; Ning, H. Emotion arousal assessment based on multimodal physiological signals for game users. IEEE Transactions on Affective Computing 2023, 14, 2582–2594.
  53. Zogan, H.; Razzak, I.; Wang, X.; Jameel, S.; Xu, G. Explainable depression detection with multi-aspect features using a hybrid deep learning model on social media. World Wide Web 2022, 25, 281–304.
  54. Devlin, J.; Chang, M.W.; Lee, K.; Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers), 2019, pp. 4171–4186.
  55. Liu, Y.; Ott, M.; Goyal, N.; Du, J.; Joshi, M.; Chen, D.; Levy, O.; Lewis, M.; Zettlemoyer, L.; Stoyanov, V. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 2019.
  56. Brown, T.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.D.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; et al. Language models are few-shot learners. Advances in neural information processing systems 2020, 33, 1877–1901.
  57. Xu, X.; Yao, B.; Dong, Y.; Gabriel, S.; Yu, H.; Hendler, J.; Ghassemi, M.; Dey, A.K.; Wang, D. Mental-llm: Leveraging large language models for mental health prediction via online text data. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 2024, 8, 1–32.
  58. Shah, S.M.; Gillani, S.A.; Baig, M.S.A.; Saleem, M.A.; Siddiqui, M.H. Advancing depression detection on social media platforms through fine-tuned large language models. Online Social Networks and Media 2025, 46, 100311.
  59. Pennebaker, J.W.; Mehl, M.R.; Niederhoffer, K.G. Psychological aspects of natural language use: Our words, our selves. Annual review of psychology 2003, 54, 547–577.
  60. Beck, A.T. Cognitive therapy and the emotional disorders; Penguin, 1979.
  61. Al-Mosaiwi, M.; Johnstone, T. In an absolute state: Elevated use of absolutist words is a marker specific to anxiety, depression, and suicidal ideation. Clinical psychological science 2018, 6, 529–542.
  62. Pennycook, G.; Rand, D.G. Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition 2019, 188, 39–50.
  63. Vizer, L.M.; Zhou, L.; Sears, A. Automated stress detection using keystroke and linguistic features: An exploratory study. International Journal of Human-Computer Studies 2009, 67, 870–886.
  64. de Jong, M.; Bonvanie, A.M.; Jolij, J.; Lorist, M.M. Dynamics in typewriting performance reflect mental fatigue during real-life office work. PLoS One 2020, 15, e0239984.
  65. Austin, D.; Jimison, H.; Hayes, T.; Mattek, N.; Kaye, J.; Pavel, M. Measuring motor speed through typing: a surrogate for the finger tapping test. Behavior research methods 2011, 43, 903–909.
  66. Carneiro, D.; Novais, P.; Pêgo, J.M.; Sousa, N.; Neves, J. Using mouse dynamics to assess stress during online exams. In Proceedings of the International Conference on Hybrid Artificial Intelligence Systems. Springer, 2015, pp. 345–356.
  67. Mastoras, R.E.; Iakovakis, D.; Hadjidimitriou, S.; Charisis, V.; Kassie, S.; Alsaadi, T.; Khandoker, A.; Hadjileontiadis, L.J. Touchscreen typing pattern analysis for remote detection of the depressive tendency. Scientific reports 2019, 9, 13414.
  68. Heraz, A.; Clynes, M. Recognition of emotions conveyed by touch through force-sensitive screens: Observational study of humans and machine learning techniques. JMIR Mental Health 2018, 5, e10104.
  69. Freeman, J.B.; Ambady, N. A dynamic interactive theory of person construal. Psychological review 2011, 118, 247.
  70. Cang, X.L.; Guerra, R.R.; Guta, B.; Bucci, P.; Rodgers, L.; Mah, H.; Feng, Q.; Agrawal, A.; MacLean, K.E. FEELing (key) Pressed: Implicit Touch Pressure Bests Brain Activity for Modeling Emotion Dynamics in the Space Between Stressed & Relaxed. IEEE Transactions on Haptics 2023, 17, 310–318.
  71. Lawrence, G.P.; Owen, R.; Gottwald, V.M.; Khan, M.A. Testing anxiety’s effect on movement planning and correction: Online upper-limb corrections are not completely automatic. Human Movement Science 2023, 87, 103022.
  72. De Vleeschhauwer, J.; Broeder, S.; Janssens, L.; Heremans, E.; Nieuwboer, A.; Nackaerts, E. Impaired touchscreen skills in Parkinson’s disease and effects of medication. Movement Disorders Clinical Practice 2021, 8, 546–554.
  73. Wiradhany, W.; Nieuwenstein, M.R. Cognitive control in media multitaskers: Two replication studies and a meta-analysis. Attention, Perception, & Psychophysics 2017, 79, 2620–2641.
  74. Sankesara, H.; Denyer, H.; Sun, S.; Deng, Q.; Ranjan, Y.; Conde, P.; Rashid, Z.; Asherson, P.; Bilbow, A.; Groom, M.J.; et al. Identifying digital markers of Attention-Deficit/Hyperactivity disorder (ADHD) in a remote monitoring setting: prospective observational study. JMIR Formative Research 2025, 9, e54531.
  75. Yang, X.; Knights, J.; Bangieva, V.; Kambhampati, V. Association between the severity of depressive symptoms and human-smartphone interactions: longitudinal study. JMIR Formative Research 2023, 7, e42935.
  76. Zhu, D.q.; Tao, S.m.; Xie, Y.; Wan, Y.h.; Wu, X.y.; Zou, L.w.; Tao, F.b. Longitudinal associations between smartphone multitasking and depressive symptoms in college students. 2024.
  77. Aledavood, T.; Lehmann, S.; Saramäki, J. Digital daily cycles of individuals. Frontiers in Physics 2015, 3, 73.
  78. Saeb, S.; Lattie, E.G.; Schueller, S.M.; Kording, K.P.; Mohr, D.C. The relationship between mobile phone location sensor data and depressive symptom severity. PeerJ 2016, 4, e2537.
  79. Wittmann, M.; Dinich, J.; Merrow, M.; Roenneberg, T. Social jetlag: misalignment of biological and social time. Chronobiology international 2006, 23, 497–509.
  80. Wulff, K.; Gatti, S.; Wettstein, J.G.; Foster, R.G. Sleep and circadian rhythm disruption in psychiatric and neurodegenerative disease. Nature Reviews Neuroscience 2010, 11, 589–599.
  81. Costa, M.; Goldberger, A.L.; Peng, C.K. Multiscale entropy analysis of biological signals. Physical Review E—Statistical, Nonlinear, and Soft Matter Physics 2005, 71, 021906.
  82. Goldberger, A.L.; Amaral, L.A.; Hausdorff, J.M.; Ivanov, P.C.; Peng, C.K.; Stanley, H.E. Fractal dynamics in physiology: alterations with disease and aging. Proceedings of the national academy of sciences 2002, 99, 2466–2472.
  83. Electrophysiology, T.F.o.t.E.S.o.C.t.N.A.S.o.P. Heart rate variability: standards of measurement, physiological interpretation, and clinical use. Circulation 1996, 93, 1043–1065.
  84. Thayer, J.F.; Hansen, A.L.; Saus-Rose, E.; Johnsen, B.H. Heart rate variability, prefrontal neural function, and cognitive performance: the neurovisceral integration perspective on self-regulation, adaptation, and health. Annals of behavioral medicine 2009, 37, 141–153.
  85. Kemp, A.H.; Quintana, D.S.; Gray, M.A.; Felmingham, K.L.; Brown, K.; Gatt, J.M. Impact of depression and antidepressant treatment on heart rate variability: a review and meta-analysis. Biological psychiatry 2010, 67, 1067–1074.
  86. Shi, F.; Ning, H.; Xiao, R.; Zhu, T.; Li, N. Skin conductance-based acupoint and non-acupoint recognition using machine learning. IEEE Journal of Biomedical and Health Informatics 2024, 28, 2569–2580.
  87. Boucsein, W. Electrodermal activity; Springer science & business media, 2012.
  88. Maskeliunas, R.; Damasevicius, R.; Martisius, I.; Vasiljevas, M. Consumer-grade EEG devices: are they usable for control tasks? PeerJ 2016, 4, e1746.
  89. Coan, J.A.; Allen, J.J. Frontal EEG asymmetry as a moderator and mediator of emotion. Biological psychology 2004, 67, 7–50.
  90. Rosario, C. Age-specific linguistic features of depression via social media. In Proceedings of the Proceedings of the 8th Student Research Workshop associated with the International Conference Recent Advances in Natural Language Processing, 2023, pp. 33–43.
  91. Lyu, S.; Ren, X.; Du, Y.; Zhao, N. Detecting depression of Chinese microblog users via text analysis: Combining Linguistic Inquiry Word Count (LIWC) with culture and suicide related lexicons. Frontiers in psychiatry 2023, 14, 1121583.
  92. Manning, C.; Schutze, H. Foundations of statistical natural language processing; MIT press, 1999.
  93. Galke, L.; Scherp, A. Bag-of-words vs. graph vs. sequence in text classification: Questioning the necessity of text-graphs and the surprising strength of a wide MLP. In Proceedings of the Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022, pp. 4038–4051.
  94. Nadeem, M. Identifying depression on Twitter. arXiv preprint arXiv:1607.07384 2016.
  95. Salton, G.; Buckley, C. Term-weighting approaches in automatic text retrieval. Information processing & management 1988, 24, 513–523.
  96. Khan, S.; et al. Reddit social media text analysis for depression prediction: using logistic regression with enhanced term frequency-inverse document frequency features. International Journal of Electrical and Computer Engineering (IJECE) 2024.
  97. Mikolov, T.; Sutskever, I.; Chen, K.; Corrado, G.S.; Dean, J. Distributed representations of words and phrases and their compositionality. Advances in neural information processing systems 2013, 26.
  98. Mikolov, T.; Chen, K.; Corrado, G.; Dean, J. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 2013.
  99. Pennington, J.; Socher, R.; Manning, C.D. Glove: Global vectors for word representation. In Proceedings of the Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, pp. 1532–1543.
  100. NA, R.M.; Veni, S. A stacked ensemble technique with glove embedding model for depression detection from tweets. Indian Journal of Computer Science and Engineering 2022, 10, 586–595.
  101. Kunder, E.; Naik, P.M. Analyzing the Effect of Text Vectorization and Word2vec on Bayesian Optimization for Mental Health Text Classification Using Deep Learning. In Proceedings of the 2025 IEEE International Conference on Distributed Computing, VLSI, Electrical Circuits and Robotics (DISCOVER). IEEE, 2025, pp. 1–6.
  102. Qasim, A.; Mehak, G.; Hussain, N.; Gelbukh, A.; Sidorov, G. Detection of depression severity in social media text using transformer-based models. Information 2025, 16, 114.
  103. Kurniadi, F.I.; Paramita, N.L.P.S.P.; Sihotang, E.F.A.; Anggreainy, M.S.; Zhang, R. BERT and RoBERTa models for enhanced detection of depression in social media text. Procedia Computer Science 2024, 245, 202–209.
  104. Salameh, K.; Suboh, T.; ElAmayreh, R.; Alhijawi, B. Deep linguistic analysis for depression in social media using RoBERTa and CNN. International Journal of Speech Technology 2025, 28, 825–836.
  105. Hua, Y.; Liu, F.; Yang, K.; Li, Z.; Na, H.; Sheu, Y.h.; Zhou, P.; Moran, L.V.; Ananiadou, S.; Clifton, D.A.; et al. Large language models in mental health care: a scoping review. Current Treatment Options in Psychiatry 2025, 12, 27.
  106. Shin, D.; Kim, H.; Lee, S.; Cho, Y.; Jung, W. Using large language models to detect depression from user-generated diary text data as a novel approach in digital mental health screening: instrument validation study. Journal of Medical Internet Research 2024, 26, e54617.
  107. Mesinovic, M.; Watkinson, P.; Zhu, T. Explainability in the age of large language models for healthcare. Communications Engineering 2025, 4, 128.
  108. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, .; Polosukhin, I. Attention is all you need. Advances in neural information processing systems 2017, 30.
  109. Lu, J.; Yang, J.; Batra, D.; Parikh, D. Hierarchical question-image co-attention for visual question answering. Advances in neural information processing systems 2016, 29.
  110. Chen, Z.; Wang, D.; Lou, L.; Zhang, S.; Zhao, X.; Jiang, S.; Yu, J.; Xiao, J. Text-guided multimodal depression detection via cross-modal feature reconstruction and decomposition. Information Fusion 2025, 117, 102861.
  111. Sun, H.; Liu, J.; Chai, S.; Qiu, Z.; Lin, L.; Huang, X.; Chen, Y. Multi-modal adaptive fusion transformer network for the estimation of depression level. Sensors 2021, 21, 4764.
  112. Esmi, N.; Shahbahrami, A.; Gaydadjiev, G.; de Jonge, P. Multimodal transformer for depression detection based on EEG and interview data. Biomedical Signal Processing and Control 2026, 113, 109039.
  113. Yang, Z.; Yang, D.; Dyer, C.; He, X.; Smola, A.; Hovy, E. Hierarchical attention networks for document classification. In Proceedings of the Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, 2016, pp. 1480–1489.
  114. Li, Z.; An, Z.; Cheng, W.; Zhou, J.; Zheng, F.; Hu, B. MHA: a multimodal hierarchical attention model for depression detection in social media. Health information science and systems 2023, 11, 6.
  115. Lu, J.; Yang, J.; Batra, D.; Parikh, D. Hierarchical question-image co-attention for visual question answering. Advances in neural information processing systems 2016, 29.
  116. Lu, J.; Batra, D.; Parikh, D.; Lee, S. Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. Advances in neural information processing systems 2019, 32.
  117. Singh, G.V.; Vemulapalli, S.V.; Firdaus, M.; Ekbal, A. Deciphering cognitive distortions in patient-doctor mental health conversations: A multimodal llm-based detection and reasoning framework. In Proceedings of the Proceedings of the 2024 conference on empirical methods in natural language processing, 2024, pp. 22546–22570.
  118. Lu, H.; Niu, X.; Wang, J.; Wang, Y.; Hu, Q.; Tang, J.; Zhang, Y.; Yuan, K.; Huang, B.; Yu, Z.; et al. Gpt as psychologist? preliminary evaluations for gpt-4v on visual affective computing. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 322–331.
  119. Belikova, J.; Kosenko, D. Deeppavlov at semeval-2024 task 3: Multimodal large language models in emotion reasoning. In Proceedings of the Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), 2024, pp. 1747–1757.
  120. Zhang, W.; Chen, J.; Zhu, E.; Cheng, W.; Li, Y.; Li, Y.; Wang, Y.J. MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models. ACM Transactions on Multimedia Computing, Communications and Applications 2026, 22, 1–23.
  121. Zhao, X.; Luo, L.; Lu, H.; Tang, B. Prototype-as-Prompt: Multimodal Sentiment Prototypes Endowing Large Language Models the Capability to Perform Multimodal Sentiment Analysis. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 23010–23020.
  122. Liu, H.; Li, C.; Wu, Q.; Lee, Y.J. Visual instruction tuning. Advances in neural information processing systems 2023, 36, 34892–34916.
  123. Li, J.; Li, D.; Savarese, S.; Hoi, S. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In Proceedings of the International conference on machine learning. PMLR, 2023, pp. 19730–19742.
  124. Cheng, Z.; Cheng, Z.Q.; He, J.Y.; Sun, J.; Wang, K.; Lin, Y.; Lian, Z.; Peng, X.; Hauptmann, A.G. Emotion-llama: Multimodal emotion recognition and reasoning with instruction tuning. Advances in Neural Information Processing Systems 2024, 37, 110805–110853.
  125. Li, J.; Selvaraju, R.; Gotmare, A.; Joty, S.; Xiong, C.; Hoi, S.C.H. Align before fuse: Vision and language representation learning with momentum distillation. Advances in neural information processing systems 2021, 34, 9694–9705.
  126. Cai, C.; Zhang, K.; Hu, Z.; Lin, X.; Pan, Z. Prompt-based hybrid supervised contrastive learning for emotion recognition in conversation. Neurocomputing 2025, 647, 130453.
  127. Wu, Y.; Chen, Y.; Cui, J.; Liu, J.; Liang, L.; Li, S. Cross-Modal Contrastive Learning for Emotion Recognition: Aligning ECG with EEG-Derived Features. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2025, pp. 64–73.
  128. Zhu, L. GAT-CL: A Graph Attention and Contrastive Learning Framework for Multimodal Behavior Modeling in Intelligent Education Systems. Informatica 2025, 49.
  129. Ngiam, J.; Khosla, A.; Kim, M.; Nam, J.; Lee, H.; Ng, A.Y.; et al. Multimodal deep learning. In Proceedings of the Icml, 2011, Vol. 11, pp. 689–696.
  130. Kittler, J.; Hatef, M.; Duin, R.P.; Matas, J. On combining classifiers. IEEE transactions on pattern analysis and machine intelligence 2002, 20, 226–239.
  131. Srivastava, N.; Salakhutdinov, R.R. Multimodal learning with deep boltzmann machines. Advances in neural information processing systems 2012, 25.
  132. Nykoniuk, M.; Basystiuk, O.; Shakhovska, N.; Melnykova, N. Multimodal data fusion for depression detection approach. Computation 2025, 13, 9.
  133. Zhu, F.; Zhang, J.; Dang, R.; Hu, B.; Wang, Q. MTNet: Multimodal transformer network for mild depression detection through fusion of EEG and eye tracking. Biomedical signal processing and control 2025, 100, 106996.
  134. Ramachandram, D.; Taylor, G.W. Deep multimodal learning: A survey on recent advances and trends. IEEE signal processing magazine 2017, 34, 96–108.
  135. Zhang, X.; Li, B.; Qi, G. A novel multimodal depression diagnosis approach utilizing a new hybrid fusion method. Biomedical Signal Processing and Control 2024, 96, 106552.
  136. Maia, T.V.; Frank, M.J. From reinforcement learning models to psychiatric and neurological disorders. Nature neuroscience 2011, 14, 154–162.
  137. Huys, Q.J.; Maia, T.V.; Frank, M.J. Computational psychiatry as a bridge from neuroscience to clinical applications. Nature neuroscience 2016, 19, 404–413.
  138. Lindström, B.; Bellander, M.; Schultner, D.T.; Chang, A.; Tobler, P.N.; Amodio, D.M. A computational reward learning account of social media engagement. Nature communications 2021, 12, 1311.
  139. Billieux, J.; Philippot, P.; Schmid, C.; Maurage, P.; De Mol, J.; Van der Linden, M. Is dysfunctional use of the mobile phone a behavioural addiction? Confronting symptom-based versus process-based approaches. Clinical psychology & psychotherapy 2015, 22, 460–468.
  140. Sutton, R.S.; Barto, A.G.; et al. Reinforcement learning: An introduction; Vol. 1, MIT press Cambridge, 1998.
  141. Montague, P.R.; Dolan, R.J.; Friston, K.J.; Dayan, P. Computational psychiatry. Trends in cognitive sciences 2012, 16, 72–80.
  142. Pizzagalli, D.A.; Jahn, A.L.; O’Shea, J.P. Toward an objective characterization of an anhedonic phenotype: a signal-detection approach. Biological psychiatry 2005, 57, 319–327.
  143. Bishop, S.J.; Gagne, C. Anxiety, depression, and decision making: a computational perspective. Annual review of neuroscience 2018, 41, 371–388.
  144. Addicott, M.A.; Pearson, J.M.; Sweitzer, M.M.; Barack, D.L.; Platt, M.L. A primer on foraging and the explore/exploit trade-off for psychiatry research. Neuropsychopharmacology 2017, 42, 1931–1939.
  145. Chen, C.; Takahashi, T.; Nakagawa, S.; Inoue, T.; Kusumi, I. Reinforcement learning in depression: A review of computational research. Neuroscience & Biobehavioral Reviews 2015, 55, 247–267.
  146. Katz, B.A.; Matanky, K.; Aviram, G.; Yovel, I. Reinforcement sensitivity, depression and anxiety: A meta-analysis and meta-analytic structural equation model. Clinical psychology review 2020, 77, 101842.
  147. Ratcliff, R.; McKoon, G. The diffusion decision model: theory and data for two-choice decision tasks. Neural computation 2008, 20, 873–922.
  148. Wiecki, T.V.; Sofer, I.; Frank, M.J. HDDM: Hierarchical Bayesian estimation of the drift-diffusion model in Python. Frontiers in neuroinformatics 2013, 7, 14.
  149. Gupta, A.; Bansal, R.; Alashwal, H.; Kacar, A.S.; Balci, F.; Moustafa, A.A. Neural substrates of the drift-diffusion model in brain disorders. Frontiers in computational neuroscience 2022, 15, 678232.
  150. Ratcliff, R.; Smith, P.L.; Brown, S.D.; McKoon, G. Diffusion decision model: Current issues and history. Trends in cognitive sciences 2016, 20, 260–281.
  151. Pitliya, R.J.; Burani, K.; Nelson, B.D.; Hajcak, G.; Jin, J. Reward-related brain activity mediates the relationship between decision-making deficits and pediatric depression symptom severity. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging 2025, 10, 138–147.
  152. Kresinszky, L.; Kheirkhah, M.; Alizadeh, S.; Shariatpanahi, B.; Savić, V.; Jamalabadi, H. From thoughts to symptoms: The temporal and dimensional dynamics of rumination in depression. Journal of Affective Disorders 2025, p. 120968.
  153. Lütkepohl, H. New Introduction to Multiple Time Series Analysis. Technical report, Springer, 2005.
  154. Meine, L.E.; Müller-Bardorff, M.; Recher, D.; Paersch, C.; Schulz, A.; Spiller, T.; Galatzer-Levy, I.; Kowatsch, T.; Fisher, A.J.; Kleim, B. Network analyses of ecological momentary emotion and avoidance assessments before and after cognitive behavioral therapy for anxiety disorders. Journal of anxiety disorders 2024, 106, 102914.
  155. Marian, S.; Costantini, G.; Macsinga, I.; Sava, F.A. The dynamic interplay of anxious and depressive symptoms in a sample of undergraduate students. Journal of Psychopathology and Behavioral Assessment 2023, 45, 150–159.
  156. Baltrušaitis, T.; Ahuja, C.; Morency, L.P. Multimodal machine learning: A survey and taxonomy. IEEE transactions on pattern analysis and machine intelligence 2018, 41, 423–443.
  157. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. nature 2015, 521, 436–444.
  158. Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural computation 1997, 9, 1735–1780.
  159. Tai, K.S.; Socher, R.; Manning, C.D. Improved semantic representations from tree-structured long short-term memory networks. In Proceedings of the Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2015, pp. 1556–1566.
  160. Zhang, W.; Mao, K.; Chen, J. A multimodal approach for detection and assessment of depression using text, audio and video. Phenomics 2024, 4, 234.
  161. Cheng, J.C.; Chen, A.L. Multimodal time-aware attention networks for depression detection. Journal of Intelligent Information Systems 2022, 59, 319–339.
  162. Xie, W.; Wang, C.; Lin, Z.; Luo, X.; Chen, W.; Xu, M.; Liang, L.; Liu, X.; Wang, Y.; Luo, H.; et al. Multimodal fusion diagnosis of depression and anxiety based on CNN-LSTM model. Computerized Medical Imaging and Graphics 2022, 102, 102128.
  163. Bai, S.; Kolter, J.Z.; Koltun, V. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271 2018.
  164. Shi, C.; Zhang, Y.; Liu, B. A multimodal fusion-based deep learning framework combined with local-global contextual TCNs for continuous emotion recognition from videos: C. Shi et al. Applied Intelligence 2024, 54, 3040–3057.
  165. Durbin, J.; Koopman, S.J. Time series analysis by state space methods; Oxford University Press (UK), 2012.
  166. Rabiner, L.R. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 2002, 77, 257–286.
  167. Leaning, I.E.; Costanzo, A.; Jagesar, R.; Reus, L.M.; Visser, P.J.; Kas, M.J.; Beckmann, C.F.; Ruhé, H.G.; Marquand, A.F. Uncovering social states in healthy and clinical populations using digital phenotyping and hidden markov models: observational study. Journal of Medical Internet Research 2025, 27, e64007.
  168. Jiang, X.; Chen, Y.; Ao, N.; Xiao, Y.; Du, F. A depression-risk mental pattern identified by hidden Markov model in undergraduates. International Journal of Environmental Research and Public Health 2022, 19, 14411.
  169. Jiang, W.; Ding, S.; Xu, C.; Ke, H.; Bo, H.; Zhao, T.; Ma, L.; Li, H. Discovering the neuronal dynamics in major depressive disorder using Hidden Markov Model. Frontiers in Human Neuroscience 2023, 17, 1197613.
  170. Malamud, J.; Guloksuz, S.; van Winkel, R.; Delespaul, P.; De Hert, M.A.; Derom, C.; Thiery, E.; Jacobs, N.; Rutten, B.P.; Huys, Q.J. Characterizing the dynamics, reactivity and controllability of moods in depression with a Kalman filter. PLOS Computational Biology 2024, 20, e1012457.
  171. Swetha, K.; Kiran, K. Kalman-Normalized GSR Analysis for Real-Time Stress Quantification in Wearable Systems. International Journal of Telemedicine and Applications 2025, 2025, 8828363.
  172. Fisher, A.J.; Medaglia, J.D.; Jeronimus, B.F. Lack of group-to-individual generalizability is a threat to human subjects research. Proceedings of the National Academy of Sciences 2018, 115, E6106–E6115.
  173. Zhang, D.; You, W.; Liu, Z.; Sun, L.; Chen, P. Personalized dynamic music emotion recognition with dual-scale attention-based meta-learning. In Proceedings of the Proceedings of the AAAI Conference on Artificial Intelligence, 2025, Vol. 39, pp. 1629–1637.
  174. Jia, Z.; Wang, Z.; Hong, F.; Ping, L.; Shi, Y.; Hu, J. Learning to Learn Personalized Neural Network for Ventricular Arrhythmias Detection on Intracardiac EGMs. In Proceedings of the IJCAI, 2021, pp. 2606–2613.
  175. Shen, L.Y.; Fang, S.X.; Lin, Y.C.; Chou, H.C.; Lee, H.y. Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning. arXiv preprint arXiv:2505.16220 2025.
  176. Sowmya, V.; Rajeswari, A. A multimodal meta-learning-augmented EmoTriSense for emotion recognition. Journal of Combinatorial Optimization 2026, 51, 27.
  177. Chen, C.; Fang, H.; Yang, Y.; Zhou, Y. Model-agnostic meta-learning for EEG-based inter-subject emotion recognition. Journal of Neural Engineering 2025, 22, 016008.
  178. Taylor, S.; Jaques, N.; Nosakhare, E.; Sano, A.; Picard, R. Personalized multitask learning for predicting tomorrow’s mood, stress, and health. IEEE Transactions on Affective Computing 2017, 11, 200–213.
  179. Saylam, B.; İncel, Ö.D. Multitask learning for mental health: depression, anxiety, stress (DAS) using wearables. Diagnostics 2024, 14, 501.
  180. Miłkowski, P.; Saganowski, S.; Gruza, M.; Kazienko, P.; Piasecki, M.; Kocoń, J. Multitask personalized recognition of emotions evoked by textual content. In Proceedings of the 2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops). IEEE, 2022, pp. 347–352.
  181. Akhtar, M.S.; Chauhan, D.; Ghosal, D.; Poria, S.; Ekbal, A.; Bhattacharyya, P. Multi-task learning for multi-modal emotion recognition and sentiment analysis. In Proceedings of the Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2019, pp. 370–379.
  182. Zhao, R.; Liu, T.; Xiao, J.; Lun, D.P.; Lam, K.M. Deep multi-task learning for facial expression recognition and synthesis based on selective feature sharing. In Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR). IEEE, 2021, pp. 4412–4419.
  183. Feng, K.; Chaspari, T. A review of generalizable transfer learning in automatic emotion recognition. Frontiers in Computer Science 2020, 2, 9.
  184. Barile, P.; Bassano, C.; Piciocchi, P.; et al. Transfer learning for facial emotion recognition on small datasets. Journal of Systemics, Cybernetics and Informatics 2024, 22, 1–5.
  185. Lu, W.; Liu, H.; Ma, H.; Tan, T.P.; Xia, L. Hybrid transfer learning strategy for cross-subject EEG emotion recognition. Frontiers in Human Neuroscience 2023, 17, 1280241.
  186. Qin, L. Sentiment analysis algorithm based on deep transfer learning for multi-source data fusion. IEEE Access 2025.
  187. Lo, I.C.; Rau, P.L.P. D-Twins: Your Digital Twin Designed for Real-Time Boredom Intervention. In Proceedings of the Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, 2025, pp. 1–15.
  188. Doraiswamy, P.M.; Duñabeitia, J.A.; Rodriguez, C.; Devanand, D.P. Digital cognitive twins in mental health. Nature Mental Health 2025, 3, 1106–1108.
  189. Alimour, S.A.; Alrabeei, M. A novel model for digital twins in mental health: the biopsychosocial AI-driven digital twin (BADT) framework. In Proceedings of the 2024 11th International Conference on Software Defined Systems (SDS). IEEE, 2024, pp. 6–10.
  190. Ashokbhai, P.K. Cognitive Digital Twins for Human-in-the-Loop Decision Support: Emotion-Aware Reasoning and Safety-Constrained Adaptation. In Proceedings of the 2026 International Conference on Machine Learning and Autonomous Systems (ICMLAS). IEEE, 2026, pp. 93–100.
  191. Cho, K.; Kim, M.; Cho, Y.; Hur, J.W.; Kim, D.H.; Park, S.; Park, S.; Jang, M.; Lee, C.G.; Kwon, J.S. Digital phenotypes for early detection of internet gaming disorder in adolescent students: explorative data-driven study. JMIR Mental Health 2024, 11, e50259.
  192. Xiao, Y.; Meng, Y.; Brown, T.T.; Keyes, K.M.; Mann, J.J. Addictive screen use trajectories and suicidal behaviors, suicidal ideation, and mental health in US youths. Jama 2025, 334, 219–228.
  193. Sano, A.; Taylor, S.; McHill, A.W.; Phillips, A.J.; Barger, L.K.; Klerman, E.; Picard, R. Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensors and mobile phones: observational study. Journal of medical Internet research 2018, 20, e210.
  194. Orben, A.; Przybylski, A.K.; Blakemore, S.J.; Kievit, R.A. Windows of developmental sensitivity to social media. Nature communications 2022, 13, 1649.
  195. Xu, X.; Zhang, X.; Zhang, Y. Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents. IEEE Transactions on Affective Computing 2026.
  196. Weidman, A.C.; Fernandez, K.C.; Levinson, C.A.; Augustine, A.A.; Larsen, R.J.; Rodebaugh, T.L. Compensatory internet use among individuals higher in social anxiety and its implications for well-being. Personality and individual differences 2012, 53, 191–195.
  197. Fernandez, K.C.; Levinson, C.A.; Rodebaugh, T.L. Profiling: Predicting social anxiety from Facebook profiles. Social Psychological and Personality Science 2012, 3, 706–713.
  198. Cain, M.S.; Mitroff, S.R. Distractor filtering in media multitaskers. Perception 2011, 40, 1183–1192.
  199. Kadirvelu, B.; Bellido Bel, T.; Freccero, A.; Di Simplico, M.; Nicholls, D.; Faisal, A.A. Digital Phenotyping for Adolescent Mental Health: Feasibility Study Using Machine Learning to Predict Mental Health Risk From Active and Passive Smartphone Data. Journal of Medical Internet Research 2026, 28, e72501.
  200. Chamarro, A.; Díaz-Moreno, A.; Bonilla, I.; Cladellas, R.; Griffiths, M.D.; Gómez-Romero, M.J.; Limonero, J.T. Stress and suicide risk among adolescents: the role of problematic internet use, gaming disorder and emotional regulation. BMC public health 2024, 24, 326.
  201. Fontana, A.; Benzi, I.M.A.; Cipresso, P. Problematic internet use as a moderator between personality dimensions and internalizing and externalizing symptoms in adolescence. Current psychology 2023, 42, 19419–19428.
  202. Cho, M.; Park, D.; Choo, M.; Han, D.H.; Kim, J. Impact of Digital Phenotypes and Question-Asking on Emotional Disorders in Adolescents: 4-Week Field Study. JMIR human factors 2025, 12, e66536.
  203. Patel, J.; Ibrahim, S.T.; Katapally, T.R. Context-Aware Digital Phenotyping of Youth Mental Health Using Mobile Ecological Prospective Assessments of Smartphone Use. medRxiv 2025, pp. 2025–08.
  204. Yang, D.; Li, Y.; Lei, Y.; Gao, B.; Luo, L. Digital Biomarkers for Depression Monitoring Using Multi-Sensing Wearable Wristband. IEEE Transactions on Instrumentation and Measurement 2026.
  205. Kim, J.S.; Wang, B.; Kim, M.; Lee, J.; Kim, H.; Roh, D.; Lee, K.H.; Hong, S.B.; Lim, J.S.; Kim, J.W.; et al. Prediction of diagnosis and treatment response in adolescents with depression by using a smartphone app and deep learning approaches: usability study. JMIR formative research 2023, 7, e45991.
  206. Mullick, T.; Radovic, A.; Shaaban, S.; Doryab, A. Predicting depression in adolescents using mobile and wearable sensors: multimodal machine learning–based exploratory study. JMIR Formative Research 2022, 6, e35807.
  207. Ren, B.; Balkind, E.G.; Pastro, B.; Israel, E.S.; Pizzagalli, D.A.; Rahimi-Eichi, H.; Baker, J.T.; Webb, C.A. Predicting states of elevated negative affect in adolescents from smartphone sensors: a novel personalized machine learning approach. Psychological Medicine 2023, 53, 5146–5154.
  208. Ng, M.Y.; Frederick, J.A.; Fisher, A.J.; Allen, N.B.; Pettit, J.W.; McMakin, D.L. Identifying person-specific drivers of depression in adolescents: protocol for a smartphone-based ecological momentary assessment and passive sensing study. JMIR Research Protocols 2024, 13, e43931.
  209. Funkhouser, C.J.; Trivedi, E.; Li, L.Y.; Helgren, F.; Zhang, E.; Sritharan, A.; Cherner, R.A.; Pagliaccio, D.; Durham, K.; Kyler, M.; et al. Detecting adolescent depression through passive monitoring of linguistic markers in smartphone communication. Journal of Child Psychology and Psychiatry 2024, 65, 932–941.
  210. Jang, M.; Cho, Y.; Kim, D.H.; Park, S.; Park, S.; Hur, J.W.; Kim, M.; Cho, K.; Lee, C.G.; Kwon, J.S. Associations between keystroke and stylus metadata and depressive symptoms in adolescents. Psychological medicine 2024, 54, 3109–3114.
  211. Huang, D.; Emedom-Nnamdi, P.; Onnela, J.P.; Van Meter, A. Design and feasibility of smartphone-based digital phenotyping for long-term mental health monitoring in adolescents. PLOS Digital Health 2025, 4, e0000883.
  212. Kross, E.; Verduyn, P.; Demiralp, E.; Park, J.; Lee, D.S.; Lin, N.; Shablack, H.; Jonides, J.; Ybarra, O. Facebook use predicts declines in subjective well-being in young adults. PloS one 2013, 8, e69841.
  213. Currey, D.; Torous, J. Digital phenotyping data to predict symptom improvement and mental health app personalization in college students: prospective validation of a predictive model. Journal of medical Internet research 2023, 25, e39258.
  214. Burnell, K.; Beltran, J.A.; Lind, M.N.; Hayes, G.R.; Odgers, C.L. Testing the feasibility of passive sensing among adolescents: Implications for mental health. Journal of psychopathology and clinical science 2025.
  215. Leijse, M.M.; Hansen, A.; Semeijn, I.K.; Beuning, E.; Staaks, J.P.; van der Pol, T.M.; Stams, G.J.J.; Popma, A.; van Dam, L. Passive Smartphone Sensing of Adolescents’ Mental Health: A Multilevel Meta-Analysis 2025.
  216. Abitante, G.; Cole, D.A.; Bean, C.; Politte-Corn, M.; Liu, Q.; Dao, A.; Dickey, L.; Pegg, S.; Kujawa, A. Temporal dynamics of positive and negative affect in adolescents: Associations with depressive disorders and risk. Journal of Mood & Anxiety Disorders 2024, 7, 100069.
  217. Ren, W.; Yang, L.; Xu, J. HuMamba: Adolescent Suicide Risk Detection with HuBERT and Mamba-Based Temporal Modeling. In Proceedings of the 2025 IEEE 5th International Conference on Computer Communication and Artificial Intelligence (CCAI). IEEE, 2025, pp. 1000–1004.
  218. Zhu, Y.; Deng, J. Multi Source Data Fusion and Graph Neural Network Based Joint Identification Algorithm for Adolescent Internet Addiction and Psychological Disorders. In Proceedings of the 2025 2nd International Conference on Digital Media, Communication and Information Systems (DMCIS). IEEE, 2025, pp. 100–104.
  219. Carter, B.; Ahmed, N.; Cassidy, O.; Pearson, O.; Calcia, M.; Mackie, C.; Kalk, N.J. ‘There’s more to life than staring at a small screen’: a mixed methods cohort study of problematic smartphone use and the relationship to anxiety, depression and sleep in students aged 13–16 years old in the UK. BMJ mental health 2024, 27.
  220. Bye, A.; Carter, B.; Leightley, D.; Trevillion, K.; Liakata, M.; Branthonne-Foster, S.; Williamson, G.; Zenasni, Z.; Dutta, R. Observational prospective study of social media, smartphone use and self-harm in a clinical sample of young people: study protocol. BMJ open 2023, 13, e069748.
  221. Ferreira, D.; Kostakos, V.; Dey, A.K. AWARE: mobile context instrumentation framework. Frontiers in ICT 2015, 2, 6.
  222. Onnela, J.P.; Dixon, C.; Griffin, K.; Jaenicke, T.; Minowada, L.; Esterkin, S.; Siu, A.; Zagorsky, J.; Jones, E. Beiwe: A data collection platform for high-throughput digital phenotyping. Journal of Open Source Software 2021, 6, 3417.
  223. Torous, J.; Kiang, M.V.; Lorme, J.; Onnela, J.P. New tools for new research in psychiatry: a scalable and customizable platform to empower data driven smartphone research. JMIR mental health 2016, 3, e5165.
  224. Ranjan, Y.; Rashid, Z.; Stewart, C.; Conde, P.; Begale, M.; Verbeeck, D.; Boettcher, S.; Hyve.; Dobson, R.; Folarin, A.; et al. RADAR-base: open source mobile health platform for collecting, monitoring, and analyzing data using sensors, wearables, and mobile devices. JMIR mHealth and uHealth 2019, 7, e11734.
  225. Vaidyam, A.; Halamka, J.; Torous, J. Enabling research and clinical use of patient-generated health data (the mindLAMP Platform): digital phenotyping study. JMIR mHealth and uHealth 2022, 10, e30557.
  226. Chang, S.; Alon, N.; Torous, J. An exploratory analysis of the effect size of the mobile mental health Application, mindLAMP. Digital Health 2023, 9, 20552076231187244.
  227. Lind, M.N.; Byrne, M.L.; Wicks, G.; Smidt, A.M.; Allen, N.B. The Effortless Assessment of Risk States (EARS) Tool: An Interpersonal Approach to Mobile Sensing. JMIR Mental Health 2018, 5.
  228. Lind, M.N.; Kahn, L.E.; Crowley, R.; Reed, W.; Wicks, G.; Allen, N.B. Reintroducing the Effortless Assessment Research System (EARS). JMIR Mental Health 2023, 10.
  229. Michelle L. Byrne, Nicholas B. Allen, M.N.L. The EASE (Effortless Assessment of Stressful Environments) Study: Assessing stress with mobile passive sensing behavioral data. https://www.stressmeasurement.org/ears (Submitted July 15, 2017).
  230. Saeb, S.; Zhang, M.; Karr, C.J.; Schueller, S.M.; Corden, M.E.; Kording, K.P.; Mohr, D.C. Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study. Journal of Medical Internet Research 2015, 17.
  231. Schueller, S.M.; Begale, M.; Penedo, F.J.; Mohr, D.C. Purple: A Modular System for Developing and Deploying Behavioral Intervention Technologies. Journal of medical Internet research 2014, 16, e181–e181.
  232. Bot, B.M.; Suver, C.; Neto, E.C.; Kellen, M.; Klein, A.; Bare, C.; Doerr, M.; Pratap, A.; Wilbanks, J.; Dorsey, E.; et al. The mPower study, Parkinson disease mobile data collected using ResearchKit. Scientific data 2016, 3, 160011.
  233. Sieberts, S.K.; Schaff, J.; Duda, M.; Pataki, B.Á.; Sun, M.; Snyder, P.; Daneault, J.F.; Parisi, F.; Costante, G.; Rubin, U.; et al. Crowdsourcing digital health measures to predict Parkinson’s disease severity: the Parkinson’s Disease Digital Biomarker DREAM Challenge. NPJ digital medicine 2021, 4, 53.
  234. Onnela, J.P.; Rauch, S.L. Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology 2016, 41, 1691–1696.
  235. Torous, J.; Kiang, M.V.; Lorme, J.; Onnela, J.P. New tools for new research in psychiatry: a scalable and customizable platform to empower data driven smartphone research. JMIR mental health 2016, 3, e5165.
  236. Torous, J.; Wisniewski, H.; Bird, B.; Carpenter, E.; David, G.; Elejalde, E.; Fulford, D.; Guimond, S.; Hays, R.; Henson, P.; et al. Creating a digital health smartphone app and digital phenotyping platform for mental health and diverse healthcare needs: an interdisciplinary and collaborative approach. Journal of Technology in Behavioral Science 2019, 4, 73–85.
  237. Zhang, Y.; Barnes, A.; Veerakanjana, K.; Denyer, H.; Sankesara, H.; Marriott, H.; Rocks, P.; Gerboni, G.; Mortera, A.; Müller-Sedgwick, U.; et al. Remote monitoring of wide-ranging real-world changes in adults following ADHD medication initiation. Translational psychiatry 2025.
  238. Ben-Zeev, D.; Brian, R.; Wang, R.; Wang, W.; Campbell, A.T.; Aung, M.S.; Merrill, M.; Tseng, V.W.; Choudhury, T.; Hauser, M.; et al. CrossCheck: Integrating self-report, behavioral sensing, and smartphone use to identify digital indicators of psychotic relapse. Psychiatric rehabilitation journal 2017, 40, 266.
  239. Zhang, H.; Diaz, J.L.; Kim, S.; Yu, Z.; Wu, Y.; Carter, E.; Banerjee, S. 2SpamH: A Two-Stage Pre-Processing Algorithm for Passively Sensed mHealth Data. Sensors 2024, 24, 7053.
  240. Qiu, Y.; Carter, E.; Benda, N.; Sirey, J.A.; Kim, S.; Kim, Y.; Yu, Z.; Kiosses, D.; Marino, P.; Gunning, F.; et al. Improving Adherence to Psychotherapy and Clinical Outcome in Patients With Late-Life Depression Through Gamified mHealth Technology. The American Journal of Geriatric Psychiatry 2025.
  241. Mohr, D.C.; Schueller, S.M.; Montague, E.; Burns, M.N.; Rashidi, P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. Journal of medical Internet research 2014, 16, e146.
  242. Mohr, D.C.; Tomasino, K.N.; Lattie, E.G.; Palac, H.L.; Kwasny, M.J.; Weingardt, K.; Karr, C.J.; Kaiser, S.M.; Rossom, R.C.; Bardsley, L.R.; et al. IntelliCare: an eclectic, skills-based app suite for the treatment of depression and anxiety. Journal of medical Internet research 2017, 19, e10.
  243. Hoque, M.; Courgeon, M.; Martin, J.C.; Mutlu, B.; Picard, R.W. Mach: My automated conversation coach. In Proceedings of the Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, 2013, pp. 697–706.
  244. Harrison, C.; Loe, B.S.; Lis, P.; Sidey-Gibbons, C. Maximizing the potential of patient-reported assessments by using the open-source concerto platform with computerized adaptive testing and machine learning. Journal of Medical Internet Research 2020, 22, e20950.
  245. Chancellor, S.; De Choudhury, M. Methods in predictive techniques for mental health status on social media: a critical review. NPJ digital medicine 2020, 3, 43.
  246. Trull, T.J.; Ebner-Priemer, U. Ambulatory assessment. Annual review of clinical psychology 2013, 9, 151–176.
  247. Martinez-Martin, N.; Kreitmair, K. Ethical issues for direct-to-consumer digital psychotherapy apps: addressing accountability, data protection, and consent. JMIR mental health 2018, 5, e9423.
  248. De Montjoye, Y.A.; Hidalgo, C.A.; Verleysen, M.; Blondel, V.D. Unique in the crowd: The privacy bounds of human mobility. Scientific reports 2013, 3, 1376.
  249. Vitak, J.; Shilton, K.; Ashktorab, Z. Beyond the Belmont principles: Ethical challenges, practices, and beliefs in the online data research community. In Proceedings of the Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing, 2016, pp. 941–953.
  250. McMahan, B.; Moore, E.; Ramage, D.; Hampson, S.; y Arcas, B.A. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the Artificial intelligence and statistics. Pmlr, 2017, pp. 1273–1282.
  251. Abadi, M.; Chu, A.; Goodfellow, I.; McMahan, H.B.; Mironov, I.; Talwar, K.; Zhang, L. Deep learning with differential privacy. In Proceedings of the Proceedings of the 2016 ACM SIGSAC conference on computer and communications security, 2016, pp. 308–318.
  252. Liu, J.C.; Goetz, J.; Sen, S.; Tewari, A. Learning from others without sacrificing privacy: Simulation comparing centralized and federated machine learning on mobile health data. JMIR mHealth and uHealth 2021, 9, e23728.
  253. Selbst, A.D.; Barocas, S. Big data’s disparate impact. California Law Review 2016, 104.
  254. Suresh, H.; Guttag, J. A framework for understanding sources of harm throughout the machine learning life cycle. In Proceedings of the Proceedings of the 1st ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, 2021, pp. 1–9.
  255. Blodgett, S.L.; Barocas, S.; Daumé Iii, H.; Wallach, H. Language (technology) is power: A critical survey of “bias” in NLP. In Proceedings of the Proceedings of the 58th annual meeting of the association for computational linguistics, 2020, pp. 5454–5476.
  256. Doshi-Velez, F.; Kim, B. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 2017.
  257. Graham, S.; Depp, C.; Lee, E.E.; Nebeker, C.; Tu, X.; Kim, H.C.; Jeste, D.V. Artificial intelligence for mental health and mental illnesses: an overview. Current psychiatry reports 2019, 21, 116.
  258. Kim, D.H.; Lee, J.; Lee, T.; Baek, S.; Jin, S.; Yoo, H.; Cho, Y.; Park, S.; Cho, K.; Lee, C.G. Ai-based mental health assessment for adolescents using their daily digital activities. In Proceedings of the 2024 IEEE 11th International Conference on Data Science and Advanced Analytics (DSAA). IEEE, 2024, pp. 1–10.
  259. Panigrahi, B.; Priya, K.; Bansal, A.; Choudhary, R. Artificial Intelligence-driven Solution for Prompt Identification of Mental Health Concerns in Adolescents. In Proceedings of the 2024 IEEE 1st International Conference on Green Industrial Electronics and Sustainable Technologies (GIEST). IEEE, 2024, pp. 1–6.
Table 1. The Affective and Cognitive Aspects of Cyber-Syndrome with Characteristic Manifestations and Corresponding Computational Approaches.
Table 1. The Affective and Cognitive Aspects of Cyber-Syndrome with Characteristic Manifestations and Corresponding Computational Approaches.
Aspect Key Manifestations Theoretical Basis Computational Approaches Key References
Table 1 continued from previous page
Aspect Key Manifestations Theoretical Basis Computational Approaches Key References
Cognitive Attention Reduced sustained attention, increased distractibility, attentional bias to digital cues, multitasking deficits Limited capacity models, attentional control theory App-switching patterns, session length, response time variability, eye-tracking (gaze patterns)  [3,19,20]
Executive Function Poor impulse control, cognitive inflexibility, decision-making deficits, planning difficulties Dual-process theory, cognitive control models Keyboard dynamics (typing patterns), task-switching costs, decision latency, error rates  [4,21,22]
Memory Working memory overload, prospective memory failures, source memory errors, encoding deficits Working memory models, memory systems framework Search behavior (repeated searches), task completion, time perception, app usage patterns  [23,24,25]
Metacognition Diminished self-awareness, discrepancies between self-perception and actual performance, reduced insight Metacognitive theory, self-monitoring and self-regulation frameworks Linguistic markers of insight, behavioral-self-report mismatches  [26,27]
Cognitive Control Conflict monitoring deficits, error detection failures, adaptive control impairments Conflict monitoring theory, reinforcement learning Error-related signals, post-error slowing, adaptation to task demands  [22,28]
Affective Mood Disorders Depressive symptoms, anxiety, mood swings, anhedonia Cognitive theory of depression, anxiety sensitivity model Sentiment analysis, emotion word usage, posting patterns, linguistic markers  [13,29,30]
Emotional Regulation Heightened reactivity, blunted affect, recovery difficulties, emotional instability Process model of emotion regulation, affective dynamics Affective variability, emotional inertia, regulatory strategies in text  [31,32,33]
Reward Processing Cue reactivity, tolerance development, withdrawal symptoms, reward deficiency Incentive-sensitization theory, reward deficiency syndrome Approach behaviors, consumption patterns, post-engagement affect, craving signals  [6,34,35]
Stress & Arousal Chronic arousal, stress reactivity, impaired recovery, allostatic load Allostatic load model, stress-diathesis framework Heart rate variability, electrodermal activity, circadian disruption, linguistic stress markers  [36,37,38]
Social Emotion Social comparison, envy, FOMO, online disinhibition Social comparison theory, online disinhibition effect Comparative language, engagement patterns, emotional contagion signals  [39,40]
Table 2. Taxonomy of Data Sources for Mental State Inference.
Table 2. Taxonomy of Data Sources for Mental State Inference.
Modality Sources Cognitive Relevance Affective Relevance
Linguistic Markers Social media posts, messages, search queries, emails Thought content, cognitive processes, reasoning style Emotional expression, mood, affect dynamics
Interaction Dynamics Keystroke patterns, mouse movements, touch gestures, app-switching Attention, motor function, cognitive control, processing speed Arousal, engagement, emotional state
Temporal Patterns Usage timing, session structure, circadian rhythms Circadian function, sleep quality, cognitive fluctuations Mood rhythms, affective variability
Neurophysiological signals Heart rate, HRV, EDA, skin temperature, consumer EEG Cognitive load, attention, mental effort Arousal, stress, emotion
Table 3. Digital Phenotyping Research Platforms and Their Functional Characteristics.
Table 3. Digital Phenotyping Research Platforms and Their Functional Characteristics.
Platform Description References
Table 3 continued from previous page
Platform Description References
AWARE Framework Concurrently captures contextual data across three dimensions—hardware, software, and human behavior—to infer users’ physiological and psychological states.  [221]
Beiwe Platform Implicitly and unobtrusively collects users’ daily digital footprints through smartphone or wearable sensors to infer behavioral addiction characteristics, such as internet overuse and cyber-anxiety.  [222,223]
RADAR-Base A high-throughput, open-source, distributed mobile health and digital phenotyping platform designed for large-scale clinical trials, utilizing a high-throughput Apache Kafka stream processing architecture to efficiently integrate passive smartphone behavioral data, active ecological momentary assessments (EMA), and a vast third-party wearable hardware ecosystem.  [224]
mindLAMP Automatically collects multimodal passive sensor data, such as screen time and behavioral trajectories, via smartphones, combining it with built-in lightweight cognitive games and psychological questionnaires for real-time active assessment; it can dynamically trigger personalized micro-interventions based on behavioral computation results, thereby achieving precise quantification and full-process management of an individual’s cognitive depletion and affective states.  [213,225,226]
EARS Captures social and affective cues in real time through individuals’ daily multimodal smartphone behavioral footprints, such as typing dynamics and text sentiment from custom keyboards, screen time, media and music preferences, vocal acoustic features, and geolocation.  [227,228,229]
Purple Robot An open-source mobile health research platform focusing on high-density, low-level contextual sensing, which executes script inference locally by fully automatically capturing smartphone physical sensor data and system interaction logs, thereby achieving unobtrusive quantitative assessment and closed-loop intervention for users’ daily digital dependence, cognitive overload, and emotional dysregulation.  [230,231]
Synapse Platform A large-scale, open digital phenotyping and scientific computing collaborative platform developed by Sage Bionetworks, which achieves micro-quantification of individual motor and neurocognitive functions through smartphone touchscreen interactions, gait sensors, and vocal acoustic analysis, and provides global researchers with algorithmic benchmark data for inferring mental states through a standardized open-source cloud ecosystem.  [232,233]
Table 4. Major Digital Phenotyping Research Centers and Their Key Scientific Achievements.
Table 4. Major Digital Phenotyping Research Centers and Their Key Scientific Achievements.
Research Center Key Achievements References
Table 4 continued from previous page
Research Center Key Achievements References
Onnela Lab-Harvard T.H. Chan School of Public Health Explicitly defined digital phenotyping as the use of personal digital devices, particularly smartphones, to quantify behavioral, social, and cognitive phenotypes; Developed the Beiwe research platform to infer human phenotypes from smartphone sensor and usage data.  [222,234,235]
Division of Digital Psychiatry-BIDMC Developed and maintains the mindLAMP platform, which integrates passive sensing, active tasks, smartphone behavior, and data analysis pipelines for digital phenotyping, clinical research, and remote monitoring.  [236]
King’s College London Institute of Psychiatry, Psychology & Neuroscience, IoPPN Development of the RADAR-base open-source platform; Professor Jonna Kuntsi’s team demonstrated that digital phenotyping can objectively evaluate ADHD medication efficacy; Professor Ben Carter’s team investigated the dynamic relationship between digital behavioral patterns and emotional instability; The 3S-YP study prospectively explored social media and smartphone usage patterns among clinical youth populations; KingsCAT supports large-scale multi-platform social media data analysis for youth mental health research.  [219,220,224,237]
BRiTE Center | Digital Mental Health Research Center Developed the CrossCheck system, a smartphone-based digital phenotyping system designed for schizophrenia relapse prediction, utilizing smartphone behavioral measurements, audio diaries, self-assessments, and performance-based cognitive tests.  [238]
Samprit Banerjee Lab | Weill Cornell Medicine Pioneered the 2SpamH two-stage preprocessing algorithm for internet usage behavior data; Developed the TREE-Connect digital intervention platform with demonstrated efficacy in randomized controlled trials for elderly patients with depression.  [239,240]
Center for Behavioral Intervention Technologies (CBITs) Proposed the BIT (Behavioral Intervention Technology) design model; Developed the IntelliCare system utilizing intelligent algorithms to dynamically schedule lightweight mini-apps for depression and anxiety interventions.  [241,242]
MIT Media Lab - Affective Computing Group Launched the SNAPSHOT research project constructing individual psychological baselines and anomaly prediction models from multimodal digital data; Developed MACH for analyzing facial expressions, vocal features, and daily behavioral performance to assist populations with social or cognitive regulation difficulties.  [193,243]
The Psychometrics Centre, University of Cambridge Developed the Concerto platform integrating Item Response Theory (IRT) with visual programming to reduce test items while maintaining measurement precision.  [244]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.