Submitted:
03 September 2025
Posted:
04 September 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
1.1. Background and Motivation
1.2. Literature Review and Extended Research Context
1.3. Key Contributions
- (1)
- Dual-validation framework: a comprehensive methodology comparing within-session and cross-session performance.
- (2)
- Temporal robustness quantification: Systematic assessment of laboratory-to-practice performance degradation.
- (3)
- Clinical translation metrics: Integration of comprehensive performance analysis and deployment readiness assessment.
- (4)
- Statistical rigor enhancement: Advanced significance testing with effect sizes and multiple comparison corrections.
- (5)
- Task-specific stability analysis: Comprehensive comparison of hand versus foot imagery temporal robustness.
2. Materials and Methods
2.1. Participants and Experimental Protocol
2.2. EEG Data Acquisition and Mathematical Signal Processing Framework
2.2.1. OpenBCI Data Acquisition
2.2.2. Signal Processing Pipeline
2.3. Machine Learning Classification Framework
- (1)
- Support Vector Machine (SVM) with RBF kernel
- (2)
- Naive Bayes Gaussian (NBG)
- (3)
- Random Forest (RF) with 100 estimators
- (4)
- K-Nearest Neighbors (KNN) with k=5
- (5)
- Decision Tree (DT) with maximum depth 10
- (6)
- Gradient Boosting (GB) with 100 estimators
- (7)
- AdaBoost (AB) with 50 estimators
- (8)
- Logistic Regression (LR) with L2 regularization
- (9)
- Multi-Layer Perceptron (MLP) with two hidden layers
- (10)
- Linear Discriminant Analysis (LDA)
2.3.1. Dual Binary Classification Architecture
- Hand Classifier: Trained to distinguish between left and right hand motor imagery.
- Foot Classifier: Trained to differentiate between left and right foot motor imagery.
2.3.2. Binary Classifier Implementation and Training
- training: {Left Fist Clench} vs. {Right Fist Clench}
- training: {Left Foot Flexion} vs. {Right Foot Flexion}
- (1)
- Specialized Performance: Each classifier focuses exclusively on its respective motor imagery modality (hand or foot).
- (2)
- Independent Optimization: Hand and foot classifiers can be optimized separately for maximum performance.
- (3)
- Modular Design: Individual classifiers can be retrained and updated independently.
- (4)
- Focused Evaluation: Enables separate analysis of hand and foot imagery classification performance.
- (5)
- Simplified Control Logic: Direct mapping from classifier output to robot commands without complex decision trees.
- (6)
- Robust Mapping: Natural correspondence between specific limb movements and robot actions.
2.4. Novel Dual-Validation Framework
2.4.1. Within-Session Validation
2.4.2. Cross-Session Validation
2.4.3. Performance Ranking System:
2.4.4. Performance Comparison Metrics
- (1)
- System accuracy: Combined accuracy metric representing overall classifier performance across both motor imagery tasks:where Hand Accuracy and Foot Accuracy represent the classification accuracies for left/right hand and left/right foot motor imagery tasks, respectively. This metric provides a comprehensive performance assessment for the dual binary classification system and serves as the basis for temporal stability calculations.
- (2)
- Accuracy degradation: Percentage difference between within-session and cross-session system accuracy:where is the within-session system accuracy and is the cross-session system accuracy.
- (3)
- Stability metrics: Coefficient of variation across validation folds/sessions:where is the standard deviation and is the mean accuracy across folds or sessions.
- (4)
- Robustness scoring: Combined performance-stability quantification:where is the mean accuracy and is the coefficient of variation normalized to [0,1].
2.5. Statistical Analysis
3. Results and Discussion
3.1. Performance Evaluation
3.1.1. Within-Session Performance Analysis
3.1.2. Cross-Session Performance Analysis
3.2. Temporal Robustness Analysis
3.3. Task-Specific Performance and Statistical Analysis
3.4. Limitations and Future Directions
4. Conclusions
Extended Version Declaration
- (1)
- Methodological Enhancement: Introduction of cross-session validation methodology to assess temporal robustness and quantify laboratory-to-practice performance degradation
- (2)
- Expanded Experimental Design: Extension from single-session to multiple-session data collection across 6 subjects, enabling systematic temporal robustness assessment under realistic deployment conditions
- (3)
- Comprehensive Performance Quantification: Addition of multi-dimensional stability metrics, robustness scoring, and detailed precision-recall analysis across all motor imagery tasks
- (4)
- Statistical Rigor: Implementation of advanced three-tier statistical testing framework (Shapiro-Wilk normality testing, Wilcoxon signed-rank tests, Cohen’s d effect size quantification) with multiple comparison corrections
- (5)
- Clinical Translation Metrics: Integration of deployment readiness assessment frameworks and evidence-based guidelines for practical BCI implementation
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
References
- Tarara, P.; Przybył, I.; Schöning, J.; Gunia, A. Motor Imagery-Based Brain-Computer Interfaces: An Exploration of Multiclass Motor Imagery-Based Control for Emotiv EPOC X. Frontiers in Neuroinformatics 2025, 19, 1625279. [Google Scholar] [CrossRef]
- Saibene, A.; Caglioni, M.; Corchs, S.; Gasparini, F. EEG-based BCIs on motor imagery paradigm using wearable technologies: a systematic review. Sensors 2023, 23, 2798. [Google Scholar] [CrossRef]
- Lotte, F.; Bougrain, L.; Cichocki, A.; Clerc, M.; Congedo, M.; Rakotomamonjy, A.; Yger, F. A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. Journal of neural engineering 2018, 15, 031005. [Google Scholar] [CrossRef]
- Hanafy, M.A.; Yusufjonov, S.; Yusufjonov, D.; Sharafianardakani, P.; Rayguru, M.M.; Popa, D.O. A Robust EEG Brain-Computer Interface Approach for Decoding Hand and Foot Motor Imagery. In Proceedings of the Proceedings of the 18th ACM International Conference on PErvasive Technologies Related to Assistive Environments, 2025, pp. 92–100.
- Hanafy, M.A.; Reynolds, H.L.; Jones, J.; Harris, D.; Popa, D.O. Assessment of BCI performance for human-robot interaction. In Proceedings of the Proceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments, 2024, pp. 252–258.
- Huang, G.; Zhao, Z.; Zhang, S.; Hu, Z.; Fan, J.; Fu, M.; Chen, J.; Xiao, Y.; Wang, J.; Dan, G. Discrepancy between inter-and intra-subject variability in EEG-based motor imagery brain-computer interface: Evidence from multiple perspectives. Frontiers in neuroscience 2023, 17, 1122661. [Google Scholar] [CrossRef]
- Vidaurre, C.; Ramos-Murguialday, A.; Haufe, S.; Gizzi, L.; Sannelli, C.; Braun, C.; Birbaumer, N. Enhancing sensorimotor BCI performance with assistive afferent activity: an online study. NeuroImage 2020, 199, 375–386. [Google Scholar] [CrossRef]
- Ma, J.; Yang, B.; Qiu, W.; Li, Y.; Gao, S.; Xia, X. A large EEG dataset for studying cross-session variability in motor imagery brain-computer interface. Scientific Data 2022, 9, 531. [Google Scholar] [CrossRef]
- Lotey, T.; Keserwani, P.; Wasnik, G.; Roy, P.P. Cross-session motor imagery EEG classification using self-supervised contrastive learning. In Proceedings of the 2022 26th International Conference on Pattern Recognition (ICPR). IEEE; 2022; pp. 975–981. [Google Scholar]
- Liu, W.; Guo, C.; Gao, C. A cross-session motor imagery classification method based on Riemannian geometry and deep domain adaptation. Expert Systems with Applications 2024, 237, 121612. [Google Scholar] [CrossRef]
- Abiri, R.; Borhani, S.; Sellers, E.W.; Jiang, Y.; Zhao, X. A comprehensive review of EEG-based brain–computer interface paradigms. Journal of Neural Engineering 2019, 16, 011001. [Google Scholar] [CrossRef] [PubMed]
- Hehenberger, L.; Kobler, R.J.; Lopes-Dias, C.; Srisrisawang, N.; Tumfart, P.; Uroko, J.B.; Torke, P.R.; Müller-Putz, G.R. Long-term mutual training for the CYBATHLON BCI race with a tetraplegic pilot: a case study on inter-session transfer and intra-session adaptation. Frontiers in Human Neuroscience 2021, 15, 635777. [Google Scholar] [CrossRef]
- Zhang, X.; Yao, L.; Wang, X.; Monaghan, J.; McAlpine, D.; Zhang, Y. A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers. Journal of Neural Engineering 2021, 18, 031002. [Google Scholar] [CrossRef] [PubMed]
- Roy, Y.; Banville, H.; Albuquerque, I.; Gramfort, A.; Falk, T.H.; Faubert, J. Deep learning-based electroencephalography analysis: a systematic review. Journal of Neural Engineering 2019, 16, 051001. [Google Scholar] [CrossRef]
- Craik, A.; He, Y.; Contreras-Vidal, J.L. Deep learning for electroencephalogram (EEG) classification tasks: a review. Journal of Neural Engineering 2019, 16, 031001. [Google Scholar] [CrossRef]
- Baspınar, U.; Tastan, Y. Enhancing Motor Imagery EEG Classification in Brain-Computer Interfaces via TransformerNet. IEEE Access 2025. [Google Scholar] [CrossRef]
- Gwon, D.; Won, K.; Song, M.; Nam, C.S.; Jun, S.C.; Ahn, M. Review of public motor imagery and execution datasets in brain-computer interfaces. Frontiers in human neuroscience 2023, 17, 1134869. [Google Scholar] [CrossRef] [PubMed]
- Hu, H.; Yue, K.; Guo, M.; Lu, K.; Liu, Y. Subject separation network for reducing calibration time of MI-based BCI. Brain Sciences 2023, 13, 221. [Google Scholar] [CrossRef]
- Lin, C.L.; Chen, L.T. Improvement of brain–computer interface in motor imagery training through the designing of a dynamic experiment and FBCSP. Heliyon 2023, 9. [Google Scholar] [CrossRef] [PubMed]
- Wu, D.; Jiang, X.; Peng, R. Transfer learning for motor imagery based brain–computer interfaces: A tutorial. Neural Networks 2022, 153, 235–253. [Google Scholar] [CrossRef]
- Ma, S.; Situ, Z.; Peng, X.; Li, Z.; Huang, Y. Multi-Class Classification Methods for EEG Signals of Lower-Limb Rehabilitation Movements. Biomimetics 2025, 10, 452. [Google Scholar] [CrossRef]
- Wei, Q.; Ding, X. Intra- and Inter-Subject Common Spatial Pattern for Reducing Calibration Effort in MI-Based BCI. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2023, 31, 904–916. [Google Scholar] [CrossRef]
- Lazcano-Herrera, A.G.; Fuentes-Aguilar, R.Q.; Chairez, I.; Alonso-Valerdi, L.M.; Gonzalez-Mendoza, M.; Alfaro-Ponce, M. Review on BCI virtual rehabilitation and remote technology based on EEG for assistive devices. Applied Sciences 2022, 12, 12253. [Google Scholar] [CrossRef]
- Kwon, O.Y.; Lee, M.H.; Guan, C.; Lee, S.W. Subject-independent brain–computer interfaces based on deep convolutional neural networks. IEEE transactions on neural networks and learning systems 2019, 31, 3839–3852. [Google Scholar] [CrossRef]
- Hosseini, M.P.; Tran, T.X.; Pompili, D.; Elisevich, K.; Soltanian-Zadeh, H. Multimodal data analysis of epileptic EEG and rs-fMRI via deep learning and edge computing. Artificial Intelligence in Medicine 2020, 104, 101813. [Google Scholar] [CrossRef]
- OpenBCI. OpenBCI Cyton Daisy Biosensing Board, 2023. Accessed: 2025-08-15.
- Reynolds, H.L.; Hanafy, M.A.; Jones, J.; Harris, D.; Popa, D.O. Comparative Study of One-Handed vs Two-Handed EEG Intent Recognition for Applications in Human-Robot Interaction. In Proceedings of the Proceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments, 2024, pp. 496–503.
- OpenBCI. All-in-One EEG Electrode Cap Bundle, 2025. Accessed: August 15, 2025.
- Blankertz, B.; Tomioka, R.; Lemm, S.; Kawanabe, M.; Muller, K.R. Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal processing magazine 2007, 25, 41–56. [Google Scholar] [CrossRef]
- Ang, K.K.; Chin, Z.Y.; Zhang, H.; Guan, C. Filter bank common spatial pattern (FBCSP) in brain-computer interface. In Proceedings of the 2008 IEEE international joint conference on neural networks (IEEE world congress on computational intelligence). IEEE; 2008; pp. 2390–2397. [Google Scholar]
- Jose, N.; Gore, D.; Vivekanandan, G.; Nithya, E.; Nallarasan, V.; Krishnakumar, K. Efficient predefined time adaptive neural network for motor execution EEG signal classification based brain-computer interaction. Knowledge-Based Systems 2024, 303, 112270. [Google Scholar] [CrossRef]
- Sharafianardakani, P.; Hanafy, M.A.; Kondaurova, I.; Ashary, A.; Rayguru, M.M.; Popa, D.O. Adaptive User Interface With Parallel Neural Networks for Robot Teleoperation. IEEE Robotics and Automation Letters 2024. [Google Scholar] [CrossRef]
- Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine learning in Python. the Journal of machine Learning research 2011, 12, 2825–2830. [Google Scholar]
- Hanafy, M.A.; Ali, H.S.; Shaalan, A.A. Rakeness with block sparse Bayesian learning for efficient ZigBee-based EEG telemonitoring. International Journal of Communication Systems 2020, 33, e4219. [Google Scholar] [CrossRef]







| Classifier | Within-Session (%) | Cross-Session (%) | Temporal | ||||
|---|---|---|---|---|---|---|---|
| Hand Acc. | Foot Acc. | System Acc. | Hand Acc. | Foot Acc. | System Acc. | Stability | |
| KNN | |||||||
| AdaBoost | |||||||
| MLP | |||||||
| Decision Tree | |||||||
| Gradient Boosting | |||||||
| SVM | |||||||
| Naive Bayes | |||||||
| Random Forest | |||||||
| Logistic Regression | |||||||
| LDA | |||||||
| Mean | |||||||
| Classifier | Within-Session Performance (%) | Cross-Session Performance (%) | ||||
|---|---|---|---|---|---|---|
| F1-Score | Precision | Recall | F1-Score | Precision | Recall | |
| Hand Imagery Classification | ||||||
| KNN | ||||||
| AdaBoost | ||||||
| MLP | ||||||
| Decision Tree | ||||||
| Gradient Boosting | ||||||
| SVM | ||||||
| Naive Bayes | ||||||
| Random Forest | ||||||
| Logistic Regression | ||||||
| LDA | ||||||
| Foot Imagery Classification | ||||||
| KNN | ||||||
| AdaBoost | ||||||
| MLP | ||||||
| Decision Tree | ||||||
| Gradient Boosting | ||||||
| SVM | ||||||
| Naive Bayes | ||||||
| Random Forest | ||||||
| Logistic Regression | ||||||
| LDA | ||||||
| Classifier | Coefficient of Variation (%) | Robustness Score | Stability Rank | ||
|---|---|---|---|---|---|
| Within | Cross | Within | Cross | ||
| KNN | 18.0 | 18.3 | 0.683 | 0.663 | 1 |
| AdaBoost | 16.9 | 19.0 | 0.698 | 0.659 | 2 |
| MLP | 19.3 | 19.3 | 0.671 | 0.653 | 3 |
| Decision Tree | 18.9 | 19.6 | 0.672 | 0.639 | 4 |
| Gradient Boosting | 20.1 | 19.6 | 0.658 | 0.638 | 5 |
| SVM | 19.8 | 20.8 | 0.659 | 0.635 | 6 |
| Naive Bayes | 21.2 | 22.4 | 0.653 | 0.615 | 7 |
| Random Forest | 21.7 | 22.0 | 0.635 | 0.602 | 8 |
| Logistic Regression | 32.9 | 25.7 | 0.495 | 0.561 | 9 |
| LDA | 31.8 | 26.8 | 0.498 | 0.543 | 10 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).