Submitted:
04 September 2025
Posted:
05 September 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Results
2.1. Sonification-Assisted ECG Surveillance Leads to Shortened Time Delay from Onset of STEMI to Reporting of Diagnosis
2.2. Sub-Group Analysis Indicates a Match Between Perceived and Actual Benefit of Sonification
3. Material and Methods
3.1. ST Elevation Sonification of ECG Signals
- From the 12 lead ECG, two lists of each 6 voltages derived from the leads are defined. List L1: , and list L2: . For each lead, the corresponding ST segment value, , is estimated and assigned to one of 5 levels according to the following cutoff rule: (s2) strongly suppressed, i.e. , (s1) moderately suppressed, i.e. , (IE) close to isoelectric with , (e1) moderately elevated, i.e. , (e2) strongly elevated, i.e. .
- A sequence of short pitched tones (duration d, fundamental frequency f) of given brightness (number of harmonics n) and level (l, in ) is generated for both sets L1 and L2 using an inter-tone interval of . The tones are pitched relative to the pitch of the QRS tone by () semitones corresponding to the 5 cases (s2, s1, IE, e1, e2). The duration d is set to according to the 5 cases such that more extreme ST segment values become more salient. Correspondingly, brightness is defined by using harmonic overtones, such that ST segments which deviate clearly from IE perceptually stand out. Further, each tone’s level is adjusted by accordingly. Finally, we use to control the curvature of the corresponding tone’s fade-out envelope such that tones for more extreme st values have a less steep fade out (cf. [6] for details).
- The structured audio message (sequence of 6 tones) for set L1 is triggered by every 8th electrical cardiac activity QRS tone. The sequence for set L2 is triggered two electrical cardiac activities after the L1 sequence, such that both sets of 6 notes can be easily discerned. Listeners thus receive adequately detailed yet aggregated information of the 12 lead ST segment values via two packets of 6 tones, the first for the limb leads along the inverse Cabrera circle with inverted aVR as -aVR, the second for the precordial leads from V1 to V6.
3.2. Study Protocol
3.2.1. Overview
3.2.2. Participants
3.2.3. Classification Task
3.2.4. Survey to Determine Relevant Self-Assessments and Attitudes
- Q1: I had experience with pre-clinical emergencies
- Q2: I have participated to more than 3 emergency trainings
- Q3: I feel confident when handling emergency situations
- Q4: For me, emergency situations cause negative stress
- SQ1: Sonification is pleasant to listen to
- SQ2: The sonification is informative, i.e., it enables to identify ST elevation changes in the ECG
- SQ3: I can imagine to listen to these sonifications for a longer time period
3.2.5. Simulated Medical Emergency Scenario
3.2.6. Medical Scenario Description
3.2.7. Medical Assessment
- establishment of basic monitoring (blood pressure measurement, oxygen saturation, 4-lead ECG) for measuring vital parameters
- recording of a 12-lead ECG (initially presented with an isoelectric ST segment)
- recording of a second ECG (now presented with significant elevation of the ST segment 90 seconds after the first ECG, indicative for an anterior STEMI)
- recognizing the ST elevation (myocardial infarction)
- correct selection and application of the indicated drugs
- report to the rescue control center and referring the patient to the nearest appropriate hospital with the option of immediate cardiac catheterization
3.2.8. Assessment of the Scenario by the Study Participants
- FB1: I acted confidently during the emergency simulation
- FB2: I felt stressed during the emergency simulation
- FB3: Sonification influenced my individual medical performance
- FB4: Sonification provided a sense of security
- FB5: Sonification was helpful in making the diagnosis
- FB6: I conceived the sound of the sonification as pleasant
- FB7: The use of sonification as a supporting tool in everyday life is conceivable
3.3. Statistical Methods
4. Discussion
5. Limitations and Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Widimsky, P.; Wijns, W.; Fajadet, J.; de Belder, M.; Knot, J.; Aaberge, L.; Andrikopoulos, G.; Baz, J.A.; Betriu, A.; Claeys, M.; et al. Reperfusion therapy for ST elevation acute myocardial infarction in Europe: description of the current situation in 30 countries. European Heart Journal 2010, 31, 943–957. [Google Scholar] [CrossRef] [PubMed]
- Eckle, V.; Lehmann, S.; Drexler, B. Prehospital management of patients with suspected acute coronary syndrome. Med Klin Intensivmed Notfmed 2021, 116, 694–697. [Google Scholar] [CrossRef] [PubMed]
- Byrne, R.A.; Rossello, X.; Coughlan, J.J.; Barbato, E.; Berry, C.; Chieffo, A.; Claeys, M.J.; Dan, G.A.; Dweck, M.R.; Galbraith, M.; et al. 2023 ESC Guidelines for the management of acute coronary syndromes: Developed by the task force on the management of acute coronary syndromes of the European Society of Cardiology (ESC). European Heart Journal 2023, 44, 3720–3826. [Google Scholar] [CrossRef] [PubMed]
- Aldana Blanco, A.L.; Grautoff, S.; Hermann, T. ECG sonification to support the diagnosis and monitoring of myocardial infarction. Journal on Multimodal User Interfaces 2020, 14, 207–218. [Google Scholar] [CrossRef]
- Aldana Blanco, A.L.; Hermann, T.; Tiesmeier, J.; Persson, J.; Grautoff, S. Sonfication enables continuous surveillance of the ST segment in the electrocardiogram. American Journal of Emergency Medicine 2022, 58, 286–297. [Google Scholar] [CrossRef] [PubMed]
- Hermann, T.; Grautoff, S.; Tielking, F.; Persson, J.; Diebner, H.H.; Tiesmeier, J. ST Elevation Sonification of a 12-Lead ECG for the Assessment, Diagnosis, and Monitoring of ST Elevation Myocardial Infarction. Sensors 2025, 25. [Google Scholar] [CrossRef] [PubMed]
- Hermann, T. Taxonomy and Definitions for Sonification and Auditory Display. In Proceedings of the Proceedings of the 14th International Conference on Auditory Display (ICAD 2008); Susini, P., Warusfel, O., Eds.; Paris, France, 2008. [Google Scholar]
- Hermann, T.; Hunt, A.; Neuhoff, J.G. (Eds.) The Sonification Handbook; Logos Publishing House: Berlin, Germany, 2011; pp. 1–586. [Google Scholar]
- Mihalas, G.; Andor, M.; Tudor, A.; Paralescu, S. Can Sonification Become a Useful Tool for Medical Data Representation? Stud Health Technol Inform 2017, 245, 526–530. [Google Scholar] [CrossRef] [PubMed]
- Iliev, I.; Tabakov, S.; Petrova, G. Audio-Conversion of Biomedical Signals - A Possible Approach to Improve Remote Monitoring of Elderly and Visually Impaired People. Stud Health Technol Inform 2023, 306, 120–126. [Google Scholar] [CrossRef] [PubMed]
- Reindl, M.; Lechner, I.; Reinstadler, S.J.; Metzler, B. Transient STEMI – No STEMI at all? International Journal of Cardiology 339, 12–13. [CrossRef] [PubMed]
- Kather, J.N.; Hermann, T.; Bukschat, Y.; Kramer, T.; Schad, L.R.; Zöllner, F.G. Polyphonic sonification of electrocardiography signals for diagnosis of cardiac pathologies. Scientific Reports 2017, 7, 44549. [Google Scholar] [CrossRef] [PubMed]
- Krasteva, V.; Iliev, I.; Tabakov, S. Application of Convolutional Neural Network for Decoding of 12-Lead Electrocardiogram from a Frequency-Modulated Audio Stream (Sonified ECG). Sensors 2024, 24. [Google Scholar] [CrossRef] [PubMed]
- R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2024. [Google Scholar]
- Frühholz, S.; Trost, W.; Grandjean, D. The role of the medial temporal limbic system in processing emotions in voice and music. Progress in Neurobiology 2014, 123, 1–17. [Google Scholar] [CrossRef] [PubMed]



| Characteristic | no1, N = 161 | yes1, N = 141 | p-value2 |
|---|---|---|---|
| Q1 | 4.00 (3.00, 5.00) | 4.50 (4.00, 5.00) | 0.5 |
| Q2 | 4.00 (2.00, 5.00) | 4.00 (3.00, 4.00) | 0.8 |
| Q3 | 4.00 (3.00, 4.00) | 4.00 (3.00, 4.00) | 0.8 |
| Q4 | 2.50 (2.00, 3.50) | 3.00 (2.00, 3.00) | 0.9 |
| SQ1 | 4.00 (2.50, 5.00) | 3.00 (3.00, 5.00) | >0.9 |
| SQ2 | 4.50 (3.00, 5.00) | 5.00 (4.00, 5.00) | 0.2 |
| SQ3 | 3.00 (2.00, 5.00) | 3.50 (2.00, 5.00) | >0.7 |
| FB1 | 2.00 (2.00, 3.00) | 3.00 (2.00, 3.00) | >0.9 |
| FB2 | 3.00 (2.00, 3.50) | 3.00 (3.00, 4.00) | 0.5 |
| Gender | 0.4 | ||
| male | 6 / 16 (38%) | 3 / 14 (21% | |
| female | 10 / 16 (63%) | 11 / 14 (79%) | |
| Age | 24.0 (23.0, 24.5) | 24.0 (23.0, 25.0) | 0.6 |
| Musicality | 1 / 16 (6.3%) | 1 / 14 (7.1%) | >0.9 |
| Instrument | 6 / 16 (38%) | 9 / 14 (64%) | 0.14 |
| Preknowledge | 1 / 16 (6.3%) | 3 / 14 (21%) | 0.3 |
| Date | 35 (7, 50) | 99 (57, 112) | 0.02 |
| Characteristic | no1 N = 8 | yes1 N = 7 | p-value2 |
|---|---|---|---|
| Heparin | 472 (402, 557) | 441 (336, 467) | 0.12 |
| NA | 0 | 2 | |
| Acetylsalicylic acid | 460 (402, 542) | 410 (291, 429) | 0.044 |
| NA | 0 | 1 | |
| Morphine Sulphate | 400 (359, 463) | 373 (315, 449) | 0.6 |
| NA | 0 | 1 | |
| Dimenhydrinate | 303 (255, 325) | 270 (270, 270) | |
| NA | 5 | 6 | |
| Oxygen | NA (NA, NA) | 267 (216, 345) | |
| NA | 8 | 3 | |
| Nitroglycerin | 430 (335, 525) | 407 (375, 446) | 0.9 |
| NA | 6 | 3 | |
| ECG1 | 117 (89, 157) | 123 (107, 150) | 0.9 |
| ECG2 | 396 (347, 431) | 250 (216, 329) | 0.025 |
| NA | 1 | 0 | |
| RMLST | 210 (180, 217) | 202 (180, 212) | 0.3 |
| NA | 1 | 1 | |
| RMLST2 | 491 (481, 532) | 356 (311, 484) | 0.006 |
| Diagnosis | 450 (379, 500) | 260 (220, 356) | 0.006 |
| ECG1 to Diagnosis | 302 (290, 375) | 133 (111, 233) | <0.001 |
| ECG1 to ECG2 | 262 (231, 329) | 118 (103, 206) | <0.001 |
| NA | 1 | 0 | |
| ECG2 to Diagnosis | 36 (28, 58) | 10 (4, 27) | 0.003 |
| NA | 1 | 0 |
| Characteristic | Beta | 95% CI1 | p-value |
|---|---|---|---|
| Sonification | |||
| no | − | − | |
| yes | -142 | -298, 14 | 0.063 |
| Date | -0.83 | -4.6, 2.9 | 0.5 |
| Gender Composition | |||
| 0 | − | − | |
| 1 | 0.04 | -340, 340 | >0.9 |
| 2 | 2.8 | -296, 302 | >0.9 |
| FB1 | -28 | -262, 205 | 0.7 |
| FB2 | -3.5 | -94, 87 | >0.9 |
| Q3 | 14 | -114, 143 | 0.7 |
| Q4 | 89 | -80, 259 | 0.2 |
| SQ1 | -31 | -190, 128 | 0.6 |
| SQ2 | 21 | -105, 146 | 0.6 |
| SQ3 | 13 | -39, 65 | 0.5 |
| Characteristic | Beta | 95% CI1 | p-value |
|---|---|---|---|
| FB3 | -13 | -41, 14 | 0.2 |
| FB4 | -7.7 | -23, 7.3 | 0.2 |
| FB5 | 33 | 11, 54 | 0.022 |
| FB6 | -16 | -31, -1.2 | 0.043 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).