Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Context-Aware Complex Human Activity Recognition using Hybrid Deep Learning Models

Version 1 : Received: 24 March 2022 / Approved: 28 March 2022 / Online: 28 March 2022 (12:33:49 CEST)

How to cite: Otebolaku, A.; Omolaja, A. Context-Aware Complex Human Activity Recognition using Hybrid Deep Learning Models. Preprints 2022, 2022030363 (doi: 10.20944/preprints202203.0363.v1). Otebolaku, A.; Omolaja, A. Context-Aware Complex Human Activity Recognition using Hybrid Deep Learning Models. Preprints 2022, 2022030363 (doi: 10.20944/preprints202203.0363.v1).

Abstract

Smart devices such as smartphones, smartwatches, etc. are promising platforms that are being used for automatic recognition of human activities. However, it is difficult to accurately monitor complex human activities due to inter-class pattern similarity, which occurs when different human activities exhibit similar signal patterns or characteristics. Current smartphone-based recognition systems depend on the traditional sensors such as accelerometer and gyroscope, which are inbuilt in these devices. Therefore, apart from using information from the traditional sensors, these systems lack contextual information to support automatic activity recognition. In this article, we explore environment contexts such as illumination(light conditions) and noise level to support sensory data obtained from the traditional sensors using a hybrid of Convolutional Neural Networks and Long Short Time Memory(CNN_LSTM) learning models. The models performed sensor fusion by augmenting the low-level sensor signals with rich contextual data to improve recognition and generalisation ability of the proposed solution. Two sets of experiments were performed to validate the proposed solution. The first set of experiments used inertial sensing data whilst the second set of extensive experiments combined inertial signals with contextual information from environment sensing data. Obtained results demonstrate that contextual information such as environment noise level and illumination using hybrid deep learning models achieved better recognition accuracy than the traditional activity recognition models without contextual information.

Keywords

Contextual information; deep hybrid learning model; activity recognition; Sensors; Smart devices

Subject

MATHEMATICS & COMPUTER SCIENCE, Artificial Intelligence & Robotics

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our diversity statement.

Leave a public comment
Send a private comment to the author(s)
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.