A morphological feature estimation method is presented, that can be used to monitor fish from low contrast underwater images and videos. The fish orientation is classified in order to apply a shape alignment technique that is based on the Ensemble of Regression Trees machine learning method. Shape alignment allows the estimation of fish dimensions (length, height, mass) and the location of fish body parts of particular interest such as the eyes and gills. The developed system can be exploited both for fish monitoring in open sea as well as aquacultures where non-invasive, low cost morphological feature extraction is essential. Fish health can be assessed from malformations in body shape, the color of the eyes or the gills as well as the fish behavior. The proposed method can estimate the position of 18 landmarks with an accuracy of about 95% from low resolution and low contrast underwater images where the fish can be hardly distinguished from its background. Hardware acceleration can be applied at various stages of the proposed method for real time video processing. As a case study, the developed system has been trained and tested with several Mediterranean fish species in the category of seabream or similar: diplodous sargus annularis (white seabream), diplodus annularis seabream (spawn), oblada melanura (saddled seabream), pagrus pagrus (common seabream), etc. A large dataset with low resolution underwater videos and images has been created in the context of this work.

A high performance Driver State Monitoring (DSM) application for the detection of driver drowsiness is presented in this paper. It relies on the usage of an Ensemble of Regression Trees (ERTs) machine learning method that aligns 68 facial landmarks. Special focus is given on the acceleration of the frame processing using reconfigurable hardware. Reducing the frame processing latency saves time that can be used to apply frame-to-frame facial shape coherency rules. False face detection and false shape estimations can be ignored for higher robustness and accuracy in the operation of the DSM application without reducing the frame processing rate that can reach 65 frames per second. The sensitivity and precision in yawning recognition can reach 93% and 97%, respectively. The implementation of the employed DSM algorithm in reconfigurable hardware is challenging since the kernel arguments require large data transfers and the degree of data reuse in the computational kernel is low. Due to this, unconventional hardware acceleration techniques have been employed that can also be useful for the acceleration of several other applications.

In this work, an IoT system with edge computing capability is proposed facilitating postoperative surveillance of patients who have undergone knee surgery. The main objective is to reliably identify whether a set of orthopedic rehabilitation exercises are executed correctly, which is critical since, it is often necessary to supervise patients during the rehabilitation period so as to avoid injuries or long recovery periods. The proposed system leverages Internet of Things (IoT) paradigm, in combination with Deep Learning and Edge Computing to classify the extend-flex movement of one’s knee via embedded Machine Learning (ML) classification algorithms. The contribution of the proposed work is multilayered. Furthermore as an outcome of this work a dataset of labeled knee movements is freely available on https://www.kaggle.com/datasets/billskarm/knee-range-of-motion to the research community. It also provides real time movement detection with an accuracy reaching 100%, which is achieved with a ML model trained to fit a low cost, off the shelf, Bluetooth Low Energy platform. The proposed Edge Computing approach allows predictions to be performed on-device rather than solely relying on a cloud service. This yields critical benefits in terms of wireless bandwidth and power conservation, drastically enhancing device autonomy, while delivering reduced event detection latency. In particular, the “on device” implementation is able to yield a drastic 99,9% wireless data transfer reduction, a critical 39% prediction delay reduction and a valuable 17% increase of prediction event. Finally, enhanced privacy comprises another significant benefit from the implemented Edge Computing ML model as sensitive data can be processed on-site and only events or predictions are shared with the medical personnel.