Mirror mirror on the wall... an unobtrusive intelligent multisensory mirror for well-being status self-assessment and visualization

Henriquez Castellano, Pedro orcid iconORCID: 0000-0001-6582-5351, Matuszewski, Bogdan J. orcid iconORCID: 0000-0001-7195-2509, Andreu-Cabedo, Yasmina, Bastiani, Luca, Colantonio, Sara, Coppini, Giuseppe, D'Acunto, Mario, Favilla, Riccardo, Germanese, Danila et al (2017) Mirror mirror on the wall... an unobtrusive intelligent multisensory mirror for well-being status self-assessment and visualization. IEEE Transactions on Multimedia, 19 (7). pp. 1467-1481. ISSN 1520-9210

[thumbnail of Author Accepted Manuscript]
Preview
PDF (Author Accepted Manuscript) - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

2MB

Official URL: https://doi.org/10.1109/TMM.2017.2666545

Abstract

A person’s well-being status is reflected by their face through a combination of facial expressions and physical signs. The SEMEOTICONS project translates the semeiotic code of the human face into measurements and computational descriptors that are automatically extracted from images, videos and 3D scans of the face. SEMEOTICONS developed a multisensory platform in the form of a smart mirror to identify signs related to cardio-metabolic risk. The aim was to enable users to self-monitor their well-being status over time and guide them to improve their lifestyle. Significant scientific and technological challenges have been addressed to build the multisensory mirror, from touchless data acquisition, to real-time processing and integration of multimodal data.


Repository Staff Only: item control page