Session abstract

This special session aims at presenting the most recent works and applications in the area of multimedia analysis and digital health solutions in medical domains and pervasive environments. More specifically, multimedia research is becoming more and more important for the medical domain, where an increasing number of videos and images are integrated in the daily routine of surgical and diagnostic work. This includes management and inspection of the data, visual analytics, as well as learning relevant semantics and using recognition results for optimizing surgical and diagnostic processes. At the same time, pervasive technologies and eHealth systems seem to offer a promising solution for accessible and affordable self-management of health problems. Specifically, multiple layers of intelligence could transform wearable devices, smart home equipment and multimedia information into meaningful behavioral monitoring, including activity recognition. In turn, trends and patterns can be highlighted while the user model and situation can deliver intuitive, personalised and context-aware spoken feedback.

This special session provides the opportunity to discuss specific research and technical topics in the aforementioned areas, sharing results and practical development experiences. It is a continuation of the MULTIMED2020 special session that has been successfully organised in MMM2020.


Research topics of interest for this special session include, but are not limited to:

  • Multimedia indexing and retrieval for multimodal interaction in the health domain
  • Multimedia indexing and retrieval with video recordings from medical endoscopy
  • Multimodal conversation and dialogue systems for social companion agents
  • Speech and audio analysis and retrieval
  • Video content exploration in endoscopic video
  • Speech and audio analysis and retrieval for health applications
  • Fusion of multimodal information for health and care-giving applications
  • Semantic web approaches for multimedia health applications
  • Semantic Web technologies in eHealth, mHealth, uHealth, Ambient Assisted Living and medical applications
  • Semantic reasoning of health multimedia data in interactive systems
  • Semantically-enriched situation awareness in smart homes
  • Semantic interoperability in IoT platforms, sensors, mobile and wearable devices in pervasive environments
  • Knowledge modelling, interpretation, context-awareness in pervasive environments
  • Activity recognition based under uncertainty, noise and incomplete data
  • Multimodal analytics for human machine interaction in the health domain
  • Web and social media retrieval for knowledge-based social companion applications
  • Multimodal conversation, dialogue systems and personal coaches
  • Facial analysis and gesture recognition in social agents
  • Intelligent user interfaces for multimedia retrieval
  • Multilingual and multimodal communication in interactive basic care and health assistive systems

Information for authors

We seek high-quality research papers with a length of up to 12 pages. The special session aims at including primarily oral presentations. In case we receive more quality submissions, we will consider separation of accepted papers into oral and poster presentations.

All papers must represent original and unpublished work that is not currently under review. Special session papers will supplement the regular research papers and be included in the proceedings of MMM 2021. Paper submissions must conform to the formatting instructions of Springer Verlag, LNCS series and they will be peer-reviewed in a double-blind review process; thus, the submissions need to be properly anonymized. Each contribution must be associated with one full conference registration; only one contribution can be associated with each registration.

For more information on submitting a paper to the special session, please visit the Authors Guidelines page of the main MMM conference.


  • Georgios Meditskos, Centre for Research and Technology Hellas, Information Technologies Institute
  • Klaus Schoeffmann, Klagenfurt University
  • Leo Wanner, ICREA – Universitat Pompeu Fabra
  • Stefanos Vrochidis, Centre for Research and Technology Hellas, Information Technologies Institute
  • Athanasios Tzioufas, Medical School of the National and Kapodistrian University of Athens

Supported by