Automatic Museum Audio Guide

An automatic “museum audio guide” is presented as a new type of audio guide for museums. The device consists of a headset equipped with a camera that captures exhibit pictures and the eyes of things computer vision device (EoT). The EoT board is capable of recognizing artworks us...

Full description

Bibliographic Details
Main Authors: Noelia Vallez, Stephan Krauss, Jose Luis Espinosa-Aranda, Alain Pagani, Kasra Seirafi, Oscar Deniz
Format: Article
Language:English
Published: MDPI AG 2020-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/3/779
id doaj-774822822fa1443db03f44f76c13f332
record_format Article
spelling doaj-774822822fa1443db03f44f76c13f3322020-11-25T03:32:40ZengMDPI AGSensors1424-82202020-01-0120377910.3390/s20030779s20030779Automatic Museum Audio GuideNoelia Vallez0Stephan Krauss1Jose Luis Espinosa-Aranda2Alain Pagani3Kasra Seirafi4Oscar Deniz5Visilab (Vision and Artificial Intelligence Group), University of Castilla-La Mancha (UCLM), E.T.S.I. Industrial, Avda Camilo Jose Cela s/n, 13071 Ciudad Real, SpainDFKI (Deutsches Forschungszentrum für Künstliche Intelligenz), Augmented Vision Research Group, Tripstaddterstr. 122, 67663 Kaiserslautern, GermanyVisilab (Vision and Artificial Intelligence Group), University of Castilla-La Mancha (UCLM), E.T.S.I. Industrial, Avda Camilo Jose Cela s/n, 13071 Ciudad Real, SpainDFKI (Deutsches Forschungszentrum für Künstliche Intelligenz), Augmented Vision Research Group, Tripstaddterstr. 122, 67663 Kaiserslautern, GermanyFluxguide, Burggasse 7-9/9, 1070 Vienna, AustriaVisilab (Vision and Artificial Intelligence Group), University of Castilla-La Mancha (UCLM), E.T.S.I. Industrial, Avda Camilo Jose Cela s/n, 13071 Ciudad Real, SpainAn automatic “museum audio guide” is presented as a new type of audio guide for museums. The device consists of a headset equipped with a camera that captures exhibit pictures and the eyes of things computer vision device (EoT). The EoT board is capable of recognizing artworks using features from accelerated segment test (FAST) keypoints and a random forest classifier, and is able to be used for an entire day without the need to recharge the batteries. In addition, an application logic has been implemented, which allows for a special highly-efficient behavior upon recognition of the painting. Two different use case scenarios have been implemented. The main testing was performed with a piloting phase in a real world museum. Results show that the system keeps its promises regarding its main benefit, which is simplicity of use and the user’s preference of the proposed system over traditional audioguides.https://www.mdpi.com/1424-8220/20/3/779internet of things (iot)computer visionautomatic audioguideartificial intelligencesystems on chip (soc)
collection DOAJ
language English
format Article
sources DOAJ
author Noelia Vallez
Stephan Krauss
Jose Luis Espinosa-Aranda
Alain Pagani
Kasra Seirafi
Oscar Deniz
spellingShingle Noelia Vallez
Stephan Krauss
Jose Luis Espinosa-Aranda
Alain Pagani
Kasra Seirafi
Oscar Deniz
Automatic Museum Audio Guide
Sensors
internet of things (iot)
computer vision
automatic audioguide
artificial intelligence
systems on chip (soc)
author_facet Noelia Vallez
Stephan Krauss
Jose Luis Espinosa-Aranda
Alain Pagani
Kasra Seirafi
Oscar Deniz
author_sort Noelia Vallez
title Automatic Museum Audio Guide
title_short Automatic Museum Audio Guide
title_full Automatic Museum Audio Guide
title_fullStr Automatic Museum Audio Guide
title_full_unstemmed Automatic Museum Audio Guide
title_sort automatic museum audio guide
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-01-01
description An automatic “museum audio guide” is presented as a new type of audio guide for museums. The device consists of a headset equipped with a camera that captures exhibit pictures and the eyes of things computer vision device (EoT). The EoT board is capable of recognizing artworks using features from accelerated segment test (FAST) keypoints and a random forest classifier, and is able to be used for an entire day without the need to recharge the batteries. In addition, an application logic has been implemented, which allows for a special highly-efficient behavior upon recognition of the painting. Two different use case scenarios have been implemented. The main testing was performed with a piloting phase in a real world museum. Results show that the system keeps its promises regarding its main benefit, which is simplicity of use and the user’s preference of the proposed system over traditional audioguides.
topic internet of things (iot)
computer vision
automatic audioguide
artificial intelligence
systems on chip (soc)
url https://www.mdpi.com/1424-8220/20/3/779
work_keys_str_mv AT noeliavallez automaticmuseumaudioguide
AT stephankrauss automaticmuseumaudioguide
AT joseluisespinosaaranda automaticmuseumaudioguide
AT alainpagani automaticmuseumaudioguide
AT kasraseirafi automaticmuseumaudioguide
AT oscardeniz automaticmuseumaudioguide
_version_ 1724566781354311680