Multimedia Knowledge and Social Media Analytics Laboratory


DigiArt: The Internet Of Historical Things And Building New 3D Cultural Worlds

DigiArt seeks to provide a new, cost efficient solution to the capture, processing and display of cultural artefacts. It offers innovative 3D capture systems and methodologies, including aerial capture via drones, automatic registration and modeling techniques to speed up post-capture processing (which is a major bottleneck), semantic image analysis to extract features from digital 3D representations, a “story telling engine” offering a pathway to a deeper understanding of art, and also augmented/virtual reality technologies offering advanced abilities for viewing, or interacting with the 3D models. The 3D data captured by the scanners and drones, using techniques such as laser detection and ranging (LIDAR), are processed through robust features that cope with imperfect data. Semantic analysis by automatic feature extraction is used to form hyper-links between artefacts. These links are employed to connect the artefacts in what the project terms “the internet of historical things”, available anywhere, at any time, on any web-enabled device. The contextual view of art is very much enhanced by the “story telling engine” that is developed within the project. The system presents the artefact, linked to its context, in an immersive display with virtual and/or with augmented reality. Linkages and information are superimposed over the view of the item itself.

The major output of the project is the toolset that will be used by museums to create such a revolutionary way of viewing and experiencing artefacts. These tools leverage the interdisciplinary skill sets of the partners to cover the complete process, namely data capture, data processing, story building, 3D visualization and 3D interaction, offering new pathways to deeper understanding of European culture. Via its three demonstration activities, the project establishes the viability of the approach in three different museum settings, offering a range of artefacts posing different challenges to the system.