UNIverse - Public Research Portal

Selected Publications

Spiess, F., Scharowski, N., Haller, A., Memeti, Z., Schuldt, H., & Brühlmann, F. (2024). Bringing Video Browsing to Virtual Reality: Empirical Evaluation of a Novel Multimedia Drawer [Proceedings-article]. 293–301. https://doi.org/10.1145/3652583.3658077

URLs

URLs

Cornut, Murielle, Raemy, Julien Antoine, & Spiess, Florian. (2023). Annotations as Knowledge Practices in Image Archives: Application of Linked Open Usable Data and Machine Learning. ACM Journal on Computing and Cultural Heritage, 16(4), 1–19. https://doi.org/10.1145/3625301

URLs

URLs

Spiess, Florian, Gasser, Ralph, Heller, Silvan, Schuldt, Heiko, & Rossetto, Luca. (2023). A Comparison of Video Browsing Performance between Desktop and Virtual Reality Interfaces. 535–539. https://doi.org/10.1145/3591106.3592292

URLs

URLs

Heller, S., Gsteiger, V., Bailer, W., Gurrin, C., Jónsson, B. Þ., Lokoč, J., Leibetseder, A., Mejzlík, F., Peška, L., Rossetto, L., Schall, K., Schoeffmann, K., Schuldt, H., Spiess, F., Tran, L.-D., Vadicamo, L., Veselý, P., Vrochidis, S., & Wu, J. (2022). Interactive video retrieval evaluation at a distance: comparing sixteen interactive video search systems in a remote setting at the 10th Video Browser Showdown. International Journal of Multimedia Information Retrieval, 11(1). https://doi.org/10.1007/s13735-021-00225-2

URLs

URLs

Selected Projects & Collaborations

Participatory Knowledge Practices in Analog and Digital Image Archives

Research Project | 2 Project Members

The common goal of this project is to design a visual interface with machine learning-based tools to make it easy to annotate, contextualize, organize, and link both images and their meta-information, to deliberately encourage the participatory use of archives. In a series of workshops and interviews with both academic and non-academic users, along with archivists and database specialists, the project will analyze the new demands of digital (and process-oriented) knowledge production in order to achieve these goals. In their own rubric - Citizen Archive - academic and non-academic users of the existing Swiss Society for Folklore Studies SSFS's (Schweizerische Gesellschaft für Volkskunde SGV) networks and partners will receive a series of Calls for Images inviting them to upload and comment current photographs as comments on historical images; this will further foster the contextualization of the archival material. In turn, these digital additions will have to be supplied with metadata and contextual knowledge. Such analysis of the context of images and collections (crowdsourcing) will enrich the metadata of the material and thus also make image searching and information retrieval more effective. Along with the design of the participatory digital image archive, this four-year research project will describe the transformation of analog archives into digital archives from the perspective of technology, communication, and the anthropology of knowledge. The common goal is the analysis and systematic description of historical and contemporary archiving practices: the generation, organization, storage, and communication of knowledge. The complex interplay of participants, epistemological orders, and the genesis and graphical representation of information and knowledge in such practices will be studied in connection with three collections from the photo archive of the Swiss Society for Folklore Studies. In previous research, these areas were mostly considered separately rather than from an interdisciplinary, cross-domain and application-oriented perspective that can capture such interplay. In contrast, the proposed project's interdisciplinary collaboration between digital humanities, cultural anthropology, and design research will serve our goal of increasing, improving, and imparting knowledge of analog and especially digital image archives and of ways to use them. As its common primary outputs, the project will produce not only the visual interface discussed above, a dynamic storage infrastructure, but also a handbook with guidelines for the future development of participatory archives as well as six dissertations and several scientific papers in the various disciplines.

vitrivr-VR

Research Project | 6 Project Members

The vitrivr-VR project aims at providing a novel and innovative Virtual Reality-based user interface to multimedia search engines, allowing advanced user interactions.

VIRTUE (VIRTUal Exhibition hall)

Research Project | 5 Project Members

The digitization of museum exhibits has raised the question of how to make these objects accessible, particularly in light of the ever growing collections being available. The VIRTUE (VIRTUal Exhibition hall) project allows curators to easily set up virtual museum exhibitions of static and dynamic 2D (paintings, photographs, videos, etc.) and 3D artifacts. Visitors may navigate through the virtual rooms, inspect the artifacts and interact with them in novel ways.

vitrivr

Research Project | 6 Project Members

With the tremendous increase of video recording devices and the resulting abundance of digital video, finding a particular video sequence in ever-growing collections is more and more becoming a major challenge. Existing approaches to retrieve videos mostly still rely on text-based retrieval techniques to find desired sequences. With vitrivr , we have open sourced our Cineast retrieval engine and the ADAM database back-end in order to encourage a large and creative community of open source developers to actively participate in the development.