Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Multimedia Retrieval and Analysis with Cottontail DB

Published: 19 December 2022 Publication History

Abstract

Analysis and retrieval of media collections get more and more challenging the larger the collections become. Keeping everything in the main memory becomes less feasible, and more and more time and effort have to be spent to deal with the data management. However, traditional relational databases do not support primitives often used in multimedia workloads, such as the nearest-neighbour search on vectors. In this column, we introduce Cottontail DB, an open-source database management system for multimedia features. Cottontail DB supports traditional relational database operations and text retrieval based on Lucene and, most importantly, efficient vector-space retrieval operations for large datasets. Cottontail DB is the new data storage system powering the vitrivr multimedia retrieval stack, which was also previously featured in the SIGMM Records [7]. Just like the other components of vitrivr, Cottontail DB is released under the permissive MIT license. It is written in Kotlin, runs on all major operating systems, and comes with a flexible and easy-to-use gRPC API, which makes it usable in many applications, independent of the programming languages used. Cottontail DB's clean and modular architecture enables the easy extension of its functionalities and also makes it useful in an educational context. In the following, we will give a brief introduction on how Cottontail DB works, what we are using it for, and, most importantly, how it can help you manage your data. To learn more about Cottontail DB, including performance evaluations, we kindly refer readers to our Open Source Software Track Contribution at ACM MM 2020 [1], where Cottontail DB was honored with that year's Best Open Source Award.

References

[1]
Gasser, R., Rossetto, L., Heller, S., & Schuldt, H. Cottontail DB: An Open Source Database System for Multimedia Retrieval and Analysis. MM '20: The 28th ACM International Conference on Multimedia, Virtual Event / Seattle, WA, USA, October 12-16, 2020.
[2]
Gasser, R., Rossetto, L., & Schuldt, H. (2019). Multimodal multimedia retrieval with Vitrivr. Proceedings of the 2019 on International Conference on Multimedia Retrieval, 391--394.
[3]
Gurrin, C., Le, T.-K., Ninh, V.-T., Dang-Nguyen, D.-T., Jónsson, B. Ó., Lokoc, J., Hurst, W., Tran, M.-T., & Schoeffmann, K. (2020). An Introduction to the Third Annual Lifelog Search Challenge, LSC'20. International Conference on Multimedia Retrieval. ACM.
[4]
Heller, S., Amiri Parian, M., Gasser, R., Sauter, L., & Schuldt, H. (2020). Interactive lifelog retrieval with vitrivr. Proceedings of the Third Annual Workshop on Lifelog Search Challenge.
[5]
Heller, S., Gasser, R., Illi, C., Pasquinelli, M., Sauter, L., Spiess, F., & Schuldt, H. (2021). Towards explainable interactive multi-modal video retrieval with vitrivr. International Conference on Multimedia Modeling. https://rdcu.be/chwVs
[6]
Jegou, H., Douze, M., & Schmid, C. (2010). Product quantization for nearest neighbor search. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(1), 117--128.
[7]
Rossetto, L., Giangreco, I., Gasser, R., & Schuldt, H. (2018). Open-source column: content-based multimedia retrieval using vitrivr. ACM SIGMultimedia Records, 9(3).
[8]
https://github.com/vitrivr/cottontaildb, last accessed 2021-03-25
[9]
https://github.com/vitrivr/cottontaildb/releases/, last accessed 2021-03-25
[10]
https://hub.docker.com/r/vitrivr/cottontaildb, last accessed 2021-03-25
[11]
https://github.com/vitrivr/cottontaildb/wiki, last accessed 2021-03-25
[12]
https://grpc.io/, last accessed 2021-03-25
[13]
https://github.com/vitrivr/cottontaildb-proto, last accessed 2021-03-25
[14]
https://github.com/vitrivr/cottontaildb-examples, last accessed 2021-03-25

Cited By

View all
  • (2023)Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021IEEE Access10.1109/ACCESS.2023.324828411(30982-30995)Online publication date: 2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMultimedia Records
ACM SIGMultimedia Records  Volume 13, Issue 1
March 2021
6 pages
EISSN:1947-4598
DOI:10.1145/3577934
Issue’s Table of Contents
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 December 2022
Published in SIGMM Volume 13, Issue 1

Check for updates

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021IEEE Access10.1109/ACCESS.2023.324828411(30982-30995)Online publication date: 2023

View Options

Login options

View options

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media