UNLIMITED
Pachyderm with Daniel Whitenack - Episode 1 by Data Engineering PodcastUNLIMITED
Optimize Your Machine Learning Development And Serving With The Open Source Vector Database Milvus
UNLIMITED
Optimize Your Machine Learning Development And Serving With The Open Source Vector Database Milvus
ratings:
Length:
59 minutes
Released:
Aug 6, 2022
Format:
Podcast episode
Description
The optimal format for storage and retrieval of data is dependent on how it is going to be used. For analytical systems there are decades of investment in data warehouses and various modeling techniques. For machine learning applications relational models require additional processing to be directly useful, which is why there has been a growth in the use of vector databases. These platforms store direct representations of the vector embeddings that machine learning models rely on for computing relevant predictions so that there is no additional processing required to go from input data to inference output. In this episode Frank Liu explains how the open source Milvus vector database is implemented to speed up machine learning development cycles, how to think about proper storage and scaling of these vectors, and how data engineering and machine learning teams can collaborate on the creation and maintenance of these data sets.
Released:
Aug 6, 2022
Format:
Podcast episode
Titles in the series (100)
- 45 min listen