5. Why?
Because most of your ML system is
not about the ML code.
Data Verification
Serving
Infrastructure
Configuration Data Collection
Feature Extraction
Process Management Tools
Analysis Tools
Monitoring
Machine Resource
Management
ML Code
Hidden Technical Debt in Machine Learning Systems (2015): https://papers.nips.cc/paper/2015/file/86df7dcfd896fcaf2674f757a2463eba-Paper.pdf
Needed to
materialize
value
6. The goal of MLOps is to reduce technical friction
to get the model from an idea into production in
the shortest possible time with as little risk as
possible.
9. Process
A few shared principles will take you a long way…
ML should be
collaborative.
ML should be
reproducible.
ML should be
continuous.
ML should be tested
& monitored.
10. Tooling
And tooling will help implement your process.
ML should be
collaborative.
ML should be
reproducible.
ML should be
continuous.
ML should be tested
& monitored.
Shared
Infrastructure
Versioning for Code,
Data and Metadata
Machine Learning
Pipelines
Model Deployment
and Monitoring
11. Time Risk
Short-term thinking
Long-term thinking
Do it fast Do it safe
Time
Do it right So it’ll be faster
next time
Risk
Avoid the “It’s too early for MLOps” trap.
12. Data analysis
ML pipeline Model serving
Model monitoring
Experimentation
Feature store
Metadata store
Model registry
Code repository
The MLOps Stack
provides one way to
think about what
tooling you might
need.
Download template:
valohai.com/mlops
13. Data analysis
ML pipeline Model serving
Model monitoring
Experimentation
Feature store
Metadata store
Model registry
Code repository
Considerations:
Self-Managed Tools
vs
Managed Tools
Point Solutions
vs
End-to-End Platforms
Download template:
valohai.com/mlops
14. The MLOps tools are aplenty…
but so are the requirements.
Self-driving car vs
recommendation
engine
Citizen data scientists
vs seasoned engineers
Healthcare & fintech vs
mobile gaming
Bootstrapping vs
well-funded
Use Case Team & skills Regulation Other resources