Machine Learning Model Serving Patterns and Best Practices

Table of Contents

1. Introducing Model Serving
2. Introducing Model Serving Patterns
3. Stateless Model Serving
4. Continuous Model Evaluation
5. Keyed Prediction
6. Batch Model Serving Pattern
7. Online Learning Model Serving
8. Two-Phase Model Pattern
9. Pipeline Pattern Model Serving
10. Ensemble Model Serving Pattern
11. Business Logic Pattern
12. Exploring Tensorflow Serving
13. Using Ray Serve
14. Using BentoML
15. Serving ML Models using a Fully Managed Cloud Solution