Model Serving
MLOps
Making models available for inference
What is Model Serving?
Systems and APIs that expose trained models for predictions, including scaling, batching, and health checks.
Real-World Examples
- •TensorFlow Serving
- •TorchServe
- •FastAPI endpoints
Related Terms
Learn more about concepts related to Model Serving