massOfai

Cold Start

Deployment & Infrastructure

Delay when initializing services or models not recently used

What is Cold Start?

Serverless functions and models that aren’t warmed produce higher latency on first requests; mitigations include warm pools and preloading.

Real-World Examples

  • Lambda function cold start