From model to inference.
Connect model configuration, serving resources, and traffic requirements.
A foundation for inference.
Define the model, its runtime, and the requests it needs to handle. Use those requirements to shape your serving configuration.
Model requirements
Serving configuration
Traffic expectations