Documentation

Inference

inference

Methods

Generic Inference ->
InferenceResponse
|
InferenceResponseChunk
post/v5/inference

Generic Inference

Domain types

InferenceCreateResponse =
InferenceResponse
|
InferenceResponseChunk
InferenceResponse = { response, object }
InferenceResponseChunk = { response, object }
LaunchInferenceConfiguration = { num_retries, timeout_seconds }