Skip to main content
Workload the latency and throughput stats measure; defaults to the workload most of the endpoints serve

Example Usage

Values

This is an open enum. Unrecognized values will not fail type checks.
  • "text_generation"
  • "image_generation"
  • "video_generation"
  • "embeddings"
  • "rerank"
  • "tts"
  • "stt"
  • "decisions"
  • "extractions"
  • "unknown"