LLMOps

Prompt, Model, Tool, and Retrieval Versioning

Treat LLM behavior as a release artifact by versioning prompts, model snapshots, tool schemas, retrieval configs, and eval sets together.

Recommended on day 5180 minutesIntermediate

Learning objectives

  • • Define the release unit for an LLM product
  • • Pin model versions and document upgrade criteria
  • • Rollback prompt, retrieval, and tool changes coherently

Interview prompts

  • • What exactly should be versioned in a production LLM app?
  • • How do you roll back a bad prompt release?