LLMOps

Prompt, Model, Tool, and Retrieval Versioning

Treat LLM behavior as a release artifact by versioning prompts, model snapshots, tool schemas, retrieval configs, and eval sets together.

Recommended on day 5180 minutesIntermediate

Learning objectives

  • Define the release unit for an LLM product
  • Pin model versions and document upgrade criteria
  • Rollback prompt, retrieval, and tool changes coherently

Interview prompts

  • What exactly should be versioned in a production LLM app?
  • How do you roll back a bad prompt release?