GenAIOps: Infrastructure, Evaluation and Observability

Course content

1. 1From MLOps to GenAIOpsComing
2. 2Foundry projects, identities and private networkingComing
3. 3Deploying Foundry with Bicep and the CLIComing
4. 4Serverless and managed compute deploymentsComing
5. 5Provisioned throughputComing
6. 6Versioning prompts with GitComing
7. 7Building evaluation datasetsComing
8. 8Groundedness, relevance, coherence and fluencyComing
9. 9Risk and safety evaluationsComing
10. 10Automated evaluation workflowsComing
11. 11Monitoring latency, tokens and costComing
12. 12Tracing and debugging generative systemsComing

Requirements

• MSAZ-260 MLOps Infrastructure on Azure Machine Learning

Recommended background. You can start any course at any time.

Description

Foundry infrastructure for generative AI, model deployment and versioning, prompt management, evaluation and monitoring.