Generative AI Safety, Evaluation and Optimization

Course content

1. 1Threats to generative AI applicationsComing
2. 2Guardrails and content filteringComing
3. 3Protecting sensitive data in prompts and outputsComing
4. 4Governance and responsible AI controlsComing
5. 5Evaluating generative AI outputComing
6. 6Automated and human evaluationComing
7. 7Testing agents and workflowsComing
8. 8Troubleshooting poor answersComing
9. 9Monitoring and observability for generative AIComing
10. 10Optimizing cost and latencyComing
11. 11Caching and model routingComing
12. 12Case study: hardening a generative AI applicationComing

Requirements

• AWS-321 Building Generative AI Applications: RAG and Agents

Recommended background. You can start any course at any time.

Description

Securing and governing generative AI applications, evaluating and testing them, and optimizing cost, latency and quality.