Optimization for Machine Learning
Gradient methods, stochastic optimization and the training dynamics of large models.
AI-310 Year 3 3 credits 5 lessons planned
Offered by HSM University · Artificial Intelligence
Course content
- 1Gradient descent and convergenceComing
- 2Stochastic gradient methodsComing
- 3Momentum, Adam and adaptive methodsComing
- 4Constrained and convex optimizationComing
- 5Non-convex landscapes and training dynamicsComing
Requirements
Recommended background. You can start any course at any time.
Description
Gradient methods, stochastic optimization and the training dynamics of large models.
Part of the Science stream, typically taken in year 3.