Matrix Calculus

The video animates the core concepts of matrix calculus, showing how the gradient of a quadratic form is derived and visualized on contour plots, including the specific case where the matrix is not symmetric. It then demonstrates least-squares gradient descent, illustrating how the step size affects convergence versus divergence, before summarizing the key identities.