What is Gradient Decent used for? What are the basic steps of Gradient Decent?

What is Gradient Decent used for?

Gradient decent is used to find the minimized values for a function, in which we simultaneously update our theta values so as not to skew our algorithm.

What are the basic steps of Gradient Decent?

1. Set our parameters equal to arbitrary values.
2. Change our thetas to reduce J(theta) until we hopefully end up a a minimum.
3.We then as which direction we can take a "baby step" in to take us "down hill" more quickly.
4. Repeat step 2 and 3 until we reach a minimum.


Learn More :