How do we implement an iteration step when calculating Gradient Descent in code?
Answer:
- At each iteration j, one should simultaneously update the parameters.
- Updating a specific parameter prior to calculating another one on the j iteration would yield to a wrong implementation.