Top Machine Learning Algorithms

Linear Regression & Gradient Descent

Gradient descent algorithm

X is the input vector, while Y is the label.

w are training weights, while b is a bias.

Predict result:

Relevant reading materials:

  1. Pattern Recognition and Machine Learning (Information Science and Statistics) by Christopher M. Bishop – Chapter 3. Linear Models for Regression (p.137 – p.178)

  2. Deep Learning by Ian Goodfellow, Yoshua Bengio, Aaron Courville- Chapter 5.1.4. Example: Linear Regression


Relevant video lectures:

  1. Andrew Ng’s – Lecture 2.1 – 2.7 Linear Regression