机器学习 docs_slides_Lecture2.ppt

Linear regression with one variable Model representation Machine Learning Housing Prices (Portland, OR) Price (in 1000s of dollars) Size (feet2) Supervised Learning Given the “right answer” for each example in the data. Regression Problem Predict real-valued output Notation: m = Number of training examples x’s = “input” variable / features y’s = “output” variable / “target” variable Size in feet2 (x) Price ($) in 1000s (y) 2104 460 1416 232 1534 315 852 178 … … Training set of housing prices (Portland, OR) Training Set Learning Algorithm h Size of house Estimated price How do we represent h ? Linear regression with one variable. Univariate linear regression. Cost function Machine Learning Linear regression with one variable How to choose ‘s ? Training Set Hypothesis: ‘s: Parameters Size in feet2 (x) Price ($) in 1000s (y) 2104 460 1416 232 1534 315 852 178 … … y x Cost functionintuition I Machine Learning Linear regression with one variable Hypothesis: Parameters: Cost Function: Goal: Simplified y x (for fixed , this is a function of x) (function of the parameter ) y x (for fixed , this is a function of x) y x (for fixed , this is a function of x) Cost functionintuition II Machine Learning Linear regression with one variable Hypothesis: Parameters: Cost Function: Goal: (for fixed , this is a function of x) (function of the parameters ) Price ($) in 1000’s Size in feet2 (x) (for fixed , this is a function of x) (function of the parameters ) (for fixed , this is a function of x) (function of the parameters ) (for fixed , this is a function of x) (function of the parameters ) (for fixed , this is a function of x) (function of the parameters ) Gradient descent Machine Learning Linear regression with one variable Have some function Want Outline: Start with some Keep changing to reduce until we h