Ng机器学习建议.pdfVIP

Advice for applying Machine Learning Andrew Ng Stanford University Andrew Y. Ng Today’s Lecture • Advice on how getting learning algorithms to different applications. • Most of today’s material is not very mathematical. But it’s also some of the hardest material in this class to understand. • Some of what I’ll say today is debatable. • Some of what I’ll say is not good advice for doing novel machine learning research. • Key ideas: 1. Diagnostics for debugging learning algorithms. 2. Error analyses and ablative analysis. 3. How to get started on a machine learning problem. – Premature (statistical) optimization. Andrew Y. Ng Debugging Learning Algorithms Andrew Y. Ng Debugging learning algorithms Motivating example: • Anti-spam. You carefully choose a small set of 100 words to use as features. (Instead of using all 50000+ words in English.) • Bayesian logistic regression, implemented with gradient descent, gets 20% test error, which is unacceptably high. • What to do next? Andrew Y. Ng Fixing the learning algorithm • Bayesian logistic regression: • Common approach: Try improving the algorithm in different ways. – Try getting more training examples. – Try a smaller set of features. – Try a larger set of features. – Try changing the features: Email header vs. email body features. – Run gradient descent for more iterations. – Try Newton’s method. – Use a different value for λ. – Try using an