Instructor:  Milos Hauskrecht
Computer Science Department
5329 Sennott Square
phone: x4-8845
e-mail: milos@cs.pitt.edu

Covered topics

Introductory ML papers

• T. Mitchell. Machine learning and data mining (1999)
• T. Dietterich. Machine-Learning Research: Four Current Directions (1997)

Comparison of supervised learning algorithms

• Thomas G. Dietterich. Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms (1998).

Multiway classification

• Tom Dieterich at al. Solving Multiclass Learning Problems via Error-Correcting Output Codes (1995).

SVMs and Kernel method

• Kernel Machines Resources
• C. J.C. Burgess. A tutorial on support vector machines for pattern recognition.
• An introduction to kernel based learning algorithms

Mixture of experts

• Michael Jordan. Hierarchical mixtures of experts and the EM algorithm (1994).

Bagging and Boosting

• L. Breiman. Arcing Classifiers.
• Yoav Freund, Robert E. Schapire. A Short Introduction to Boosting (1999)
• Yoav Freund, Robert E. Schapire.Experiments with a New Boosting Algorithm (1996)
• Robert E. Schapire. Using output codes to boost multiclass learning problems (1997)
• Robert E. Schapire, Yoav Freund, Peter Bartlett, Wee Sun Lee. Boosting the Margin: A New Explanation for the Effectiveness of Voting Methods (1998)
• Thomas G. Dietterich.Ensemble Methods in Machine Learning (2000)

Reinforcement Learning

• Reinforcement Learning repository
• L.P. Kaelbling, M.L. Littman, A. W. Moore. Reinforcement learning: a survey.

Other special topics (not covered in the course)

Text classification

• Mc Callum and Nigam. A Comparison of Event Models for Naive Bayes Text Classification (1998)
• Yiming Yang. An Evaluation of Statistical Approaches to Text Categorization (1997)
• Yiming Yang, Xin Liu. A re-examination of text categorization methods (1999)
• Yiming Yang, Jan O. Pedersen. Comparative Study on Feature Selection in Text Categorization (1997)
• T. Joachims. Text Categorization with Support Vector Machines: Learning with Many Relevant Features (1998)
• Tong Zhang, Frank J. Oles. Text Categorization Based on Regularized Linear Classification Methods (2000).

Link analysis

• Allan Borodin, Gareth O. Roberts, Jeffrey S. Rosenthal. Finding Authorities and Hubs From Link Structures on the World Wide Web (2001).
• Sergey Brin, Lawrence Page. The Anatomy of a Large-Scale Hypertextual Web Search Engine (1998).
• Jon M. Kleinberg. Authoritative Sources in a Hyperlinked Environment (1999).
• R. Lempel, S. Moran. The Stochastic Approach for Link-Structure Analysis (SALSA) and the TKC Effect (2000).
• Andrew Y. Ng, Alice X. Zheng, Michael I. Jordan. Stable Algorithms for Link Analysis (2001).