===== 13 - Information theory, statistics, and decision trees ======

April 6th, 2010

=== Slides ===

[[cos424>slides/13-info.pdf|PDF]] [[cos424>slides/13-info.djvu|DJVU]]   

=== Scribe Notes ===

FIXME

=== Summary ===

   * Basic information theory.
   * Decision trees.
   * Information theory and statistics. 

=== Readings ===

   * (optional) Chris Bishop: Information Theory. //Pattern Recognition and Machine Learning//, section 1.6, pages 48-58.

   * (optional) Andrew Moore: //[[http://www.autonlab.org/tutorials/dtree.html|Decision Trees]]//. Tutorial slides.

=== Books ===

   * David MacKay: //[[http://www.inference.phy.cam.ac.uk/itprnn/book.html|Information Theory, Inference, and Learning Algorithms]]//. Cambridge University Press, 2003