Monday, April 19, 2004

From Elements of Information Theory by Thomas M. Cover and Joy A. Thomas:

Theorem 2.5.3 (Chain rule for relative entropy): D(p(x,y)||q(x,y))=D(p(x)||q(x))+D(p(y|x)||q(y|x)).
(Note: Yes, the statement of a theorem is a sentence for all relevant purposes).

Instructions:

  1. Grab the nearest book.
  2. Open the book to page 23.
  3. Find the fifth sentence.
  4. Post the text of the sentence in your journal along with these instructions.
(Via Dennis and Scott via join-the-dots).


6:07:11 PM    


© Copyright 2006 Fernando Pereira .
Last update: 8/2/06; 11:11:43 PM .

Click here to visit the Radio UserLand website. Valid CSS! Subscribe to "Fresh Tracks" in Radio UserLand. Click to see the XML version of this web page. Click here to send an email to the editor of this weblog.