"Kolmogorov complexity provides a theoretical foundation for induction and machine learning. This is the classic introduction. Quite heavy but worth persevering."
"Deals with the often overlooked issue of calibrating the reliability of learning algorithms. This book provides a framework for algorithms that control risk of error through hedged predictions."
"Well-written account of using the kernel method in machine learning and learning theory. Several kernelized algorithms are discussed including SVM, discriminant analysis and PCA."