Statistical Learning

This textbook considers statistical learning applications when interest centers on the conditional distribution of the response variable, given a set of predictors, and when it is important to characterize how the predictors are related to the response. As a first approximation, this can be seen as an extension of nonparametric regression.

This textbook provides an accessible overview of statistical learning methods and techniques, and includes case studies using the statistical software Stata. After introductory material on statistical learning concepts and practical aspects, each further chapter is devoted to a statistical learning algorithm or a group of related techniques. In particular, the book presents logistic regression, regularized linear models such as the Lasso, nearest neighbors, the Naive Bayes classifier, classification trees, random forests, boosting, support vector machines, feature engineering, neural networks, and stacking. It also explains how to construct n-gram variables from text data. Examples, conceptual exercises and exercises using software are featured throughout, together with case studies in Stata, mostly from the social sciences; true to the book’s goal to facilitate the use of modern methods of data science in the field. Although mainly intended for upper undergraduate and graduate students in the social sciences, given its applied nature, the book will equally appeal to readers from other disciplines, including the health sciences, statistics, engineering and computer science.

The inexpensive collection, storage, and transmission of vast amounts of visual data has revolutionized science, technology, and business. Innovations from various disciplines have aided in the design of intelligent machines able to detect and exploit useful patterns in data. One such approach is statistical learning for pattern analysis.

This textbook provides an accessible overview of statistical learning methods and techniques, and includes case studies using the statistical software Stata. After introductory material on statistical learning concepts and practical aspects, each further chapter is devoted to a statistical learning algorithm or a group of related techniques. In particular, the book presents logistic regression, regularized linear models such as the Lasso, nearest neighbors, the Naive Bayes classifier, classification trees, random forests, boosting, support vector machines, feature engineering, neural networks, and stacking. It also explains how to construct n-gram variables from text data. Examples, conceptual exercises and exercises using software are featured throughout, together with case studies in Stata, mostly from the social sciences; true to the book’s goal to facilitate the use of modern methods of data science in the field. Although mainly intended for upper undergraduate and graduate students in the social sciences, given its applied nature, the book will equally appeal to readers from other disciplines, including the health sciences, statistics, engineering and computer science.

An Introduction to Statistical Learning provides an accessible overview of the field of statistical learning, an essential toolset for making sense of the vast and complex data sets that have emerged in fields ranging from biology to finance to marketing to astrophysics in the past twenty years.

The aim of this book is to discuss the fundamental ideas which lie behind the statistical theory of learning and generalization. It considers learning as a general problem of function estimation based on empirical data. Omitting proofs and technical details, the author concentrates on discussing the main results of learning theory and their connections to fundamental problems in statistics. These include: * the setting of learning problems based on the model of minimizing the risk functional from empirical data * a comprehensive analysis of the empirical risk minimization principle including necessary and sufficient conditions for its consistency * non-asymptotic bounds for the risk achieved using the empirical risk minimization principle * principles for controlling the generalization ability of learning machines using small sample sizes based on these bounds * the Support Vector methods that control the generalization ability when estimating function using small sample size.

The most crucial ability for machine learning and data science is mathematical logic for grasping their essence rather than knowledge and experience. This textbook approaches the essence of machine learning and data science by considering math problems and building R programs.

This book describes the important ideas in a variety of fields such as medicine, biology, finance, and marketing in a common conceptual framework. While the approach is statistical, the emphasis is on concepts rather than mathematics. Many examples are given, with a liberal use of colour graphics.