Mathematical Foundations of Infinite-Dimensional Statistical Models

Mathematical Foundations of Infinite-Dimensional Statistical Models PDF Author: Evarist Giné
Publisher: Cambridge University Press
ISBN: 1009022784
Category : Mathematics
Languages : en
Pages : 706

Get Book

Book Description
In nonparametric and high-dimensional statistical models, the classical Gauss–Fisher–Le Cam theory of the optimality of maximum likelihood estimators and Bayesian posterior inference does not apply, and new foundations and ideas have been developed in the past several decades. This book gives a coherent account of the statistical theory in infinite-dimensional parameter spaces. The mathematical foundations include self-contained 'mini-courses' on the theory of Gaussian and empirical processes, approximation and wavelet theory, and the basic theory of function spaces. The theory of statistical inference in such models - hypothesis testing, estimation and confidence sets - is presented within the minimax paradigm of decision theory. This includes the basic theory of convolution kernel and projection estimation, but also Bayesian nonparametrics and nonparametric maximum likelihood estimation. In a final chapter the theory of adaptive inference in nonparametric models is developed, including Lepski's method, wavelet thresholding, and adaptive inference for self-similar functions. Winner of the 2017 PROSE Award for Mathematics.

Mathematical Foundations of Infinite-Dimensional Statistical Models

Mathematical Foundations of Infinite-Dimensional Statistical Models PDF Author: Evarist Giné
Publisher: Cambridge University Press
ISBN: 1009022784
Category : Mathematics
Languages : en
Pages : 706

Get Book

Book Description
In nonparametric and high-dimensional statistical models, the classical Gauss–Fisher–Le Cam theory of the optimality of maximum likelihood estimators and Bayesian posterior inference does not apply, and new foundations and ideas have been developed in the past several decades. This book gives a coherent account of the statistical theory in infinite-dimensional parameter spaces. The mathematical foundations include self-contained 'mini-courses' on the theory of Gaussian and empirical processes, approximation and wavelet theory, and the basic theory of function spaces. The theory of statistical inference in such models - hypothesis testing, estimation and confidence sets - is presented within the minimax paradigm of decision theory. This includes the basic theory of convolution kernel and projection estimation, but also Bayesian nonparametrics and nonparametric maximum likelihood estimation. In a final chapter the theory of adaptive inference in nonparametric models is developed, including Lepski's method, wavelet thresholding, and adaptive inference for self-similar functions. Winner of the 2017 PROSE Award for Mathematics.

Probability with Martingales

Probability with Martingales PDF Author: David Williams
Publisher: Cambridge University Press
ISBN: 9780521406055
Category : Mathematics
Languages : en
Pages : 274

Get Book

Book Description
This is a masterly introduction to the modern, and rigorous, theory of probability. The author emphasises martingales and develops all the necessary measure theory.

Statistics for High-Dimensional Data

Statistics for High-Dimensional Data PDF Author: Peter Bühlmann
Publisher: Springer Science & Business Media
ISBN: 364220192X
Category : Mathematics
Languages : en
Pages : 558

Get Book

Book Description
Modern statistics deals with large and complex data sets, and consequently with models containing a large number of parameters. This book presents a detailed account of recently developed approaches, including the Lasso and versions of it for various models, boosting methods, undirected graphical modeling, and procedures controlling false positive selections. A special characteristic of the book is that it contains comprehensive mathematical theory on high-dimensional statistics combined with methodology, algorithms and illustrations with real data examples. This in-depth approach highlights the methods’ great potential and practical applicability in a variety of settings. As such, it is a valuable resource for researchers, graduate students and experts in statistics, applied mathematics and computer science.

High-Dimensional Probability

High-Dimensional Probability PDF Author: Roman Vershynin
Publisher: Cambridge University Press
ISBN: 1108415199
Category : Business & Economics
Languages : en
Pages : 299

Get Book

Book Description
An integrated package of powerful probabilistic tools and key applications in modern mathematical data science.

Probabilistic Symmetries and Invariance Principles

Probabilistic Symmetries and Invariance Principles PDF Author: Olav Kallenberg
Publisher: Springer Science & Business Media
ISBN: 9780387251158
Category : Mathematics
Languages : en
Pages : 536

Get Book

Book Description
This is the first comprehensive treatment of the three basic symmetries of probability theory—contractability, exchangeability, and rotatability—defined as invariance in distribution under contractions, permutations, and rotations. Originating with the pioneering work of de Finetti from the 1930's, the theory has evolved into a unique body of deep, beautiful, and often surprising results, comprising the basic representations and invariance properties in one and several dimensions, and exhibiting some unexpected links between the various symmetries as well as to many other areas of modern probability. Most chapters require only some basic, graduate level probability theory, and should be accessible to any serious researchers and graduate students in probability and statistics. Parts of the book may also be of interest to pure and applied mathematicians in other areas. The exposition is formally self-contained, with detailed references provided for any deeper facts from real analysis or probability used in the book. Olav Kallenberg received his Ph.D. in 1972 from Chalmers University in Gothenburg, Sweden. After teaching for many years at Swedish universities, he moved in 1985 to the US, where he is currently Professor of Mathematics at Auburn University. He is well known for his previous books Random Measures (4th edition, 1986) and Foundations of Modern Probability (2nd edition, 2002) and for numerous research papers in all areas of probability. In 1977, he was the second recipient ever of the prestigious Rollo Davidson Prize from Cambridge University. In 1991–94, he served as the Editor in Chief of Probability Theory and Related Fields. Professor Kallenberg is an elected fellow of the Institute of Mathematical Statistics.

Fundamentals of Nonparametric Bayesian Inference

Fundamentals of Nonparametric Bayesian Inference PDF Author: Subhashis Ghosal
Publisher: Cambridge University Press
ISBN: 0521878268
Category : Business & Economics
Languages : en
Pages : 671

Get Book

Book Description
Bayesian nonparametrics comes of age with this landmark text synthesizing theory, methodology and computation.

Statistical Foundations of Data Science

Statistical Foundations of Data Science PDF Author: Jianqing Fan
Publisher: CRC Press
ISBN: 1466510854
Category : Mathematics
Languages : en
Pages : 752

Get Book

Book Description
Statistical Foundations of Data Science gives a thorough introduction to commonly used statistical models, contemporary statistical machine learning techniques and algorithms, along with their mathematical insights and statistical theories. It aims to serve as a graduate-level textbook and a research monograph on high-dimensional statistics, sparsity and covariance learning, machine learning, and statistical inference. It includes ample exercises that involve both theoretical studies as well as empirical applications. The book begins with an introduction to the stylized features of big data and their impacts on statistical analysis. It then introduces multiple linear regression and expands the techniques of model building via nonparametric regression and kernel tricks. It provides a comprehensive account on sparsity explorations and model selections for multiple regression, generalized linear models, quantile regression, robust regression, hazards regression, among others. High-dimensional inference is also thoroughly addressed and so is feature screening. The book also provides a comprehensive account on high-dimensional covariance estimation, learning latent factors and hidden structures, as well as their applications to statistical estimation, inference, prediction and machine learning problems. It also introduces thoroughly statistical machine learning theory and methods for classification, clustering, and prediction. These include CART, random forests, boosting, support vector machines, clustering algorithms, sparse PCA, and deep learning.

Introduction to the Mathematical and Statistical Foundations of Econometrics

Introduction to the Mathematical and Statistical Foundations of Econometrics PDF Author: Herman J. Bierens
Publisher: Cambridge University Press
ISBN: 9780521542241
Category : Business & Economics
Languages : en
Pages : 356

Get Book

Book Description
This book is intended for use in a rigorous introductory PhD level course in econometrics.

Analysis of Multivariate and High-Dimensional Data

Analysis of Multivariate and High-Dimensional Data PDF Author: Inge Koch
Publisher: Cambridge University Press
ISBN: 0521887933
Category : Business & Economics
Languages : en
Pages : 531

Get Book

Book Description
This modern approach integrates classical and contemporary methods, fusing theory and practice and bridging the gap to statistical learning.

Introduction to High-Dimensional Statistics

Introduction to High-Dimensional Statistics PDF Author: Christophe Giraud
Publisher: CRC Press
ISBN: 1000408353
Category : Computers
Languages : en
Pages : 410

Get Book

Book Description
Praise for the first edition: "[This book] succeeds singularly at providing a structured introduction to this active field of research. ... it is arguably the most accessible overview yet published of the mathematical ideas and principles that one needs to master to enter the field of high-dimensional statistics. ... recommended to anyone interested in the main results of current research in high-dimensional statistics as well as anyone interested in acquiring the core mathematical skills to enter this area of research." —Journal of the American Statistical Association Introduction to High-Dimensional Statistics, Second Edition preserves the philosophy of the first edition: to be a concise guide for students and researchers discovering the area and interested in the mathematics involved. The main concepts and ideas are presented in simple settings, avoiding thereby unessential technicalities. High-dimensional statistics is a fast-evolving field, and much progress has been made on a large variety of topics, providing new insights and methods. Offering a succinct presentation of the mathematical foundations of high-dimensional statistics, this new edition: Offers revised chapters from the previous edition, with the inclusion of many additional materials on some important topics, including compress sensing, estimation with convex constraints, the slope estimator, simultaneously low-rank and row-sparse linear regression, or aggregation of a continuous set of estimators. Introduces three new chapters on iterative algorithms, clustering, and minimax lower bounds. Provides enhanced appendices, minimax lower-bounds mainly with the addition of the Davis-Kahan perturbation bound and of two simple versions of the Hanson-Wright concentration inequality. Covers cutting-edge statistical methods including model selection, sparsity and the Lasso, iterative hard thresholding, aggregation, support vector machines, and learning theory. Provides detailed exercises at the end of every chapter with collaborative solutions on a wiki site. Illustrates concepts with simple but clear practical examples.