Large Covariance and Autocovariance Matrices

Large Covariance and Autocovariance Matrices PDF Author: Arup Bose
Publisher: CRC Press
ISBN: 1351398156
Category : Mathematics
Languages : en
Pages : 272

Get Book

Book Description
Large Covariance and Autocovariance Matrices brings together a collection of recent results on sample covariance and autocovariance matrices in high-dimensional models and novel ideas on how to use them for statistical inference in one or more high-dimensional time series models. The prerequisites include knowledge of elementary multivariate analysis, basic time series analysis and basic results in stochastic convergence. Part I is on different methods of estimation of large covariance matrices and auto-covariance matrices and properties of these estimators. Part II covers the relevant material on random matrix theory and non-commutative probability. Part III provides results on limit spectra and asymptotic normality of traces of symmetric matrix polynomial functions of sample auto-covariance matrices in high-dimensional linear time series models. These are used to develop graphical and significance tests for different hypotheses involving one or more independent high-dimensional linear time series. The book should be of interest to people in econometrics and statistics (large covariance matrices and high-dimensional time series), mathematics (random matrices and free probability) and computer science (wireless communication). Parts of it can be used in post-graduate courses on high-dimensional statistical inference, high-dimensional random matrices and high-dimensional time series models. It should be particularly attractive to researchers developing statistical methods in high-dimensional time series models. Arup Bose is a professor at the Indian Statistical Institute, Kolkata, India. He is a distinguished researcher in mathematical statistics and has been working in high-dimensional random matrices for the last fifteen years. He has been editor of Sankhyā for several years and has been on the editorial board of several other journals. He is a Fellow of the Institute of Mathematical Statistics, USA and all three national science academies of India, as well as the recipient of the S.S. Bhatnagar Award and the C.R. Rao Award. His first book Patterned Random Matrices was also published by Chapman & Hall. He has a forthcoming graduate text U-statistics, M-estimates and Resampling (with Snigdhansu Chatterjee) to be published by Hindustan Book Agency. Monika Bhattacharjee is a post-doctoral fellow at the Informatics Institute, University of Florida. After graduating from St. Xavier's College, Kolkata, she obtained her master’s in 2012 and PhD in 2016 from the Indian Statistical Institute. Her thesis in high-dimensional covariance and auto-covariance matrices, written under the supervision of Dr. Bose, has received high acclaim.

Large Covariance and Autocovariance Matrices

Large Covariance and Autocovariance Matrices PDF Author: Arup Bose
Publisher: CRC Press
ISBN: 1351398156
Category : Mathematics
Languages : en
Pages : 272

Get Book

Book Description
Large Covariance and Autocovariance Matrices brings together a collection of recent results on sample covariance and autocovariance matrices in high-dimensional models and novel ideas on how to use them for statistical inference in one or more high-dimensional time series models. The prerequisites include knowledge of elementary multivariate analysis, basic time series analysis and basic results in stochastic convergence. Part I is on different methods of estimation of large covariance matrices and auto-covariance matrices and properties of these estimators. Part II covers the relevant material on random matrix theory and non-commutative probability. Part III provides results on limit spectra and asymptotic normality of traces of symmetric matrix polynomial functions of sample auto-covariance matrices in high-dimensional linear time series models. These are used to develop graphical and significance tests for different hypotheses involving one or more independent high-dimensional linear time series. The book should be of interest to people in econometrics and statistics (large covariance matrices and high-dimensional time series), mathematics (random matrices and free probability) and computer science (wireless communication). Parts of it can be used in post-graduate courses on high-dimensional statistical inference, high-dimensional random matrices and high-dimensional time series models. It should be particularly attractive to researchers developing statistical methods in high-dimensional time series models. Arup Bose is a professor at the Indian Statistical Institute, Kolkata, India. He is a distinguished researcher in mathematical statistics and has been working in high-dimensional random matrices for the last fifteen years. He has been editor of Sankhyā for several years and has been on the editorial board of several other journals. He is a Fellow of the Institute of Mathematical Statistics, USA and all three national science academies of India, as well as the recipient of the S.S. Bhatnagar Award and the C.R. Rao Award. His first book Patterned Random Matrices was also published by Chapman & Hall. He has a forthcoming graduate text U-statistics, M-estimates and Resampling (with Snigdhansu Chatterjee) to be published by Hindustan Book Agency. Monika Bhattacharjee is a post-doctoral fellow at the Informatics Institute, University of Florida. After graduating from St. Xavier's College, Kolkata, she obtained her master’s in 2012 and PhD in 2016 from the Indian Statistical Institute. Her thesis in high-dimensional covariance and auto-covariance matrices, written under the supervision of Dr. Bose, has received high acclaim.

Large Covariance and Autocovariance Matrices

Large Covariance and Autocovariance Matrices PDF Author: Arup Bose
Publisher: CRC Press
ISBN: 1351398164
Category : Mathematics
Languages : en
Pages : 272

Get Book

Book Description
Large Covariance and Autocovariance Matrices brings together a collection of recent results on sample covariance and autocovariance matrices in high-dimensional models and novel ideas on how to use them for statistical inference in one or more high-dimensional time series models. The prerequisites include knowledge of elementary multivariate analysis, basic time series analysis and basic results in stochastic convergence. Part I is on different methods of estimation of large covariance matrices and auto-covariance matrices and properties of these estimators. Part II covers the relevant material on random matrix theory and non-commutative probability. Part III provides results on limit spectra and asymptotic normality of traces of symmetric matrix polynomial functions of sample auto-covariance matrices in high-dimensional linear time series models. These are used to develop graphical and significance tests for different hypotheses involving one or more independent high-dimensional linear time series. The book should be of interest to people in econometrics and statistics (large covariance matrices and high-dimensional time series), mathematics (random matrices and free probability) and computer science (wireless communication). Parts of it can be used in post-graduate courses on high-dimensional statistical inference, high-dimensional random matrices and high-dimensional time series models. It should be particularly attractive to researchers developing statistical methods in high-dimensional time series models. Arup Bose is a professor at the Indian Statistical Institute, Kolkata, India. He is a distinguished researcher in mathematical statistics and has been working in high-dimensional random matrices for the last fifteen years. He has been editor of Sankhyā for several years and has been on the editorial board of several other journals. He is a Fellow of the Institute of Mathematical Statistics, USA and all three national science academies of India, as well as the recipient of the S.S. Bhatnagar Award and the C.R. Rao Award. His first book Patterned Random Matrices was also published by Chapman & Hall. He has a forthcoming graduate text U-statistics, M-estimates and Resampling (with Snigdhansu Chatterjee) to be published by Hindustan Book Agency. Monika Bhattacharjee is a post-doctoral fellow at the Informatics Institute, University of Florida. After graduating from St. Xavier's College, Kolkata, she obtained her master’s in 2012 and PhD in 2016 from the Indian Statistical Institute. Her thesis in high-dimensional covariance and auto-covariance matrices, written under the supervision of Dr. Bose, has received high acclaim.

High-Dimensional Covariance Estimation

High-Dimensional Covariance Estimation PDF Author: Mohsen Pourahmadi
Publisher: John Wiley & Sons
ISBN: 1118034295
Category : Mathematics
Languages : en
Pages : 204

Get Book

Book Description
Methods for estimating sparse and large covariance matrices Covariance and correlation matrices play fundamental roles in every aspect of the analysis of multivariate data collected from a variety of fields including business and economics, health care, engineering, and environmental and physical sciences. High-Dimensional Covariance Estimation provides accessible and comprehensive coverage of the classical and modern approaches for estimating covariance matrices as well as their applications to the rapidly developing areas lying at the intersection of statistics and machine learning. Recently, the classical sample covariance methodologies have been modified and improved upon to meet the needs of statisticians and researchers dealing with large correlated datasets. High-Dimensional Covariance Estimation focuses on the methodologies based on shrinkage, thresholding, and penalized likelihood with applications to Gaussian graphical models, prediction, and mean-variance portfolio management. The book relies heavily on regression-based ideas and interpretations to connect and unify many existing methods and algorithms for the task. High-Dimensional Covariance Estimation features chapters on: Data, Sparsity, and Regularization Regularizing the Eigenstructure Banding, Tapering, and Thresholding Covariance Matrices Sparse Gaussian Graphical Models Multivariate Regression The book is an ideal resource for researchers in statistics, mathematics, business and economics, computer sciences, and engineering, as well as a useful text or supplement for graduate-level courses in multivariate analysis, covariance estimation, statistical learning, and high-dimensional data analysis.

High-Dimensional Covariance Matrix Estimation

High-Dimensional Covariance Matrix Estimation PDF Author: Aygul Zagidullina
Publisher: Springer Nature
ISBN: 3030800652
Category : Business & Economics
Languages : en
Pages : 123

Get Book

Book Description
This book presents covariance matrix estimation and related aspects of random matrix theory. It focuses on the sample covariance matrix estimator and provides a holistic description of its properties under two asymptotic regimes: the traditional one, and the high-dimensional regime that better fits the big data context. It draws attention to the deficiencies of standard statistical tools when used in the high-dimensional setting, and introduces the basic concepts and major results related to spectral statistics and random matrix theory under high-dimensional asymptotics in an understandable and reader-friendly way. The aim of this book is to inspire applied statisticians, econometricians, and machine learning practitioners who analyze high-dimensional data to apply the recent developments in their work.

Large Dimensional Covariance Matrix Estimation with Decomposition-based Regularization

Large Dimensional Covariance Matrix Estimation with Decomposition-based Regularization PDF Author:
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book

Book Description
Estimation of population covariance matrices from samples of multivariate data is of great importance. When the dimension of a covariance matrix is large but the sample size is limited, it is well known that the sample covariance matrix is dissatisfactory. However, the improvement of covariance matrix estimation is not straightforward, mainly because of the constraint of positive definiteness. This thesis work considers decomposition-based methods to circumvent this primary difficulty. Two ways of covariance matrix estimation with regularization on factor matrices from decompositions are included. One approach replies on the modified Cholesky decomposition from Pourahmadi, and the other technique, matrix exponential or matrix logarithm, is closely related to the spectral decomposition. We explore the usage of covariance matrix estimation by imposing L1 regularization on the entries of Cholesky factor matrices, and find the estimates from this approach are not sensitive to the orders of variables. A given order of variables is the prerequisite in the application of the modified Cholesky decomposition, while in practice, information on the order of variables is often unknown. We take advantage of this property to remove the requirement of order information, and propose an order-invariant covariance matrix estimate by refining estimates corresponding to different orders of variables. The refinement not only guarantees the positive definiteness of the estimated covariance matrix, but also is applicable in general situations without the order of variables being pre-specified. The refined estimate can be approximated by only combining a moderate number of representative estimates. Numerical simulations are conducted to evaluate the performance of the proposed method in comparison with several other estimates. By applying the matrix exponential technique, the problem of estimating positive definite covariance matrices is transformed into a problem of estimating symmetric matrices. There are close connections between covariance matrices and their logarithm matrices, and thus, pursing a matrix logarithm with certain properties helps restoring the original covariance matrix. The covariance matrix estimate from applying L1 regularization to the entries of the matrix logarithm is compared to some other estimates in simulation studies and real data analysis.

Random Matrices and Non-Commutative Probability

Random Matrices and Non-Commutative Probability PDF Author: Arup Bose
Publisher: CRC Press
ISBN: 1000458822
Category : Mathematics
Languages : en
Pages : 420

Get Book

Book Description
This is an introductory book on Non-Commutative Probability or Free Probability and Large Dimensional Random Matrices. Basic concepts of free probability are introduced by analogy with classical probability in a lucid and quick manner. It then develops the results on the convergence of large dimensional random matrices, with a special focus on the interesting connections to free probability. The book assumes almost no prerequisite for the most part. However, familiarity with the basic convergence concepts in probability and a bit of mathematical maturity will be helpful. Combinatorial properties of non-crossing partitions, including the Möbius function play a central role in introducing free probability. Free independence is defined via free cumulants in analogy with the way classical independence can be defined via classical cumulants. Free cumulants are introduced through the Möbius function. Free product probability spaces are constructed using free cumulants. Marginal and joint tracial convergence of large dimensional random matrices such as the Wigner, elliptic, sample covariance, cross-covariance, Toeplitz, Circulant and Hankel are discussed. Convergence of the empirical spectral distribution is discussed for symmetric matrices. Asymptotic freeness results for random matrices, including some recent ones, are discussed in detail. These clarify the structure of the limits for joint convergence of random matrices. Asymptotic freeness of independent sample covariance matrices is also demonstrated via embedding into Wigner matrices. Exercises, at advanced undergraduate and graduate level, are provided in each chapter.

U-Statistics, Mm-Estimators and Resampling

U-Statistics, Mm-Estimators and Resampling PDF Author: Arup Bose
Publisher: Springer
ISBN: 9811322481
Category : Mathematics
Languages : en
Pages : 174

Get Book

Book Description
This is an introductory text on a broad class of statistical estimators that are minimizers of convex functions. It covers the basics of U-statistics and Mm-estimators and develops their asymptotic properties. It also provides an elementary introduction to resampling, particularly in the context of these estimators. The last chapter is on practical implementation of the methods presented in other chapters, using the free software R.

Random Circulant Matrices

Random Circulant Matrices PDF Author: Arup Bose
Publisher: CRC Press
ISBN: 0429788185
Category : Mathematics
Languages : en
Pages : 98

Get Book

Book Description
Circulant matrices have been around for a long time and have been extensively used in many scientific areas. This book studies the properties of the eigenvalues for various types of circulant matrices, such as the usual circulant, the reverse circulant, and the k-circulant when the dimension of the matrices grow and the entries are random. In particular, the behavior of the spectral distribution, of the spectral radius and of the appropriate point processes are developed systematically using the method of moments and the various powerful normal approximation results. This behavior varies according as the entries are independent, are from a linear process, and are light- or heavy-tailed. Arup Bose obtained his B.Stat., M.Stat. and Ph.D. degrees from the Indian Statistical Institute. He has been on its faculty at the Theoretical Statistics and Mathematics Unit, Kolkata, India since 1991. He is a Fellow of the Institute of Mathematical Statistics, and of all three national science academies of India. He is a recipient of the S.S. Bhatnagar Prize and the C.R. Rao Award. He is the author of three books: Patterned Random Matrices, Large Covariance and Autocovariance Matrices (with Monika Bhattacharjee) and U-Statistics, M_m-Estimators and Resampling (with Snigdhansu Chatterjee). Koushik Saha obtained a B.Sc. in Mathematics from Ramakrishna Mission Vidyamandiara, Belur and an M.Sc. in Mathematics from Indian Institute of Technology Bombay. He obtained his Ph.D. degree from the Indian Statistical Institute under the supervision of Arup Bose. His thesis on circulant matrices received high praise from the reviewers. He has been on the faculty of the Department of Mathematics, Indian Institute of Technology Bombay since 2014.

Sparse Graphical Modeling for High Dimensional Data

Sparse Graphical Modeling for High Dimensional Data PDF Author: Faming Liang
Publisher: CRC Press
ISBN: 0429584806
Category : Mathematics
Languages : en
Pages : 151

Get Book

Book Description
A general framework for learning sparse graphical models with conditional independence tests Complete treatments for different types of data, Gaussian, Poisson, multinomial, and mixed data Unified treatments for data integration, network comparison, and covariate adjustment Unified treatments for missing data and heterogeneous data Efficient methods for joint estimation of multiple graphical models Effective methods of high-dimensional variable selection Effective methods of high-dimensional inference

Introduction to High-Dimensional Statistics

Introduction to High-Dimensional Statistics PDF Author: Christophe Giraud
Publisher: CRC Press
ISBN: 1000408329
Category : Computers
Languages : en
Pages : 364

Get Book

Book Description
Praise for the first edition: "[This book] succeeds singularly at providing a structured introduction to this active field of research. ... it is arguably the most accessible overview yet published of the mathematical ideas and principles that one needs to master to enter the field of high-dimensional statistics. ... recommended to anyone interested in the main results of current research in high-dimensional statistics as well as anyone interested in acquiring the core mathematical skills to enter this area of research." —Journal of the American Statistical Association Introduction to High-Dimensional Statistics, Second Edition preserves the philosophy of the first edition: to be a concise guide for students and researchers discovering the area and interested in the mathematics involved. The main concepts and ideas are presented in simple settings, avoiding thereby unessential technicalities. High-dimensional statistics is a fast-evolving field, and much progress has been made on a large variety of topics, providing new insights and methods. Offering a succinct presentation of the mathematical foundations of high-dimensional statistics, this new edition: Offers revised chapters from the previous edition, with the inclusion of many additional materials on some important topics, including compress sensing, estimation with convex constraints, the slope estimator, simultaneously low-rank and row-sparse linear regression, or aggregation of a continuous set of estimators. Introduces three new chapters on iterative algorithms, clustering, and minimax lower bounds. Provides enhanced appendices, minimax lower-bounds mainly with the addition of the Davis-Kahan perturbation bound and of two simple versions of the Hanson-Wright concentration inequality. Covers cutting-edge statistical methods including model selection, sparsity and the Lasso, iterative hard thresholding, aggregation, support vector machines, and learning theory. Provides detailed exercises at the end of every chapter with collaborative solutions on a wiki site. Illustrates concepts with simple but clear practical examples.