Statistical inference in massive data sets
Analysis of massive data sets is challenging owing to limitations of computer primary memory. In this paper, we propose an approach to estimate population parameters from a massive data set. The proposed approach significantly reduces the required amount of primary memory, and the resulting estimate will be as efficient if the entire data set was analyzed simultaneously. Asymptotic properties of the resulting estimate are studied, and the asymptotic normality of the resulting estimator is established. The standard error formula for the resulting estimate is proposed and empirically tested; thus, statistical inference for parameters of interest can be performed. The effectiveness of the proposed approach is illustrated using simulation studies and an Internet traffic data example.
Files
Metadata
| Work Title | Statistical inference in massive data sets |
|---|---|
| Access | |
| Creators |
|
| Keyword |
|
| License | In Copyright (Rights Reserved) |
| Work Type | Article |
| Publisher |
|
| Publication Date | July 5, 2012 |
| Publisher Identifier (DOI) |
|
| Deposited | July 19, 2022 |
Versions
Analytics
Collections
This resource is currently not in any collection.