With the growing availability of large-scale biomedical data, it is often time-consuming or infeasible to directly perform traditional statistical analysis with relatively limited computing resources at hand. We propose a fast and stable subsampling method to effectively approximate the full data maximum partial likelihood estimator in Cox's model, which reduces the computational burden when analyzing massive survival data. We establish consistency and asymptotic normality of a general subsample-based estimator. The optimal subsampling probabilities with explicit expressions are determined via minimizing the trace of the asymptotic variance-covariance matrix for a linearly transformed parameter estimator. We propose a two-step subsampling algorithm for practical implementation, which has a significant reduction in computing time compared to the full data method. The asymptotic properties of the resulting two-step subsample-based estimator is established. In addition, a subsampling-based Breslow-type estimator for the cumulative baseline hazard function and a subsample estimated survival function are presented. Extensive experiments are conducted to assess the proposed subsampling strategy. Finally, we provide an illustrative example about large-scale lymphoma cancer dataset from the Surveillance, Epidemiology,and End Results Program.
View on arXiv