Statistical Estimation And Inference For Large-Scale Categorical Data