SSS

Shotgun stochastic search for “Large p” regression Model search in regression with very large numbers of candidate predictors raises challenges for both model specification and computation, for which standard approaches such as Markov chain Monte Carlo (MCMC) methods are often infeasible or ineffective. We describe a novel shotgun stochastic search (SSS) approach that explores ”interesting” regions of the resulting high-dimensional model spaces and quickly identifies regions of high posterior probability over models. We describe algorithmic and modeling aspects, priors over the model space that induce sparsity and parsimony over and above the traditional dimension penalization implicit in Bayesian and likelihood analyses, and parallel computation using cluster computers. We discuss an example from gene expression cancer genomics, comparisons with MCMC and other methods, and theoretical and simulation-based aspects of performance characteristics in large-scale regression model searches. We also provide software implementing the methods.


References in zbMATH (referenced in 29 articles )

Showing results 1 to 20 of 29.
Sorted by year (citations)

1 2 next

  1. Andrade, Daniel; Takeda, Akiko; Fukumizu, Kenji: Robust Bayesian model selection for variable clustering with the Gaussian graphical model (2020)
  2. Kirsner, Daniel; Sansó, Bruno: Multi-scale shotgun stochastic search for large spatial datasets (2020)
  3. Dobra, Adrian; Valdes, Camilo; Ajdic, Dragana; Clarke, Bertrand; Clarke, Jennifer: Modeling association in microbial communities with clique loglinear models (2019)
  4. Narisetty, Naveen N.; Shen, Juan; He, Xuming: Skinny Gibbs: a consistent and scalable Gibbs sampler for model selection (2019)
  5. Kim, Joungyoun; Lim, Johan; Kim, Yongdai; Jang, Woncheol: Bayesian variable selection with strong heredity constraints (2018)
  6. Ročková, Veronika: Particle EM for variable selection (2018)
  7. Papathomas, Michail; Richardson, Sylvia: Exploring dependence between categorical variables: benefits and limitations of using variable selection within Bayesian clustering in relation to log-linear modelling with interaction terms (2016)
  8. Castillo, Ismaël; Schmidt-Hieber, Johannes; van der Vaart, Aad: Bayesian linear regression with sparse priors (2015)
  9. Elliott, Graham; Gargano, Antonio; Timmermann, Allan: Complete subset regressions with large-dimensional sets of predictors (2015)
  10. Ghosh, Joyee; Tan, Aixin: Sandwich algorithms for Bayesian variable selection (2015)
  11. Pungpapong, Vitara; Zhang, Min; Zhang, Dabao: Selecting massive variables using an iterated conditional modes/medians algorithm (2015)
  12. Bleich, Justin; Kapelner, Adam; George, Edward I.; Jensen, Shane T.: Variable selection for BART: an application to gene regulation (2014)
  13. Elliott, Graham; Gargano, Antonio; Timmermann, Allan: Complete subset regressions (2013)
  14. García-Donato, G.; Martínez-Beneito, M. A.: On sampling strategies in Bayesian variable selection problems with large model spaces (2013)
  15. Guedj, Benjamin; Alquier, Pierre: PAC-Bayesian estimation and prediction in sparse additive models (2013)
  16. Petralias, Athanassios; Dellaportas, Petros: An MCMC model search algorithm for regression problems (2013)
  17. Turnbull, Bradley; Ghosal, Subhashis; Zhang, Hao Helen: Iterative selection using orthogonal regression techniques (2013)
  18. Woodard, Dawn B.; Rosenthal, Jeffrey S.: Convergence rate of Markov chain methods for genomic motif discovery (2013)
  19. Dellaportas, Petros; Forster, Jonathan J.; Ntzoufras, Ioannis: Joint specification of model space and parameter space prior distributions (2012)
  20. Oates, Chris J.; Mukherjee, Sach: Network inference and biological dynamics (2012)

1 2 next