Skip to main content
  • Textbook
  • © 2013

Bayesian and Frequentist Regression Methods

Authors:

  • Provides a balanced, modern summary of Bayesian and frequentist methods for regression analysis
  • A book website contains R code to reproduce all of the analyses and figures in the book: http://faculty.washington.edu/jonno/regression-methods.html
  • Includes supplementary material: sn.pub/extras

Part of the book series: Springer Series in Statistics (SSS)

Buy it now

Buying options

eBook USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (19 chapters)

  1. Front Matter

    Pages i-xix
  2. Introduction and Motivating Examples

    • Jon Wakefield
    Pages 1-24
  3. Inferential Approaches

    1. Front Matter

      Pages 25-25
    2. Frequentist Inference

      • Jon Wakefield
      Pages 27-83
    3. Bayesian Inference

      • Jon Wakefield
      Pages 85-151
    4. Hypothesis Testing and Variable Selection

      • Jon Wakefield
      Pages 153-191
  4. Independent Data

    1. Front Matter

      Pages 193-193
    2. Linear Models

      • Jon Wakefield
      Pages 195-252
    3. General Regression Models

      • Jon Wakefield
      Pages 253-303
    4. Binary Data Models

      • Jon Wakefield
      Pages 305-350
  5. Dependent Data

    1. Front Matter

      Pages 351-351
    2. Linear Models

      • Jon Wakefield
      Pages 353-423
    3. General Regression Models

      • Jon Wakefield
      Pages 425-500
  6. Nonparametric Modeling

    1. Front Matter

      Pages 501-501
    2. Preliminaries for Nonparametric Regression

      • Jon Wakefield
      Pages 503-545
    3. Spline and Kernel Methods

      • Jon Wakefield
      Pages 547-595
  7. Appendices

    1. Front Matter

      Pages 647-647
    2. Differentiation of Matrix Expressions

      • Jon Wakefield
      Pages 649-651
    3. Matrix Results

      • Jon Wakefield
      Pages 653-654

About this book

Bayesian and Frequentist Regression Methods provides a modern account of both Bayesian and frequentist methods of regression analysis. Many texts cover one or the other of the approaches, but this is the most comprehensive combination of Bayesian and frequentist methods that exists in one place.
The two philosophical approaches to regression methodology are featured here as complementary techniques, with theory and data analysis providing supplementary components of the discussion. In particular, methods are illustrated using a variety of data sets. The majority of the data sets are drawn from biostatistics but the techniques are generalizable to a wide range of other disciplines.


Reviews

“JonWakefield’s Bayesian and Frequentist Regression Methods provides an excellent parallel treatment of Frequentist followed by Bayesian approaches to linear, generalised linear, generalised linear mixed and non-parametric regression models. This book is impressive both in terms of its coverage and its contents and is an exceptional resource for students and researchers who have some familiarity with these topics.” (Sanjib Basu, International Statistical Review, Vol. 84 (1), 2016)

"Jon Wakefield’s book Bayesian and Frequentist Regression Methods is an incomparable regression text in that it provides the most comprehensive combination of Bayesian and frequentist methods that exists...The book also discusses a comparison of Bayesian and frequentist approaches in basic inferential procedures, hypothesis testing, variable selection, and general regression modeling...no book expounds the subject in the manner of this book, which provides an extensive and thorough discussionof the regression analysis to reflect recent advances in the field from the two statistical perspectives in terms of methods, implementation, and practical applications." (Taeryon Choi, Journal of Agricultural, Biological, and Environmental Statistics

“This book is dedicated to describing the Bayesian and frequentist regression methods and to illustrating the use of these methods. … This book could be used for three separate graduate courses: regression methods for independent data; regression methods for dependent data; and nonparametric regression and classification. … the book would be a valuable asset for graduate students, researchers in the area of Bayesian and frequentist methods and an invaluable resource for libraries.” (B. M. Golam Kibria, Mathematical Reviews, January, 2014)

"There are a number of books on applied regression, but connecting the applied principles to theory is a challenge. A related challenge in exposition is to unify thethree goals noted at the beginning of this review. Wakefield’s book is an excellent start." (Andrew Gelman, Statistics in Medicine, 2015)

This book is a gem. It is a unique modern regression book, because it includes both Frequentist and Bayesian methods for many of the data types encountered in modern regression analysis, generally put one after the other, so that readers can learn about and compare the two approaches immediately. Topics go through and beyond nonlinear mixed models. All the methods are motivated by interesting data sets, and there are many other data sets available from the author’s web site. There is both R and WinBUGS code for everything. The writing is unusually clear: philosophically, about the practical problems, about the development of the methods and in the data analysis, and it also has a strong series of exercises. It serves especially well as a textbook, but can also be used as a methods reference book.

-Raymond J. Carroll, Distinguished Professor, Texas A&M University

Arguably the most important development of the statistical discipline over the last 40 years has been itsprogressive de-compartmentalisation.  In the 1970s, generalized linear models unified a wide range of statistical methods for analysing independently replicated data.  In the 1980s, generalized linear mixed models did much the same for dependent data of various kinds, including spatial, longitudinal and genetic settings. Jon Wakefield’s impressive new book takes this process a stage further by recognising that modern computational developments have made models outside the generalized linear class equally accessible, and by taking a refreshingly pragmatic view of different approaches to inference.  The book delivers much more than its title suggests – it could very easily be used as the core-text for a year-long masters course in statistical modelling and inference.

-Peter J Diggle, Distinguished University Professor, Lancaster University

Estimating equations, sandwich estimators, Bayesian inference, MCMC and longitudinal models, all in one book. This text is truly unique both for its broad coverage and its pragmatic approach to inference. Wakefield rejects the usual Bayesian-Frequentist divide and instead shows how good data analysis embraces the best of both worlds. To quote the author: "Each of the frequentist and Bayesian approaches have their merits and can often be used in tandem ..." Thorough and clear, this book is a wonderful resource for students and researchers who want a complete and practical understanding of modern regression methods.

-Larry Wasserman, Professor, Department of Statistics and Machine Learning Department, Carnegie Mellon University

Authors and Affiliations

  • Department of Statistics & Biostatistics, University of Washington, Seattle, USA

    Jon Wakefield

About the author

Jon Wakefield is Professor in the Departments of Statistics and Biostatistics at the University of Washington. His interests lie in biostatistics, epidemiology and genetics and in links between frequentist and Bayesian methods. His work has been published extensively. He received his PhD from the University of Nottingham, and his honors include the Guy Medal in Bronze from the Royal Statistical Society, and he is a Fellow of the American Statistical Association. He has previously been the Chair of the Department of Statistics at the University of Washington.

Bibliographic Information

  • Book Title: Bayesian and Frequentist Regression Methods

  • Authors: Jon Wakefield

  • Series Title: Springer Series in Statistics

  • DOI: https://doi.org/10.1007/978-1-4419-0925-1

  • Publisher: Springer New York, NY

  • eBook Packages: Mathematics and Statistics, Mathematics and Statistics (R0)

  • Copyright Information: Springer Science+Business Media, LLC, part of Springer Nature 2013

  • Hardcover ISBN: 978-1-4419-0924-4Published: 03 January 2013

  • Softcover ISBN: 978-1-4939-3862-9Published: 23 August 2016

  • eBook ISBN: 978-1-4419-0925-1Published: 04 January 2013

  • Series ISSN: 0172-7397

  • Series E-ISSN: 2197-568X

  • Edition Number: 1

  • Number of Pages: XIX, 697

  • Topics: Statistical Theory and Methods, Statistics, general

Buy it now

Buying options

eBook USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access