This article, by Dr. Adam Pintar of NIST and former Chair of the ASQ Statistics Division is very informative is describing the differences between Bayesian and Frequentist Statistics.

One Statistical Paradigm to Rule Them All?