How to find valid information?

Do you know if there are any guidelines about how statistics are generally used in science and to what degree consensus is achieved among scientists with regards interpretation of statistics?

My feeling is that where the statistical evidence isn't clear-cut there will be arguments about methods and approaches, but where it's sufficiently strong those arguments will evaporate. Though the Bayesian approach is more subjective and therefore offers more scope for those with cherished preconceptions to defend them against experimental evidence.