In a nutshell, it frequently helps to refer to an expert when evaluating a claim. But caveat emptor, experts can be wrong and frequently are, especially when going outside their own area of expertise.
Riniolo refers us to James Randi's famous "Project Alpha" in which Randi trained two amateur magicians in basic conjuring tricks and used them to bamboozle scientists at the McDonnell Laboratory for Psychical Research.
If you're not familiar with "Project Alpha" it was quite an elaborate hoax that took 21 months!
http://en.wikipedia.org/wiki/Project_Alpha
Here's the quote from the beginning of this chapter:
James Randi: "Many men of science stupidly assume that because they have been trained in the physical sciences or medical arts, they are capable of flawless judgment in the investigation of alleged psychics. Nothing could be further from the truth. In fact, the more scientifically trained a person's mind, the more he or she is apt to be duped by an enterprising performer."
I think this
assumption to which Randi refers underscores the importance of intellectual humility. A scientist or other "expert" can be easily led into believing he or she is superior than others in evaluating claims. Likewise, people tend to have a great deal of confidence in scientists and if they get burned once or twice they'll tend to mistrust scientists and science in general.