• In total there are 22 users online :: 0 registered, 0 hidden and 22 guests (based on users active over the past 60 minutes)
    Most users ever online was 789 on Tue Mar 19, 2024 5:08 am

Soft science have a reproducibility problem. And it's pretty big

Engage in discussions encompassing themes like cosmology, human evolution, genetic engineering, earth science, climate change, artificial intelligence, psychology, and beyond in this forum.
Forum rules
Do not promote books in this forum. Instead, promote your books in either Authors: Tell us about your FICTION book! or Authors: Tell us about your NON-FICTION book!.

All other Community Rules apply in this and all other forums.
User avatar
ant

1G - SILVER CONTRIBUTOR
BookTalk.org Hall of Fame
Posts: 5935
Joined: Thu Jun 02, 2011 12:04 pm
12
Has thanked: 1371 times
Been thanked: 969 times

Soft science have a reproducibility problem. And it's pretty big

Unread post

http://www.nature.com/news/over-half-of ... NatureNews

http://www.nature.com/news/first-result ... st-1.17433
The results should convince everyone that psychology has a replicability problem, says Hal Pashler, a cognitive psychologist at the University of California, San Diego, and an author of one of the papers whose findings were successfully repeated. “A lot of working scientists assume that if it’s published, it’s right,” he says. “This makes it hard to dismiss that there are still a lot of false positives in the literature.”
User avatar
ant

1G - SILVER CONTRIBUTOR
BookTalk.org Hall of Fame
Posts: 5935
Joined: Thu Jun 02, 2011 12:04 pm
12
Has thanked: 1371 times
Been thanked: 969 times

Re: Soft science have a reproducibility problem. And it's pretty big

Unread post

Given the smallness of most study samples in social and cognitive psychology and the subtlety of most of the effects that we study, we cannot almost always obtain a significant outcome as the literature appears to suggest. There are surveys in which most psychological researchers admit to making opportunistic decisions in collecting and analyzing data, and in presenting their results.
User avatar
DWill

1H - GOLD CONTRIBUTOR
BookTalk.org Hall of Fame
Posts: 6966
Joined: Thu Jan 31, 2008 8:05 am
16
Location: Luray, Virginia
Has thanked: 2262 times
Been thanked: 2470 times

Re: Soft science have a reproducibility problem. And it's pretty big

Unread post

The results don't surprise me, or maybe there is a small surprise in the almost 40 per cent of experiments whose results can be replicated. In psychology experiments there are frequently many moving parts which makes the job of setting them up again difficult. I have to confess to some pleasure in this meta-study. A part of me wants to celebrate humans resisting reductive scrutiny. Perhaps qualitative research in the social sciences is in the end more valuable than quantitative.

However, two things to add: In order to do anything interesting in psychology, experiments might need to be "out there" somewhat. Who wants to hear about some obvious finding? That degree of difficulty will increase the chance that the next one to try the experiment won't get the dame data. Also, we don't even know (do we?) what the score would be if experiments in a hard science were examined. Psychology was the choice here because it is Brian Nosek's own field of expertise.
Post Reply

Return to “Science & Technology”