I wrote a little rant

Get your science fix here: research, quackery, activism and all the rest
Post Reply
User avatar
sTeamTraen
After Pie
Posts: 2581
Joined: Mon Nov 11, 2019 4:24 pm
Location: Palma de Mallorca, Spain

I wrote a little rant

Post by sTeamTraen » Tue Sep 10, 2024 8:09 pm

... about dishonest science, in PLOS Biology.
Something something hammer something something nail

Nero
Fuzzable
Posts: 270
Joined: Mon Nov 11, 2019 1:01 pm

Re: I wrote a little rant

Post by Nero » Wed Sep 11, 2024 7:17 am

Good rant, well done.

User avatar
Martin Y
Stummy Beige
Posts: 3214
Joined: Mon Nov 11, 2019 1:08 pm

Re: I wrote a little rant

Post by Martin Y » Wed Sep 11, 2024 10:29 am

Nero wrote:
Wed Sep 11, 2024 7:17 am
Good rant, well done.
Yes, very good, but also frustrating, as is the way with stuff that deserves ranting I guess.

IvanV
Stummy Beige
Posts: 3071
Joined: Mon May 17, 2021 11:12 am

Re: I wrote a little rant

Post by IvanV » Wed Sep 11, 2024 10:03 pm

Thank you so much for this. There's a few bits I didn't quite follow, implications rather than written out in full, that doubtless the practitioners get but I don't. The most cryptic was this one, there's no additional info on the Xwitter link.
In another case, a field-leading journal rejected a completed Stage 2 Registered Report on the basis of the results obtained after pre-registration, defeating the purpose of this article type.
Is the implication that the data showed a null result, so the journal rejected the paper because that's too boring? Whereas actually it is important to know that experiment failed to demonstrate the hypothesis.

kerrya1
Clardic Fug
Posts: 193
Joined: Tue Nov 12, 2019 11:13 am

Re: I wrote a little rant

Post by kerrya1 » Thu Sep 19, 2024 12:46 pm

This is so incredibly depressing, but also utterly unsurprising. My job is to promote and support Open Research in a Russell Group Uni but it's like banging my head off a brick wall much of the time. Funders set requirements for grant holders but there are no consequences for just ignoring them, publisher requirements are mostly ignored, REF pays the barest lip service to OR, reproducibility, and transparency, and the reward and recognition systems in academic are still almost entirely based on citations / H-index and grant income.

Early career researchers are normal keen and can see the benefits of OR, but without the active support and encouragement from PIs and dept/school leaders they quickly realise that they need to keep playing the same old games or leave academia.

Anyway, excellent rant.

User avatar
sTeamTraen
After Pie
Posts: 2581
Joined: Mon Nov 11, 2019 4:24 pm
Location: Palma de Mallorca, Spain

Re: I wrote a little rant

Post by sTeamTraen » Wed Sep 25, 2024 11:59 pm

IvanV wrote:
Wed Sep 11, 2024 10:03 pm
Thank you so much for this. There's a few bits I didn't quite follow, implications rather than written out in full, that doubtless the practitioners get but I don't. The most cryptic was this one, there's no additional info on the Xwitter link.
In another case, a field-leading journal rejected a completed Stage 2 Registered Report on the basis of the results obtained after pre-registration, defeating the purpose of this article type.
Is the implication that the data showed a null result, so the journal rejected the paper because that's too boring? Whereas actually it is important to know that experiment failed to demonstrate the hypothesis.
Yes. Of course this applies to any study, within the limits of what we can learn given its statistical power, but with a Registered Report in particular the whole point is that you get the reviewing of the method, etc, done first and then the article is guaranteed to be accepted even if it doesn't find anything. But many journals just pay lip service to that as a general practice, while continuing to cherry-pick positive results for themselves.
Something something hammer something something nail

User avatar
shpalman
Princess POW
Posts: 8478
Joined: Mon Nov 11, 2019 12:53 pm
Location: One step beyond
Contact:

Re: I wrote a little rant

Post by shpalman » Thu Sep 26, 2024 10:27 am

having that swing is a necessary but not sufficient condition for it meaning a thing
@shpalman@mastodon.me.uk
@shpalman.bsky.social / bsky.app/profile/chrastina.net
threads.net/@dannychrastina

User avatar
sTeamTraen
After Pie
Posts: 2581
Joined: Mon Nov 11, 2019 4:24 pm
Location: Palma de Mallorca, Spain

Re: I wrote a little rant

Post by sTeamTraen » Fri Sep 27, 2024 7:07 pm

I think this is a case where the senior people should have had (except that never happens) a "kill your darlings" moment on the author list. Apparently they have been working on this paper in various ways since 2012, and the last author really believes in a Heisenberg-style explanation for the decline effect (which would be totally Upminster). I suspect the whole project had become a sort of living zombie, and it didn't need a lot of external critical insight after 11 years of groupthink and/or "Please let's get this over with" to spot the accumulated problems.
Something something hammer something something nail

Post Reply