Ouch

Feb. 13th, 2012 08:39 am
snousle: (badger)
[personal profile] snousle
Bad news in my field - I only just heard about it today, after a 60 minutes episode on it aired last night. An earlier article in The Economist describes it pretty well. CBS called it "one of the biggest medical research frauds ever". Oh, joy.

This is exactly the kind of analysis I do so it hits rather close to home. What is disturbing is that the problems in the data were obvious and were found rather easily, but it took a very long time for the fraud to be fully exposed at the administrative level.

I must confess, when I started with my current client, my first reaction to their research was "this is way too good to be true", but after conducting a completely independent analysis reaching the same result as our academic founders had published, I was, and still am, confident in the correctness of the data. We have, to be sure, received data from collaborators with exactly the same kinds of errors mentioned in the Economist article, but there are simple consistency checks that flush them out immediately.

Makes me wonder what would happen if I had to issue a thumbs-down in the middle of a multimillion dollar project. I like to think it would halt everything in its tracks, but the pressures that surround high-impact research like this can cause people to behave in peculiar ways. There is no way this kind of fraud can continue forever - it will always become obvious in time - and Potti must have known early on that the gig would be up eventually. But, as they say, denial isn't just a river in Egypt. And the terrible thing is that the fraud propagated right through to actual clinical trials, affecting the lives of real people. This is certain to make future research much more difficult. It's already hard enough to satisfy IRBs, who are absurdly cautious, and this is going to make them even more paranoid. Nobody gets fired for research that never gets approved, and there is every chance that truly effective treatments will now get left on the cutting room floor.

In the meanwhile, I'm cheered by a jobs review in Nature, just arrived this morning, which says that I'm going to be infinitely employable forever. I have no idea why, ten years after the completion of the genome, there aren't hordes of university graduates clamoring for these positions, rendering me obsolete. But there aren't.

Date: 2012-02-13 05:43 pm (UTC)
From: [identity profile] bitterlawngnome.livejournal.com
because it's hard, and not glam?

Date: 2012-02-13 06:21 pm (UTC)
From: [identity profile] snousle.livejournal.com
Maybe. I keep thinking that it's not nearly hard enough to justify all the fuss, but then again, "I'm soaking in it".

Bioinformatics: softens hands while you do statistics!

Date: 2012-02-13 06:22 pm (UTC)
From: [identity profile] muckefuck.livejournal.com
Yeah, and you have to, like, know stuff. Fuck that.

Date: 2012-02-14 01:29 am (UTC)
ext_173199: (Dr. Theopolis)
From: [identity profile] furr-a-bruin.livejournal.com
Maybe people who simultaneously "get" biology and statistics are somewhat rare. When I was taking a class on QSAR, the chemistry was the easy part - the statistics was like pulling teeth for me. I completely understood why it was essential - we're collating data on a family of chemicals from a variety of sources and we had to be sure the results were actually significant and not some form of data artifact. That didn't make it any easier to actually DO, of course.

Date: 2012-02-14 07:42 am (UTC)
From: [identity profile] broduke2000.livejournal.com
The following is a script of "Deception at Duke"...

Yes, I've been deceived, many times.

Date: 2012-02-14 02:29 pm (UTC)
From: [identity profile] barbarian-rat.livejournal.com
Maybe I'm missing something here ... why isn't independent analysis required as the project goes along so that these kinds of problems are found early an dealt with before it blows up in everyone's face?

Date: 2012-02-14 03:29 pm (UTC)
From: [identity profile] snousle.livejournal.com
Well, there was an independent analysis, and the analysts said "this is poo poo" early on. Potti didn't back down, so Duke submitted it to a second review team, but Potti faked the data that was sent. When the second team agreed with Potti, the trials continued.

Although it is hard to fake data convincingly, this created enough confusion and reasonable doubt that it wasn't declared "fraud" for quite some time. Deliberate fraud of this kind is actually very rare, so the presumption was that everything was being done in good faith.

Date: 2012-02-15 04:46 pm (UTC)
From: [identity profile] barbarian-rat.livejournal.com
I see.
I haven't seen the climate deniers latch onto this yet, but I think they will in time.

Profile

snousle: (Default)
snousle

August 2013

S M T W T F S
    123
45 678910
11121314151617
1819202122 2324
25262728293031

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Feb. 11th, 2026 02:17 pm
Powered by Dreamwidth Studios