Piecing Things Together

by Rant on March 23, 2008 · 26 comments

in Doping in Sports

Back in October 2006, trying to get to my dad’s house before he passed away, I was stuck on the tarmac in Atlanta, cursing the airshow in Washington, DC (my destination) that was delaying my departure. Time was short. Very short. And the two-hour delay was maddening. As I sat on the plane waiting for it to get in the air and get me to DC, I needed a distraction.

To get my mind of the never-ending wait, and the consequences of arriving late, I read some scientific articles related to doping. One of the articles, “Evaluation of Testosterone/Epitestosterone Ratio Influential Factors as Determined in Doping Analysis” from the Journal of Analytical Toxicology’s March 2000 issue especially caught my attention, as it offers some very interesting background on the T/E ratio that has been used as an indication of doping for more than a quarter century. I discussed the article in this post from way back when.

There’s an interesting history to the use of the T/E ratio, starting with the Moscow Olympics in 1980. Because techniques had come into use to detect the use of anabolic steroids during the mid- to late-1970s, many athletes who were doping switched to the use of testosterone, instead. The IOC suspected that many athletes in Moscow were using synthetic testosterone, but didn’t have a way to prove it. To determine whether or not an athlete was using testosterone, the IOC relied on studies that showed the vast majority of (Caucasian) individuals would have a T/E ratio at or below 6:1. In 1982, IOC-accredited anti-doping labs started testing for the T/E ratio, and anyone whose ratio exceeded 6:1 was considered guilty of doping with exogenous testosterone.

Over the years, the requirements to prove a doping case involving testosterone changed, to the point that eventually the 6:1 ratio became an indication to gather more data, in order to rule out naturally high ratios and/or high ratios due to some illness or other pathology. The data to prove a positive case could come from previous tests, various endocrinological investigations or tests, or unannounced testing over a period of several months (or more).

In more recent years, the T/E ratio has been used as a screening test and when an athlete exceeded the proscribed ratio (subsequently reduced to 4:1 in 2005), carbon isotope ratio testing is conducted in order to determine whether the testosterone in the athlete’s system is natural or not. Interestingly, even when the article in the Journal of Analytical Toxicology was published eight years ago, there were questions about how good a test the T/E ratio was.

Back in 2000, carbon isotope ratio (also known as GC-C-IRMS or IRMS) testing was just coming into use. It’s a much more complicated type of testing, which takes more time and is more costly to perform. But it’s also said to be able to discriminate between natural (or endogenous) testosterone and the synthetic (or exogenous) variety. Along the way, the T/E ratio test morphed into the screening test that would be followed up by IRMS studies, if necessary. The question in 2000 and today is whether the T/E is even a good screening test.

The March 2000 Journal of Analytical Toxicology article notes a number of potential problems that can affect the outcome of a T/E ratio test, and notes a number of promising technologies both for screening and confirmation. Ultimately, it found that despite the test’s flaws, it was the best method of screening for testosterone doping available at the time.

Among the flaws in the test, the authors noted, were that a certain ethnic group had very low T/E ratios (0.76, or about 3:4). These individuals, even when given large doses of testosterone, would not exceed the screening level that would trigger further investigation. This pointed to a problem of false negatives. What it didn’t address, however, was how it came to be that these people had such low T/E ratios. It also didn’t address the implications of what the cause of that might mean in in terms of the test and its value.

Well, a new paper entitled “Doping Test Results Dependent on Genotype of UGT2B17, the Major Enzyme for Testosterone Glucuronidation” being published in the June issue of the Journal of Clinical Endocrinology & Metabolism offers a potential answer. The paper suggests that there is a genetic trait that can undermine the effectiveness of the T/E ratio as a screening test. According to the press release (available over at Trust But Verify):

“Genetic factors may play an important role in the accuracy and sensitivity of testosterone doping tests,” said Jenny J. Schulze, Ph.D, of the Karolinska University Hospital in Stockholm, and lead author of the JCEM study. “This is of interest not only for combating androgen doping in sports, but also for detecting and preventing androgen abuse in society.”

Here’s the low-down, there is a set of genetic traits that, when an individual inherits one version can cause a 40% false negative rate, and when an individual inherits a different variant can cause a 14% false positive rate. Now, for the false positives, the IRMS test (when performed and interpreted correctly) is very likely to determine that a false positive has occurred. But, as the press release posted at TBV notes:

“False positive results are not only of concern for the legal rights of the sportsman,” said Dr. Schulze, “they also yield extra workload for the doping laboratories.”

So, one thing to do would be to find a way to eliminate false positives, in order to eliminate extra work and expense for the anti-doping labs. But what about the people who were false negatives? They, like all the other participants in the study, were given 360 milligram doses of testosterone, and still came up negative on the T/E screening test. In the case of false positives, if you have a follow-up test that can weed those results out (and if the results remain confidential unless an anti-doping case is pressed against an athlete — which is a big if in some places) at least no harm is done to anyone.

Athletes avoiding detection, however, do harm others — at least in the sense that they are able to cheat and get away with it, which may influence others to cheat, too. So we need to be equally or more concerned with those who manage to evade detection as with those who come up as false positives.

One common refrain is that a large number of athletes who are cheating are somehow evading detection. It’s a hard proposition to prove in a quantifiable way, because so few who have done so have ever admitted publicly that they beat the system. How many athletes have come forward voluntarily to say, “Yeah, I beat the vampires”? In Marion Jones’ case, she wouldn’t have admitted anything were it not for a certain check fraud scam of former boyfriend Tim Montgomery that came back to haunt her, too.

For a screening test to be effective, the percentage of false negatives has to remain low. Otherwise, it’s pretty well worthless. With a large number of false negatives, lots of people could evade detection. In addition, there is no additional follow-up testing that is done to see about false negatives, so once an athlete has escaped detection, he or she is out of the woods — at least until the next test. Now, however, there is evidence that some people could, in theory, evade detection by the current T/E screening tests due to the luck of who their parents were.

Sounds an awful lot like the T/E screening test with a one-size fits all threshold level is not “fit for purpose,” and that a new approach is needed. As the authors of this new study note:

Ideally, the researchers suggest that, depending on the athlete’s genotype, there should be different cut-off levels for doping tests.

Additionally, back in 2000, some other types of screening tests were already on the drawing board. It might behoove those in the anti-doping community to seriously consider changing the current protocol to be based on an athlete’s variant of the genetic trait, and also to investigate whether the techniques proposed at back in 2000 also be better equipped to discern who might or might not be cheating.

Of course, basing T/E test results on each athlete’s variant of a particular genetic trait also means knowing what variant each athlete has. And that gets into the issue of genetic and DNA testing, which raises even more issues. The solution offered by the Karolinska Institute’s researchers is intriguing. I’ll be looking forward to reading the full paper when it comes out in June. The biggest pitfall to this approach is whether or not athletes will be willing to allow such DNA or genetic testing. I suspect in some sports they will, while in other sports there will be some strong resistance to providing such samples and data.

The Karolinska researchers’ discovery is a development to keep your eyes on.

Thomas A. Fine March 24, 2008 at 6:36 am

Hi Rant,

I said a long time ago, and I still believe, that a doper is less likely to fail the testosterone tests than a clean athlete.

Someone doping would simply take T and epi-T in proper proportions to insure that their T/E ratio looked proper. Regular doping would keep their T/E even more normal and even than it could be in a clean athlete. Hence, their risk exposure to any false positive rate in the NEW test would be zero.

The clean athlete meanwhile might have that bad gene and fail the T/E, and then be exposed to testing under the new test, and to the false positive rate of that test, whatever it might be.

But that’s not the central issue for me. The big issue is that you made the same mistake that everyone makes. “The new test is newer so it must be good.” Sure the new test has a solid base of research behind it. But so did the T/E test. The issue is the same – was the test adequately researched for the outside case, or for outside influences on the test? After many years, we now know that the answer for the T/E test is “no”. Why then, do you still assume the new test is proof against false positives?

tom

Rant March 24, 2008 at 7:09 am

Tom,
Very good point. By the new test, I assume you mean the CIR/IRMS? Whether or not it was well enough researched to constitute proof against false positives is a good question. I’ll have to go back tonight and look at the the first paper to see exactly what they said about it, but they did make some comments in 2000 about the relative effectiveness of the test.
Newer isn’t always better, as you’ve noted. (Anyone who used Mavic’s electronic gear shifting system in the early 90s can attest to that. It had a small problem with moisture screwing things up during inclement weather.)
“The Cream” from BALCO is a good illustration of how to beat the screening tests. T and epi-T were balanced in just the way you suggest. Of course, someone who’s doping really isn’t running a risk of a false positive. 😉 They’re running the risk (and trying to avoid) getting caught.
I wouldn’t go quite so far as to say that the CIR/IRMS test is a complete guarantee against false positives. The Landis case is a good example of testing (or more accurately, testers) run amok. If it’s truly capable of determining whether the T is natural or artificial, it’s at least a way of catching false positives on the T/E test. But a lack of standards on what constitutes a positive (1 metabolite, 2?, 3? all 4?) makes the interpretation of the results more than a little iffy in my mind.
I think it’s more fair to say that if the newer test really does deliver the results claimed, then it’s at least a way of catching some (though I suspect not all) false positives that show up using the T/E screening. When it comes to trying to ban the use of naturally occurring hormones and detecting artificial versions, the devil is in the details. And among the details is how accurate are any of the tests to differentiate between the two.
I probably should have taken more time to flesh out that part of the post.

Thomas A. Fine March 24, 2008 at 8:33 am

I think it’s also a case of test design run amok.

The CIR test involves the same kind of standard deviation estimates as the original T/E tests. It makes the same kind of presumptions of simplistic metabolism models that the T/E test presumed.

Floyd’s single metabolite being positive should’ve raised more alarms than it did, specifically about what it means about what’s happening inside the body. The T-Gel results that Schanzer found are on the surface a possible explanation of Floyd’s profile, but these results themselves should have raised alarms that there are things happening within this test more complicated than anyone understands.

There’s no way to know right now if Floyd’s body processes things differently due to some random set of genetic differences. On the other hand there is already enough evidence (IMHO) to exclude the test on the basis of alcohol.

tom

Rant March 24, 2008 at 9:51 am

Tom,
I share your concerns about test design. Some of the papers cited by the March 2000 article were for studies that involved as few as 3 participants. Others were in the range of 5, 10, 15, maybe even as many as 30.
While any of those sample sizes can offer intriguing results that may suggest a pattern, I wonder whether the sample sizes aren’t too small to draw statistically significant conclusions. It seems to me, given the overall population that the data is extrapolated to, such studies are woefully short in terms of participants to offer more anything more meaningful than a hunch or suggestion of how something works, or whether a test is accurate.

sandman in TN March 24, 2008 at 1:12 pm

We should give the Karolinska researchers kudos for putting together what seems like a well-designed study with a reasonable number of subjects. It’s not powerful enough to draw definitive conclusions, but it certainly generates additional hypotheses and supports a need for more study. Of course, TBV reminded us recently that Berry pointed out the dangers of testosterone testing (in relation to the Slaney affair) several years ago – but his warnings fell on deaf ears.
Rant – great job, btw.

BannaOj March 24, 2008 at 1:50 pm

On the human interest side, were you able to get to your father in time? I’ve been in that sort of situation and it isn’t fun.

Rant March 24, 2008 at 5:22 pm

BannaOj,

Sadly, I arrived less than five minutes too late.

Larry March 24, 2008 at 8:02 pm

Rant, I’m so sorry to hear that.

Jean C March 25, 2008 at 3:52 am

I can have miss some points but if the T/E ratio is affected by genetics, it’s probably easy to detect those athletes, and at least they can easily defend themself is’nt it?

Rant March 25, 2008 at 4:10 am

Jean,
True, with this new information and DNA testing, it ought to be possible to detect those people. But, as a screening test, knowing that there’s a number of people whose genetics make it easy for them to cheat and not be detected (because their T/E ratios are extremely low and the T metabolism isn’t as great), I have to wonder how effective the screening test is. Defending a false positive could be done (though it involves more work for the labs and lawyers on both sides). It’s best to reduce the number, however, to reduce the costs for the labs, the athletes and the anti-doping system. But even if that’s done, at least as big a challenge as that is finding those false negatives — the ones who are cheating and getting away with it. People who have a genetic trait that allows them to test negative on the screening tests, despite using a drug, are at a clear advantage.

karuna March 25, 2008 at 5:04 am

It seems to me that there are two important problems concerning the T/TE test and tests in general.
-The first is that there’s just not enough money to do the right test and to do the right research.
-And thus: there is not enough research

Where Rant is pointing to in this post is something that was already seen in 1997, the study Larry gave in his summary about the Landis evidence: http://ia351412.us.archive.org/1/items/Floyd_Landis_Case_Documents_14/GDC01091-GDC01100.pdf.
In the full study (this is just a part of it) is already mentioned that some subject never came above the critical threshold despite the fact that they were taking testosterone injections.
Okay, after that there was some research, but as Rant says in a comment: with just a few subjects. Not enough from a scientific point of view.
So it seems to me that the false negatives are taken for granted because there’s not enough to go on: not enough research to make a good distinction between ethical background, not enough money to do a IRMS test on everyone, not enough labs to do IRMS tests.

There is something else that wondered me. It is just an observation, it might mean nothing.
In the study: Confirming testosterone administration by isotope ratio mass spectrometric analysis of urinary androstanediols (that’s the name of the study Larry gave us), is spoken about food being able to change the result of a IRMS testosterone test.
Without going into detail, it’s very easily said in the study that food does have an influence but that it can’t influence the verdict positive or negative for exogenous testosterone.
To say it very simple: the plants we eat could not have the right carbon atoms.
Well, that was in 1997. But now we eat genetically altered soy products.
Maybe that doesn’t change anything. I couldn’t find anything about it.
And since exogenous testosterone can be made out of byproducts of soy it made me wonder.

William Schart March 25, 2008 at 5:12 am

We have had, I believe, some questions about foricing athletes to submit DNA samples in the OP affair – UCI wants athletes to prove DNA samples so they can match up the blood bags, athletes are reluctant to provide such samples. As far as I know, it stands there. Of course, UCI/WADA could implement rules requiring DNA samples as part of the standard contract riders sign; how such rules would play in various countries is beyond my expertise. I know there has been questions raised here in the US about having people submit to DNA testing as a requirement of employment, primarily on the idea that if certain genetic conditions are know, someone might be denied a job or insurance.

As far a defending against a false positive, of course an athlete could voluntarily submit to DNA testing to determine if he has the genetic trait in question. DNA testing is expensive, however. I also question if the current system would actually allow such a defense.

But the bigger issue here is whether or not a test with an error rate of 54% (40% false negetive 14% false positive) should be relied on at all.

karuna March 25, 2008 at 5:15 am

Oh,
I am reading a lot to catch up on everything concerning the Landis case, but I didn’t read everything yet. For instance, I did not read the transcripts yet. So maybe the “˜foodthing’ came up but I didn’t see it.
In that case: sorry to have wasted your time!

karuna March 25, 2008 at 6:06 am

I did find something about the food:

Short communication
Longitudinal profiling of urinary steroids by gas chromatography/combustion/isotope ratio mass spectrometry: Diet change may result in carbon isotopic variations

Christophe Saudana, , , Matthias Kamberb, Giulia Barbatic, Neil Robinsona, Aurélien Desmarcheliera, Patrice Mangina and Martial Saugya
aLaboratoire Suisse d’Analyse du Dopage, Institut Universitaire de Médecine Légale, Rue du Bugnon 21, 1005 Lausanne, Switzerland
bSwiss Federal Office of Sport, 2532 Magglingen, Switzerland
cCentro di Statistica Medica, AFaR, Ospedale Fatebenefratelli, Rome, Italy
Received 13 June 2005; accepted 18 November 2005. Available online 9 December 2005.

Abstract
Longitudinal profiling of urinary steroids was investigated by using a gas chromatography/combustion/isotope ratio mass spectrometry (GC/C/IRMS) method. The carbon isotope ratio of three urinary testosterone (T) metabolites: androsterone, etiocholanolone, 5β-androstane-3α,17β-diol (5β-androstanediol) together with 16(5α)-androsten-3α-ol (androstenol) and 5β-pregnane-3α,20α-diol (5β-pregnanediol) were measured in urine samples collected from three top-level athletes over 2 years. Throughout the study, the subjects were living in Switzerland and were residing every year for a month or two in an African country. 13C-enrichment larger than 2.5″° was observed for one subject after a 2-month stay in Africa. Our findings reveal that 13C-enrichment caused by a diet change might be reduced if the stay in Africa was shorter or if the urine sample was not collected within the days after return to Switzerland. The steroids of interest in each sample did not show significant isotopic fractionation that could lead to false positive results in anti-doping testing. In contrast to the results obtained with the carbon isotopic ratio, profiling of urinary testosterone/epitestosterone (T/E) ratios was found to be unaffected by a diet change.

Keywords: Steroids; Diet; Isotope ratio mass spectrometry (IRMS); Doping control

Corresponding author. Tel.: .

Journal of Chromatography B
Volume 831, Issues 1-2, 2 February 2006, Pages 324-327

bitch slap me back! March 25, 2008 at 6:44 am

Yes but if Landis had the “bad” gene that would provide for a false positive, then he would have been setting the alarms off years ago. Genetics: either you got it or you ain’t got it.

William Schart March 25, 2008 at 7:20 am

True, but remember that our discussions here are on 2 levels: oness level concerns the Landis case directly, the second level are the broader implications which may not be relevant to the Landis case, but would be relevant in other cases.

bitch slap me back! March 25, 2008 at 9:39 am

doesn’t matter william. if you have the bad gene you should set the alarm off enuf times to either convict your ass or the test. so either pro riders are mostly/entirely devoid of the bad gene and so do not set off this test over and over during testing, or the test is not that sensitive after all such that having the bad or good gene is irrelevant. either way this is a moot point as far as the reliability of testing is concerned.

Thomas A. Fine March 25, 2008 at 9:47 am

It doesn’t matter what year, we’ve always eaten foods that could influence
the CIR test. If you really want to go down this road, it’s already been paved, by me.

Read these in order:

http://hea-www.harvard.edu/~fine/opinions/testosterone_d13C.html

http://hea-www.harvard.edu/~fine/opinions/testosterone_again.html

http://www.dailypelotonforums.com/main/index.php?showtopic=3929

tom

karuna March 25, 2008 at 10:05 am

Thank you Tom
I didn’t know you already wrote things about the ‘foodthingy’. I will take a look at your links!

William Schart March 25, 2008 at 10:47 am

Slap:

The false positive issue is only one side of the equation, and the smaller side at that. More significant (although not to Landis) are the 40% false negatives. This means that the could be a significant number of riders who can dope with T and avoid detection, without having to do anything.

Larry March 25, 2008 at 11:31 am

Tom –

What, exactly, is testosterone glucuronide? Is this a testosterone metabolite?

I haven’t paid as much attention to the T/E side of things as to the CIR test.

I hope you hang around here and participate frequently. I’ll have a lot of questions for you.

Morgan Hunter March 25, 2008 at 11:40 pm

Thomas A. Fine,

That is exceptional detecting work – thank you for taking the trouble and time to getting us closer to understanding the important issues that are not discussed in the mainstream…at least not with the clarity you bring to it.

Thomas A. Fine March 26, 2008 at 11:37 am

Always happy to help. Or I was, up until about eight months ago when I just decided I’d dedicated enough time to Floyd, and that I should get back to some of my own projects. I’m just dropping in to check on things at this point, but still trying to stay out of it for my own sanity. So hopefully you won’t see too much of me, barring some dramatic turn of events.

I can’t really answer the testosterone glucuronide question very well. It’s not something I focused on. Google is your friend…

tom

Rant March 26, 2008 at 12:04 pm

Tom,
All the work you have done is greatly appreciated. But one’s sanity is most important of all. Looking forward to seeing you check back from time to time. The most dramatic turn of events (if that’s how it will play out) may not be for a few months, yet. In the meantime, stop on by whenever you get a chance.

Rant March 26, 2008 at 6:57 pm

Larry,

Thanks. In answer to your question about testosterone glucuronide, it is a metabolite or related form of testosterone that is found in urine. As is epitestosterone glucuronide. The T/E ratio that we all know and love is a measure of TG/EG, actually. (Source for this information is the first article I cited in this post, “Evaluation of Testosterone/Epitestosterone Ratio Influential Factors as Determined by Doping Analysis” by D.H. van de Kerkhof, D. de Boer, and R.A.A. Maes, published in the March 2000 issue of the Journal of Analytical Toxicology, pages 102 – 115.)

{ 1 trackback }

Previous post:

Next post: