Friday, February 11, 2011

Exactly how many ways are there to get an autism diagnosis?


There’s a saying in autism circles that I really like: “If you’ve met one person with autism, you’ve met one person with autism”. I reckon I’ve met a few hundred in my time, and I can vouch for the fact that people with autism are a pretty mixed bunch.

This has a big influence on the way I think about autism and, increasingly, the way I conduct autism research. Rather than just trying to determine whether or not X (whatever X is) happens to be impaired in autism, my colleagues and I look at our group of participants with autism and try and work out which individuals have problems with X and what makes them different from the individuals with autism that don’t have a problem. This seems an eminently sensible approach to us. One that might actually tell us some useful stuff. But it doesn't always go down very well.

I’ve given a few talks on the issue, which have been really well received. But then again, I’ve mostly been speaking to teachers and paediatricians – people who actually work with lots of different people with autism every day – or to researchers who don’t do autism research and so have a fairly neutral perspective.

But when we try and publish this research, we invariably come up against reviewers conditioned to think in terms of autism as a big box of amorphous abnormality; reviewers who consider that any study is "fatally flawed" and "theoretically irrelevant" if it doesn't finish up with a conclusion that X is impaired / normal / enhanced (delete as applicable) in autism. Not all reviewers, I hasten to add. But enough to make it very difficult for journal editors to accept the papers.

In my talks, I usually start off with a couple of slides that show the current diagnostic criteria for autistic disorder according to the clinical psychologist’s bible, DSM IV. In a nutshell, there are 12 different things that the person making the diagnosis should look for – 12 different boxes that can be ticked or not. To get a diagnosis, you need at least 6 ticks. It’s not quite as simple as that though. The 12 boxes are divided into three categories, headed social interaction; communication impairments; and repetitive behaviours / restricted interests. You need at least two ticks in the first category and at least one tick in the other category. If you don’t, then you don’t have autism.

I know what you’re thinking but them’s the rules.




I then point out the fact that, in principle, this means that you can have two different people with the same diagnosis despite ticking six completely different boxes. And I illustrate this with two imaginary kids who have nothing in common other than their diagnostic label.




Anyway, today I was busily trying to write a paper related to these issues and I got to wondering, just how many different ways are there to get an autism diagnosis?

So this is what I did. I made a spreadsheet in Excel which had 12 columns, corresponding to the 12 different boxes that can be ticked. I then filled each of the rows below with a different combination of ticks and crosses (actually 1s and 0s).

Altogether there were 4096 possible combinations of ticks and crosses, going from all crosses to all ticks with everything in between (mathematically inclined readers will spot that 4096 is 2 to the power 12).

Then I added a 13th column that showed for each row whether the particular combination of ticks and crosses would get you a DSM IV diagnosis of autistic disorder. Finally I added up the number of rows with a positive diagnosis.

The answer… drum roll… is 2027. That’s right. Two thousand and twenty seven different ways of getting an autism diagnosis.

Now, you can argue that some of the combinations might not actually exist in reality. And you might well be right. But that’s not really the point.

The point is that a lot of autism research begins with the premise that even though there are 2027 different ways of getting an autism diagnosis, being in the autism 'gang' makes you (a) fundamentally similar to all the other gang members and (b) fundamentally different to everyone that doesn't make the grade. That’s a big, big assumption. And I for one am not willing to make it.


Notes:

I've posted the Excel sheet here. Feel free to download it, check my sums, and tell me if I've done something stupid!!


Update (31/01/12):

The always excellent Autism and Oughtisms pointed out that in DSM 5, the number of combinations will drop from 2027 to 11. However, that's mainly because the 8 boxes under social and communication are being replaced with a single box called "Deficits in social-emotional reciprocity". Although this is mandatory (you'll need a tick in this box to get a diagnosis), it's incredibly broad. "Deficits" can range “from abnormal social approach and failure of normal back and forth conversation through reduced sharing of interests, emotions, and affect and response to total lack of initiation of social interaction”.

Then Allen Frances in the Huffington Post somehow concludes that the number of combinations will go down from 2688 to 6. I have no idea where he gets these numbers from. He also completely misses the point that the number of combinations is only meaningful if the items themselves are the same.

Finally, writing in Scientific American, Ferris Jabr got some astronomer dude to write a computer program for him to work out the combinations. He gets 2027 and 11 too. And computers are always right. Right? Jabr argues that the 2027 is meaningless because cluster analysis suggests there are far fewer combinations that actually exist. He's right of course. But it doesn't change the fact that, regardless of whether we're looking at DSM IV or DSM 5 criteria, the heterogeneity within autism is massive, and it's a bit bonkers for us all to keep pretending that it isn't there.

13 comments:

  1. I wonder how many combinations there are when you add pdd-nos and Aspergers to the mix. Its no wonder that every person involved with autism has a different impression of what it is like.

    What I find particularly interesting though is the fact that my identical twin daughters who both have autism can be so different from each other. They both share the same core problems areas but the manifestation of these problems are different about half of the time.

    For example, they are both sensitive to sound but one likes to have constant loud noises in the background while the other can't stand it. Another example is that their stereotypies are different different from each other with very little overlap.

    It makes me wonder how many of the behaviors of autism are "genetic" in the classic sense of the word and how many are driven by the person's experiences and environment.

    ReplyDelete
  2. That is very interesting, the possible combinations. That is diversity!

    Off topic, sorry, the "lack of imaginative play" bothers me.It seems some autistics play is visual, not verbal. They see whole scenarios in their mind. I thought that was the definition of imagination, being able to visualize something.

    ReplyDelete
  3. MJ: Thanks for the comment. I'd love to hear more.

    I happen to think that identical twins are the most fascinating and potentially the most informative cases of autism, because they're right at the intersection of environmental and genetic causes. When geneticists talk 'environmental', they don't necessarily mean major identifiable life events or experiences but any variation between individuals that can't be attributed to their genes. In the case of your daughters, all the differences between them are 'environmental'. Genes are a large part of the autism story, but they're not the whole story.

    Incidentally, I recently came across a fantastic post on this issue over on the Wiring the Brain website:

    http://wiringthebrain.blogspot.com/2009/06/nature-nurture-and-noise.html

    ReplyDelete
  4. RB: The "imagination" issue is a funny one. I think I'm right in saying that originally the distinction was between (typical) imaginative social play and (autistic) stereotyped non-social play (eg lining all your cars up rather than playing with them 'properly'). Which makes sense to me.

    It's kind of relevant to the social side of autism and also relevant to the repetitive behaviours / restricted interests. But somehow that's ended up as being filed under "communication" in DSM IV, which is bonkers.

    Unfortunately, it's also been translated into "people with autism have no imagination", which really is just rubbish.

    ReplyDelete
  5. Rubbish indeed. I love the post. My wife and I were just talking about how everyone is "on the spectrum" when that is simply not true. Every person I have come across has their own distinct position on the spectrum.

    I sometimes wonder whats not typical about lining all your cars up. I was in a HUGE line of cars all day today, essentially every where a person drives is in a line isn't it?

    ReplyDelete
  6. I agree with Danon, you represent the world in the way you think. How can you do otherwise? No drug or therapy can make a visual thinker think auditorily. Even with practice, it will always be his "native tongue".

    ReplyDelete
  7. I wonder how the criteria proposed for the DSM-V will change these results.

    RB- I think imaginative play is a reflection of how an individual both represents the world and how he/she is able to manipulate it.

    ReplyDelete
  8. Just want to say that I'm really enjoying reading these comments. Keep 'em coming!

    If I get a chance I'll try and work out the combos for Asperger's and PDDNOS. Although I think the point has already been made - it's gonna be an even bigger number!

    Danon - that line about traffic jams made me laugh out loud.

    Can I also draw attention to R.B's post that I'm proud to say was inspired by this discussion!! See the link at the bottom of the page under "Links to this post"

    ReplyDelete
  9. None of the twelve symptoms contained in DSM-IV are specific to autism. The DSM-III defintion required a pervasive lack of responsiveness to others (including parents) to be present for a diagnosis. That definition has been completly removed and in DSM-IV and all the gold standard diagnostic tools based on DSM-IV diagnostic criteria has been replaced by the ambigous lack of social and emotional reciprocity.

    Can dramatic changes in diagnostic criteria result in dramatic increases in autism prevelance rates? Yes, diagnostic substitution and the over-diagnosing of autism is not a new phenomenon in the brief history of autism. In 1965, Kanner joined Van Krevelen in vigorously objecting to the 'abuse of the diagnosis of autism' that 'threatens to become a fashion':
    Kanner wrote in 1965:
    “While the majority of the Europeans were satisfied with a sharp delineation of infantile autism as an illness sui generis, there was a tendency in this country to view it as a developmental anomaly ascribed exclusively to maternal emotional determinants. Moreover, it became a habit to dilute the original concept of infantile autism by diagnosing it in many disparate conditions which show one or another isolated symptom found as a part feature of the overall syndrome. Almost overnight, the country seemed to be populated by a multitude of autistic children, and somehow this trend became noticeable overseas as well. Mentally defective children who displayed bizarre behavior were promptly labeled autistic” Kanner 1965

    ReplyDelete
  10. Huh. The link to RB's post has been mysteriously disappeared. Here it is:

    http://hardwonwisdom.blogspot.com/2011/02/for-being-visionary-were-awfully.html

    Anonymous: Thanks for the Kanner quote. Personally I'm all in favour of relaxing diagnostic criteria if it means more people get services they need. But it does make it awful difficult for us researchers.

    ReplyDelete
  11. Fascinating data and on the flip-side, we surely cannot subscribe to a generic 'neurotypical'. As you allude to, Dr. Brock, and an old 'Stone's' song says ... 'you can't always get what you want, but you can get what you need.' That's all we want and seek for anyone.

    ReplyDelete
  12. To addreess the comments about "lack of imagination or initiative play" in the DSM-IV, I thought I'd use the experience of my little boy to explain what, and why this is important.
    My son is autistic (HF, which DSM-IV wont be using as a diagnosis anymore), and he had such a literal translation of language he could not understand sarcasim, sardonic, or ironic humor. He also was unable to initiate play with NT children his own age, because they completely lost him the second they said.."lets pretend"... He couldn't play without being rigid and repetetive, because he didn't know how to play any other way.
    Here is why imaginative play is important. Not only does it give them the ability to understand playful/non-literal language, but it also helps children initiate play with each other. I once watched my boy stand absolutely still, while watching a goup of NT boys play pretend pirates. The look on his face, showed absolute confusion, and they might as well have been from Mars for all he understood of their game! He gave them a wide berth as he played by himself, (that's where I always found him, on the peripheral of playing children) all alone.
    I enrolled him in a pre-k school with a special curriculum that teaches autistic children how to pretend. The change in his life was quick and astounding. He started pretending at home (for the very first time in his 4 years), and playing pretend with other children too.
    It opened up his world, like a wall came down! He is now able to understand when I say "it's raining cats and dogs" that it really isn't, and when he is on a playground he can say to another child..."lets pretend I'm the good guy, and your the bad guy"... Learning to pretend has made a HUGE impact on his life!
    I hope this antidote has helped explain the inclusion of imaginative play in the DSM-IV, and why it's an important skill. It has transformed my little boy. :)

    ReplyDelete
  13. As I stated in twitter:
    doesn't it make you think that something is wrong with the "people WITH autism" expression.

    Why maintain that there is something called autism , as a real explanatory entity, based on a combination of certain behaviors?

    ReplyDelete