You don't need to be signed in to read BMJ Blogs, but you can register here to receive updates about other BMJ products and services via our site.

StatsMiniBlog: Will Rogers Phenomenon

21 Nov, 14 | by Bob Phillips

20140205-091454.jpgThe American humorist, Will Rogers, was reported to have said (of the migration of folk from Oklahoma to California):

When the Okies left Oklahoma and moved to California, they raised the average intelligence level in both states

While this is a deeply unkind comment reinforcing geographical stereotypes, it does a neat job of capturing an epidemological paradox. If you re-define group definitions, you can make both groups averages improve (survival, or IQ) without changing one jot the overall truth. Such a phenomenon must be guarded against when re-defining risk groups, for example on the basis of new diagnostic technologies, and seeing ‘group based’ benefits.

To take it pictorially:

If we have two risk groups, and individuals with good (80%), moderate (50%) and poor survival (10%), we can split them like this:

Slide1

The overall survival rate is 50%; the low risk group ~70% and high risk group ~20%.

If, by better diagnostic technology, we split the orange patients out and plop them in the high risk group this happens:

Slide2

The low risk group improves, now ~80% and high risk group also improves, now 30%. Despite our increasing surival rates in both low and high risk groups, theĀ overall survival rate is unchanged at 50%.

We’ve done nothing.

The Will Rogers phenomenon is subtle, but real. Beware when reading comparisons across time and between different groups. Is some thing really going on?

– Archi

 

By submitting your comment you agree to adhere to these terms and conditions
You can follow any responses to this entry through the RSS 2.0 feed.
ADC blog homeapage

ADC Online

Education, debate, and meandering thoughts on child health, using evidence and research.Visit site



Creative Comms logo
  • ADC Twitter Journal Club

  • Recent Posts

  • Categories

  • Pages

  • ADC Podcasts

Latest from Archives of Disease in Childhood

Latest from Archives of Disease in Childhood