{"id":20,"date":"2008-10-06T10:02:11","date_gmt":"2008-10-06T09:02:11","guid":{"rendered":"https:\/\/blogs.bmj.com\/medical-ethics\/?p=20"},"modified":"2018-08-19T14:02:53","modified_gmt":"2018-08-19T13:02:53","slug":"a-fishy-affair","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/","title":{"rendered":"A fishy affair"},"content":{"rendered":"

By David Hunter<\/strong><\/p>\n

Writing in his usual uncompromising style Ben Goldacre describes the latest carry-ons in the “trial”<\/a> carried out in Durham by the Council on whether fish oils improve GCSE performance:<\/p>\n

You\u2019ll remember the Durham fish oil \u201ctrial\u201d story, possibly the greatest example of scientific incompetence ever documented from a local authority.<\/p>\n

Initially they said – to blanket media coverage \u2013 that they were running a trial on fish oils, giving pills to 3,000 children to see if it improved GCSE performance. I pointed out, along with several academics, that their experiment was incompetently designed, for no good reason, and so would only produce false positive results. They responded that this was okay, as they hadn\u2019t called it a \u201ctrial\u201d.<\/p><\/blockquote>\n

<\/p>\n

Now despite not being a “proper” trial, they bizarrely are reporting their results, although as Goldacre points out their analysis is woeful.<\/p>\n

\u201cDetailed analysis of the outcome of the initiative,\u201d they say \u201cshows that pupils who took the Omega-3 supplement did better than those who did not.\u201d Hardly. Let\u2019s try to disentangle what they think they\u2019ve done.<\/p>\n

\u201cInitially, just over 3,000 Year 11 pupils began the study, taking the Omega-3 tablets at school and at home. By the time GCSE examinations came around, 832 pupils had 80 per cent or greater compliance.\u201d This is appalling. 2,168 of their subjects dropped out of the trial: they must count these people in the results. They do not. This makes the rest of their claimed results even more meaningless.<\/p>\n

\u201cMr Ford and his colleagues then sought to identify the same number of Year 11 pupils who had not taken the supplement and match them to those who had, according to school, gender, prior attainment and social background.\u201d They originally said they were going to compare childrens\u2019 predicted GCSE performance (whatever on earth that means) against actual performance. Of course, they refused to say how they would analyse this, despite hundreds of requests: and it is vitally important that people performing experiments are clear what they are measuring, and how they will analyse it, before they begin, otherwise they can move the goalposts and get a false positive result afterwards, by slicing the cake a dozen different ways.<\/p>\n

\u201cThe GCSE results of 629 \u2018matched pairs\u2019 \u2013 fish oil takers and non-fish oil takers – were then analysed.\u201d Who are these 629? I thought it was 832? But more importantly, by selectively only looking at the results from the pupils who were most highly adherent to the capsules regime, they have skewed their sample, entirely unnecessarily. They have, in fact, simply discovered that school performance is better in children who are more highly adherent to a school regime involving pills, and who are, in all probability, also more adherent to everything at school, harder working, better performing, from completely different families, with higher aspirations, and so on. If you wanted to design an experiment to produce a spurious false positive result, you could not do any better than this.<\/p><\/blockquote>\n

Anders Sandburg has already discussed over at Practical Ethics the unfortunate likely impact of this research: The price of ignorance: the Durham study and research ethics<\/a> and there are other concerns to be raised about this poor quality science and indeed the risks it poised for no possible benefit for research participants.<\/p>\n

However I instead want to focus on what might be done to avoid it occurring again largely by making an unpopular suggestion. This is of course that all research involving human subjects big or small, NHS or not, medical or social science, ought to get reviewed by an appropriate independent research ethics committee before being allowed to go ahead.<\/p>\n

Here in the UK we have a rigorous system of ethical review for projects involving the staff, patients and resources of the National Health Service, and some (depending on which bit of the UK you are in) other research activities are legally required to go through that system as well. (Primarily research involving clinical trials, human tissue & those lacking mental capacity). However if you fall outside those categories then there is no requirement for review of the research by an appropriately constituted independent committee.<\/p>\n

The result of this “system” is precisely that research like this can be carried out, the only time regulation may occur is legally if something goes seriously wrong (so for example if one of the children involved in this trial had a problem with bleeding that was arguably exacerbated by the fish oil pills).<\/p>\n

It is difficult to see a justification for the present system. It might be thought that research related to the NHS is likely to be more risky, but if anything then that justifies a staggered system of ethical review, proportional to the likely risk (not that I am fond of that notion<\/a>) rather than a two tiered system where some but not all of the highly risky research gets rigorous review and the rest gets no review at all. What the UK needs is a comprehensive and coherent system for the review of research.<\/p>\n","protected":false},"excerpt":{"rendered":"

By David Hunter Writing in his usual uncompromising style Ben Goldacre describes the latest carry-ons in the “trial” carried out in Durham by the Council on whether fish oils improve GCSE performance: You\u2019ll remember the Durham fish oil \u201ctrial\u201d story, possibly the greatest example of scientific incompetence ever documented from a local authority. Initially they […]<\/p>\n

Read More…<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[317,7942],"class_list":["post-20","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-research","tag-research-ethics"],"yoast_head":"\nA fishy affair - Journal of Medical Ethics blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A fishy affair - Journal of Medical Ethics blog\" \/>\n<meta property=\"og:description\" content=\"By David Hunter Writing in his usual uncompromising style Ben Goldacre describes the latest carry-ons in the “trial” carried out in Durham by the Council on whether fish oils improve GCSE performance: You\u2019ll remember the Durham fish oil \u201ctrial\u201d story, possibly the greatest example of scientific incompetence ever documented from a local authority. Initially they [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/\" \/>\n<meta property=\"og:site_name\" content=\"Journal of Medical Ethics blog\" \/>\n<meta property=\"article:published_time\" content=\"2008-10-06T09:02:11+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-08-19T13:02:53+00:00\" \/>\n<meta name=\"author\" content=\"BMJ\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"BMJ\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/\"},\"author\":{\"name\":\"BMJ\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/person\\\/ba3da426ed20e8f1d933ca367d8216fe\"},\"headline\":\"A fishy affair\",\"datePublished\":\"2008-10-06T09:02:11+00:00\",\"dateModified\":\"2018-08-19T13:02:53+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/\"},\"wordCount\":834,\"commentCount\":2,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\"},\"keywords\":[\"Research\",\"Research Ethics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/\",\"name\":\"A fishy affair - Journal of Medical Ethics blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#website\"},\"datePublished\":\"2008-10-06T09:02:11+00:00\",\"dateModified\":\"2018-08-19T13:02:53+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/2008\\\/10\\\/06\\\/a-fishy-affair\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A fishy affair\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\",\"name\":\"Journal of Medical Ethics blog\",\"description\":\"A blog to discuss the ethics of medicine in its many guises and formats.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#organization\",\"name\":\"Journal of Medical Ethics blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/files\\\/2026\\\/04\\\/jme-logo.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/files\\\/2026\\\/04\\\/jme-logo.png\",\"width\":200,\"height\":50,\"caption\":\"Journal of Medical Ethics blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/#\\\/schema\\\/person\\\/ba3da426ed20e8f1d933ca367d8216fe\",\"name\":\"BMJ\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"caption\":\"BMJ\"},\"sameAs\":[\"https:\\\/\\\/blogs.bmj.com\\\/\"],\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/medical-ethics\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A fishy affair - Journal of Medical Ethics blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/","og_locale":"en_US","og_type":"article","og_title":"A fishy affair - Journal of Medical Ethics blog","og_description":"By David Hunter Writing in his usual uncompromising style Ben Goldacre describes the latest carry-ons in the “trial” carried out in Durham by the Council on whether fish oils improve GCSE performance: You\u2019ll remember the Durham fish oil \u201ctrial\u201d story, possibly the greatest example of scientific incompetence ever documented from a local authority. Initially they [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/","og_site_name":"Journal of Medical Ethics blog","article_published_time":"2008-10-06T09:02:11+00:00","article_modified_time":"2018-08-19T13:02:53+00:00","author":"BMJ","twitter_card":"summary_large_image","twitter_misc":{"Written by":"BMJ","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/"},"author":{"name":"BMJ","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/person\/ba3da426ed20e8f1d933ca367d8216fe"},"headline":"A fishy affair","datePublished":"2008-10-06T09:02:11+00:00","dateModified":"2018-08-19T13:02:53+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/"},"wordCount":834,"commentCount":2,"publisher":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization"},"keywords":["Research","Research Ethics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/","url":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/","name":"A fishy affair - Journal of Medical Ethics blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#website"},"datePublished":"2008-10-06T09:02:11+00:00","dateModified":"2018-08-19T13:02:53+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/2008\/10\/06\/a-fishy-affair\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/medical-ethics\/"},{"@type":"ListItem","position":2,"name":"A fishy affair"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#website","url":"https:\/\/blogs.bmj.com\/medical-ethics\/","name":"Journal of Medical Ethics blog","description":"A blog to discuss the ethics of medicine in its many guises and formats.","publisher":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/medical-ethics\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#organization","name":"Journal of Medical Ethics blog","url":"https:\/\/blogs.bmj.com\/medical-ethics\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/medical-ethics\/files\/2026\/04\/jme-logo.png","contentUrl":"https:\/\/blogs.bmj.com\/medical-ethics\/files\/2026\/04\/jme-logo.png","width":200,"height":50,"caption":"Journal of Medical Ethics blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/medical-ethics\/#\/schema\/person\/ba3da426ed20e8f1d933ca367d8216fe","name":"BMJ","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","caption":"BMJ"},"sameAs":["https:\/\/blogs.bmj.com\/"],"url":"https:\/\/blogs.bmj.com\/medical-ethics\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts\/20","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/comments?post=20"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/posts\/20\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/media?parent=20"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/categories?post=20"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/medical-ethics\/wp-json\/wp\/v2\/tags?post=20"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}