{"id":601,"date":"2014-11-10T14:40:40","date_gmt":"2014-11-10T14:40:40","guid":{"rendered":"https:\/\/blogs.bmj.com\/ebn\/?p=601"},"modified":"2014-11-10T14:40:40","modified_gmt":"2014-11-10T14:40:40","slug":"how-valid-and-reliable-are-qualitative-studies","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/","title":{"rendered":"How valid and reliable are qualitative studies?"},"content":{"rendered":"

Qualitative work has been identified in some quarters as weak, without rigour, subjective and of little use. For an interesting discussion on this see http:\/\/www.biomedcentral.com\/1471-2288\/9\/52<\/a>. In contrast, quantitative research, which aims to delineate phenomena into measurable categories, generalizable to other populations is often viewed as superior. In quantitative research standardised measures are often used in an attempt to collect varying perspectives and experiences of people. For example a list of behaviours may be rated by an observer using a predetermined scale as an instrument in the research to collect data. This is all well and good but once the tool has been used to collect the numbered answers how do we know the measuring instrument was able to measure what it was supposed to measure. Also if we are carrying out a randomised controlled trial of a drug therapy and the drug is not taken regularly by participants in the trial how do we determine why that was if managing an experiment using only quantitative methods? Sometimes we need to ask questions and analyse answers in words in order to understand human experience. As Eisner says a well-executed qualitative study can help us \u201cunderstand a situation that would otherwise be enigmatic or confusing\u201d (Eisner, 1991, p. 58). The enlightened eye: Qualitative inquiry and the enhancement of educational practice<\/em>. New York, NY: Macmillan Publishing Company.<\/p>\n

But back to the issue of validity and reliability \u2013 how do we ensure qualitative studies are of high calibre and we can trust the findings presented. How do we know they are trustworthy? Lincoln and Guba are two well-known and very experienced qualitative researchers who have guided the qualitative debate over many years. See Lincoln & Guba (1985) Naturalistic Inquiry<\/a>, for further discussion<\/p>\n

They discuss a variety of ways to enhance qualitative work and each should be easily identified in any good study:<\/p>\n

Credibility<\/strong> \u2013 this is viewed as one of the most important constructs that assists in establishing trustworthiness of research. Credibility means we have confidence in the findings of the study and it can be established in a number of ways<\/p>\n

    \n
  1. prolonged engagement in the setting with a range of people.<\/li>\n
  2. Triangulation where multiple data sources are used to produce understanding. Previously triangulation has been viewed as a method for testing for validity.\u00a0 This has become controversial as it assumes that it is always possible to make sense of different accounts but this is very difficult to do.<\/li>\n
  3. Peer debriefing defined as:<\/li>\n<\/ol>\n

    “a process of exposing oneself to a disinterested peer in a manner paralleling an analytical session and for the purpose of exploring aspects of the inquiry that might otherwise remain only implicit within the inquirer’s mind” (Lincoln & Guba, 1985, p. 308)<\/p>\n

    Someone who helps debrief can assist the researcher to uncover taken for granted biases, or assumptions and deal with these.<\/p>\n

      \n
    1. Member checking – when data and conclusions are tested with members of those groups from whom the data were originally obtained. Again this is controversial as it relies on the assumption of a fixed truth or reality that is presented by the researcher and confirmed by a respondent<\/li>\n<\/ol>\n

      Transferability<\/strong> \u2013 this means the findings have applicability in other contexts. Giving a \u2018thick description\u2019 of a phenomenon in sufficient detail allows readers to evaluate the extent to which the conclusions drawn are transferable to their settings and people.<\/p>\n

      Dependability<\/strong> \u2013 this is concerned with demonstrating that the findings are consistent and could be repeated. External audits can help with this where a researcher not involved in the research examines the processes and findings of the research study in order to evaluate accuracy and if the findings and conclusions are supported by the data.<\/p>\n

      Confirmability<\/strong> \u2013\u00a0this is the extent to which the findings of a study are shaped on what has been reported by participants and not researcher bias. Reflexivity is an important concept here and involves the researcher attending to how knowledge has been constructed and the effect of the research on the researcher and the researcher on the research.<\/p>\n

      In trying to identify valid and reliable qualitative research studies there are a number of tools which can be used and are recommended, particularly for the novice researcher \u2013 the websites below should help:<\/p>\n

      http:\/\/www.casp-uk.net\/<\/a><\/p>\n

      http:\/\/www.casp-uk.net\/#!casp-tools-checklists\/c18f8<\/a><\/p>\n

      http:\/\/www.huttvalleydhb.org.nz\/content\/e2d00f37-f0ed-4c59-b2bb-05254f2dec9b.cmr<\/a><\/p>\n

      There is a also a great utube video here: http:\/\/www.youtube.com\/watch?v=izaIWCWA5Rc<\/p>\n

      The CASP tool is a good place to start. It includes 10 questions starting with \u2018Was there a clear aim to the research\u2019. Best of luck in finding the best qualitative research to inform your practice. Also look out for a short piece I will be writing in the New Year on validity and reliability for Evidence Based Nursing<\/p>\n

       <\/p>\n","protected":false},"excerpt":{"rendered":"

      Qualitative work has been identified in some quarters as weak, without rigour, subjective and of little use. For an interesting discussion on this see http:\/\/www.biomedcentral.com\/1471-2288\/9\/52. In contrast, quantitative research, which aims to delineate phenomena into measurable categories, generalizable to other populations is often viewed as superior. In quantitative research standardised measures are often used in […]<\/p>\n

      Read More…<\/a><\/p>\n","protected":false},"author":171,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[3641,3640,317,3655],"class_list":["post-601","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-qualitative-research-2","tag-reliability","tag-research","tag-validity"],"yoast_head":"\nHow valid and reliable are qualitative studies? - Evidence-Based Nursing blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How valid and reliable are qualitative studies? - Evidence-Based Nursing blog\" \/>\n<meta property=\"og:description\" content=\"Qualitative work has been identified in some quarters as weak, without rigour, subjective and of little use. For an interesting discussion on this see http:\/\/www.biomedcentral.com\/1471-2288\/9\/52. In contrast, quantitative research, which aims to delineate phenomena into measurable categories, generalizable to other populations is often viewed as superior. In quantitative research standardised measures are often used in [...]Read More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/\" \/>\n<meta property=\"og:site_name\" content=\"Evidence-Based Nursing blog\" \/>\n<meta property=\"article:published_time\" content=\"2014-11-10T14:40:40+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/\"},\"author\":{\"name\":\"\",\"@id\":\"\"},\"headline\":\"How valid and reliable are qualitative studies?\",\"datePublished\":\"2014-11-10T14:40:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/\"},\"wordCount\":811,\"commentCount\":1,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/#organization\"},\"keywords\":[\"qualitative research\",\"reliability\",\"research\",\"validity\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/\",\"name\":\"How valid and reliable are qualitative studies? - Evidence-Based Nursing blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/#website\"},\"datePublished\":\"2014-11-10T14:40:40+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/2014\\\/11\\\/10\\\/how-valid-and-reliable-are-qualitative-studies\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How valid and reliable are qualitative studies?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/\",\"name\":\"Evidence-Based Nursing blog\",\"description\":\"Analysis and discussion of developments in Evidence-Based Nursing.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/#organization\",\"name\":\"Evidence-Based Nursing blog\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/files\\\/2018\\\/04\\\/blog-logo-ebn.png\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/files\\\/2018\\\/04\\\/blog-logo-ebn.png\",\"width\":289,\"height\":34,\"caption\":\"Evidence-Based Nursing blog\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/ebn\\\/author\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How valid and reliable are qualitative studies? - Evidence-Based Nursing blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/","og_locale":"en_US","og_type":"article","og_title":"How valid and reliable are qualitative studies? - Evidence-Based Nursing blog","og_description":"Qualitative work has been identified in some quarters as weak, without rigour, subjective and of little use. For an interesting discussion on this see http:\/\/www.biomedcentral.com\/1471-2288\/9\/52. In contrast, quantitative research, which aims to delineate phenomena into measurable categories, generalizable to other populations is often viewed as superior. In quantitative research standardised measures are often used in [...]Read More...","og_url":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/","og_site_name":"Evidence-Based Nursing blog","article_published_time":"2014-11-10T14:40:40+00:00","twitter_card":"summary_large_image","twitter_misc":{"Written by":"","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/"},"author":{"name":"","@id":""},"headline":"How valid and reliable are qualitative studies?","datePublished":"2014-11-10T14:40:40+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/"},"wordCount":811,"commentCount":1,"publisher":{"@id":"https:\/\/blogs.bmj.com\/ebn\/#organization"},"keywords":["qualitative research","reliability","research","validity"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/","url":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/","name":"How valid and reliable are qualitative studies? - Evidence-Based Nursing blog","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/ebn\/#website"},"datePublished":"2014-11-10T14:40:40+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/ebn\/2014\/11\/10\/how-valid-and-reliable-are-qualitative-studies\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/ebn\/"},{"@type":"ListItem","position":2,"name":"How valid and reliable are qualitative studies?"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/ebn\/#website","url":"https:\/\/blogs.bmj.com\/ebn\/","name":"Evidence-Based Nursing blog","description":"Analysis and discussion of developments in Evidence-Based Nursing.","publisher":{"@id":"https:\/\/blogs.bmj.com\/ebn\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/ebn\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/ebn\/#organization","name":"Evidence-Based Nursing blog","url":"https:\/\/blogs.bmj.com\/ebn\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/ebn\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/ebn\/files\/2018\/04\/blog-logo-ebn.png","contentUrl":"https:\/\/blogs.bmj.com\/ebn\/files\/2018\/04\/blog-logo-ebn.png","width":289,"height":34,"caption":"Evidence-Based Nursing blog"},"image":{"@id":"https:\/\/blogs.bmj.com\/ebn\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"","url":"https:\/\/blogs.bmj.com\/ebn\/author\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/posts\/601","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/users\/171"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/comments?post=601"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/posts\/601\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/media?parent=601"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/categories?post=601"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/ebn\/wp-json\/wp\/v2\/tags?post=601"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}