{"id":22057,"date":"2012-11-06T14:42:35","date_gmt":"2012-11-06T13:42:35","guid":{"rendered":"https:\/\/blogs.bmj.com\/bmj\/?p=22057"},"modified":"2012-11-06T14:45:11","modified_gmt":"2012-11-06T13:45:11","slug":"muir-gray-choosing-criteria-for-systems-of-care","status":"publish","type":"post","link":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/","title":{"rendered":"Muir Gray: Choosing criteria for systems of care"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.bmj.com\/site\/blog\/icons\/muir_gray.jpg\" alt=\"Muir Gray\" width=\"160\" height=\"110\" align=\"left\" \/><em>Read the rest of this series of blogs about designing and planning population based systems of care <a href=\"https:\/\/blogs.bmj.com\/bmj\/category\/muir-gray\/\">here<\/a>.<\/em><strong><\/strong><strong><\/strong><\/p>\n<p><strong>Step 4: Choosing criteria<\/strong><\/p>\n<p>Choosing criteria is a more time consuming process and may need to be addressed separately. For example it is important to reach an agreed definition by what is meant by &#8220;diagnose quickly&#8221; and &#8220;diagnose accurately.&#8221;<\/p>\n<p>Each objective needs to have one or more criteria associated with it in order to measure progress. Without criteria, objectives are meaningless.\u00a0 \u00a0<!--more--><\/p>\n<p>Several terms are used as synonyms for criteria: &#8220;metrics,&#8221; &#8220;indicators,&#8221; or &#8220;measures.&#8221; Some people use the term &#8220;measures&#8221; to mean criteria that are considered to be of greater validity than indicators. For example, they would use the term &#8220;measure&#8221; about systematic surveys of patient experience, whereas they would use the word &#8220;indicator&#8221; for the number of letters of complaint or commendation that a hospital chief executive receives. Although the latter is less costly, it is less<br \/>\nvaluable in terms of feedback for the system than the accurate measures used in the former.<\/p>\n<p><strong>The trade-off between validity and feasibility<\/strong><\/p>\n<p>When selecting criteria, the most important issue to tackle is the trade-off between their validity and feasibility (and cost) of collecting the data. Validity is the degree to which a criterion measures what it is intended to measure; feasibility is the ease with which the information can be collected. In general, the greater the validity of a measure, the greater the cost to collect it. In the course of designing an information subsystem to underpin a healthcare system, the aim must be to build the required data into the routine data collection process. For instance, at Dartmouth Hitchcock Medical Center, there is a well developed information subsystem where patient preferences are routinely recorded, as is the type of treatment given to patients. It is then possible to compare the treatment received with stated preference to identify whether patients\u2019 preferences are being met.<\/p>\n<p><strong>How to gain ownership of the criteria<\/strong><\/p>\n<p>The same group of people who set the objectives for a system can also be involved in selecting criteria. In addition, it is useful to invite others, such as academics, who can bring rigour to pinpointing definitions and the meaning of specific criteria. It may be necessary to set up a subgroup to address the issues associated with selecting appropriate criteria.<\/p>\n<p><em><strong><br \/>\nMuir Gray<\/strong> is visiting professor of knowledge management, Nuffield Department of Surgery, University of Oxford. <\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Read the rest of this series of blogs about designing and planning population based systems of care here. Step 4: Choosing criteria Choosing criteria is a more time consuming process [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/\">More&#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2087],"tags":[],"class_list":["post-22057","post","type-post","status-publish","format-standard","hentry","category-muir-gray"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Muir Gray: Choosing criteria for systems of care - The BMJ<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Muir Gray: Choosing criteria for systems of care - The BMJ\" \/>\n<meta property=\"og:description\" content=\"Read the rest of this series of blogs about designing and planning population based systems of care here. Step 4: Choosing criteria Choosing criteria is a more time consuming process [...]More...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/\" \/>\n<meta property=\"og:site_name\" content=\"The BMJ\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bmjdotcom\/\" \/>\n<meta property=\"article:published_time\" content=\"2012-11-06T13:42:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2012-11-06T13:45:11+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.bmj.com\/site\/blog\/icons\/muir_gray.jpg\" \/>\n<meta name=\"author\" content=\"BMJ\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@bmj_latest\" \/>\n<meta name=\"twitter:site\" content=\"@bmj_latest\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"BMJ\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/\"},\"author\":{\"name\":\"BMJ\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/person\\\/ba3da426ed20e8f1d933ca367d8216fe\"},\"headline\":\"Muir Gray: Choosing criteria for systems of care\",\"datePublished\":\"2012-11-06T13:42:35+00:00\",\"dateModified\":\"2012-11-06T13:45:11+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/\"},\"wordCount\":409,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.bmj.com\\\/site\\\/blog\\\/icons\\\/muir_gray.jpg\",\"articleSection\":[\"Muir Gray\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/\",\"name\":\"Muir Gray: Choosing criteria for systems of care - The BMJ\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.bmj.com\\\/site\\\/blog\\\/icons\\\/muir_gray.jpg\",\"datePublished\":\"2012-11-06T13:42:35+00:00\",\"dateModified\":\"2012-11-06T13:45:11+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#primaryimage\",\"url\":\"http:\\\/\\\/www.bmj.com\\\/site\\\/blog\\\/icons\\\/muir_gray.jpg\",\"contentUrl\":\"http:\\\/\\\/www.bmj.com\\\/site\\\/blog\\\/icons\\\/muir_gray.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/2012\\\/11\\\/06\\\/muir-gray-choosing-criteria-for-systems-of-care\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Muir Gray: Choosing criteria for systems of care\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#website\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/\",\"name\":\"The BMJ\",\"description\":\"Helping doctors make better decisions.\",\"publisher\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#organization\",\"name\":\"The BMJ\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2018\\\/05\\\/The-BMJ-logo.jpg\",\"contentUrl\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/files\\\/2018\\\/05\\\/The-BMJ-logo.jpg\",\"width\":852,\"height\":568,\"caption\":\"The BMJ\"},\"image\":{\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/bmjdotcom\\\/\",\"https:\\\/\\\/x.com\\\/bmj_latest\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/#\\\/schema\\\/person\\\/ba3da426ed20e8f1d933ca367d8216fe\",\"name\":\"BMJ\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g\",\"caption\":\"BMJ\"},\"sameAs\":[\"https:\\\/\\\/blogs.bmj.com\\\/\"],\"url\":\"https:\\\/\\\/blogs.bmj.com\\\/bmj\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Muir Gray: Choosing criteria for systems of care - The BMJ","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/","og_locale":"en_US","og_type":"article","og_title":"Muir Gray: Choosing criteria for systems of care - The BMJ","og_description":"Read the rest of this series of blogs about designing and planning population based systems of care here. Step 4: Choosing criteria Choosing criteria is a more time consuming process [...]More...","og_url":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/","og_site_name":"The BMJ","article_publisher":"https:\/\/www.facebook.com\/bmjdotcom\/","article_published_time":"2012-11-06T13:42:35+00:00","article_modified_time":"2012-11-06T13:45:11+00:00","og_image":[{"url":"http:\/\/www.bmj.com\/site\/blog\/icons\/muir_gray.jpg","type":"","width":"","height":""}],"author":"BMJ","twitter_card":"summary_large_image","twitter_creator":"@bmj_latest","twitter_site":"@bmj_latest","twitter_misc":{"Written by":"BMJ","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#article","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/"},"author":{"name":"BMJ","@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/person\/ba3da426ed20e8f1d933ca367d8216fe"},"headline":"Muir Gray: Choosing criteria for systems of care","datePublished":"2012-11-06T13:42:35+00:00","dateModified":"2012-11-06T13:45:11+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/"},"wordCount":409,"commentCount":0,"publisher":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#organization"},"image":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#primaryimage"},"thumbnailUrl":"http:\/\/www.bmj.com\/site\/blog\/icons\/muir_gray.jpg","articleSection":["Muir Gray"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/","url":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/","name":"Muir Gray: Choosing criteria for systems of care - The BMJ","isPartOf":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#primaryimage"},"image":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#primaryimage"},"thumbnailUrl":"http:\/\/www.bmj.com\/site\/blog\/icons\/muir_gray.jpg","datePublished":"2012-11-06T13:42:35+00:00","dateModified":"2012-11-06T13:45:11+00:00","breadcrumb":{"@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#primaryimage","url":"http:\/\/www.bmj.com\/site\/blog\/icons\/muir_gray.jpg","contentUrl":"http:\/\/www.bmj.com\/site\/blog\/icons\/muir_gray.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.bmj.com\/bmj\/2012\/11\/06\/muir-gray-choosing-criteria-for-systems-of-care\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.bmj.com\/bmj\/"},{"@type":"ListItem","position":2,"name":"Muir Gray: Choosing criteria for systems of care"}]},{"@type":"WebSite","@id":"https:\/\/blogs.bmj.com\/bmj\/#website","url":"https:\/\/blogs.bmj.com\/bmj\/","name":"The BMJ","description":"Helping doctors make better decisions.","publisher":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.bmj.com\/bmj\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blogs.bmj.com\/bmj\/#organization","name":"The BMJ","url":"https:\/\/blogs.bmj.com\/bmj\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/logo\/image\/","url":"https:\/\/blogs.bmj.com\/bmj\/files\/2018\/05\/The-BMJ-logo.jpg","contentUrl":"https:\/\/blogs.bmj.com\/bmj\/files\/2018\/05\/The-BMJ-logo.jpg","width":852,"height":568,"caption":"The BMJ"},"image":{"@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/bmjdotcom\/","https:\/\/x.com\/bmj_latest"]},{"@type":"Person","@id":"https:\/\/blogs.bmj.com\/bmj\/#\/schema\/person\/ba3da426ed20e8f1d933ca367d8216fe","name":"BMJ","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b4d8f39281bcae118348a1c027347b8e53b82d42520e774a8b50dd9a6ac6c01d?s=96&d=mm&r=g","caption":"BMJ"},"sameAs":["https:\/\/blogs.bmj.com\/"],"url":"https:\/\/blogs.bmj.com\/bmj\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/22057","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/comments?post=22057"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/22057\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/media?parent=22057"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/categories?post=22057"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/tags?post=22057"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}