{"id":298,"date":"2017-01-12T02:26:27","date_gmt":"2017-01-12T02:26:27","guid":{"rendered":"http:\/\/nccororgms.wpengine.com\/tools-mruserguides\/?page_id=298"},"modified":"2017-05-31T19:25:31","modified_gmt":"2017-05-31T19:25:31","slug":"evaluating-existing-measures","status":"publish","type":"page","link":"https:\/\/www.nccor.org\/tools-mruserguides\/food-environment\/evaluating-existing-measures\/","title":{"rendered":"4. Evaluating Existing Measures"},"content":{"rendered":"<div id=\"pl-298\"  class=\"panel-layout\" ><div id=\"pg-298-0\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-298-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-298-0-0-0\" class=\"so-panel widget widget_text panel-first-child panel-last-child\" data-index=\"0\" ><h3 class=\"widget-title\">Food Environment<\/h3>\t\t\t<div class=\"textwidget\"><img decoding=\"async\" src=\"https:\/\/www.nccor.org\/tools-mruserguides\/wp-content\/themes\/mcuserguide\/assets\/images\/grey.gif\" data-original=\"\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2017\/01\/food.jpg\" alt=\"environment\" width=\"350\" class=\"lazy aligncenter size-full\" \/><noscript><img decoding=\"async\" src=\"\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2017\/01\/food.jpg\" alt=\"environment\" width=\"350\" class=\"aligncenter size-full\" \/><\/noscript>\r\n\r\n&nbsp;\r\n\r\n<p>MEASURES REGISTRY USER GUIDE<\/p>\r\n<p><a href=\"http:\/\/nccororgms.wpengine.com\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2017\/NCCOR_MR_User_Guide_Food_Environment-FINAL.pdf\"><b>Download Full PDF <\/b><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.nccor.org\/tools-mruserguides\/wp-content\/themes\/mcuserguide\/assets\/images\/grey.gif\" data-original=\"http:\/\/nccororgms.wpengine.com\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2016\/11\/pdf.jpg\" alt=\"pdf\" width=\"19\" height=\"20\" class=\"lazy aligncenter wp-image-75\" style=\"display: inline-block;\" \/><noscript><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/nccororgms.wpengine.com\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2016\/11\/pdf.jpg\" alt=\"pdf\" width=\"19\" height=\"20\" class=\"aligncenter wp-image-75\" style=\"display: inline-block;\" \/><\/noscript><\/a>\r\n\r\n&nbsp;<\/p>\r\n\r\n<div class=\"wpcmsdev-accordion\">\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-1-introduction\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>1. Introduction<\/a><\/h3><div id=\"accordion-item-1-introduction\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/introduction\/#overview\">Overview of the Food Environment Measures Registry User Guide<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/introduction\/#organization\">Organization of This User Guide<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-2-measuring-food-environments\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>2. Measuring Food Environments<\/a><\/h3><div id=\"accordion-item-2-measuring-food-environments\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/measuring-food-environments\/#why\">Why Study the Food Environment?<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/measuring-food-environments\/#defining\">Defining Food Environments<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-3-key-concepts-in-food-environment-assessment\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>3. Key Concepts in Food Environment Assessment<\/a><\/h3><div id=\"accordion-item-3-key-concepts-in-food-environment-assessment\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/key-concepts-in-food-environment-assessment\/#physical\">Physical Food Environment<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/key-concepts-in-food-environment-assessment\/#social\">Social Environment<\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/key-concepts-in-food-environment-assessment\/#person-centered\">Person-centered Environment<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-4-evaluating-existing-measures\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>4. Evaluating Existing Measures<\/a><\/h3><div id=\"accordion-item-4-evaluating-existing-measures\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/evaluating-existing-measures\/#importance\">The Importance of Psychometric Properties<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-5-measures-with-evidence-of-reliability-and-validity\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>5. Measures with Evidence of Reliability and Validity<\/a><\/h3><div id=\"accordion-item-5-measures-with-evidence-of-reliability-and-validity\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/measures-with-evidence-of-reliability-and-validity\/#physical\">Physical Food Environment<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/measures-with-evidence-of-reliability-and-validity\/#social\">Social Food Environment<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/measures-with-evidence-of-reliability-and-validity\/#person-centered\">Person-Centered Environment<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-6-selecting-measures\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>6. Selecting Measures<\/a><\/h3><div id=\"accordion-item-6-selecting-measures\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/selecting-measures\/#project\">Project Purpose<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/selecting-measures\/#population\">Population and Venues of Interest<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/selecting-measures\/#data\">Data Collection and Analysis Resources<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/selecting-measures\/#health\">Health Behavior or Outcome of Interest<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/selecting-measures\/#process\">Suggested Process for Using the Measures Registry<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-7-collecting-and-reporting-data\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>7. Collecting and Reporting Data<\/a><\/h3><div id=\"accordion-item-7-collecting-and-reporting-data\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/collecting-and-reporting-data\/#mode\">Data Collection Mode and Sampling<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/collecting-and-reporting-data\/#collectors\">Data Collectors<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/collecting-and-reporting-data\/#time\">Data Collection Time Period<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/collecting-and-reporting-data\/#analysis\">Data Analysis and Reporting<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-8-case-studies\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>8. Case Studies<\/a><\/h3><div id=\"accordion-item-8-case-studies\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/case-studies\/#case1\">Case Study 1: Evaluating a School-Based Intervention on its Ability to Positively Influence the School Food Environment<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/case-studies\/#case2\">Case Study 2: Evaluating a Family-Based Intervention on its Ability to Reduce BMI-Z Scores in Children with Obesity<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/case-studies\/#case3\">Case Study 3: Improving Healthy Eating Behaviors in Independent Neighborhood Restaurants<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/case-studies\/#case4\">Case Study 4 Implementing a Farmers\u2019 Market-based Obesity Treatment Program to Change Purchase and Eating Behaviors for Women and Children Enrolled in WIC\/SNAP Programs<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-9-future-considerations-in-food-environment-assessment\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>9. Future Considerations in Food Environment Assessment<\/a><\/h3><div id=\"accordion-item-9-future-considerations-in-food-environment-assessment\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/future-considerations\/#considering\">Considering the Level of Variability obtained in Food Environmental Measures<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/future-considerations\/#moving\">Moving Beyond Observation Data and Increasing the Evaluation of Longitudinal Relationships and Change Over Time<\/a><\/b><\/p>\n<p><b><a href=\"\/tools-mruserguides\/food-environment\/future-considerations\/#increasing\">Increasing the Attention Paid to the Expected Associations Between Environmental Measures and Outcomes<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-10-conclusion\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>10. Conclusion<\/a><\/h3><div id=\"accordion-item-10-conclusion\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/conclusion\">Conclusion<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<div class=\"accordion-item\"><h3 class=\"accordion-item-title\"><a href=\"#accordion-item-references\"><i class=\"fa fa-plus icon-for-inactive\"><\/i><i class=\"fa fa-minus icon-for-active\"><\/i>References<\/a><\/h3><div id=\"accordion-item-references\" class=\"accordion-item-content\"><p><b><a href=\"\/tools-mruserguides\/food-environment\/references\">References<\/a><\/b><\/p>\n<\/div><\/div>\r\n\r\n<\/div><\/div>\n\t\t<\/div><\/div><div id=\"pgc-298-0-1\"  class=\"panel-grid-cell\" ><div id=\"panel-298-0-1-0\" class=\"so-panel widget widget_text panel-first-child\" data-index=\"1\" ><div class=\"print-this panel-widget-style panel-widget-style-for-298-0-1-0\" >\t\t\t<div class=\"textwidget\"><div class='printomatic pom-small ' id='id4527'  data-print_target='.print-this'><\/div>\n<div class=\"wpcmsdev-columns\">\n<div class=\"column column-width-one-fifth\"><div class=\"wpcmsdev-box\">\n<h3 class=\"box-title\">SECTION<\/h3>\n<div class=\"box-content\">\n<h1>4<\/h1>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"column column-width-four-fifths\"><h1>Evaluating Existing Measures <\/h1>\n<\/div>\n<\/div>\n\n<h4 class=\"body-heading\">The Importance of Psychometric Properties<\/h4>\n<p>Measurement is an extremely important aspect of science, research, and evaluation. To understand the relationship between factors or a factor\u2019s impact on an outcome, one must be able to accurately and reliably measure the factor as well as the outcome. In the physical sciences (including physics, astronomy, chemistry and earth sciences) the ability to accurately measure important factors are typically dictated by the rules of physics, physiology, or biology. Consider measurement related to assessing blood pressure: Blood pressure is reliably assessed with some degree of confidence because a sphygmomanometer is assessing a biological event that is extremely predictable. Although blood pressure varies somewhat, both within and between people, the event that is being measured (blood flow through veins and arteries) is the same process for everyone.<\/p>\n\n<p>However, in the social and behavioral sciences (fields that include psychology, sociology, anthropology, politics, education, and economics), such predictable rules of nature do not apply. Social and behavioral scientists are faced with the task of attempting to assess abstract and amorphous concepts and to assess environments that may not be static or experienced the same by all. <\/p>\n\n<p>At the person-centered level, behavioral scientists attempt to measure peoples\u2019 perceptions, attitudes, beliefs, and values. In considering how to measure one\u2019s perceptions of the food environment, those perceptions may or may not be grounded in reality and may be highly fluid, even within individuals, based on their most recent, or significant, experiences with the environment. How do investigators or practitioners assess something that may be highly individual, possibly very changeable, and impossible to objectively quantify? Attempts to assess the influence of the social environment encounter equally complex questions: Who makes up one\u2019s social environment and what aspects of it are important to measure? Does it include all social norms that individuals are exposed to through the media and larger culture or is it more important to focus on a more proximal sphere of influence? How stable is one\u2019s social environment and how does it change as youth get older?<\/p>\n\n<p>It might seem that elements of the physical environment should be easier to assess because their elements are more tangible and concrete than are perceptions of the environment or evaluations of social influence. One would expect that the presence of a grocery store in a neighborhood, the amount of shelf space available for fruits and vegetables, or the absence or presence of promotional materials should be evident to all and fairly straightforward to assess. But even here, challenges abound. The physical environment is not static: grocery stores open and close, a store owner makes changes in how shelf space is allocated, and what one data collector calls a promotional material is just a price sign for another data collector. <\/p>\n\n<p>Understanding the qualities and robustness of measures is extremely important when choosing measurement tools. The \u201cpsychometric properties\u201d of a measure are considered as indicators of overall measure quality and generally fall into two categories: reliability and validity.<\/p>\n\n<h6>Reliability<\/h6>\n\n<p>In general terms, reliability is the extent to which a measure is consistent or stable over time. Reliability helps to assess the quality of questions and instructions in a measurement tool as well as the stability of the abstract concepts that the measurement tool is trying to assess.<sup>23<\/sup> <a href=\"#table2\">Table 2<\/a> provides a definition of three types of reliability that are typically assessed, how each is measured, how they are applied to environmental measures, and examples from the food environment field. Briefly:<\/p>\n\n<p>\n<ul>\n<li><b style=\"color:#954989;\">Inter-rater reliability<\/b> evaluates the degree to which two or more data collectors assess the same environment in the same way. Inter-rater reliability is testing both the clarity of the instrument as well as the consistency and quality of training of data collectors. Testing an instrument for its inter-rater reliability properties happens during pretesting of the instrument but may also occur during the data collection as a quality assurance check. Poor inter-rater reliability during data collection phase indicates that retraining of staff is needed or may indicate that the environment being assessed has changed in significant ways, requiring some adaptation of the tool.<\/li>\n<li><b style=\"color:#954989;\">Test-retest reliability<\/b> assesses consistency between a single respondent\u2019s answers over time and is typically tested in the pilot phase of questionnaire development to evaluate clarity of questions and directions. Test-retest assessments typically occur within about 2 to 4 weeks of each other and are looking for inconsistencies in responses that may occur because the questions or instructions are not clear. Note, however, that test-retest does not evaluate the measurement tool\u2019s ability to detect actual change. For questionnaires that are attempting to assess perceptions or attitudes, one would expect little actual change over a short period of time; rather, a low correlation on test-retest likely identifies questions that are not clear to the respondent.<\/li>\n<li><b style=\"color:#954989;\">Internal consistency<\/b> is important to assess when a number of questions are developed to try to understand the same attitude. As an example, a researcher may want to assess the extent to which perceived barriers are influencing an individual\u2019s food choices in a community center. The researcher creates a 10-item scale made up of questions related to barriers to choosing healthy foods in that community center. One would expect that those 10 items are correlated or \u201cinternally consistent.\u201d To test the internal consistency of those items, the researcher would pilot the questionnaire and then use the pilot data to assess the level of consistency using a Cronbach\u2019s alpha. Items that are not correlated might be eliminated from the scale to improve the consistency of the rest of the items in the scale or new items may need to be created and tested.<\/li>\n<\/ul>\n<\/p>\n\n<div class=\"wpcmsdev-alert color-green\"><div class=\"alert-content\"><p><b id=\"table2\">Table 2: <\/b>Reliability Definitions, Measures, Applications to, and Examples from Food Environment Measurement<\/p>\n<\/div><\/div>\n<img decoding=\"async\" src=\"https:\/\/www.nccor.org\/tools-mruserguides\/wp-content\/themes\/mcuserguide\/assets\/images\/grey.gif\" data-original=\"\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2017\/05\/FE-Table2.jpg\" alt=\"Table 2: Reliability Definitions, Measures, Applications to, and Examples from Food Environment Measurement\" width=\"100%\" class=\"lazy aligncenter size-full\" \/><noscript><img decoding=\"async\" src=\"\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2017\/05\/FE-Table2.jpg\" alt=\"Table 2: Reliability Definitions, Measures, Applications to, and Examples from Food Environment Measurement\" width=\"100%\" class=\"aligncenter size-full\" \/><\/noscript>\n\n<h6>Validity<\/h6>\n\n<p>Validity is another important psychometric property. Validity refers to the ability of a measure to assess what it intends to assess. We often think of four kinds of validity: face validity, criterion validity, content validity, and construct validity. <a href=\"#table3\">Table 3<\/a> provides definitions on types of validity, how each type is evaluated, application to the food environment field, and examples from the food environment field. Briefly:<\/p>\n\n<p>\n<ul>\n<li><b style=\"color:#954989;\">Face validity<\/b> is the weakest of the validity measures and involves having others, besides the developers of the instrument, review the instrument to provide feedback on whether they believe that the instrument is asking the \u201cright questions\u201d or whether the questions are asked in a way that would be meaningful and relevant to the target population. Based on feedback from those providing an assessment of face validity, the tool developer might modify the questions. <\/li>\n<li><b style=\"color:#954989;\">Criterion validity<\/b> involves comparing the developed instrument with some \u201cgold standard\u201d that may not be practical to use because of cost or logistical considerations. If criterion validity can be established with the new instrument, the researchers can anticipate that it will respond in the same way as the criterion and be useful as a less expensive or burdensome proxy.<\/li>\n<li><b style=\"color:#954989;\">Content validity<\/b> refers to an assessment of the degree to which the measurement tool captures the important elements of the factor. Content validity may be assessed by an external review that provides feedback on the comprehensiveness of the questions included to capture the important elements of the factor of interest. In addition, content validity could be assessed using factor analysis. Using the perceived barriers in the community environment as an example, the questionnaire writer might include a list of potential barriers that are specific to cost, taste preference, access, and social norms. If those four content areas are adequately captured through the measurement tool, a factor analysis should reveal four separate factors in the data.<\/li>\n<li><b style=\"color:#954989;\">Construct validity<\/b> is a measure of the association between the factor of interest and an outcome of interest. A measure might be highly reliable and have strong face, criterion, and content validity, but if it is not associated with an important health-related outcome, its utility is questionable. <a href=\"http:\/\/nccororgms.wpengine.com\/tools-mruserguides\/food-environment\/future-considerations\/\" target=\"_blank\">Section 9<\/a> talks more about the importance and challenges of construct validity in this field.<\/li>\n<\/ul>\n<\/p>\n\n<div class=\"wpcmsdev-alert color-green\"><div class=\"alert-content\"><p><b id=\"table3\">Table 3: <\/b>Validity Definitions, Measures, Applications to, and Examples from Food Environment Measurement<\/p>\n<\/div><\/div>\n<img decoding=\"async\" src=\"https:\/\/www.nccor.org\/tools-mruserguides\/wp-content\/themes\/mcuserguide\/assets\/images\/grey.gif\" data-original=\"\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2017\/01\/FE-Table3rev.png\" alt=\"Table 3: Validity Definitions, Measures, Applications to, and Examples from Food Environment Measurement\" width=\"100%\" class=\"lazy aligncenter size-full\" \/><noscript><img decoding=\"async\" src=\"\/tools-mruserguides\/wp-content\/uploads\/sites\/2\/2017\/01\/FE-Table3rev.png\" alt=\"Table 3: Validity Definitions, Measures, Applications to, and Examples from Food Environment Measurement\" width=\"100%\" class=\"aligncenter size-full\" \/><\/noscript>\n<br\/>\n\n<p>The <a href=\"https:\/\/tools.nccor.org\/measures\" target=\"_blank\">Measures Registry<\/a> allows users to see and compare measures of reliability and validity that have been reported on for the measures that may fit users\u2019 needs. Psychometric properties are not available on all measures included in the Registry, but when they are, they provide important insight to the quality of the measure.<\/p>\n<\/div>\n\t\t<\/div><\/div><div id=\"panel-298-0-1-1\" class=\"so-panel widget widget_text panel-last-child\" data-index=\"2\" >\t\t\t<div class=\"textwidget\"><div class=\"wpcmsdev-columns\">\n<div class=\"column column-width-one-half\"><p><a class=\"wpcmsdev-button color-violet\" href=\"\/tools-mruserguides\/food-environment\/key-concepts-in-food-environment-assessment\/\"><span>Previous<\/span><\/a><\/p>\n<\/div>\n<div class=\"column column-width-one-half\"><p style=\"text-align:right;\"><a class=\"wpcmsdev-button color-violet\" href=\"\/tools-mruserguides\/food-environment\/measures-with-evidence-of-reliability-and-validity\/\"><span>Next<\/span><\/a><\/p>\n<\/div>\n<\/div><\/div>\n\t\t<\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>The Importance of Psychometric Properties Measurement is an extremely important aspect of science, research, and evaluation. To understand the relationship between factors or a factor\u2019s impact on an outcome, one must be able to accurately and reliably measure the factor as well as the outcome. In the physical sciences (including physics, astronomy, chemistry and earth [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":282,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"class_list":["post-298","page","type-page","status-publish","hentry"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/pages\/298","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/comments?post=298"}],"version-history":[{"count":0,"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/pages\/298\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/pages\/282"}],"wp:attachment":[{"href":"https:\/\/www.nccor.org\/tools-mruserguides\/wp-json\/wp\/v2\/media?parent=298"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}