Childhood Obesity Evidence Base (COEB): Test of a Novel Taxonomic Meta-Analytic Method
The NCCOR Childhood Obesity Evidence Base (COEB): Test of a Novel Taxonomic Meta-Analytic Method aims to:
Use a novel taxonomic (classification) method of data aggregation
Identify successful approaches used to prevent childhood obesity in children aged 2 to 5 years
Provide evidence regarding mechanisms, pathways, and implementation strategies to inform future efforts to reduce rates of early childhood obesity
Provide a scoping review of the literature regarding prevention efforts of childhood obesity for children aged 2–5 years.
The COEB Project aligns with NCCOR’s efforts to identify and evaluate practical and sustainable interventions as well as facilitate the ability of childhood obesity researchers and program evaluators to conduct research and program evaluation.
Conventional Meta-Analysis: A study design used to systematically assess the results of previous of similar study design to derive conclusions about that body of research
Taxonomic Meta-Analysis: A meta-analytic method that relies on the heterogeneity of standardized intervention components to uncover which are most effective for achieving a given outcome
Taxonomy: A framework for organizing and classifying concepts, shows relationships between concepts, is often hierarchical, and produces standardized definitions for concepts
Intervention components: An observable, replicable, and irreducible component of a program, intervention (or policy) designed to change the behavior, attitude or status of a recipient
Example: implement nutrition standards, provide nutrition education and training to facilitators, or increase healthy food options
This project was published as a special supplement in Childhood Obesity.
As a result of the NCCOR COEB Project, a taxonomic-specific database and several other resources were developed, which can be used to examine additional interventions and research in the field. These products are available on the NCCOR COEB Project Documentation page.
The COEB Project was carried as a part of a collaborative effort with the NCCOR COEB workgroup, Mission Measurement, and External Expert Panel. Full acknowledgments are listed on the acknowledgments page.
How does this project advance childhood obesity research?
The NCCOR COEB Project is an example of a novel taxonomic approach to social science evidence aggregation, which classifies childhood obesity prevention interventions by characteristics such as study design, intended recipients, context, and intervention components. Traditionally, conventional meta-analytic approaches have been used to examine the effectiveness of childhood obesity prevention interventions. These methods tend to examine narrowly defined obesity prevention initiatives, for example, focusing on solely school-based interventions and/or those designed as randomized controlled trials. As such, they do not allow the field to draw conclusions across settings, participants, or subjects. In the field of childhood obesity research, there is a need for analytic techniques that would allow synthesis of learning across interventions of varying designs and conducted in various settings. This approach, known as a taxonomic meta-analysis, can be a powerful tool for summarizing the evidence that exists and for generating hypotheses that are worthy of more rigorous testing.
For the NCCOR COEB Project, this principle is applied to childhood obesity prevention interventions using body mass index (BMI) as an outcome measure. In this approach, discrete activities are isolated, which may relate to positive child outcomes in a variety of contexts for the intended recipients, children aged 2–5 years. By using the taxonomic meta-analytic approach, we can examine which intervention components may be more effective for specific outcomes, like BMI, rather than childhood obesity prevention or public health in general. The full list of intervention components (created by Mission Measurement through a ground up approach and reviewed/approved by the NCCOR Workgroup and the External Expert Panel is listed in supplementary materials on the NCCOR COEB Project Documentation page.1,2
What are the differences between conventional meta-analysis and taxonomic meta-analysis?
The figure below explains major differences between conventional and taxonomic meta-analysis.
|Conventional Meta-analysis||Taxonomic Meta-analysis|
|Objective||Objective is to identify the effect of one or more types of interventions that are defined in advance.|
Researchers plan a conventional meta-analysis where the objective is to learn the effect of a type of intervention, e.g., increased physical activity, in community-based interventions.
|Objective is to model the variation of effects as a function of intervention components, contexts, intended recipients, and methodological characteristics.
Researchers plan a taxonomic meta-analysis to evaluate the efficacy of multiple intervention components, such as setting, content focus, and duration, which may include efforts to increase physical activity.
|Hypothesis Orientation||Hypothesis-testing orientation|
At the beginning of the project, researchers want to test the hypothesis: Does the average effect of the treatments support that the treatments are effective in changing the pre-designated outcome?
The researchers generate hypotheses following a taxonomic meta-analysis, i.e., are certain patterns of treatment components associated with larger effects in the desired outcome?
|Procedure||Inclusion rules that limit the set of admissible research designs|
Fixes a set of coding categories and analyses before coding begins
Typically focuses on one particular effect size (regarding the pre-designated outcome) and narrow set of pre-defined contextual characteristics
Typically focuses on a narrow range of design types or study quality ratings intended to assure internal validity
Typically focuses on average effects and their consistency across studies
In conventional meta-analyses, researchers begin by specifying rules to decide which studies to include, which variables to code, and what statistical analyses of the components to perform.
|Wider range of research designs and sources of evidence
Coding categories emerge from “ground up” coding of a training set of documents to develop taxonomies; the final codebook is then applied to a larger set of studies
Typically focuses on a wider range of design, contextual, and component characteristics
Can include a wider range of study effect indicators that may be defined differently but are targeting the same outcome
Typically includes a wider range of design types, but accounts for both internal and external validity by coding study characteristics (e.g. sample and publication bias, data omission, and skewing) that could influence internal validity or external validity
Typically focuses on modeling variation as a function of components of interventions, contexts, and methodological characteristics
In taxonomic meta-analyses, it begins with a broader specification of rules for study inclusion and then develops coding categories for interventions, their intended recipients, and contexts. Statistical meta-analytic methods are adopted to account for variations in these factors.
For more information on why the NCCOR COEB Project completed a taxonomic meta-analysis, see A Rationale for Taxonomic vs Conventional Meta-Analysis.1
How did this approach work? What are the results?
In order to execute the taxonomic meta-analysis, Mission Measurement and the Systematic Review and Meta-Analysis Research Methods team completed four tasks, which were reviewed and iterated with the NCCOR workgroup:
Completed a scoping review of the literature regarding prevention efforts of childhood obesity for children aged 2–5 years,
Created taxonomies that catalogued the outcomes, intervention components, intended recipients, and contexts of policies and interventions,
Applied taxonomies to a set of childhood obesity studies following the standard Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist, and
Used taxonomic meta-analysis to investigate the relationship of intervention components and effect size with consideration for contextual differences, which allows for the identification of intervention components that correlate with childhood obesity prevention for the intended recipients.
Findings from the NCCOR COEB Project showed that interventions focused on early childhood obesity prevention efforts may be successful in reducing rate of increase in BMI over time, Specific intervention components that emerged as promising strategies include 1) training caregivers in healthy behavior change strategies, particularly reducing screen time, 2) engaging healthcare providers directly in the delivery of obesity prevention efforts, and 3) using health care settings for interventions. Importantly, multi-modal interventions, those where multiple intervention components are combined to target different levels of impact, appear promising.
For more information on how the NCCOR COEB Project developed taxonomies to be applied in taxonomic meta-analysis, see Methods for Taxonomy Development for Application in Taxonomic Meta-Analysis.4
For more detailed information on the results of the taxonomic meta-analysis itself, see A Systematic Review and Meta-Analysis of a Taxonomy of Intervention Components to Prevent Obesity in Children 2 to 5 Years of Age, 2005 to 2019.5
Implications of the NCCOR COEB Project
In addition to allowing childhood obesity researchers to draw conclusions from interventions, the process of developing a taxonomic meta-analysis resulted in several resources that can be used by researchers, such as a literature informed database that includes a project overview, table of contents, document log, dataset, and dataset glossary.
The NCCOR COEB searchable database has the potential to inform future initiatives, taking into account intended recipients, delivery channels, intervention components, and context, thereby facilitating initiative customization and potentiating successful outcomes.
There are numerous, possible analyses using the NCCOR COEB dataset. A few expected uses include:
- Comparing evidence from studies of varying levels of rigor and specificity
- Examining the effectiveness of specific intervention components for the intended recipients in context
- Providing a comparison to evidence generated by well accepted meta-analytic methods
For more detailed information on the implications of the NCCOR COEB project, see Building Translational Capacity Through Meta-Analytic Methods.4
The NCCOR COEB searchable database and project documentation can be found here.
- Glaser B, Strauss A. The Discovery of Grounded Theory: Strategies for qualitative research.Chicago: Aldine. 1967.
- Strauss A, Corbin J. Grounded theory methodology. Handbook of Qualitative Research. 1994;17:273-85.
- Hedges L, Saul J, Cyr C, et al. Childhood Obesity Evidence Base Project: A Rationale for Taxonomic vs Conventional Meta-analysis. Childhood Obesity.
- King H, Magnus M, Hedges, LV, et al. Childhood Obesity Evidence Base Project: Methods for taxonomy development for application in taxonomic meta-analysis. Childhood Obesity.
- Scott-Sheldon LAJ, Hedges LV, Cyr C, et al. Childhood Obesity Evidence Base Project: A systematic review and meta-analysis of a taxonomy of intervention components to prevent obesity in children 2 to 5 years of age, 2005 to 2019. Childhood Obesity.
- Young-Hyman D, and Kettel Khan L. Childhood Obesity Evidence Base Project: Building translational capacity through meta-analytic methods. Childhood Obesity. 2020.