{"text_format":"3","workbook":"xls","n_sheets":1,"sheets":["Additional File 8-Within study "],"read":"whole","date_system":"1900","formulas":"cached_only"}

{"sheet":"Additional File 8-Within study ","index":0,"n_rows":80,"n_cols":30,"rows_kept":80,"flags":["formulas_cached_only"]}
["Refid","Authors","Year","Study design","Random sequence generation\nWas the allocation sequence adequately generated?","Random sequence generation\nWas the allocation sequence adequately generated?_comment","Allocation concealment\nWas the allocation sequence adequately concealed from the participants and the researcher?","Allocation concealment\nWas the allocation sequence adequately concealed from the participants and the researcher?_comment","Similarity of baseline outcomes\nWere baseline measurements taken and results compared across groups to ensure comparability?","Similarity of baseline outcomes\nWere baseline measurements taken and results compared across groups to ensure comparability?_comment","Similarity of baseline characteristics\nWere participant demographics compared across groups to ensure comparability?","Similarity of baseline characteristics\nWere participant demographics compared across groups to ensure comparability?_comment","Blinding of participants and personnel\nWere participants and personnel blinded from knowledge of intervention/ control group status?","Blinding of participants and personnel\nWere participants and personnel blinded from knowledge of intervention/ control group status?_comment","Blinding of participants to the research question/purpose\nWere participants blinded from knowledge of the research question/ purpose?","Blinding of participants to the research question/purpose\nWere participants blinded from knowledge of the research question/ purpose?_comment","Blinding of outcome assessment\nWere outcome assessors blinded from knowledge of which intervention a participant received?","Blinding of outcome assessment\nWere outcome assessors blinded from knowledge of which intervention a participant received?_comment","Independence of intervention effect from confounding bias\nAre there any concerns that confounders have not been appropriately identified and accounted for?","Independence of intervention effect from confounding bias\nAre there any concerns that confounders have not been appropriately identified and accounted for?_comment","Valid/reliable outcome measurement\nWere outcome measurement instruments valid and reliable?","Valid/reliable outcome measurement\nWere outcome measurement instruments valid and reliable?_comment","Incomplete outcome data\nWere losses to follow-up (attrition) and exclusions from analysis reported and comparable in both groups?","Incomplete outcome data\nWere losses to follow-up (attrition) and exclusions from analysis reported and comparable in both groups?_comment","Selective reporting\nDid the authors report all intended outcomes?","Selective reporting\nDid the authors report all intended outcomes?_comment","Other\nWas the study free of other problems that could put it at a high risk of bias? \n(e.g. study funded by industry with concerns about sponsor involvement, inadequate control of hierarchical data structure, or possible contamination/exposure of control group to the intervention)","Other\nWas the study free of other problems that could put it at a high risk of bias? \n(e.g. study funded by industry with concerns about sponsor involvement, inadequate control of hierarchical data structure, or possible contamination/exposure of control group to the intervention)_comment","Overall risk-of-bias for each outcome (within-study summary assessment)","Overall risk-of-bias for each outcome (within-study summary assessment)_comment"]
[1120,"A. Bearth, M. -E Cousin and M. Siegrist.",2013,"RCT","Unclear","Randomization method not described: \"After finishing the online questionnaire, the students were randomly assigned to one of three conditions\"","Unclear","No details provided","Low","No significant differences in all outcomes across study groups (see results Tables 2-4)","Low","Only gender reported, but appears consistent across all groups, pg. 396= \"There were 74 participants in EG1 (36.5% male), 93 participants in EG2 (44.1% male) and 122 participants in CG (39.3% male)\"","Unclear","No details provided","N/A - controlled trials",null,"Separate risk for different outcomes, specify:","Low for objective knowledge outcome (unlikely to be affected by lack of blinding); Unclear for subjective knowledge/behaviours, as self-assessed outcomes and no details provided","Low","Randomized trial (pg. 395)","Low","Although no information about questionnaire pre-testing was provided, the outcome scales were determined and validated with principal components analysis and Cronbach's alpha (pg. 397 methods)","Unclear","Very low level of missing data unlikely to bias the effect, pg. 398= \"About 99.0% (n = 286) of the participants did not have any missing values for the variables included. For the remaining 1.0% (n = 3) with randomly missing values, the mean was substituted for the missing values.\" Also n=89 participants excluded from behaviour outcome analysis because they didn't prepare poultry during that time (and couldn't be assessed for changes in this behaviour), but proportion appeared equal across the 3 groups. Some loss to follow up (Fig 1)","Low","All 3 key outcomes measured are reported (objective and subjective knowledge, and behaviours)","Low","Repeated-measures analysis conducted to account for different time point measurements (pg. 398)","Unclear","Unclear across some key domains"]
[2547,"J. S. Dollahite, E. I. Pijai, M. Scott-Pierce, C. Parker and W. Trochim.",2014,"RCT","Unclear","Randomization method not described","Low","Appears that sites conducted randomization: \"Participants were randomly assigned to 1 of 2 groups at each site, either immediate education (IE) or delayed education (DE).\" Also since all participants received intervention, unlikely to affect enrollment.","Low","No significant difference was observed between the 2 study groups for enrollment scores (T1), indicating that the groups' initial reported behavior was similar","Low","Groups were demographically similar","Low","Blinding unlikely to be an issue due to study design (both groups received treatment)","N/A - controlled trials",null,"Low","Blinding unlikely to be an issue due to study design (both groups received treatment)","Low","RCT","Low","used standard/valid/reliable EFNEP Behavior Checklist","Low","More dropouts in delayed intervention group, no significant demographic differences between completed and drop outs except for age (drop outs more likely to be younger)-but age was not related to outcome","Low",null,"Unclear","First, there was no separate control group for the follow-up period of the IE group, introducing the possibility that other sources of nutrition information could influence the results.","Low"]
[2770,"David Anthony Engel.",2003,"RCT","Low","Randomization done on matched pairs","Low","Not a concen given allocation method (in pairs)","Low","Not measured but authors provide rationle for this in methods","Low","analysis found no difference in groups (pg. 86-88)","Unclear","Not clear if participants knew what intervention was vs. control and their group","N/A - controlled trials",null,"Unclear",null,"Low","analysis found no difference in groups (pg. 86-88)","Low","Use of prior/reliable scales","Low","Minor missing values for some questions","Low",null,"Low",null,"Low"]
[2873,"Claudia Fajardo-Lira and Cynthia Heiss.",2006,"RCT","Unclear","details not provided","Low","low since assigned in groups","Low","No sign. differences (Table 1)","Unclear","Demograpics not stratified by group so can't tell","Unclear",null,"N/A - controlled trials",null,"Low","Low since objective knowledge measure","Low",null,"Unclear","no details on instrument provided","High","6 drop outs only in control (lecture) group- large proportion and impact unknown","Low",null,"Low",null,"High"]
[3090,"Angela Marie Fraser.",1995,"RCT","Low","Systematic: Sample assignment to groups was random so that the assumption could be made that the four groups for both samples were not different. The names (day care home provider or child care center) selected from each MDSS list were each continuously numbered 1 through 10 until all were assigned a number.\"","Low","Not a concern with systematic allocation from database","Low","not compared-but controlled for in ANOVA analysis","Low","details not provided - but RCT so unlikey to be a huge concern","Low","The Solomon Four-Group Design was selected because it controls for the external threats to validity of pretesting and reading the booklet and all other threats to internal validity (Appendix F). Controlling for the effect of pretesting and reading the booklet was essential to making valid conclusions about change in mean scores for perceptions (research questions 1-3).","N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low for knowledge (objective); unclear others","Low","RCT","Low","Validity and reliability tested","Low","Low response rate, but equal in both groups for population of interest (day care home providers)","High","Quant. data not reported for one of the 3 main outcomes that was not significant (pg. 94)","Low",null,"Low"]
[3122,"Brandi N. Frisby, Shari R. Veil and Timothy L. Sellnow.",2014,"RCT","Unclear","not clear","Low","recruited using electronic system","Low","no sign. difference in baseline outcomes","Unclear","baseline characteristics not compared","Unclear","no details provided","N/A - controlled trials",null,"Unclear","no details provided","Unclear","can't tell as no info was provided about how intervention was administered","Low","Both outcomes reliable/valid","Low","doesn't appear to be any drop outs","Low","Both key outcomes reported","Unclear","can't tell as no info was provided about how intervention was administered","Unclear"]
[3401,"A. Gold, N. Yu, B. Buro and J. Garden-Robinson.",2014,"RCT","Unclear","Method not described= \"Individuals who agreed to participate were randomly assigned to 1 of 3 different conditions (cooking class, food safety discussion map class, or no education).\"","Unclear","not described","Unclear","not compared pre-intervention","Unclear","sign. more females in control group vs. intervention groups - impact not clear","Unclear","not described","N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low for knowledge; unclear for behaviours","Low","RCT","Low","The questionnaire series used in this studywas specially developed and then audience tested in a much larger (unpublished) formative evaluation study; All questionnaires were tested with asmall group of international students (2–3 people) to make sure the language used was simple enough and the answers provided were meaningful.","Low","small number of 5 drop outs (~20%) from cooking group, none for other groups","Low",null,"Low",null,"Unclear"]
[4846,"Katherine M. Kosa MS, Sheryl C. Cates BA, Godwin, Sandria L,PhD, RD, Melanie Ball BS and Robert E. Harrison PhD.",2011,"RCT","Low","The sample was selected from a Web-enabled panel developed and main- tained by Knowledge Networks (Menlo Park, CA), a survey research firm. The Web-enabled panel is constructed using a list-assisted, random-digit-dial sample selected from all 10-digit telephone numbers in the United States and is designed to be representative of the U.S. population (11). Households that are selected for the panel and do not have Internet access are provided with a free computer and Internet access. A sample of 566 adults aged 70 to 75 years with a high school education or less was selected from the panel. The sample was constrained based on age and education to increase the homogeneity of the study population. Table 2 summarizes the number of study participants for the control and the two intervention groups for each stage of data collection. In October 2008, the presurvey questionnaire was e-mailed to selected panel members (n ¼ 566), and two e-mail reminders were sent to nonrespondents to encour- age participation. Data were collected over a 3-week period, and a total of 446 completed surveys were received, for a 79 % cooperation rate. Parti- cipants who completed the presurvey were randomly assigned to either the control or one of the two intervention groups. The print materials intervention group (n ¼ 131) received the print materials by mail using the address information maintained on panelists. The Web site intervention group (n ¼ 164) received an e-mail with an Internet link to a Web site that contained the same information as the print materials. Approximately 2 weeks after sending the e-mail or print materials, an e-mail reminder was sent to the two intervention groups reminding them to read the print materi- als or visit the Web site. The control group (n ¼ 151) received an e-mail thanking them for their participation","Low","participants were unaware and the reserchers were partially unaware as a third party identified the initial sampling frame.  No need to down grade.","Low","A couple differences noted for some outcomes (Tables 5-6), but analysis adjusted for change from baseline in both groups","Low","Pg. 374 \"The intervention and control groups had similar demographic characteristics\".","Unclear","Insufficient information provided to permit judgement","N/A - controlled trials",null,"Low","As the intervention was given to individuals there is no reason to believe that a lack of blinding is an issue.","Low","Randomization conducted","Unclear","No details provided on questionnaire validity","High","16% loss to follow up from pre-to-post survey was fairly comparable across intervention groups. However, only those who viewed materials included in analysis not all who received intervention. Pg. 374. Intention to treat issue","Low","All intended outcomes reported","Low","time-by-treatment interactions accounted for in analysis (pg. 374)","High","High for key domain (incomplete outcome data) and unclear for several others raises some doubts"]
[6005,"Alyssa C. Milton and Barbara A. Mullan.",2012,"RCT","Low","computer-generated","Low","Measures were taken at both baseline and follow-up by a researcher blind via an allocation concealment process","Low","accounted for in analysis (change from baseline)","Low","Table 1","Low","Participants were blind to their allocated group and all completed online questionnaires","N/A - controlled trials",null,"Low","Measures were taken at both baseline and follow-up by a researcher blind via an allocation concealment process.","Low","RCT","Low","Participant’s food safety malpractices and correct behaviors were recorded by a trained observer on a detailed observational checklist adapted from both Mullan’s (2009) and Redmond and Griffith’s (2006) observational studies; validated TBP questionnaire","Low","0 loss to follow up","Low",null,"Low",null,"Low"]
[6202,"B. Mullan and C. Wong.",2010,"RCT","Unclear",null,"Unclear",null,"Low","Low for knowledge outcome since data presented to account for differences in analysis","Unclear","not compared across groups","Unclear",null,"N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low for knowledge; unclear others","Low","RCT","Low","reliable scales","Low","small loss to follow up unlikely to affect results","Low",null,"Low",null,"Unclear","unclear in a few criteria"]
[6302,"M. J. Nauta, A. R. H. Fischer, E. D. Van Asselt, A. E. I. De Jong, L. J. Frewer and R. De Jonge.",2008,"RCT","Unclear","method of randmization not specified","Low","Af- ter clicking on the link, participants were forwarded to the research Internet site where they were randomly allocated to one of the four versions of the risk infor- mation conditions described above","Unclear","not measured","High","no details provided","Low","Participants were blinded to purpose of study (pg. 183)","N/A - controlled trials",null,"Low","not a concern with this outcome","Low","RCT","Low","Valid/reliable questionnaire and microbial tests","Low",null,"Low",null,"Low",null,"Unclear","unclear if groups are comparable in terms of key characterisitcs/baseline outcomes"]
[7081,"V. Quick, K. W. Corda, B. Chamberlin, D. W. Schaffner and C. Byrd-Bredbenner.",2013,"RCT","Unclear","method not specified","Low","classroom level","Low","accounted for in analysis","Low","some differences accounted for in analysis","Unclear",null,"N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low knowledge; unclear others","Low","RCT","Low","Before commencing with data collection, the study questionnaire was cognitively tested with middle schoolers (n ¼ 4) to ensure accuracy of interpretation and readability. Additionally, an expert review panel of food safety and nutrition educators (n ¼ 6) examined the questionnaire to ensure content validity of survey items; minor refinements were made.","Low","Low overall drop out","Low",null,"Low","Regular food safety instruction was delayed until after the follow-up test.","Low","Overall no major limitations"]
[8017,"Mary Michelle Snow.",2012,"RCT","Unclear",null,"Unclear",null,"Low","accounted for in analysis","Low","No significant difference in the distribution of participant demographics among interventions for the independent variables lesson language, age, breastfeeding, or income","Low","The NEAs did not review the testing instrument with participants nor did they provide the participants with the correct answers.","N/A - controlled trials",null,"Low",null,"Low","RCT","Low","Used or based on standard EFNEP instrument","Low","No NEA attrition was noted during the study time frame. After the target enrollment of 247 participants was reached, enrollment was discontinued","Low",null,"Low",null,"Low"]
[8559,"Marilyn S. Townsend, Margaret Johns, Mical Kay Shilts and Lucrecia FarfanRamirez.",2006,"RCT","Low","Random assignment was determined using the random numbers table.","Low","by group so not a factor","Low","incorporated in analysis","Low","key demographics controlled for in analysis","Low","personnel no but best as good be done; for children not likely to be an issue","N/A - controlled trials",null,"Low","not likely to be an issue in this study","Low","RCT","Low","validity, pre-test and reliability","Low","As treated analysis NOT conducted (see results); however was small proportion of all groups so not likely to be a huge factor","Low",null,"Low","To incorporate individual-level variables, participant data were included in the model, with group included as a random effect","Low"]
[8569,"Trepka, Mary Jo,MD, MSPH, Frederick L. Newman PhD, Evelyn P. Davila MPH, Karen J. Matthew MPH, Zisca Dixon and Huffman, Fatma G,PhD, RD.",2008,"RCT","Low","The randomization process involved creating 420 envelopes with 210 including a notice that the client would be in the pamphlet group and 210 including a notice that the client would be in the interactive multimedia group. The sealed envelopes were put in sets of 10 each with 5 of each study group. The envelopes in each set were shuffled prior to the beginning of the study.","Low","The randomization process involved creating 420 envelopes with 210 including a notice that the client would be in the pamphlet group and 210 including a notice that the client would be in the interactive multimedia group. The sealed envelopes were put in sets of 10 each with 5 of each study group. The envelopes in each set were shuffled prior to the beginning of the study.","Low","controlled for in analysis","Low","there were no statistically significant differences in the demographic characteristics between participants in the interactive multimedia and pamphlet groups except for employment status, where students made up a larger proportion of participants in the interactive multimedia group than in the pamphlet group","Unclear","Not clear if participants knew which was intervention vs. control","N/A - controlled trials",null,"Unclear",null,"Low",null,"Low","Two studies were conducted to determine the psychometric characteristics of the resulting instrument","Low","Similar loss to follow up in both groups. Also: \"There were no significant differences between the demographic characteristics of those who did and did not complete the follow-up questionnaire (data not shown).\"","Low",null,"Low",null,"Low"]
[8579,"E. Trifiletti, S. Crovato, D. Capozza, E. P. Visintin and L. Ravarotto.",2012,"RCT","Unclear","method not stated","Unclear","not stated","Unclear","only measured/compared for positive/negative traits outcome","Unclear","not compared","Unclear","not stated","N/A - controlled trials",null,"Unclear",null,"Low",null,"Low","pilot tested go-no-go instrument, and measure of internal consistency (Cronbach’s alpha) was computed for outcomes","Unclear",null,"Low",null,"Low",null,"Unclear"]
[9650,"Amanda Hovis and Karol Kaye Harris.",2007,"RCT","Unclear",null,"Unclear",null,"Unclear",null,"Unclear",null,"Unclear",null,"N/A - controlled trials",null,"Low","low for knowledge outcome (only one reported here)","Unclear",null,"Unclear",null,"High","higher drop out in intervention group which could affect outcome","High","non-significant behavioural intention not reported here","Unclear",null,"High","abstract only-many details not reported"]
[1770,"A. D. Caruso, M. D. Horm-Wingerd and C. J. Golas.",1998,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Unclear","Insufficient details provided","Low","There was a significant difference between baseline outcomes (pg. 230) - however analysis of covariance conducted to account for this. SO low rating ONLY IF the analysis of covariance results used in meta-analysis. I.E. should NOT compared post measures between groups, need to compare pre-post difference across groups otherwise this should be rated as high risk","Low","No significant differences in demographics, but a couple differences in terms of characteristics of their program work (but does't appear to be reason to downgrade)","Unclear","Insufficient details provided","N/A - controlled trials",null,"Unclear","Not clear, not sure if participants were blinded and trainers likely weren't","Low",null,"Low","Instruments were pilot tested","Low","High loss to follow up but appeared relatively equal in both groups = \"Of the 239 potential subjects in the training group, 136 (56.90%) supplied pre-training and 1-month post-training data and 91 (38.08%) supplied pre-training, 1-month, and 6-month post-training data. Of the 130 potential comparisons, 97 (74.62%) supplied pre-training and l-month post-training data and 41 (3 1.54%) supplied pre-training, 1-month, and 6-month post-training data.\" Also no significant differences found in drop out group= \"Analyses indicated that no significant differences existed between individuals (both trainee and comparison subjects) who did and did not complete all portions of the evaluation component on the seven personal (sex, age, marital status, ethnicity, education, income, number of children) and five employee characteristics (current Head Start position, years in current position, total years in Head Start, total years working with children in non-Head Start positions, training on similar topics) analyzed. Analyses also indicated no significant within group differences on these same variables for both the training and comparison groups.\"","Low",null,"Low",null,"Low"]
[1980,"H. Chipman, P. Kendall, M. Slater and G. Auld.",1996,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","Not applicable since a cross-over type design was used (participants saw all interventions in random order)","Low","N/a since outcomes measured only once (reaction to media formats)","Low","N/a since participants received all interventions in different order","Low","N/a since participants received all interventions in different order","N/A - controlled trials",null,"Low",null,"Low",null,"Low","\"Development and testing of the instruments used to categorize participants, assess their individual reactions to the media formats, and determine the strengths and limitations of each format have been described in detail.\"","Low","Eighty-six of the 101 women who were recruited participated in the message evaluation sessions.This is a typical show rate for focus groups sessions and was planned for during recruitment.","Low",null,"Low",null,"Low"]
[2709,"J. E. Ehiri, G. P. Morris and J. McEwen.",1997,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","Controls drawn randomly from database","Unclear","Although not explicitly compared in article, looking at different tables for pre-test, there are some large differences across many questions (intervention group had higher pre answers)- however because only the post test groups were compared - not sure if pre test answers were the same for these groups","Low","There were no significant differences between the two groups","Low",null,"N/A - controlled trials",null,"Unclear","Not likely, as control didn't receive any intervention, but unsure of impact on results","Low","Groups matched on key confounders","Low","The questionnaire was first validated by means of a pilot survey","High","Doesn't appear to be any drop outs; but pre-post test groups excluded from intervention vs. comparison analysis","High","It appears not all questions were reported in results section for intervention vs. comparison group","Low",null,"High"]
[3646,"Irja Hannele Haapala.",2001,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","applied at classroom level","Low","similar (controlled for in anlaysis)","Low","relatively similar","Unclear",null,"N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low for knowledge; unclear other outcomes","Low",null,"Low","All instruments were pilot tested for validity with one classroom (n= 20) in one of the participating schools to ascertain the understandability of the content and the questionnaire, after which minor changes were made to the questionnaire","Low","Similar across groups","Low",null,"Low","The researcher administered all tests and provided classroom instruction to control for the teacher effect as a threat to internal validity","Low"]
[3845,"Shauna Carol Henley.",2013,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","Unit of allocation was library/supermarket not individuals and allocation performed all at once at beginning of study (pg. 109)","Unclear","No baseline measure of outcomes conducted","Low","Some differences between demographics of neighbourhoods between intervention/control site locations, but overall were reasonably similar. Participants differed significantly for race/ethnicity (pg. 116-7) but not for other variables. However, in limitations authors indicate this is unlikely to be a confounder pg. 132 \"The control and  intervention group were not stratified by race and ethnicity because previous formative  research determined that consumers across all races and ethnicities wash raw chicken\"","Low","No blinding reported, but since allocation was at library/supermarket level, unlikely to affect outcome in this case","N/A - controlled trials",null,"Low","No indication of whether researchers administering surveys were blinded, but surveys with intervention group participants didn't ask about previous exposure to interventions until end of survey (pg. 223)","Low","Pg. 109 \"Community sites were matched by median household income (2011) by their respective Census tract number\".","Low","Although no explicit pre-testing, survey questions adapted from previous studies/validated tools/literature","Low","Measurement was retrospective, so attrition not really an issue. Also, results reported for total intervention particpants and proportion that saw and took home materials (Table 12). Missing data not included in analysis (but appears to be only minor amount)","Low","All intended outcomes measured (Table 12)","Low","Control participants screened to ensure they didn't visit intervention sites (Pg. 113-4)","Low","Low across key criteria"]
[4287,"K. J. James, J. A. Albrecht, R. E. Litchfield and C. A. Weishaar.",2013,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","conducted at community level","Unclear","not measured","Low","The researchers carefully selected control communities similar in size and demographics to the pilot test communities based on the Metropolitan and Micropolitan Statistical Areas of the U.S. Census Bureau (http://www.census.gov/population/metro/) and ensure that traditional media channels in these communities did not overlap in the test and control communities.","Unclear","can't tell if participants prompted about campaign before or after outcome questions","N/A - controlled trials",null,"Unclear","can't tell if participants prompted about campaign before or after outcome questions","Low","Of the 300 participants surveyed from the pilot-test communities, 24% (N = 70) provided unprompted or prompted awareness of the 4 Day Throw Away campaign. In the control communities, only 1% (3 individuals) had heard of the campaign even when prompted. This was a significant difference (P = 0.0001) between awareness of the campaign in pilot-test communities compared to the control communities.","Unclear","not details provided","Low",null,"Unclear","not clear as full details not provided on survey instrument","Low","The researchers carefully selected control communities similar in size and demographics to the pilot test communities based on the Metropolitan and Micropolitan Statistical Areas of the U.S. Census Bureau (http://www.census.gov/population/metro/) and ensure that traditional media channels in these communities did not overlap in the test and control communities.","Unclear"]
[4399,"S. Johnson, C. A. Stephens and S. Kleihauer.",2009,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","treatment schools and 94 for the comparison schools. The comparison group consisted of every seventh grade student registered at Burchfield and Huntsville Middle Schools. The treatment group consisted of seventh grade students at Fairview and Oneida Middle Schools.","Unclear","not measured in control group","Unclear","not compared","Unclear",null,"N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low for knowledge; unclear other outcomes","Low",null,"Low","The survey instrument was tested for instrument reliability, consistency and instrument validity utilizing 51 seventh grade students from a middle school in a local county nearby","Unclear","lower response rate among control group","Low",null,"Low",null,"Unclear"]
[5711,"A. B. Mayer and J. A. Harrison.",2012,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","not an issue since allocation at class section level","Low","No significant differences were found between the treatment and control groups for attitude, practice, or knowledge scores at the time the pretest was administered.","Unclear","some differences in demographics related to the outcomes and impact unclear","Unclear",null,"N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low for knowledge; unclear others","Low",null,"Low","questionnaire pre-tested","Low",null,"Low",null,"Low",null,"Low"]
[6611,"Lacye A. Osborn.",2001,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","assigned at class level","Low","for knowledge outcome","Low","some minor differences but no obvious impact on results","Unclear",null,"N/A - controlled trials",null,"Low","for knowledge","Low",null,"Low","Questionnaires pre-tested","Low","similar drop out in both groups","Unclear","no control group data for key outcomes","Low",null,"Low","overall low for both outcomes- since no control group data reported for attitudes/behaviours those automatically downgraded to uncontolled before after studies (no reason to further downgrade)"]
[8414,"Terry Lee Taylor.",1997,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Low","group level","Low","controlled for in analysis","Unclear","stated to be similar but data not provided","Unclear",null,"N/A - controlled trials",null,"Separate risk for different outcomes, specify:","low knowledge; unclear others","Low","attempts to prevent contamination of intervention to control","Low","questionnaire pre-tested/reliability tested","Low","large loss to follow up but similar % in each group","Low",null,"Low",null,"Low"]
[8716,"Nurhan Unusan.",2007,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Unclear",null,"Low","accounted for in mean change outcome","Low","appear similar","Unclear",null,"N/A - controlled trials",null,"Unclear",null,"Unclear",null,"Low","Based on previous questionnaires and reliability tested","Unclear","not stated","Low",null,"Low",null,"Unclear","details not well reported"]
[8884,"W. Verbeke, F. Vanhonacker, L. J. Frewer, I. Sioen, S. De Henauw and J. Van Camp.",2008,"NRT","N/A - non-randomized/uncontrolled before-after study",null,"Unclear","not stated","Low","accounted for in outcome data","Unclear","not compared by group","Low","not stated, but likely not a huge factor in this study","N/A - controlled trials",null,"Low","as above","Low",null,"Unclear","not stated","Unclear","not clear if drop out was similar across groups","Low",null,"Low",null,"Unclear"]
[497,"Jaclyn Maurer Abbot, Peggy Policastro, Christine Bruhn, Donald W. Schaffner and Carol Byrd-Bredbenner.",2012,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"High","Based on description of intervention and survey (pg. 1120), it's unlikely participants were blinded","N/A - uncontrolled before-after study",null,"Low","No reason to believe confounding occured","Low","Extensive formative research conducted; details on survey instrument testing/development reported in companion papers","Low","Large loss to follow up (~half) - but most of these due to unrelated change at one site (details not given). Significant difference between participants and losses to follow up on pre-test found for only one outcome (knowledge)- but was higher in loss to follow up group so any bias would underestimate not overestimate effect size. So no reason to downgrade.","Low","All key outcomes reported","Low",null,"Low","Overall low risk-no significant reason to further downgrade"]
[979,"Ayanna D. Baker, Jasen Gilley, Jessica James and Maureen Kimani.",2012,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","Details not provided","N/A - uncontrolled before-after study",null,"Low","No likely bias","Unclear","No details provided on questionnaire questions/development/testing","Low","Food safety/nutrition module only had 14 participants, but all completed pre and post test","Low","Knowledge was key outcome which was reported- behaviour also measured but only in post test","Low",null,"Low","No reasons to downgrade"]
[1143,"Patricia A. Beffa-Negrini, Nancy L. Cohen, Mary Jane Laus and Lynne A. McLandsborough.",2007,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","Not clear - but likely based on description: \"Approximately monthly, teachers were recruited for the Food Safety FIRST program using emails, teacher listservs, NSTA newsletters, or flyers distributed at NSTA national and regional conferences.\"","N/A - uncontrolled before-after study",null,"Low","No likely bias","Low","Instrument assessed for validity and pre-tested (pg.67)","Unclear","Nearly 20% didn't complete post-tests, and some missing values (Table 2) - impact unclear. \"Forty-six teachers completed one or more modules for a 64.7% completion rate and we were able to match pretest and posttest surveys from 38 of these completers.\"","Low","All outcomes reported","Low",null,"Unclear","Due to incomplete outcome data"]
[1158,"Ryan A. Bell, Virginia N. Hillers and Theo A. Thomas.",1999,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","Abuela educators not likely blinded, unclear for worksop participants, and likely low risk for media campaign/survey respondents","N/A - uncontrolled before-after study",null,"Unclear","Workshop participants could have also been exposed to media campaign (could have influence follow up survey); no risk for media survey participants as its specifically stated they didn't participate in workshops","Unclear","No details provided","Low","High response rate for follow up survey-The cooperation rate was 91.5% for those reached by telephone ","Unclear","Not clear if additional questions were asked on questionnaire","Low",null,"Unclear","Overall unclear (might even be considered high for workshop intervention due to possible co-intervention with media campaign)"]
[1649,"Abel Caballero Deza.",2006,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","Parents knew purpose of study but children were aged 3-5 so not likely to be a factor of concern","N/A - uncontrolled before-after study",null,"Low",null,"Low","Developed from validated surveys, evaluated for content validity","Unclear",null,"Low","All intended outcomes reported","Low",null,"Low"]
[1799,"S. C. Cates, K. M. Kosa, T. Teneyck, L. A. Jaykus, C. Moore and P. Cowen.",2006,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"High","Participants with high risk practices specifically selected which would over-inflate effect size (didn't own thermometer and stored deli meats for longer than usual)","Unclear","No info provided","Low",null,"High","Only post-survey responses reported for behaviour outcomes","Low",null,"High","Due to possible confounding"]
[1808,"Catherine Greenwell Arnold and Jeffery Sobal.",2000,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","Not clear since retrospective study","N/A - uncontrolled before-after study",null,"Low",null,"Low","Used standard instruements and new questions with face validity","Low","Random selection of previous grads","Low",null,"Low",null,"Low"]
[2040,"Jane M. Clary.",2000,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"High","Likely not conducted, pg.64 \"The FNP Assistants were trained on survey administration by the FNP Director and the assistants provided each client a brief description of the research project and asked clients if they were willing to participate in the study\"; however not a reason to downgrade on its own","N/A - uncontrolled before-after study",null,"Low",null,"Low","The survey was written and reviewed by campus staff for content and construct validity, and pilot tested in FNP counties by the FNP Assistants. ","Low","Proportion of missing values is low (Tables)","Low",null,"Low",null,"Low"]
[2191,"Elizabeth Colette Cragun.",2008,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low","Excluded two counties implementing a different curriculum (pg. 17)","Low","Standard questionnaire, factor analysis of outcome scores","Low","Low number of drop outs, but demographics compared and relatively similar for key variables (Pg. 21)","Low",null,"Low",null,"Low"]
[2526,"P. A. Dipersio, J. N. Sofos and P. A. Kendall.",2006,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","Can't determine but seems unlikely","N/A - uncontrolled before-after study",null,"Low",null,"Low","Reviewed for content validity and reliability tested","Unclear","High loss to follow-up (53/75) and impact not discussed","Unclear","some behaviour outcomes appear not reported","Low",null,"Unclear","Loss to follow up impact not clear"]
[2661,"M. S. Dworkin, C. E. Peterson, W. H. Gao, A. Mayor, R. Hunter, E. Negron, A. Fleury and C. L. Besch.",2013,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","Each recipient was instructed to read it but no explanation of content was provided","N/A - uncontrolled before-after study",null,"Low",null,"Unclear","Can't tell since details reported in another paper","Unclear","Nearly 50% drop out and some notable differences in groups: \"Compared to those who completed only a baseline survey, those who completed the entire study had a higher proportion of Hispanic Whites and a lower proportion of African Americans (35% intervention versus 19% only baseline and 47% intervention versus 64% only baseline, respectively, p value 0.009). Concerning their educational background, those who remained in the study were more often at the extremes of education (11%, 57%, and 32% with <high school, high school, and college or higher education for the baseline only group versus 19%, 45%, and 46% for those remaining in the study, p value 0.05). Those who were lost after the baseline versus those who participated in the entire study were not different based on age, sex, or baseline food safety score (64% versus 63%).\"","Low",null,"Low",null,"Unclear"]
[3007,"Eduardo Flores.",2008,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","Participants were aware of purpose (Appendix A)- but anonymity ensured and outcome was objective knowledge","N/A - uncontrolled before-after study",null,"Low",null,"Unclear","no details provided","Low","2 drop outs (<15% even though small sample)","Low",null,"Low",null,"Low","no reason to downgrade"]
[3049,"SC Forster-Cox, T. Mangadu, B. Jacquez and L. Fullerton.",2010,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"High","The households or participants were recruited through community presentations conducted by the promotoras. In addition, new participants were referred by project participants from previous years through their social networks. At the end of the first visit, a large  magnet was placed on the refrigerator indicating which  environmental health and home safety issues were to be  addressed by the participant before the promotora’s  follow-up visit","N/A - uncontrolled before-after study",null,"Low",null,"Unclear","no details provided","Unclear","not stated","Unclear","full survey not given so not sure if there were additional food safety questions asked and not reported","Low",null,"Unclear"]
[3315,"S. Ghebrehewet and L. Stevenson.",2003,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","No details provided","N/A - uncontrolled before-after study",null,"Low",null,"Unclear","Insufficient information provided to permit judgement","Low","No loss to follow up reported (same sample size before-after). However, not all questions reported by all households, but only a few missing values and unlikely to influence results much","Unclear","No details provided on questionnaire and other measures collected \"the community-based facilitators completed a questionnaire and an action sheet that had been designed to measure participants’ prior knowledge and behaviour in relation to a range of important food hygiene issues\" (P170)","Low","No other likely biases","Unclear","Unclear for some key domains (no info on validity of questionnaire and selective reporting)"]
[4312,"K. S. U. Jayaratne, J. A. Harrison and D. W. Bales.",2009,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"High","Blinding likely not conducted based on this statement: pg. 2 \"The study sample included all 77 in-home childcare providers who elected to participate in the pilot program of a childcare self-study Extension course focused on safe food handling in family childcare homes\"","N/A - uncontrolled before-after study",null,"Low",null,"Low","Outcome measures checked with Chronbach's alpha (pg. 3)","Separate risk for different outcomes, specify:","Low for knowledge (full follow up); Unclear for behaviour, as only 27/77 agreed to be audited for this outcome, and of those, only 23/27 completed the audit (which could over-inflate the effect)","Low","Both intended outcomes reported","Low","No other biases present","Separate risk for different outcomes, specify:","Low=knowledge; unclear=behaviour"]
[4370,"Jigna Morarji Dharod, Rafael Perez-Escamilla, Angela Bermudez-Millan, Sofia Segura-Perez and Grace Damio.",2004,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","not clear","N/A - uncontrolled before-after study",null,"Low","The consistency in sampling frameworks used led to similar demographic and socioeconomic characteristics of pre- and postsurvey respondents","Low","Pre-tested and reliable scales","Low",null,"Low",null,"Low",null,"Low","no major reason to downgrade"]
[5369,"C. Losasso, V. Cappa, V. Cibin, C. Mantovani, N. Costa, E. Faccio, I. Andrighetto and A. Ricci.",2014,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Unclear","details not provided","Unclear","Can't tell","Low",null,"Low",null,"Unclear"]
[5370,"C. Losasso, V. Cibin, V. Cappa, A. Roccato, A. Vanzo, I. Andrighetto and A. Ricci.",2012,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Unclear","reliability of questionnaire/outcome scales not reported","Unclear","high drop out and impact not clear","Low",null,"Low",null,"Unclear"]
[5435,"Rebecca A. Lynch, Dale M. Steen, Todd J. Pritchard, Paul R. Buzzell and Stephen J. Pintauro.",2008,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low",null,"N/A - uncontrolled before-after study",null,"Low","Teachers reported that they did not supplement the program with other food safety material","Low","n order to develop a tool with content validity, the assessment was given to a panel of 7 experts, which included professionals in the field of food safety and professionals with expertise in educational methods and assessments. In addition, feedback was obtained from 3 middle school students.","Unclear","One school was dropped from statistical analysis since the teacher reported that a last-minute scheduling conflict prevented nearly all of her students from taking the posttest and the students who took the posttest did not take it seriously. Furthermore, 71 students were eliminated from analysis because either they did not complete a posttest or they did not complete the LSI. Impact not assessed","Low",null,"Low",null,"Low"]
[5763,"S. M. McCurdy, S. Johnson, C. Hampton, J. Peutz, L. Sant and G. Wittman.",2010,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","The evaluation form was pilot-tested at a statewide Extension conference poster session in 2007","Unclear",null,"Unclear","unclear if questionnaire contained only those 3 Qs or additional ones","Unclear",null,"Unclear","methods not well reported"]
[5857,"Lydia C. Medeiros, R. Thomas George, Karen Bruns, Carol Chandler, Susan Crusey, Joyce Fittro, Melinda Hill, Marcia Jess, Carol Miller, Joan Reid and Eileene Welker.",1996,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","The possibility of a learning effect from pre- to post-testing was assessed by comparing the scores of this group with the scores of another group of educators attending the same inservice who were given a dummy pretest and the actual post-test","N/A - uncontrolled before-after study",null,"Low","The possibility of a learning effect from pre- to post-testing was assessed by comparing the scores of this group with the scores of another group of educators attending the same inservice who were given a dummy pretest and the actual post-test. Each participant was randomly assigned to one of the two groups. The two groups were compared for differences in post-test scores.","Low","pre-tested, reliable","Low",null,"Low",null,"Low",null,"Low"]
[5861,"L. C. Medeiros, Gang Chen, Horn, J. van,Fralic, J., V. Hillers and P. Kendall.",2006,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","tested, reliable","Unclear","no. incomplete/excluded not reported","Low",null,"Low",null,"Low"]
[5949,"Molly M. Michelman, Claudia Probart and Elaine McDonnell.",1998,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","students not given info on why pre-test was given","N/A - uncontrolled before-after study",null,"Low",null,"Low","pre-tested","Low","low drop out","Low",null,"Low",null,"Low"]
[6388,"Linda Gould Nierman.",1986,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","Used standardized questionnaire: Michigan Family Fare Survey","Low","Some loss to follow up for T2=large loss to T3 but compared to larger sample: \" Demographic characteristics of the Time 3 sample (n =? 45) were representative of the larger sample.\"","Low",null,"Low",null,"Low"]
[6471,"M. Nydahl, F. Jacobsson, M. Lindblom and I. Marklinder.",2012,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Unclear","no info provided","Low","Low loss to follow up","Unclear","can't tell how many questions were in questionnaire and whether all were reported","Low",null,"Unclear","reporting issues"]
[6611,"Lacye A. Osborn.",2001,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","Questionnaires pre-tested","Low",null,"Unclear","some missing outcomes","Low",null,"Low"]
[6794,"Sheri Pelletier.",2010,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","unlikely to bias outcome for this population","N/A - uncontrolled before-after study",null,"Low",null,"Unclear",null,"Low",null,"Low",null,"Low",null,"Low"]
[7182,"Elizabeth C. Redmond and Christopher J. Griffith.",2006,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","The reliability of the observation tec hnique as a tool for evaluating food safety behaviours in the model kitchen has prev iously been determined and previous research has shown that observations of c onsumer food safety malpractices in the model kitchen are representative of prac tices implemented in the home (Redmond, 2002)","Unclear","not reported","Low",null,"Low",null,"Low"]
[7244,"Jennifer Richards, Gary Skolits, Janie Burney, Ashley Pedigo and Ann F. Draughon.",2008,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","This instrument was evaluated by the Univ. of Tennessee’s (UT) Inst. for Assessment and Evaluation (IAE). The instrument was also field tested for reliability and validity (? = 0.868) prior to its use by a group of similar 7th-grade students at a nonpilot test school","Unclear","attrition rate not reported","Low",null,"Low",null,"Low"]
[7361,"Frederick R. Rohs and Janet Panter Wheeler.",1987,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","reliable questionnaires","Low","retrospective study of available data","Low",null,"Low",null,"Low"]
[7687,"Amanda R. Scott, Paul E. Pope and Britta M. Thompson.",2009,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","Checked for content/face validity and reliability of scales","Low","although not clear if follow up sub-sample similar to larger participants","Low",null,"Low",null,"Low"]
[7714,"T. Sellers, E. Andress, J. G. Fischer and M. A. Johnson.",2006,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","content validity","Low","reasons for loss to follow up reported, unlikely to bias result","Low",null,"Low",null,"Low"]
[7795,"A. E. H. Shearer, O. S. Snider and K. E. Kniel.",2014,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","unlikely to be a factor for this study/objective knowledge outcome","N/A - uncontrolled before-after study",null,"Low",null,"Unclear","not stated","Low","low drop out (237/270)","Low",null,"Low",null,"Low"]
[7796,"A. E. H. Shearer, O. S. Snider and K. E. Kniel.",2013,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","unlikely to be a factor for this study/objective knowledge outcome","N/A - uncontrolled before-after study",null,"Low","The extent of exposure during the workshop was sufficient to enhance the awareness of food microbiological safety concepts among the educators with positive change recorded in correct responses to the same questions at the workshop conclusion. The pre- and posttest results were not viewed until after the conclusion of the workshop, and there was no discussion of test questions or responses with workshop participants","Unclear","not reported","Low",null,"Low",null,"Low",null,"Low"]
[7997,"Lauren Smith, Sujata A. Sirsat and Jack A. Neal.",2014,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Unclear",null,"Unclear","large loss to follow up (34/52 completed) and small sample, impact not explored/clear","Low",null,"Low",null,"Unclear"]
[8017,"Mary Michelle Snow.",2012,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","Used or based on standard EFNEP instrument","Low","No NEA attrition was noted during the study time frame. After the target enrollment of 247 participants was reached, enrollment was discontinued","Low",null,"Low",null,"Low"]
[8170,"S. E. Stein, B. P. Dirks and J. J. Quinlan.",2010,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","The survey instrument used to collect baseline data had been previously developed and piloted by researchers at Rutgers Univ. (Byrd-Bredbenner and others 2007c, 2007d).","Unclear","large drop off in pre vs. post and not necessarily in same students","Unclear","behaviour/attitude outcomes only reported in text","Unclear",null,"Unclear"]
[8342,"M. T. Takeuchi, Edlefsen, M, McCurdy,S.M. and V. N. Hillers.",2005,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","The questionnaire, which had been pilot tested for reliability and validity in a previous study","Unclear","only 37% follow up from initial questionnaire and demographics not compared","Low",null,"Low",null,"Unclear"]
[8541,"Todd W. Tonova.",2001,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","low for children outcomes (unlikely to bias), likely high for parent outcomes","N/A - uncontrolled before-after study",null,"Low",null,"Low","validity tested","Unclear","high drop out >30% and demographics not compared; however author indicates was due to length of test and not other reasons","Low",null,"Low",null,"Low"]
[8989,"Trent Wilson Wakenight.",2004,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear","not stated","N/A - uncontrolled before-after study",null,"Low",null,"Low","reliability tested measures","Unclear","some drop outs, number not stated, could have significant impact given small sample","Low",null,"Low",null,"Unclear"]
[8998,"Gretchen Lynn Wall.",2011,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Unclear","not specified","Low","none indicated","Low",null,"Low",null,"Low"]
[9240,"M. J. Winter, L. Stanton and C. J. Boushey.",1999,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","not likely to be a factor given age of participants","N/A - uncontrolled before-after study",null,"Low",null,"Low","face validity, reliability tested","Unclear","good follow up on post test, although less for follow up","Low",null,"Low",null,"Low"]
[9241,"Carl K. Winter, Angela M. Fraser, Jeanne B. Gleason, Susan K. Hovey, Sandra M. McCurdy and Sue O. Snider.",2009,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","unlikely to be a factor in this study","N/A - uncontrolled before-after study",null,"Low",null,"Unclear","no details provided","Low",null,"Low",null,"Low",null,"Low"]
[9276,"M. Woodburn and S. VanDeRiet.",1985,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","knowledge outcome","N/A - uncontrolled before-after study",null,"Low",null,"Low","The schedule was pretested by in- terviewing 10 consumers and then revised","Low",null,"Low",null,"Low",null,"Low"]
[9421,"Yarrow, Linda, PhD,RD/LD, CDE, Remig, Valentina M, PhD,RD, FADA and Higgins, Mary Meck, PhD,RD/LD, CDE.",2009,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","Majority of questions taken from previously validated survey","Unclear","Drop out <15%, however; Intention to treat not conducted (participants who didn't view materials removed from analysis)","Low",null,"Low",null,"Unclear"]
[9646,"USDA.",2005,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low","Pg.13=Nothing occurred during the campaign that was likely to have influenced meat preparation behavior of the population in the study area","Unclear",null,"Low",null,"Unclear","Researchers did not include results from the control county survey in the report, because the results are similar to the pre-campaign results in the other counties","Low",null,"Low","since already downgraded for being uncontrolled before-after study"]
[9652,"J. Dollahite and M. Scott-Pierce.",2003,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low",null,"Low","Of these, 7636 were excluded from the analyses presented here because they did not respond to one or more checklist items or chose \"not applicable.\" There were no differences in this group as compared to the group analyzed (n=9524) based on age, gender, race, income, household size, education, size of home community, or percentage receiving individual vs. group education","Low",null,"Low",null,"Low"]
[9658,"J. I. Nies and P. G. Van Laanen.",1995,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","Reviewed for content validity and pilot tested","Low","random selection of participants with complete data","Low",null,"Low",null,"Low"]
[9660,"L. F. Pivarnik, M. S. Patnoad and M. Giddings.",1994,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Low","unlikely to be a factor in this study","N/A - uncontrolled before-after study",null,"Low",null,"Low","Was pilot tested","Low","Small drop out %","Low",null,"Low",null,"Low"]
[9668,"M. K. Wardlaw and S. Baker.",2012,"UBA","N/A - non-randomized/uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"N/A - uncontrolled before-after study",null,"Unclear",null,"N/A - uncontrolled before-after study",null,"Low",null,"Low","standardized questionnaire","Low","some loss to follow up and differences in final group vs. whole program (sample was more female, white, higher income)-but not sure this would have much negative impact on results","Low",null,"Low",null,"Low"]