Skip Navigation

This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Related articles in Am. J. Epidemiol.
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (213)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Subar, A. F.
Right arrow Articles by Rosenfeld, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Subar, A. F.
Right arrow Articles by Rosenfeld, S.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

American Journal of Epidemiology Vol. 154, No. 12 : 1089-1099
Copyright © 2001 by The Johns Hopkins University School of Hygiene and Public Health


NUTRITIONAL EPIDEMIOLOGY

Comparative Validation of the Block, Willett, and National Cancer Institute Food Frequency Questionnaires

The Eating at America's Table Study

Amy F. Subar1, Frances E. Thompson1, Victor Kipnis2, Douglas Midthune2, Paul Hurwitz3, Suzanne McNutt3, Anna McIntosh3 and Simon Rosenfeld2

1 Applied Research Program, Division of Cancer Control and Population Sciences, National Cancer Institute, Bethesda, MD.
2 Biometry Research Group, Division of Cancer Prevention, National Cancer Institute, Bethesda, MD.
3 Westat, Rockville, MD.

ABSTRACT

Researchers at the National Cancer Institute developed a new cognitively based food frequency questionnaire (FFQ), the Diet History Questionnaire (DHQ). The Eating at America's Table Study sought to validate and compare the DHQ with the Block and Willett FFQs. Of 1,640 men and women recruited to participate from a nationally representative sample in 1997, 1,301 completed four telephone 24-hour recalls, one in each season. Participants were randomized to receive either a DHQ and Block FFQ or a DHQ and Willett FFQ. With a standard measurement error model, correlations for energy between estimated truth and the DHQ, Block FFQ, and Willett FFQ, respectively, were 0.48, 0.45, and 0.18 for women and 0.49, 0.45, and 0.21 for men. For 26 nutrients, correlations and attenuation coefficients were somewhat higher for the DHQ versus the Block FFQ, and both were better than the Willett FFQ in models unadjusted for energy. Energy adjustment increased correlations and attenuation coefficients for the Willett FFQ dramatically and for the DHQ and Block FFQ instruments modestly. The DHQ performed best overall. These data show that the DHQ and the Block FFQ are better at estimating absolute intakes than is the Willett FFQ but that, after energy adjustment, all three are more comparable for purposes of assessing diet-disease risk.

diet; epidemiologic methods; food habits; nutrition assessment; nutrition surveys; questionnaires

Abbreviations: CSFII, Continuing Survey of Food Intakes by Individuals; DHQ, Diet History Questionnaire; EATS, Eating at America's Table Study; FFQ, food frequency questionnaire; FIAS 3.0, Food Intake Analysis System, version 3.0

Nutritional exposures are considered among the major modifiable risk factors for several major cancers (1Go, 2Go). The most practical and economical method for collection of comprehensive dietary data in large epidemiologic studies is the food frequency questionnaire (FFQ). Improved methods in this area are essential to providing accurate estimates of dietary intake for observational epidemiologic studies and clinical trials, thereby enhancing our understanding of the role of diet in the etiology and prevention of chronic diseases. In addition, it is estimated that, if FFQs could be improved such that correlations between the measured and true exposure of percentage of energy from fat increased from 0.60 to 0.70, sample size requirements for epidemiologic studies would be reduced by 50 percent (3Go), leading to substantial reductions in study costs.

FFQs ask respondents to report their usual frequency of consumption of each food from a list of foods for a specific time period. Compared with other approaches, such as 24-hour dietary recalls and food records, the FFQ generally collects less detail regarding the foods consumed, cooking methods, and portion size. Therefore, the quantification of intake is not considered as accurate. However, unlike records or recalls, FFQs are designed to capture usual dietary intake. Most are completed independently by a respondent and are relatively inexpensive. Therefore, the FFQ is usually the method of choice in large-scale epidemiologic studies.

FFQs require validation prior to or as part of dietary research. The approach taken in most studies is to examine the concordance of food frequency responses with reference instruments such as multiple 24-hour dietary recalls or diet records using measurement error models to estimate correlations between nutrient intakes measured by FFQs and truth. For most foods and nutrients, such correlations are in the range of 0.40–0.70 (4Go).

Because of the continuing need for improved measurement of usual dietary intake and of epidemiologic questionnaires in general (5Go, 6Go), investigators at the National Cancer Institute developed a new, cognitively based FFQ, the Diet History Questionnaire (DHQ). The DHQ, which inquires about usual intake over the past year, extends previous National Cancer Institute research that led to development of the National Cancer Institute-Block Health Habits and History Questionnaire (Block) (7Go). Improvements in the questionnaire incorporated changes in three major areas.

First, the questionnaire was refined based on results from intensive cognitive interviewing in over 75 persons, 50–70 years of age, varying in income, education, and ethnicity. Numerous cognitive issues in FFQs related to comprehension, order of food items, intake of seasonal foods, intake averages from multiple food items, and format were found and addressed in the DHQ. Details regarding this work have been summarized elsewhere (8Go). Many of the cognitive changes in the DHQ improved the validity of frequency estimates (9Go).

Second, the list of foods and the portion size ranges for the DHQ were developed from analyses of the most recent available nationally representative dietary data, the US Department of Agriculture's 1994–1996 Continuing Survey of Food Intakes by Individuals (CSFII) (10Go). Particular attention was given to the increased presence of low-fat choices in the food supply and to the use of fats in food preparation. To develop the food list, the CSFII data were also examined with respect to the food sources of the nutrients of interest to chronic disease etiology or prevention: energy, fiber, carotenoids, and vitamins E, C, and A (11Go).

Third, a new method was developed to convert FFQ responses into daily nutrient intake estimates (12Go). These conversions have been made in various ways. The Block FFQ was a major advance in that food use data from a representative sample of the US population were used to derive both nutrient and portion size values (7Go). The analytical approach developed for the DHQ is a refinement of the Block method and represents refinement in using national dietary data to develop a FFQ nutrient database.

Among the FFQs in use in the United States over the past decade, the Block and Willett FFQs or modifications of either are among the most widely used in epidemiologic research. The purpose of the Eating at America's Table Study (EATS) was to determine correlations between nutrient intakes estimated from each of the three FFQs (DHQ, Block, and Willett) and "truth" and to compare the correlations obtained from each of the instruments. "True" intakes were estimated using a measurement error model based on repeat 24-hour recalls collected over the course of 1 year as the reference (validation) instrument.

MATERIALS AND METHODS

Sample and study design
EATS, which began in August 1997, incorporated nationally representative sampling and random digit dialing techniques to obtain 12,615 telephone numbers. The intent was to include participants 20–70 years of age, balanced by gender, and to exclude those on liquid diets or who self-reported poor English reading skills. After excluding nonworking, nonresidential, or unanswered numbers and ineligible participants, 3,590 eligible persons were identified; 1,640 (46 percent) were willing to participate. At the time of the initial telephone screening, eligible participants were administered a brief questionnaire regarding demographics, body weight, smoking history, and physical activity. This was followed by four telephone-administered, nonconsecutive, 24-hour recalls, timed to occur throughout 1 calendar year, with one recall per season. The timing and number of recalls provided data to assess seasonal variations in intake and enough days to estimate the intraindividual variability associated with a range of nutrients with precision (13Go). Following the year in which the 24-hour dietary recalls were collected, participants were randomized into two groups, each completing two FFQs, 1 month apart: One group completed the DHQ and Block FFQ, and the other completed the DHQ and Willett FFQ. Within groups, the administration order was randomized. All respondents received the FFQs by mail and were instructed to complete the questionnaires independently and return them in postage-paid return envelopes. This study was approved by the institutional review boards at the National Cancer Institute and Westat. Informed consent was obtained via respondents' voluntary willingness to participate in telephone interviews and to complete questionnaires.

Twenty-four-hour dietary recalls
The four 24-hour recalls, scheduled 3 months apart, were collected from September 1997 to August 1998. Participants were required to complete a previous recall to be eligible to stay in the study. Specific goals for the weekday-weekend pattern of collected intakes were established to ensure that the intake data better reflected participants' usual dietary intake patterns. The study set goals for the weekday-weekend pattern of collected intakes to be four weekday intakes on 25 percent of the participants, three weekday/one weekend intakes on 50 percent, and two weekday/two weekend intakes on 25 percent to allow for the practical aspects of data collection as well as to ensure variability in weekend versus weekday distributions across participants. These goals were met by more than 99 percent of the sample. Eighty-four percent of the participants reported using the measuring guides (measuring cups and spoons, ruler, and two-dimensional pictures), and the remainder used their own guides or were interviewed without guides.

Interviewers for the recalls were required to have at least a Bachelor's degree in health, nutrition, or home economics and to participate in a 32-hour interviewer training. Their work was closely monitored for quality control among senior staff nutritionists by reviewing 100 percent of the collected data and by listening to 10 percent of the interviews. The 24-hour dietary recalls were collected using the multiple-pass methodology developed for the 1994–1996 CSFII (10Go). The Food Instruction Booklet, used in that survey and adapted for EATS, contained probes specific to each category of foods to ensure standardized interviews.

The 24-hour dietary recall data were coded using the Food Intake Analysis System, version 3.0 (FIAS 3.0), developed at the University of Texas. At the time of this study, FIAS 3.0 was up-to-date with the 1994 and 1995 CSFII. Foods not found in the database were added on the basis of released CSFII data files through 1997.

Food frequency questionnaires
The DHQ used in EATS was a 36-page booklet. The DHQ queries the frequency of intake for 124 separate food items and asks portion size for most of these by providing a choice of three ranges. For 44 of the 124 foods, from one to seven additional embedded questions are asked about related factors such as seasonal intake, food type (e.g., low fat, lean, diet, caffeine free), and/or fat uses or additions. The DHQ also includes six additional questions about the use of low-fat foods, four summary questions, and ten dietary supplement questions. A copy of the instrument used in EATS is available at the following site: http://appliedresearch.cancer.gov/DHQ/index.html.

The 1995 Block and the Willett (purple form) instruments were the versions used in EATS, as these were the most common FFQs being used at the time the study began. The Block FFQ is eight pages and queries 106 foods. It asks usual portion size as "small," "medium," or "large," providing reference medium portion sizes. In addition, it includes 13 dietary supplement questions, six questions on restaurant eating, five summary questions, eight questions on fat use or low-fat foods, and seven demographic/health-related questions. National dietary data were used to construct the food list, portion sizes, and nutrient database (7Go). For this study, scanned data for the Block instrument were processed at the National Cancer Institute using available software. Standard software settings were used except that "Fruit-Adjust," "Veg-Adjust," and "Recalc" were turned off.

The four-page Willett FFQ queries 126 foods. It does not include separate portion size questions but asks respondents to report their frequency of a given reference portion size. It includes ten dietary supplement questions and ten questions primarily regarding fat intake. No information is published about how the nutrient database for the Willett instrument is constructed. For this study, the Willett instrument was scanned and processed at Harvard.

Thirty-five respondents were excluded from DHQ analyses because they had skipped two facing pages of the 36-page booklet. For all three FFQs, we excluded questionnaire data that suggested biologically implausible daily energy intakes of <800 or >4,200 kcal for men or <600 or >3,500 kcal for women. This excluded 7 percent, 7 percent, and 4 percent of women and 9 percent, 4 percent, and 4 percent of men for the DHQ, Block FFQ, and Willett FFQ, respectively.

Analyses
Descriptive statistics were carried out to assess the demographics, response rates, and median nutrient intakes excluding supplements. There were 26 nutrients or dietary constituents (including the percentage of macronutrients from energy) common to the recall and the three FFQ nutrient databases for which analyses across all instruments could be performed. In each study group, nutrient correlations were estimated for each FFQ and truth with a measurement error model and 24-hour dietary recalls as the reference instrument (14Go) using all available recall and FFQ data. The model assumes that error in a test instrument may include systematic bias as well as within-person variation, but error in the reference instrument (here, 24-hour recalls) includes only within-person random error uncorrelated with error in any FFQ. The measurement error model is written as follows:


where Qi is the FFQ value for the ith person, Ti is the true usual intake of a given nutrient for the ith person, ß0 is the intercept and ß1 is the slope of the linear regression of Qi on Ti, ei is random within-person error, Fij is the jth repeat reference measurement (24-hour recalls) for person i, and uij is within-person random error for person i, repeat measurement j, assumed to be independent of Ti and ei. Essentially, the estimated correlation coefficients between the FFQ and true intakes are equivalent to deattenuated crude correlations between the FFQ and reference instruments. Because, in this case, the repeat recalls were conducted about 3 months apart, it is further assumed that random error uij and uij' corresponding to four repeat measurements of the same person are independent. Except for energy and the percentage of energy from macronutrients, the measurement error models were applied both with and without energy adjustment using the residual method (13Go).

There are many parameters of interest when evaluating how each FFQ performs relative to true dietary intake. For each FFQ comparison, we estimated the correlation coefficient between the FFQ and true intake ({rho}) and the attenuation coefficient ({lambda}). {rho} reflects validity, which is whether the FFQs measure what they are supposed to measure. The attenuation coefficient is the amount by which the log relative risk between the exposure and some disease would be distorted because of measurement error in the FFQ. Although, in general, the {lambda} can take on any value, it typically ranges from 0 to 1 for dietary variables. A {lambda} close to 1 indicated minimum attenuation, whereas a {lambda} close to 0 indicates maximum attenuation.

Generally, nutrient intakes were not normally distributed for any of the instruments. Therefore, prior to modeling, by nutrient and gender, we calculated a Box-Cox power transformation (15Go) that maximized the Shapiro-Wilk test statistic (16Go, 17Go) for the average of the four recalls. This power transformation was then applied to all instruments. After transformations, nutrient outliers were excluded from the modeling if intakes were less or greater than three times the interquartile range between the first and third quartiles for that nutrient. Exclusions across all nutrients and instruments ranged from zero persons for calcium to 14 for vitamin A. On average, three men and three women were excluded in the modeling for any given nutrient.

RESULTS

Of the 1,640 respondents (829 men and 811 women) who agreed to participate in the screening interview, 1,500, 1,418, 1,358, and 1,301 completed the first, second, third, and fourth 24-hour dietary recall, respectively. These 1,301 participants were randomized into the two study groups. Of these, 1,024 returned the first FFQ mailing, 999 completed the second, and 961 completed both FFQs. Table 1 presents the demographic characteristics of participants as the study progressed from completion of one recall, to randomization after completion of four recalls, to completion of at least one FFQ. These data show that, compared with those completing all four recalls, those completing at least one FFQ were significantly more likely to be women, older, and of White race/ethnicity. No educational differences were seen.


View this table:
[in this window]
[in a new window]
 
TABLE 1. Demographic characteristics of respondents who completed one recall, four recalls, and at least one food frequency questionnaire, Eating at America's Table Study, 1997–1998

 
Table 2 presents the response rates for the instruments by gender. Response rates ranged from 72 percent for the Block FFQ and DHQ among men to 86 percent for the Willett FFQ among women.


View this table:
[in this window]
[in a new window]
 
TABLE 2. Response rates for each food frequency questionnaire, Eating at America's Table Study, 1997–1998

 
Tables 3 and 4 show, for women and men, respectively, median intakes for 26 nutrients/dietary constituents for the recalls and FFQs by study group among respondents completing all four recalls and at least one FFQ. The values marked with a single-dagger footnote in the tables indicate FFQ values greater than 15 percent different from the recall median (after averaging the four recalls). All three FFQs estimated nutrient intakes that were closer to recalls for women than for men. For women, the DHQ- and Block FFQ-estimated nutrient intakes were fairly comparable with the recalls, though the DHQ overestimated vitamin C intake by about 38 percent. The Willett instrument's nutrient estimates tended to overestimate intakes for women and were more than 25 percent greater than the recalls for vitamins A, E, and C; vitamin B6; and sodium. For men, underestimation was common for all FFQs, as compared with recalls, but was most common and of greater magnitude for the Willett instrument. Fats and cholesterol were among the most commonly underestimated nutrients for men across all three FFQs.


View this table:
[in this window]
[in a new window]
 
TABLE 3. Median intakes for women completing one or two food frequency questionnaires and four recalls by study group and questionnaire, Eating at America's Table Study, 1997–1998

 

View this table:
[in this window]
[in a new window]
 
TABLE 4. Median intakes for men completing one or two food frequency questionnaires and four recalls by study group and questionnaire, Eating at America's Table Study, 1997–1998

 
Table 5 shows the estimated correlations between truth and the FFQs for the transformed nutrients with and without energy adjustment, by gender. Correlations of energy with truth for both genders for the DHQ and Block questionnaire were close to 0.5; for the Willett instrument, correlations were about 0.2. Generally, correlations for the Willett instrument were substantially lower than either the DHQ or Block FFQ before energy adjustment. After energy adjustment, however, these correlations improved dramatically for the Willett FFQ, while for the DHQ and Block FFQ, they also improved, but less so. The net effect was that, after energy adjustment, the correlations for all three instruments became more similar to one another. Overall, the DHQ and Block FFQ performed most similarly to one another, and both performed differently from the Willett FFQ; the DHQ correlations were generally as good as or better than those for either the Block FFQ or the Willett FFQ after adjustment.


View this table:
[in this window]
[in a new window]
 
TABLE 5. Deattenuated correlations (p) between the food frequency questionnaires and truth using a measurement error model, unadjusted and adjusted for energy intake, Eating at America's Table Study, 1997–1998

 
Table 6 shows selected attenuation coefficients for nutrients. The findings are similar to those shown in table 5, with improvement from unadjusted to adjusted greatest for the Willett instrument. Overall, the DHQ had the highest coefficients (smallest attenuation) for both men and women.


View this table:
[in this window]
[in a new window]
 
TABLE 6. Selected attenuation coefficients ({lambda}) between the food frequency questionnaire and truth using a measurement error model, unadjusted and adjusted for energy intake, Eating at America's Table Study, 1997–1998

 
Given the interpretation considerations related to multiple testing, we chose not to test for significant differences in correlations between instruments. Table 7 summarizes, through counts and means, information from tables 3GoGo6 for purposes of descriptive comparison of the FFQs. With respect to how closely each instrument estimated nutrient intakes compared with the recalls, the DHQ was superior for men. The Willett instrument performed the least favorably with up to 65 percent of the nutrient values for men 15 percent less or greater than the median recall values. For correlations, two comparisons are shown. The first is a count of how many times the correlations were highest for each FFQ, and the second is the mean of the correlations across all nutrients. The DHQ correlations were highest for most nutrients in all analyses. The mean correlation coefficients were also higher for the DHQ, though never by more than 0.07 for the energy-adjusted values. The DHQ was highest with respect to attenuation except for unadjusted values for men, though the mean coefficients were similar for all instruments in energy-adjusted models.


View this table:
[in this window]
[in a new window]
 
TABLE 7. Summary of correlation and attenuation data by gender and food frequency questionnaire, Eating at America's Table Study, 1997–1998

 
DISCUSSION

These data indicate that the DHQ and Block instruments tended to track together in the magnitude of correlations before energy adjustment and to increase similarly after adjustment compared with the Willett FFQ. This is not surprising. These two instruments rely on national dietary data to develop the food lists, portion sizes, and nutrient databases (7Go, 12Go), ask specific portion size questions, and assign different portion size values to men and women. The Willett instrument does not specifically ask portion size, and the analytical software used at Harvard assigns identical portion sizes for men and women.

These validation data are generally comparable with those found from previous studies of various versions of the Block FFQ and the Willett FFQ (18GoGoGoGoGoGoGoGoGoGo–28Go). Direct comparisons of the present data with this previous research are difficult because of the variations in analytical methods used for assessing correlation coefficients (crude vs. deattenuated) and adjusting for energy intake (none vs. nutrient density or residual methods). In addition, some of the previous studies use different reference instruments (records or recalls of varying numbers of days), have varying sample sizes, and consist of distinctly specific population groups (female nurses, male health professionals, prepregnant/pregnant women, etc.). Because this study was not embedded in a larger epidemiologic study, sampling could occur randomly nationwide, across a wide age range. Though, no doubt, willingness to participate leads to some self-selection, these data represent a more general population than most other validations.

An unexpected finding was the generally lower deattenuated correlations for the Willett FFQ and the dramatic impact of energy adjustment in improving these values compared with the Block and DHQ instruments. This suggests that, for the purposes of assessing absolute intakes, the Block FFQ and DHQ are substantially better choices than the Willett FFQ and that energy adjustment must be used when using the Willett instrument. Generally, the correlations for all three instruments are higher and more comparable after energy adjustment, indicating that this may reduce error in FFQ reporting.

Two important questions are why the Willett instrument produced lower correlations for absolute intakes than the other two FFQs and why energy adjustment was so much more important for the Willett than for the DHQ or Block FFQ. A possible explanation for the differences in absolute intakes may be due to how portion size information is handled in the three FFQs. Unlike the other two instruments, the Willett FFQ does not ask portion size, and the standard data processing program provided by Harvard does not assign different portion sizes to men and women. Interestingly, this is not the case in Harvard cohort studies (Laura Sampson, Harvard School of Public Health, personal communication, 2001). There is evidence in our study that this lack of specificity in portion sizes creates error in absolute nutrient estimates: The Willett instrument tends to underestimate the nutrient intakes of men and to overestimate the nutrient intakes of women. In a highly heterogeneous population, such as in the present study, the assumption of a standard portion size across all groups is likely to create additional substantial error, diminishing all correlations. This may explain the difference in the correlation coefficients between the Willett FFQ and the other two FFQs.

Energy adjustment, in general, appears to reduce measurement error in all FFQs. Energy comes from nearly all items asked and therefore may serve as a good surrogate variable to adjust for all other nutrients. In this study, too, the correlation coefficients in all three instruments improved after energy adjustment. The particularly dramatic improvement in the Willett FFQ may be due to a substantial portion size error in absolute intakes that is reduced by energy adjustment.

The measurement model underlying all the calculations in this paper is based on the assumptions that error in the reference instrument (here the 24-hour recall) is unbiased and contains only within-person variation uncorrelated with errors in the FFQ. Recent evidence suggests that these assumptions may be unwarranted for self-reported reference instruments. Studies involving biomarkers, such as doubly labeled water for measuring energy intake and urinary nitrogen for protein intake (29GoGoGoGoGoGo–35Go), suggest that reports using food records or recalls are biased (on average toward underreporting) and that persons may systematically differ in their reporting accuracy. This could mean that all dietary report instruments involve bias at the individual level. Part of the bias may depend on true intake and manifest itself in what is often called a flattened slope syndrome. Part of the bias may also be person specific (36Go) and correlate with its counterpart in the FFQ.

For this reason, Kipnis et al. (36Go, 37Go) proposed a new measurement error model that allows for correlated person-specific biases in the dietary report reference instrument and in the FFQ. Using sensitivity analysis (36Go), they showed that, if the correlation between person-specific biases in the FFQ and reference instrument was 0.3 or greater, the usual measurement error model would be seriously wrong. It would substantially overestimate the correlation between nutrient and true intake and the slope of the regression of the FFQ on true intake, and it would underestimate true attenuation. In a subsequent paper (37Go), they estimated the correlation between person-specific biases in the 4-day weighed food record and a version of the Willett FFQ to be at least 0.35. However, currently we lack information on the magnitude of this correlation for recalls and different questionnaires and do not know how this correlation, if it exists, may alter our results.

Using this new model, one can speculate that the correlation between person-specific biases in 24-hour recalls and the Block FFQ or DHQ may be somewhat higher than the Willett FFQ because of similarities in how portion size is asked (these two FFQs and recalls require respondents to recall portion size). This may lead to somewhat inflated correlation coefficients for absolute intakes for the DHQ and Block instruments and be part of the explanation for why the Willett instrument produced substantially lower correlation coefficients with true intake. We think, however, that the correlation between the errors in FFQs and recalls induced by portion size questions constitutes only a small part of the correlation between person-specific biases; these biases may be induced by many other factors related to self-reporting, such as other personality and cultural characteristics. Therefore, the additional correlations between errors in different instruments that may be caused by portion size questions are likely to explain only a small part of the discrepancy in the estimated correlations between three different FFQs and truth.

To better understand the structure of measurement error in FFQs, further research needs to be conducted in varied populations with biomarker reference instruments that are not based on self-report, such as urinary nitrogen and doubly labeled water. Such research will provide the necessary information to assess properties of different FFQs both for absolute intakes and intakes after energy adjustment.

At the time the study was conducted, we used the versions of the Willett and Block instruments most widely used in diet and epidemiologic research. The Block instrument, originally created in the early 1990s at the National Cancer Institute, was updated in 1992, 1995, and 1998. Several of the cognitive improvements suggested in our previous research (8Go) and integral to the DHQ have been incorporated in the 1998 version. However, the method by which portion size is now asked is quite different from the original versions. The most recent Willett instrument, too, has been modified to incorporate more low-fat foods. Validation work on both of these newer instruments needs to be conducted to ensure and justify their use.

The DHQ represents a new FFQ available to researchers. Most investigators pause at its 36-page length. However, most of this length is due not so much to the increased amount of information asked, but rather to a non-grid formatting style that repeats response categories. Cognitively, this is recommended by survey designers because the questions and answers appear as a unit for every item and because the navigational flow is consistent across questions. Further, this format allows for more flexibility in asking nonstandard questions within the instrument. This study, as well as one earlier investigation in a large prospective screening trial (38Go), has shown that the increased page length or time required to complete the DHQ (about 1 hour) does not materially affect response rates. The screening trial data also showed that the non-grid format led to fewer missing data and scanning errors, particularly for portion size. The DHQ will, however, lead to increased printing, scanning, and mailing costs (though the software and nutrient analyses are in the public domain).

The current study includes a unique study design and new standard for validation by including a comparison of our new FFQ directly with two widely used FFQs. These data show clearly that the efforts put into creating and testing a cognitively based FFQ (8Go, 9Go, 12Go, 38Go) were worthwhile in a domain of data collection that is, at this point in time, still primarily self-reported. Overall the DHQ is as good as or better than the two FFQs with which it was compared. This makes it both a reasonable alternative for investigators to use in their diet research and a candidate for further development in diverse populations. Information about obtaining and using the DHQ can be found at http://appliedresearch.cancer.gov/DHQ/index.html.

NOTES

Editor's note: Invited commentaries on this article appear on pages 1100 and 1103, and the authors' response appears on page 1105.

Reprint requests to Dr. Amy F. Subar, 6130 Executive Boulevard, MSC 7344, EPN 4005, Rockville, MD 20852 (e-mail: amy_subar{at}nih.gov).

REFERENCES

  1. Greenwald P, Clifford C. Dietary prevention. In: Greenwald P, Kramer BS, Weed DL, eds. Cancer prevention and control. New York, NY: Marcel Dekker, Inc, 1995:303–27.
  2. World Cancer Research Fund, American Institute for Cancer Research. Food, nutrition and the prevention of cancer: a global perspective. Washington, DC: American Institute for Cancer Research, 1997.
  3. Freedman LS, Schatzkin A, Wax Y. The impact of dietary measurement error on planning sample size required in a cohort study. Am J Epidemiol 1990;132:1185–95.[Abstract/Free Full Text]
  4. Thompson FE, Byers T. Dietary assessment resource manual. J Nutr 1994;124(suppl):2245S–317S.
  5. Friedenreich CM. Improving long-term recall in epidemiologic studies. Epidemiology 1994;5:1–4.[Web of Science][Medline]
  6. Buzzard IM, Sievert YA. Research priorities and recommendations for dietary assessment methodology. First International Conference on Dietary Assessment Methods. Am J Clin Nutr 1994;59(suppl):275S–80S.[Abstract/Free Full Text]
  7. Block G, Hartman AM, Dresser CM, et al. A data-based approach to diet questionnaire design and testing. Am J Epidemiol 1986;124:453–69.[Abstract/Free Full Text]
  8. Subar AF, Thompson FE, Smith AF, et al. Improving food frequency questionnaires: a qualitative approach using cognitive interviewing. J Am Diet Assoc 1995;95:781–8.[Web of Science][Medline]
  9. Thompson FE, Subar AF, Brown CC, et al. Cognitive research enhances accuracy of food frequency questionnaire reports: results of an experimental validation study. J Am Diet Assoc (in press).
  10. Agricultural Research Service, US Department of Agriculture. Design and operation: the continuing survey of food intakes by individuals and the diet and health knowledge survey, 1994–96. Washington, DC: US Department of Agriculture, 1997.
  11. Subar AF, Krebs-Smith SM, Cook A, et al. Dietary sources of nutrients among US adults, 1989 to 1991. J Am Diet Assoc 1998;98:537–47.[Web of Science][Medline]
  12. Subar AF, Midthune D, Kulldorff M, et al. An evaluation of alternative approaches to assign nutrient values to food groups in food frequency questionnaires. Am J Epidemiol 2000;152:279–86.[Abstract/Free Full Text]
  13. Willett WC. Nutritional epidemiology. New York, NY: Oxford University Press, 1998.
  14. Freedman LS, Carroll RJ, Wax Y. Estimating the relation between dietary intake obtained from a food frequency questionnaire and true average intake. Am J Epidemiol 1991;134:310–20.[Abstract/Free Full Text]
  15. Box G, Cox D. An analysis of transformations. J R Stat Soc (B) 1964;26:211–52.
  16. Shapiro S, Wilk M. An analysis of variance test for normality (complete samples). Biometrika 1965;52:591–611.[Free Full Text]
  17. Shapiro S, Francia R. An approximate analysis of variance test for normality. J Am Stat Assoc 1973;67:215–16.
  18. Willett WC, Sampson L, Stampfer MJ, et al. Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol 1985;122:51–65.[Abstract/Free Full Text]
  19. Rimm EB, Giovannucci EL, Stampfer MJ, et al. Reproducibility and validity of an expanded self-administered semiquantitative food frequency questionnaire among male health professionals. Am J Epidemiol 1992;135:1114–26.[Abstract/Free Full Text]
  20. Munger RG, Folsom AR, Kushi LH, et al. Dietary assessment of older Iowa women with a food frequency questionnaire: nutrient intake, reproducibility, and comparison with 24-hour dietary recall interviews. Am J Epidemiol 1992;136:192–200.[Abstract/Free Full Text]
  21. Longnecker MP, Lissner L, Holden JM, et al. The reproducibility and validity of a self-administered semiquantitative food frequency questionnaire in subjects from South Dakota and Wyoming. Epidemiology 1993;4:356–65.[Web of Science][Medline]
  22. Brown JE, Buzzard IM, Jacobs DR Jr, et al. A food frequency questionnaire can detect pregnancy-related changes in diet. J Am Diet Assoc 1996;96:262–6.[Web of Science][Medline]
  23. Rockett HR, Breitenbach M, Frazier AL, et al. Validation of a youth/adolescent food frequency questionnaire. Prev Med 1997;26:808–16.[Web of Science][Medline]
  24. Block G, Woods M, Potosky AL, et al. Validation of a self-administered diet history questionnaire using multiple diet records. J Clin Epidemiol 1990;43:1327–35.[Web of Science][Medline]
  25. Block G, Thompson FE, Hartman A, et al. Comparison of two dietary questionnaires validated against multiple dietary records collected during a 1-year period. J Am Diet Assoc 1992;92:686–93.[Web of Science][Medline]
  26. Mares-Perlman JA, Klein BE, Klein R, et al. A diet history questionnaire ranks nutrient intakes in middle-aged and older men and women similarly to multiple food records. J Nutr 1993;123:489–501.
  27. Potischman N, Carroll RJ, Iturria SJ, et al. Comparison of the 60- and 100-item NCI-Block questionnaires with validation data. Nutr Cancer 1999;34:70–5.[Web of Science][Medline]
  28. Bingham SA, Day NE. Using biochemical markers to assess the validity of prospective dietary assessment methods and the effect of energy adjustment. Am J Clin Nutr 1997;65(suppl):1130S–7S.[Abstract/Free Full Text]
  29. Bandini LG, Schoeller DA, Cyr HN, et al. Validity of reported energy intake in obese and nonobese adolescents. Am J Clin Nutr 1990;52:421–5.[Abstract/Free Full Text]
  30. Livingstone MBE, Prentice AM, Strain JJ, et al. Accuracy of weighed dietary records in studies of diet and health. BMJ 1990;300:708–12.
  31. Heitmann BL. The influence of fatness, weight change, slimming history and other lifestyle variables on diet reporting in Danish men and women aged 35–65 years. Int J Obes 1993;17:329–36.[Web of Science][Medline]
  32. Heitmann BL, Lissner L. Dietary underreporting by obese individuals—is it specific or non-specific? BMJ 1995;311:986–9.[Abstract/Free Full Text]
  33. Martin LJ, Su W, Jones PJ, et al. Comparison of energy intakes determined by food records and doubly labeled water in women participating in a dietary-intervention trial. Am J Clin Nutr 1996;63:483–90.[Abstract/Free Full Text]
  34. Sawaya AL, Tucker K, Tsay R, et al. Evaluation of four methods for determining energy intake in young and older women: comparison with doubly labeled water measurements of total energy expenditure. Am J Clin Nutr 1996;63:491–9.[Abstract/Free Full Text]
  35. Black AE, Bingham SA, Johansson G, et al. Validation of dietary intakes of protein and energy against 24 hour urinary N and DLW energy expenditure in middle-aged women, retired men and post-obese subjects: comparisons with validation against presumed energy requirements. Eur J Clin Nutr 1997;51:405–13.[Web of Science][Medline]
  36. Kipnis V, Carroll RJ, Freedman LS, et al. A new dietary measurement error model and its implications for the estimation of relative risk: application to four calibration studies. Am J Epidemiol 1999;150:642–51.[Abstract/Free Full Text]
  37. Kipnis V, Midthune D, Freedman LS, et al. Empirical evidence of correlated biases in dietary assessment instruments and its implications. Am J Epidemiol 2001;153:394–403.[Abstract/Free Full Text]
  38. Subar AF, Ziegler RG, Thompson FE, et al. Is shorter always better?: relative importance of dietary questionnaire length and cognitive ease on response rates and data quality. Am J Epidemiol 2001;153:404–9.[Abstract/Free Full Text]
Received for publication January 12, 2001. Accepted for publication June 22, 2001.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?

Related articles in Am. J. Epidemiol.:

Invited Commentary: A Further Look at Dietary Questionnaire Validation
Walter Willett
Am. J. Epidemiol. 2001 154: 1100-1102. [Extract] [FREE Full Text]  

Invited Commentary: Another Perspective on Food Frequency Questionnaires
Gladys Block
Am. J. Epidemiol. 2001 154: 1103-1104. [Extract] [FREE Full Text]  

Subar et al. Respond to "A Further Look at Dietary Questionnaire Validation" and "Another Perspective on Food Frequency Questionnaires"
Amy F. Subar, Frances E. Thompson, and Victor Kipnis
Am. J. Epidemiol. 2001 154: 1105-1106. [Extract] [FREE Full Text]  



This article has been cited by other articles:


Home page
Arch Intern MedHome page
D. Corella, G. Peloso, D. K. Arnett, S. Demissie, L. A. Cupples, K. Tucker, C.-Q. Lai, L. D. Parnell, O. Coltell, Y.-C. Lee, et al.
APOA2, Dietary Fat, and Body Mass Index: Replication of a Gene-Diet Interaction in 3 Independent Populations
Arch Intern Med, November 9, 2009; 169(20): 1897 - 1906.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
L. Y. Sue, C. Schairer, X. Ma, C. Williams, S.-C. Chang, A. B. Miller, C. A. McCarty, B. J. Willcox, and R. G. Ziegler
Energy Intake and Risk of Postmenopausal Breast Cancer: An Expanded Analysis in the Prostate, Lung, Colorectal, and Ovarian Cancer Screening Trial (PLCO) Cohort
Cancer Epidemiol. Biomarkers Prev., November 1, 2009; 18(11): 2842 - 2850.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
M. Junyent, L. D Parnell, C.-Q. Lai, Y.-C. Lee, C. E Smith, D. K Arnett, M. Y Tsai, E. K Kabagambe, R. J Straka, M. Province, et al.
Novel variants at KCTD10, MVK, and MMAB genes interact with dietary carbohydrates to modulate HDL-cholesterol concentrations in the Genetics of Lipid Lowering Drugs and Diet Network Study
Am. J. Clinical Nutrition, September 1, 2009; 90(3): 686 - 694.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
L. Cahill, P. N. Corey, and A. El-Sohemy
Vitamin C Deficiency in a Population of Young Canadian Adults
Am. J. Epidemiol., August 15, 2009; 170(4): 464 - 471.
[Abstract] [Full Text] [PDF]


Home page
NEJMHome page
K. H. Schmitz, R. L. Ahmed, A. Troxel, A. Cheville, R. Smith, L. Lewis-Grant, C. J. Bryan, C. T. Williams-Smith, and Q. P. Greene
Weight Lifting in Women with Breast-Cancer-Related Lymphedema
N. Engl. J. Med., August 13, 2009; 361(7): 664 - 673.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
K. Wallace, M. V. Grau, D. Ahnen, D. C. Snover, D. J. Robertson, D. Mahnke, J. Gui, E. L. Barry, R. W. Summers, G. McKeown-Eyssen, et al.
The Association of Lifestyle and Dietary Factors with the Risk for Serrated Polyps of the Colorectum
Cancer Epidemiol. Biomarkers Prev., August 1, 2009; 18(8): 2310 - 2317.
[Abstract] [Full Text] [PDF]


Home page
JNCI J Natl Cancer InstHome page
A. C. M. Thiebaut, L. Jiao, D. T. Silverman, A. J. Cross, F. E. Thompson, A. F. Subar, A. R. Hollenbeck, A. Schatzkin, and R. Z. Stolzenberg-Solomon
Dietary Fatty Acids and Pancreatic Cancer in the NIH-AARP Diet and Health Study
J Natl Cancer Inst, July 15, 2009; 101(14): 1001 - 1011.
[Abstract] [Full Text] [PDF]


Home page
ANN INTERN MEDHome page
J. A. Yanovski, S. J. Parikh, L. B. Yanoff, B. I. Denkinger, K. A. Calis, J. C. Reynolds, N. G. Sebring, and T. McHugh
Effects of Calcium Supplementation on Body Weight and Adiposity in Overweight and Obese Adults: A Randomized Trial
Ann Intern Med, June 16, 2009; 150(12): 821 - 829.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
N. Tasevska, R. Sinha, V. Kipnis, A. F Subar, M. F Leitzmann, A. R Hollenbeck, N. E Caporaso, A. Schatzkin, and A. J Cross
A prospective study of meat, cooking methods, meat mutagens, heme iron, and lung cancer risks
Am. J. Clinical Nutrition, June 1, 2009; 89(6): 1884 - 1894.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
C. D. Williams, J. A. Satia, L. S. Adair, J. Stevens, J. Galanko, T. O. Keku, and R. S. Sandler
Dietary Patterns, Food Groups, and Rectal Cancer Risk in Whites and African-Americans
Cancer Epidemiol. Biomarkers Prev., May 1, 2009; 18(5): 1552 - 1561.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
M. Junyent, D. K. Arnett, M. Y. Tsai, E. K. Kabagambe, R. J. Straka, M. Province, P. An, C.-Q. Lai, L. D. Parnell, J. Shen, et al.
Genetic Variants at the PDZ-Interacting Domain of the Scavenger Receptor Class B Type I Interact with Diet to Influence the Risk of Metabolic Syndrome in Obese Men and Women
J. Nutr., May 1, 2009; 139(5): 842 - 848.
[Abstract] [Full Text] [PDF]


Home page
Arch Intern MedHome page
L. Jiao, P. N. Mitrou, J. Reedy, B. I. Graubard, A. R. Hollenbeck, A. Schatzkin, and R. Stolzenberg-Solomon
A Combined Healthy Lifestyle Score and Risk of Pancreatic Cancer in a Large Cohort Study
Arch Intern Med, April 27, 2009; 169(8): 764 - 770.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
J. M. Genkinger, D. Spiegelman, K. E. Anderson, L. Bergkvist, L. Bernstein, P. A. van den Brandt, D. R. English, J. L. Freudenheim, C. S. Fuchs, G. G. Giles, et al.
Alcohol Intake and Pancreatic Cancer Risk: A Pooled Analysis of Fourteen Cohort Studies
Cancer Epidemiol. Biomarkers Prev., March 1, 2009; 18(3): 765 - 776.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
A. E. Millen, M. Pettinger, J. L. Freudenheim, R. D. Langer, C. A. Rosenberg, Y. Mossavar-Rahmani, C. M. Duffy, D. S. Lane, A. McTiernan, L. H. Kuller, et al.
Incident Invasive Breast Cancer, Geographic Location of Residence, and Reported Average Time Spent Outside
Cancer Epidemiol. Biomarkers Prev., February 1, 2009; 18(2): 495 - 507.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
W. Demark-Wahnefried, T. J. Polascik, S. L. George, B. R. Switzer, J. F. Madden, M. T. Ruffin IV, D. C. Snyder, K. Owzar, V. Hars, D. M. Albala, et al.
Flaxseed Supplementation (Not Dietary Fat Restriction) Reduces Prostate Cancer Proliferation Rates in Men Presurgery
Cancer Epidemiol. Biomarkers Prev., December 1, 2008; 17(12): 3577 - 3587.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
J. Dai, D. P Jones, J. Goldberg, T. R Ziegler, R. M Bostick, P. W Wilson, A. K Manatunga, L. Shallenberger, L. Jones, and V. Vaccarino
Association between adherence to the Mediterranean diet and oxidative stress
Am. J. Clinical Nutrition, November 1, 2008; 88(5): 1364 - 1370.
[Abstract] [Full Text] [PDF]


Home page
J Health PsycholHome page
C. E. Mosher, I. M. Lipkus, R. Sloane, W. E. Kraus, D. C. Snyder, B. Peterson, L. W. Jones, and W. Demark-Wahnefried
Cancer Survivors' Health Worries and Associations with Lifestyle Practices
J Health Psychol, November 1, 2008; 13(8): 1105 - 1112.
[Abstract] [PDF]


Home page
PediatricsHome page
S. B. Fein, J. Labiner-Wolfe, K. R. Shealy, R. Li, J. Chen, and L. M. Grummer-Strawn
Infant Feeding Practices Study II: Study Methods
Pediatrics, October 1, 2008; 122(Supplement_2): S28 - S35.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
L. S. Freedman, P. M. Guenther, S. M. Krebs-Smith, and P. S. Kott
A Population's Mean Healthy Eating Index-2005 Scores Are Best Estimated by the Score of the Population Ratio when One 24-Hour Recall Is Available
J. Nutr., September 1, 2008; 138(9): 1725 - 1729.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
L. C. Vinikoor, J. C. Schroeder, R. C. Millikan, J. A. Satia, C. F. Martin, J. Ibrahim, J. A. Galanko, and R. S. Sandler
Consumption of trans-Fatty Acid and Its Association with Colorectal Adenomas
Am. J. Epidemiol., August 1, 2008; 168(3): 289 - 297.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
A. Flood, T. Rastogi, E. Wirfalt, P. N Mitrou, J. Reedy, A. F Subar, V. Kipnis, T. Mouw, A. R Hollenbeck, M. Leitzmann, et al.
Dietary patterns as identified by factor analysis and colorectal cancer among middle-aged Americans
Am. J. Clinical Nutrition, July 1, 2008; 88(1): 176 - 184.
[Abstract] [Full Text] [PDF]


Home page
Clin TrialsHome page
W. Demark-Wahnefried, S. L George, B. R Switzer, D. C Snyder, J. F Madden, T. J Polascik, M. T Ruffin IV, and R. T Vollmer
Overcoming challenges in designing and implementing a phase II randomized controlled trial using a presurgical model to test a dietary intervention in prostate cancer
Clinical Trials, June 1, 2008; 5(3): 262 - 272.
[Abstract] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
D. C. Snyder, R. Sloane, D. Lobach, I. M. Lipkus, B. Peterson, W. Kraus, and W. Demark-Wahnefried
Differences in Baseline Characteristics and Outcomes at 1- and 2-Year Follow-up of Cancer Survivors Accrued via Self-Referral versus Cancer Registry in the FRESH START Diet and Exercise Trial
Cancer Epidemiol. Biomarkers Prev., May 1, 2008; 17(5): 1288 - 1294.
[Abstract] [Full Text] [PDF]


Home page
Hum ReprodHome page
S.S. Young, B. Eskenazi, F.M. Marchetti, G. Block, and A.J. Wyrobek
The association of folate, zinc and antioxidant intake with sperm aneuploidy in healthy non-smoking men
Hum. Reprod., May 1, 2008; 23(5): 1014 - 1022.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
S. Koutros, A. J. Cross, D. P. Sandler, J. A. Hoppin, X. Ma, T. Zheng, M. C.R. Alavanja, and R. Sinha
Meat and Meat Mutagens and Risk of Prostate Cancer in the Agricultural Health Study
Cancer Epidemiol. Biomarkers Prev., January 1, 2008; 17(1): 80 - 87.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
S. Kim, T. O. Keku, C. Martin, J. Galanko, J. T. Woosley, J. C. Schroeder, J. A. Satia, S. Halabi, and R. S. Sandler
Circulating Levels of Inflammatory Cytokines and Risk of Colorectal Adenomas
Cancer Res., January 1, 2008; 68(1): 323 - 328.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
J. R. Hebert, T. G. Hurley, K. E. Peterson, K. Resnicow, F. E. Thompson, A. L. Yaroch, M. Ehlers, D. Midthune, G. C. Williams, G. W. Greene, et al.
Social Desirability Trait Influences on Self-Reported Dietary Measures among Diverse Participants in a Multicenter Multiple Risk Factor Trial
J. Nutr., January 1, 2008; 138(1): 226S - 234S.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
M. L. Molag, J. H. M. de Vries, M. C. Ocke, P. C. Dagnelie, P. A. van den Brandt, M. C. J. F. Jansen, W. A. van Staveren, and P. van't Veer
Design Characteristics of Food Frequency Questionnaires in Relation to Their Validity
Am. J. Epidemiol., December 15, 2007; 166(12): 1468 - 1478.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
U. Nothlings, K. Hoffmann, M. M. Bergmann, and H. Boeing
Fitting Portion Sizes in a Self-Administered Food Frequency Questionnaire
J. Nutr., December 1, 2007; 137(12): 2781 - 2786.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
J. M. Chan, F. Wang, and E. A. Holly
Whole Grains and Risk of Pancreatic Cancer in a Large Population-based Case-Control Study in the San Francisco Bay Area, California
Am. J. Epidemiol., November 15, 2007; 166(10): 1174 - 1185.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
L. B. Dixon, A. F. Subar, U. Peters, J. L. Weissfeld, R. S. Bresalier, A. Risch, A. Schatzkin, and R. B. Hayes
Adherence to the USDA Food Guide, DASH Eating Plan, and Mediterranean Dietary Pattern Reduces Risk of Colorectal Adenoma
J. Nutr., November 1, 2007; 137(11): 2443 - 2450.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
K. H Schmitz, P. J Hannan, S. D Stovitz, C. J Bryan, M. Warren, and M. D Jensen
Strength training and adiposity in premenopausal women: Strong, Healthy, and Empowered study
Am. J. Clinical Nutrition, September 1, 2007; 86(3): 566 - 572.
[Abstract] [Full Text] [PDF]


Home page
JNCI J Natl Cancer InstHome page
C. J. Kavanaugh, P. R. Trumbo, and K. C. Ellwood
The U.S. Food and Drug Administration's Evidence-Based Review for Qualified Health Claims: Tomatoes, Lycopene, and Cancer
J Natl Cancer Inst, July 18, 2007; 99(14): 1074 - 1085.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
W. Demark-Wahnefried, E. C. Clipp, I. M. Lipkus, D. Lobach, D. C. Snyder, R. Sloane, B. Peterson, J. M. Macri, C. L. Rock, C. M. McBride, et al.
Main Outcomes of the FRESH START Trial: A Sequentially Tailored, Diet and Exercise Mailed Print Intervention Among Breast and Prostate Cancer Survivors
J. Clin. Oncol., July 1, 2007; 25(19): 2709 - 2718.
[Abstract] [Full Text] [PDF]


Home page
Clin. Chem.Home page
D. Corella, D. K. Arnett, M. Y. Tsai, E. K. Kabagambe, J. M. Peacock, J. E. Hixson, R. J. Straka, M. Province, C.-Q. Lai, L. D. Parnell, et al.
The -256T>C Polymorphism in the Apolipoprotein A-II Gene Promoter Is Associated with Body Mass Index and Food Intake in the Genetics of Lipid Lowering Drugs and Diet Network Study
Clin. Chem., June 1, 2007; 53(6): 1144 - 1152.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
G. L. Austin, L. S. Adair, J. A. Galanko, C. F. Martin, J. A. Satia, and R. S. Sandler
A Diet High in Fruits and Low in Meats Reduces the Risk of Colorectal Adenomas
J. Nutr., April 1, 2007; 137(4): 999 - 1004.
[Abstract] [Full Text] [PDF]


Home page
JNCI J Natl Cancer InstHome page
A. C. M. Thiebaut, V. Kipnis, S.-C. Chang, A. F. Subar, F. E. Thompson, P. S. Rosenberg, A. R. Hollenbeck, M. Leitzmann, and A. Schatzkin
Dietary Fat and Postmenopausal Invasive Breast Cancer in the National Institutes of Health-AARP Diet and Health Study Cohort
J Natl Cancer Inst, March 21, 2007; 99(6): 451 - 462.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
K. D Stark, R. J Pawlosky, R. J Sokol, J. H Hannigan, and N. Salem Jr
Maternal smoking is associated with decreased 5-methyltetrahydrofolate in cord plasma
Am. J. Clinical Nutrition, March 1, 2007; 85(3): 796 - 802.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
L. B. Dixon, A. F. Subar, L. Wideroff, F. E. Thompson, L. L. Kahle, and N. Potischman
Carotenoid and Tocopherol Estimates from the NCI Diet History Questionnaire Are Valid Compared with Multiple Recalls and Serum Biomarkers
J. Nutr., December 1, 2006; 136(12): 3054 - 3061.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
A. Flood, U. Peters, D. J. Jenkins, N. Chatterjee, A. F Subar, T. R Church, R. Bresalier, J. L Weissfeld, R. B Hayes, A. Schatzkin, et al.
Carbohydrate, glycemic index, and glycemic load and colorectal adenomas in the Prostate, Lung, Colorectal, and Ovarian Screening Study.
Am. J. Clinical Nutrition, November 1, 2006; 84(5): 1184 - 1192.
[Abstract] [Full Text] [PDF]


Home page
Int J EpidemiolHome page
L. S Freedman, N. Potischman, V. Kipnis, D. Midthune, A. Schatzkin, F. E Thompson, R. P Troiano, R. Prentice, R. Patterson, R. Carroll, et al.
A comparison of two dietary instruments for evaluating the fat-breast cancer relationship
Int. J. Epidemiol., August 1, 2006; 35(4): 1011 - 1021.
[Abstract] [Full Text] [PDF]


Home page
AJPHHome page
E. B. Gold, A. Colvin, N. Avis, J. Bromberger, G. A. Greendale, L. Powell, B. Sternfeld, and K. Matthews
Longitudinal Analysis of the Association Between Vasomotor Symptoms and Race/Ethnicity Across the Menopausal Transition: Study of Women's Health Across the Nation
Am J Public Health, July 1, 2006; 96(7): 1226 - 1235.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
S.-C. Chang, R. G. Ziegler, B. Dunn, R. Stolzenberg-Solomon, J. V. Lacey Jr., W.-Y. Huang, A. Schatzkin, D. Reding, R. N. Hoover, P. Hartge, et al.
Association of energy intake and energy balance with postmenopausal breast cancer in the prostate, lung, colorectal, and ovarian cancer screening trial.
Cancer Epidemiol. Biomarkers Prev., February 1, 2006; 15(2): 334 - 341.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
M. M. Cantwell, A. E. Millen, R. Carroll, B. L. Mittl, S. Hermansen, L. A. Brinton, and N. Potischman
A Debriefing Session with a Nutritionist Can Improve Dietary Assessment Using Food Diaries
J. Nutr., February 1, 2006; 136(2): 440 - 445.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
G. C. Marks, M. C. Hughes, and J. C. van der Pols
Relative Validity of Food Intake Estimates Using a Food Frequency Questionnaire Is Associated with Sex, Age, and Other Personal Characteristics
J. Nutr., February 1, 2006; 136(2): 459 - 465.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
A. E. Millen, D. Midthune, F. E. Thompson, V. Kipnis, and A. F. Subar
The National Cancer Institute Diet History Questionnaire: Validation of Pyramid Food Servings
Am. J. Epidemiol., February 1, 2006; 163(3): 279 - 288.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
J. A. Meyerhardt, D. Heseltine, H. Campos, M. D. Holmes, W. C. Willett, E. P. Winer, P. C. Enzinger, C. A. Bunnell, M. H. Kulke, and C. S. Fuchs
Assessment of a Dietary Questionnaire in Cancer Patients Receiving Cytotoxic Chemotherapy
J. Clin. Oncol., November 20, 2005; 23(33): 8453 - 8460.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
U. Lim, M. Schenk, L. E. Kelemen, S. Davis, W. Cozen, P. Hartge, M. H. Ward, and R. Stolzenberg-Solomon
Dietary Determinants of One-Carbon Metabolism and the Risk of Non-Hodgkin's Lymphoma: NCI-SEER Case-Control Study, 1998-2000
Am. J. Epidemiol., November 15, 2005; 162(10): 953 - 964.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
D. R. Paul, D. G. Rhodes, M. Kramer, D. J. Baer, and W. V. Rumpler
Validation of a Food Frequency Questionnaire by Direct Measurement of Habitual ad Libitum Food Intake
Am. J. Epidemiol., October 15, 2005; 162(8): 806 - 814.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Clin. Nutr.Home page
K. D Stark, R. J Pawlosky, S. Beblo, M. Murthy, V. P Flanagan, J. Janisse, M. Buda-Abela, H. Rockett, J. E Whitty, R. J Sokol, et al.
Status of plasma folate after folic acid fortification of the food supply in pregnant African American women and the influences of diet, smoking, and alcohol consumption
Am. J. Clinical Nutrition, March 1, 2005; 81(3): 669 - 677.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
V. Ganji and M. R. Kafai
Population Determinants of Serum Lycopene Concentrations in the United States: Data from the Third National Health and Nutrition Examination Survey, 1988-1994
J. Nutr., March 1, 2005; 135(3): 567 - 572.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
I. Shai, B. A. Rosner, D. R. Shahar, H. Vardi, A. B. Azrad, A. Kanfi, D. Schwarzfuchs, and D. Fraser
Dietary Evaluation and Attenuation of Relative Risk: Multiple Comparisons between Blood and Urinary Biomarkers, Food Frequency, and 24-Hour Recall Questionnaires: the DEARR Study
J. Nutr., March 1, 2005; 135(3): 573 - 579.
[Abstract] [Full Text] [PDF]


Home page
PediatricsHome page
S. Beblo, K. D. Stark, M. Murthy, J. Janisse, H. Rockett, J. E. Whitty, M. Buda-Abela, S. S. Martier, R. J. Sokol, J. H. Hannigan, et al.
Effects of Alcohol Intake During Pregnancy on Docosahexaenoic Acid and Arachidonic Acid in Umbilical Cord Vessels of Black Women
Pediatrics, February 1, 2005; 115(2): e194 - e203.
[Abstract] [Full Text] [PDF]


Home page
Int J EpidemiolHome page
N. Day, M. Wong, S Bingham, K. Khaw, R Luben, K. Michels, A Welch, and N. Wareham
Correlated measurement error--implications for nutritional epidemiology
Int. J. Epidemiol., December 1, 2004; 33(6): 1373 - 1381.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
M. M. Gaudet, J. A. Britton, G. C. Kabat, S. Steck-Scott, S. M. Eng, S. L. Teitelbaum, M. B. Terry, A. I. Neugut, and M. D. Gammon
Fruits, Vegetables, and Micronutrients in Relation to Breast Cancer Modified by Menopause and Hormone Receptor Status
Cancer Epidemiol. Biomarkers Prev., September 1, 2004; 13(9): 1485 - 1494.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
S. M. Smith, J. E. Davis-Street, J. V. Fesperman, M. D. Smith, B. L. Rice, and S. R. Zwart
Nutritional Status Changes in Humans during a 14-Day Saturation Dive: The NASA Extreme Environment Mission Operations V Project
J. Nutr., July 1, 2004; 134(7): 1765 - 1771.
[Abstract] [Full Text]


Home page
J. Nutr.Home page
M. Messerer, S.-E. Johansson, and A. Wolk
The Validity of Questionnaire-Based Micronutrient Intake Estimates Is Increased by Including Dietary Supplement Use in Swedish Men
J. Nutr., July 1, 2004; 134(7): 1800 - 1805.
[Abstract] [Full Text]


Home page
J. Nutr.Home page
L. S. Freedman, D. Midthune, R. J. Carroll, S. Krebs-Smith, A. F. Subar, R. P. Troiano, K. Dodd, A. Schatzkin, P. Ferrari, and V. Kipnis
Adjustments to Improve the Estimation of Usual Dietary Intake Distributions in the Population
J. Nutr., July 1, 2004; 134(7): 1836 - 1843.
[Abstract] [Full Text]


Home page
Am J EpidemiolHome page
E. B. Gold, G. Block, S. Crawford, L. Lachance, G. FitzGerald, H. Miracle, and S. Sherman
Lifestyle and Demographic Factors in Relation to Vasomotor Symptoms: Baseline Results from the Study of Women's Health Across the Nation
Am. J. Epidemiol., June 15, 2004; 159(12): 1189 - 1199.
[Abstract] [Full Text] [PDF]


Home page
Health Educ BehavHome page
J. F. Thrasher, M. K. Campbell, and V. Oates
Behavior-Specific Social Support for Healthy Behaviors Among African American Church Members: Applying Optimal Matching Theory
Health Educ Behav, April 1, 2004; 31(2): 193 - 205.
[Abstract] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
M. Cantwell, B. Mittl, J. Curtin, R. Carroll, N. Potischman, N. Caporaso, and R. Sinha
Relative Validity of a Food Frequency Questionnaire with a Meat-Cooking and Heterocyclic Amine Module
Cancer Epidemiol. Biomarkers Prev., February 1, 2004; 13(2): 293 - 298.
[Abstract] [Full Text] [PDF]


Home page
Journals of Gerontology Series A: Biological Sciences and Medical SciencesHome page
S. M. Roth, J. M. Zmuda, J. A. Cauley, P. R. Shea, and R. E. Ferrell
Vitamin D Receptor Genotype Is Associated With Fat-Free Mass and Sarcopenia in Elderly Men
J. Gerontol. A Biol. Sci. Med. Sci., January 1, 2004; 59(1): B10 - 15.
[Abstract] [Full Text] [PDF]


Home page
Int J EpidemiolHome page
A. Schatzkin, V. Kipnis, R. J Carroll, D. Midthune, A. F Subar, S. Bingham, D. A Schoeller, R. P Troiano, and L. S Freedman
A comparison of a food frequency questionnaire with a 24-hour recall for use in an epidemiological cohort study: results from the biomarker-based Observing Protein and Energy Nutrition (OPEN) study
Int. J. Epidemiol., December 1, 2003; 32(6): 1054 - 1062.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
J. Satia-Abouta, J. A. Galanko, J. D. Potter, A. Ammerman, C. F. Martin, and R. S. Sandler
Associations of Total Energy and Macronutrients with Colon Cancer Risk in African Americans and Whites: Results from the North Carolina Colon Cancer Study
Am. J. Epidemiol., November 15, 2003; 158(10): 951 - 962.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
D. Shahar, D. Fraser, I. Shai, and H. Vardi
Development of a Food Frequency Questionnaire (FFQ) for an Elderly Population Based on a Population Survey
J. Nutr., November 1, 2003; 133(11): 3625 - 3629.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
J. Satia-Abouta, J. A. Galanko, C. F. Martin, J. D. Potter, A. Ammerman, and R. S. Sandler
Associations of Micronutrients with Colon Cancer Risk in African Americans and Whites: Results from the North Carolina Colon Cancer Study
Cancer Epidemiol. Biomarkers Prev., August 1, 2003; 12(8): 747 - 754.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
A. F. Subar, V. Kipnis, R. P. Troiano, D. Midthune, D. A. Schoeller, S. Bingham, C. O. Sharbaugh, J. Trabulsi, S. Runswick, R. Ballard-Barbash, et al.
Using Intake Biomarkers to Evaluate the Extent of Dietary Misreporting in a Large Sample of Adults: The OPEN Study
Am. J. Epidemiol., July 1, 2003; 158(1): 1 - 13.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
V. Kipnis, A. F. Subar, D. Midthune, L. S. Freedman, R. Ballard-Barbash, R. P. Troiano, S. Bingham, D. A. Schoeller, A. Schatzkin, and R. J. Carroll
Structure of Dietary Measurement Error: Results of the OPEN Biomarker Study
Am. J. Epidemiol., July 1, 2003; 158(1): 14 - 21.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
W. Willett
Invited Commentary: OPEN Questions
Am. J. Epidemiol., July 1, 2003; 158(1): 22 - 24.
[Full Text] [PDF]


Home page
Am J EpidemiolHome page
V. Kipnis, A. F. Subar, A. Schatzkin, D. Midthune, R. P. Troiano, D. A. Schoeller, S. Bingham, and L. S. Freedman
Kipnis et al. Respond to "OPEN Questions"
Am. J. Epidemiol., July 1, 2003; 158(1): 25 - 26.
[Full Text] [PDF]


Home page
J. Nutr.Home page
C. Kavanaugh and J. E. Green
The Use of Genetically Altered Mice for Breast Cancer Prevention Studies
J. Nutr., July 1, 2003; 133(7): 2404S - 2409.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
C. A. Thomson, A. Giuliano, C. L. Rock, C. K. Ritenbaugh, S. W. Flatt, S. Faerber, V. Newman, B. Caan, E. Graver, V. Hartz, et al.
Measuring Dietary Change in a Diet Intervention Trial: Comparing Food Frequency Questionnaire and Dietary Recalls
Am. J. Epidemiol., April 15, 2003; 157(8): 754 - 762.
[Abstract] [Full Text] [PDF]


Home page
Diabetes CareHome page
B. McCulloch, R. McDermott, G. Miller, D. Leonard, M. Elwell, and R. Muller
Self-Reported Diabetes and Health Behaviors in Remote Indigenous Communities in Northern Queensland, Australia
Diabetes Care, February 1, 2003; 26(2): 397 - 403.
[Abstract] [Full Text] [PDF]


Home page
J. Nutr.Home page
U. Noethlings, K. Hoffmann, M. M. Bergmann, and H. Boeing
Portion Size Adds Limited Information on Variance in Food Intake of Participants in the EPIC-Potsdam Study
J. Nutr., February 1, 2003; 133(2): 510 - 515.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
T. Keku, R. Millikan, K. Worley, S. Winkel, A. Eaton, L. Biscocho, C. Martin, and R. Sandler
5,10-Methylenetetrahydrofolate Reductase Codon 677 and 1298 Polymorphisms and Colon Cancer in African Americans and Whites
Cancer Epidemiol. Biomarkers Prev., December 1, 2002; 11(12): 1611 - 1621.
[Abstract] [Full Text] [PDF]


Home page
Am J EpidemiolHome page
T. Byers
Food Frequency Dietary Assessment: How Bad Is Good Enough?
Am. J. Epidemiol., December 15, 2001; 154(12): 1087 - 1088.
[Full Text] [PDF]


Home page
Am J EpidemiolHome page
W. Willett
Invited Commentary: A Further Look at Dietary Questionnaire Validation
Am. J. Epidemiol., December 15, 2001; 154(12): 1100 - 1102.
[Full Text] [PDF]


Home page
Am J EpidemiolHome page
G. Block
Invited Commentary: Another Perspective on Food Frequency Questionnaires
Am. J. Epidemiol., December 15, 2001; 154(12): 1103 - 1104.
[Full Text] [PDF]


Home page
Am J EpidemiolHome page
A. F. Subar, F. E. Thompson, and V. Kipnis
Subar et al. Respond to "A Further Look at Dietary Questionnaire Validation" and "Another Perspective on Food Frequency Questionnaires"
Am. J. Epidemiol., December 15, 2001; 154(12): 1105 - 1106.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Related articles in Am. J. Epidemiol.
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (213)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Subar, A. F.
Right arrow Articles by Rosenfeld, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Subar, A. F.
Right arrow Articles by Rosenfeld, S.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?