https://orcid.org/0000-0002-2968-1175
Figures
Abstract
Mediterranean diet (MD) is among the most commonly investigated diets and recognized as one of the healthiest dietary patterns. Due to its complexity, geographical and cultural variations, it also represents a challenge for quantification. The aim of this cross-sectional study was to assess reliability and validity of the Croatian version of the 14-item Mediterranean Diet Serving Score (MDSS), using the Mediterranean Diet Adherence Screener (MEDAS) as the referent test. We included the exploratory sample of 360 medical students, and a confirmatory sample of 299 health studies students from the University of Split, Croatia. Test-retest reliability and validity of the MDSS were tested using intra-class correlation coefficients (ICC), while Cohen’s kappa statistic was used to test correct classification of subjects into MD adherent/non-adherent category. A very good reliability was shown for the overall MDSS score (ICC = 0.881 [95% CI 0.843–0.909]), and a moderate reliability for the binary adherence (κ = 0.584). Concurrent validity of the MDSS was also better when expressed as a total score (ICC = 0.544 [0.439–0.629]) as opposed to the adherence (κ = 0.223), with similar result in the confirmatory sample (ICC = 0.510 [0.384–0.610]; κ = 0.216). Disappointingly, only 13.6% of medical students were adherent to the MD according to MDSS, and 19.7% according to the MEDAS questionnaire. Nevertheless, MDSS score was positively correlated with age (ρ = 0.179: P = 0.003), self-assessed health perception (ρ = 0.123; P = 0.047), and mental well-being (ρ = 0.139: P = 0.022). MDSS questionnaire is a short, reliable and reasonably valid instrument, and thus useful for assessing the MD adherence, with better results when used as a numeric score, even in the population with low MD adherence.
Citation: Marendić M, Polić N, Matek H, Oršulić L, Polašek O, Kolčić I (2021) Mediterranean diet assessment challenges: Validation of the Croatian Version of the 14-item Mediterranean Diet Serving Score (MDSS) Questionnaire. PLoS ONE 16(3): e0247269. https://doi.org/10.1371/journal.pone.0247269
Editor: Cristina Vassalle, Fondazione Toscana Gabriele Monasterio, ITALY
Received: August 22, 2020; Accepted: February 3, 2021; Published: March 1, 2021
Copyright: © 2021 Marendić et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying the results presented in the study are available from: https://figshare.com/search?q=10.6084%2Fm9.figshare.13560497.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Nutrition has a profound impact on health, both in the short-term and life-long scale. Nutrition affects the disease burden of both infectious and non-communicable disease outcomes. According to the Global Burden of Disease Study for 2017, dietary risk factors are accountable for as many as 11 million deaths and 255 million DALYs worldwide, with the biggest contribution from high sodium intake, low intake of whole grains and fruit [1].
Unhealthy diet is contributing to both poor (or insufficient) nourishment and environmental degradation, which points to the urgent need for a global transformation of the food system, ideally back towards traditional diets [2]. An example of such a diet is the Mediterranean diet (MD) [2, 3]. The MD is one of the most commonly investigated dietary patterns, with many beneficial effects for human health described so far [4], playing a role in prevention of cardiovascular diseases (CVD) [5–7], CVD risk factors [8], diabetes [9, 10], cancer [11, 12], protection of mental health [13, 14], and better health-related quality of life [15].
According to the revised MD pyramid, the guidelines for adults include high daily intake of vegetables, fruits, whole grains, and olive oil, moderate daily consumption of nuts, dairy products, and red wine, weekly intake of legumes, fish, eggs and poultry, and overall low intake of red and processed meat and other processed foods [16]. The MD is an incredibly rich nutritional pattern, with many varieties of dishes, flavors, textures, and nutrients, creating a complex “exposome”, which is the reason why it represents a challenge for defining and measuring [17].
In general, measuring nutrition and eating habits is far from being simple. There are several different approaches and all of them have their advantages and limitations. Dietary pattern can be defined using a general description, dietary pyramids, a priori scoring systems, a posteriori dietary pattern formation, or by quantifying food and nutrient content [18, 19]. A priori approach is more commonly applied and it uses a predefined scoring system, i.e. a diet index, in case of the MD an “attempt to make a global evaluation of the quality of the diet based on a traditional Mediterranean reference pattern” [20]. The indexes are usually based on data acquired within a 24 h quantitative intake recall, dietary records or food frequency questionnaires (FFQs) [21]. FFQ is one of the most commonly used approach for dietary assessment, usually showing good reproducibility and validity for MD assessment in heterogeneous samples [22]. Unfortunately, FFQs include an exhaustive number of questions that take a long time to answer [23]. To overcome this issue, numerous short indexes have been developed to assess the adherence to the overall MD pattern. Because they are useful in rapidly evaluating a patient’s eating habits, such brief questionnaires are of special interest to researchers in the field of nutrition, as well as public health professionals and clinicians. Ideally, dietary questionnaires should not require much time to complete, should be easily and quickly evaluated, and interpretation of the result should not require elaborate knowledge on nutrition [24]. Mediterranean Diet Adherence Screener (MEDAS) [25], and the Mediterranean Diet Serving Score (MDSS) are examples of such indexes [26].
MEDAS emerged within the PREDIMED study (Prevención con Dieta Mediterránea), one of the most comprehensive experimental studies in nutrition to date, aimed at investigating the long-term effects of the MD on incident CVD in high risk individuals [27]. This questionnaire transcended its original use in the Spanish population, and has been used widely in various cultural and societal settings. Several validation studies showed that MEDAS is a valid and reliable questionnaire in different countries and languages [28–33].
MDSS is another example of a simple and short scoring approach, and it incorporates 14 food groups in exact accordance with the new MD pyramid [16, 26], which is an important advantage of this index. According to the original study, MDSS is a valid instrument [26].
Despite existence of many dietary indexes used in literature for assessing compliance with the MD, the evidence on their applicability and psychometric quality is scarce [34]. Due to the differences in the design of the studies, as well as the reliability and validity of the instruments, it is not possible to determine which questionnaire is the best.
Even though Croatia is one of the seven Mediterranean countries that participated in the process of inscription of the MD to the UNESCO’s representative list of the intangible cultural heritage of humanity, no study has so far tested any dietary questionnaire regarding its validity. Only one previous study has assessed the reliability of the KIDMED questionnaire in a sample of students from the continental part of Croatia, and not from the Mediterranean region [35]. This study aims to evaluate validity (accuracy) and test-retest reliability of the Croatian version of the short, 14-item Mediterranean Diet Serving Score (MDSS) questionnaire, compared to the Mediterranean Diet Adherence Screener (MEDAS), based on a sample of students from the University of Split, Croatia.
Materials and methods
Study design and subjects
This cross-sectional study was carried out in Split, Croatia, the largest city on the coast of the Adriatic Sea. We included two independent samples in order to assess psychometric properties of the Croatian version of a short MD questionnaire. The initial, exploratory sample of medical students from the University of Split School of Medicine was used for reliability testing (test-retest repeatability) and concurrent and construct validity of the Croatian version of the short MDSS questionnaire. A total of 377 medical students enrolled in the first, third and fifth study year (out of six study years) were sampled during the period of December 2018—October 2019, with the overall response rate of 80.2%. The second confirmatory sample was used to replicate results and confirm the initial MDSS questionnaire validity results and to investigate its’ predictive validity. This independent confirmatory sample consisted of 320 students from the University Department of Health Studies (nurses, lab technicians, radiology technicians, physiotherapists; response rate 81.2%) sampled during the period of May—December 2019. Inclusion criteria were age over 18 years, both genders, and the willingness to provide informed consent. There were no exclusion criteria.
Procedures
The MEDAS questionnaire was selected as the reference (gold standard) to validate the MDSS questionnaire in Croatian language, due to its broad use in the literature and previous results in several validation studies [28–33]. The first step was to translate both the MDSS and MEDAS questionnaires into Croatian, using the originally proposed and validated instruments [23, 26]. This was done according to the guidelines from the International Society for Pharmacoeconomics and Outcomes Research (ISPOR, Fig 1) [36].
The same translation procedure was used for both the Mediterranean Diet Serving Score (MDSS) questionnaire [26] and the Mediterranean Diet Adherence Screener (MEDAS) questionnaire [23].
In short, an independent, proficient English speaker did a back-translation (from Croatian to English), followed by a second back translation (from English to Croatian). A certified English translator compared the original and back-translated versions of the English questionnaire, while a professor of the Croatian language compared two translated Croatian versions. All discrepancies were resolved, and Croatian versions of both questionnaires were harmonized. Finally, we performed a pilot study including 51 students from the University Department of Health Studies to test applicability of the questionnaires. Namely, we aimed to obtain information about respondent and administrative burden, and to assess the cultural acceptability and language applicability [34], these responses were not used for validity or reliability analysis. There were no major objections by the involved students, and the questionnaires were finalized accordingly. Detailed flow chart of the study is presented in Fig 2.
All stages of data collection are depicted, along with the sample size included in each stage and the final analysis of the data.
The students were invited to participate in the study during their mandatory courses, in order to ensure the highest possible response rate. After the initial explanation of the purpose and procedures of the study, students who decided to participate were asked to provide informed consent. Medical students filled out the questionnaire twice, whereas health studies (nursing) students just once, the latter group filled out a more detailed survey. Since students answered the questionnaire anonymously, they were asked to provide a unique code using letters and numbers related to their identity (the first letter of their parent’s name, the first letter of the place they were born, and two starting digits of their birthday date). This code was needed to pair the data obtained during the first and second time point (test and retest), simultaneously avoiding unnecessary memorization of the codes [37]. The retest was carried out between one and two weeks after the first round of data collection (Fig 2), which is acceptable for evaluating test-retest reliability [38]. All of the data were collected using a paper-based, self-administered approach, and the average time needed to complete the survey was 10 minutes for medical students and 15 minutes for health studies students. During this time, a facilitator was present (at least one of the authors of this study during each surveying sessions), ready to assist with any questions regarding the survey posed by respondents.
Questionnaire
Subjects in the exploratory sample completed an anonymous self-administered questionnaire consisting of general questions (gender, age, study program, and the year of study) and two short MD questionnaires.
The confirmatory sample of subjects was additionally asked about other characteristics and habits needed for predictive validity assessment, such as body weight, body height, how long ago they had weighed themselves (in days), and smoking habits (active smokers, ex-smokers, non-smokers). Using body weight and height, we calculated the body mass index using the standard formula:
Additionally, health studies students answered questions on eating habits, including the number of meals per day (both main meals and snacks, separately for working days and weekend days), how often they usually eat breakfast (days per week), and whether they cook (possible answers were “yes, frequently”, “sometimes” or “no”). We also asked whether they have ever been on a weight loss diet (“yes” or “no”), whether they are satisfied with their body appearance (“yes”, “no” or “I don’t think about it”), and whether they are snacking while watching TV (possible answers “yes, frequently”, “yes, sometimes” or “no”). Questions on physical activity included practicing any sports (“yes, weekly”, “rarely” or “never”) and going to the gym (“yes, weekly”, “rarely” or “never”). Finally, we asked students to rate their self-perceived health and quality of life using a Likert scale, where 0 represented a very poor health or quality of life, and 10 represented full health or quality of life.
Additionally, we used the Warwick–Edinburgh Mental Well-being Scale (WEMWBS), a validated questionnaire used for measuring mental well-being, especially focusing on the positive aspects of mental health [39]. This questionnaire was translated to Croatian using the same ISPOR procedure [36], and it was applied in both exploratory and confirmatory sample. The purpose of WEMWBS questionnaire was to serve as a non-dietary reliability comparator and as an outcome in the predictive validity analysis in order to investigate the association between the MD and well-being in students.
MD assessment instruments.
We used two short MD questionnaires in this study. The MDSS questionnaire [26] was being validated and the MEDAS questionnaire [23] was selected as the gold standard, due to its extensive previous use in the literature.
The Mediterranean Diet Serving Score (MDSS) is an MD index that was originally validated against the Mediterranean Dietary Score (MDS), proposed by Trichopoulou et al. [40]. In the validation study on 1,155 women aged 12–83 years from Spain, both MDSS and MDS indexes were based on the data obtained from the semi-quantitative food frequency questionnaire (FFQ) [26]. It was found that MDSS index was “an updated, easy, valid, and accurate instrument to assess MD adherence based on the consumption of foods and food groups per meal, day, and week” [26], while being in accordance with the latest update of the Mediterranean Diet Pyramid [16, 26]. MDSS index incorporates 14 typical MD food groups, and individuals whose intake is within the recommended range receive either 3, 2, or 1 points for each of the specific food groups consumption per meal, daily or weekly, while those individuals who don’t reach the particular goal get 0 points (Table 1).
Therefore, the MDSS index can range between 0 and 24 points for adults and between 0 and 23 for adolescents, since alcoholic beverages intake is not considered appropriate in this age group [26]. Out of the maximum 24 points, 12 points (50%) can be obtained for recommended intake of fruits, vegetables, cereals, and olive oil (3 points each, for consumption during every main meal). Additional 4 points can be obtained for daily intake of dairy products and nuts (2 points each), and 8 points for weekly intake of legumes, potatoes, eggs, fish, white meat, red meat and sweets (Table 1). According to the original study, people with a score of ≥13.5 on the MDSS scale can be considered as adherent to the principles of the MD, which we rounded up to 14 points (Table 1) [26]. The same MDSS scoring system was used in our previous study in the general population of Dalmatia, but the data were obtained through the FFQ [41]. We did not use the FFQ in this study due to the more extensive burden of this approach to the subjects. Instead, we have used only 14 questions including food groups that comprise the original MDSS index (S1 Table), with the exception that we didn’t include beer in the fermented beverages, as originally proposed [26]. Instead, we only included wine, which is in accordance with the modern MD pyramid [16]. Additionally, the question on juices and sugar-sweetened beverages was introduced as a separate item, but it was scored within sweets, as proposed [26]. The full questionnaire is presented in both Croatian and English in S1 Table.
Mediterranean Diet Adherence Screener (MEDAS) was chosen as a gold standard needed to assess the validity of the MDSS index. Since MEDAS was not previously validated for application in Croatian language, we used the same steps for questionnaire preparation as for the MDSS questionnaire, and we also performed MEDAS test-retest reliability assessment.
The original version of MEDAS was designed and validated in Spain [23, 25]. It was translated into several languages and validated for use in Germany [28], Iran [29], UK [30], Turkey [31], Korea [32] and Portugal [33]. The original version of the MEDAS questionnaire contains 14 items (S1 Table), with 12 questions about the frequency of food consumption, and two items are about the eating habits characteristic for the Spanish area [23]. Each item is scored with either a 0 or 1, with the overall score ranging between 0 and 14 (Table 1). There are two ways to categorize the overall MEDAS score. Subjects can be divided into 3 subgroups, where the score of ≤5 points indicates low adherence, 6–9 indicates moderate adherence and ≥10 points indicates high level of adherence to the principles of the MD (Table 1) [23, 25]. Additionally, a cut-off score of ≥8 points has been used to denote adherence to the principles of the MD, while MEDAS score of ≤7 points represents MD non-adherence [23]. Croatian version of the MEDAS questionnaire is presented in S1 Table.
There are some differences between MEDAS and MDSS questionnaires. For example, some food groups are included in MDSS and not in MEDAS, such as cereals, dairy products, eggs, and potatoes. MDSS separates fruit juices from fresh fruit consumption and it does not include processed meat, unlike MEDAS. On the other hand, MEDAS incorporates sofrito sauce, butter or margarine or cream and sweetened beverage intake as separate groups, whereas all types of juices are regarded as sweets according to the MDSS questionnaire scoring [26]. MEDAS distinguishes between cooked and raw vegetables and includes two questions on olive oil, which is not the case in MDSS index. Furthermore, there is a difference in proposed frequency of consumption for nuts, legumes, fish and red meat. MEDAS questionnaire aims to incorporate higher intake of traditional Mediterranean staples, such as vegetables, fruits, olive oil and fish, but it also takes into account some of the non-traditional, Western type of foods, such as already mentioned margarine or cream, processed meat and sweetened beverages, demanding their lower intake. On the other hand, MDSS questionnaire asks only about consumption of the traditional MD foods, entirely in accordance to the recommendations of the modern MD pyramid [16, 26]. MDSS is also giving more weight to the foods at the base of the MD pyramid and more points are awarded for higher intake of vegetables, fruit, cereals and olive oil, unlike in the MEDAS index. All of these differences between MDSS and MEDAS are presented in Table 1.
Statistical analysis
Categorical variables were presented as absolute numbers and percentages. Numerical variables were mostly non-normally distributed (tested by Kolmogorov–Smirnov test), and they were presented as medians and interquartile ranges (IQR). Differences between groups were tested using chi-square test for categorical variables, and Mann–Whitney U test for numerical variables. Spearman rank test was used to test bivariate correlation between numerical variables.
Test-retest reliability was tested using intra-class correlation coefficients (ICC; two-way mixed model) and Spearman rank test for both MDSS and MEDAS overall scores. Based on the ICC estimates, values <0.50 were considered to show poor agreement, values between 0.50 and 0.75 as moderate, between 0.75 and 0.90 as good agreement, while values greater than 0.90 were regarded as excellent reliability [42]. Cohen’s kappa statistic was used for assessing agreement between test-retest classification of subjects into tertiles and for MD adherence/non-adherence classification based on the appropriate cut-off points available in Table 1. According to McHugh et al., values ≤0 indicate that there is no agreement, and values 0.01–0.20 indicate that there is a slight agreement, 0.21–0.40 as fair agreement, 0.41–0.60 as moderate agreement, 0.61–0.80 as substantial agreement, and 0.81–1.00 as almost perfect agreement [43]. Additionally, test-retest agreement was calculated using kappa statistic for all of the separate food groups [43].
Concurrent validity of MDSS index was also tested using ICC, Spearman rank test and Cohen’s kappa statistic, against MEDAS index, both for the first testing time, and for the retest. Despite methodological limitations, Spearman’s rank test was calculated to provide comparison with previous studies.
We also applied the Principal Component Analysis (PCA) to both MD questionnaires to test construct validity and to identify food groups (factors), using Varimax rotation and the cut-off of >0.30 for absolute factor loadings to suppress small coefficients. The suitability of the data for factor analysis was tested by the Kaiser–Meyer–Olkin measure of sampling adequacy (≥0.60) and Bartlett’s test of sphericity (P<0.05). Factors with an Eigenvalue ≥1.0 were retained, and total explained variance was recorded.
Due to missing data from the MD questionnaires, we excluded 17 medical students from the initial, exploratory sample (see Fig 2). This resulted in a sample size of 360 students at the first time point, included in concurrent validity analysis, while 210 of these students were available during the second time point (retest), and they were included in the test-retest reliability analysis. This was an appropriate sample size, based on the estimate of an ideal subject to questionnaire item ratio being between 10:1 and 20:1 [44].
All statistical analyses were performed using IBM SPSS Statistics for Windows, Version 21.0. (Armonk, NY: IBM Corp.). The level of significance was set at P<0.05.
Ethical approval
The study was carried out following the Declaration of Helsinki and the protocol was approved by the Ethical Committee of the University Department of Health Studies (2181-228-07-19-0021) and the Ethical Committee of the University of Split School of Medicine (2181-198-03-04-18-0027).
Results
Sample characteristics
The exploratory sample of 360 medical students was included in the analysis, and 210 students were available for the retesting procedure (58.3%). The study included 248 women (71%) and 102 men (29%), while 10 students didn’t provide information on the gender. There was no difference in MD compliance between men and women, assessed either with MEDAS (P = 0.224) or MDSS questionnaire (P = 0.202), even though women reported slightly higher MD adherence compared to men (21.4% vs 15.7%, respectively, for MEDAS questionnaire, and 14.9% vs 9.8% for MDSS questionnaire) (Table 2).
Students displayed different degree of adherence to MD food groups, ranging from 0.8% for wine in women to 92% for potatoes (both within MDSS index). Women reported higher compliance with olive oil intake, chicken, red/processed meat and sofrito sauce intake according to MEDAS questionnaire, and with red meat intake according to MDSS questionnaire, while men reported slightly higher adherence to wine intake, which was overall very low among students (Table 2). Less than half of the sample was adherent to the main staples of the MD, such as olive oil, cereals, vegetables, fruits and fish (Table 2).
Repeatability (reliability) and validity analysis
Based on the ICC and correlation analysis, the test-retest reliability was very good for both MDSS questionnaire (ICC = 0.881, 95% CI 0.843–0.909, P<0.001; ρ = 0.627, P<0.001), and for MEDAS questionnaire (ICC = 0.887, 95% CI 0.852–0.914, P<0.001; ρ = 0.717, P<0.001) (Table 3).
In order to estimate the concurrent validity of the MDSS questionnaire expressed as an overall score, ICC was calculated with MEDAS score as a comparator. The agreement was moderate during both first testing session (ICC = 0.544, 95% CI 0.439–0.629, P<0.001), and the second testing session (ICC = 0.533, 95% CI 0.387–0.644; P<0.001) (Table 3).
As a comparator for reliability analysis, students’ responses on the Warwick–Edinburgh Mental Well-being Scale (WEMWBS) were used. The correlation coefficient between the WEMWBS test and retest score was 0.800 (P<0.001), and ICC was 0.892 (95% CI 0.811–0.938, P<0.001). Performance of this questionnaire was tested as a binary variable, the sample was divided according to the median of 55 points into the subgroup below the median and the subgroup having the score equal or above the median. This yielded a kappa value of 0.581 (P<0.001) for test-retest repeatability of WEMWBS questionnaire.
Table 4 shows an estimate of concurrent validity of the MDSS index against the MEDAS index, when both were expressed as a binary variable. A fair agreement was demonstrated at both first time point (κ = 0.205; P<0.001) and the second assessment time point (κ = 0.223; P<0.001), while test-retest repeatability was better and showed a moderate agreement for MDSS (κ = 0.584; P<0.001), and substantial agreement for MEDAS questionnaire (κ = 0.620, P<0.001) (Table 4).
Subjects were further divided into distribution-defined tertiles according to both MEDAS and MDSS questionnaires scores obtained at the first and second assessment time point, and used in reliability and validity analysis. A fair agreement was demonstrated between MEDAS and MDSS tertile distribution only for the second assessment time point (κ = 0.211, P<0.001), while test-retest repeatability showed a moderate agreement for both MDSS (κ = 0.447, P<0.001) and MEDAS questionnaire (κ = 0.511, P<0.001) (S2 Table).
Table 5 shows the agreement between adherence to all of the food groups represented within MDSS and MEDAS questionnaires, based on the appropriate cut-off points (see Table 1). Kappa values for agreement between MDSS and MEDAS questionnaires varied considerably across food groups, with substantial agreement obtained only for sweets during the retesting, moderate agreement for red meat and wine, fair agreement for legumes and fish, while for other food groups we found none or only slight agreement (Table 5).
Test-retest agreement for food groups within each of the questionnaire was moderate or even better. Furthermore, MDSS questionnaire performed comparably or even better than MEDAS questionnaire for most of the food groups, except for the white meat agreement (κ = 0.397 for MDSS vs. κ = 0.830 for MEDAS questionnaire) (Table 5).
Finally, in order to assess construct validity of both MD indexes, factor analysis was performed, for which the appropriateness of the data was supported by the Kaiser–Meyer–Olkin measure of sampling adequacy (0.60 for MEDAS, and 0.61 for MDSS) and Bartlett’s test of sphericity (P<0 .001, both MEDAS and MDSS). Six food factors (each with Eigenvalue >1) were extracted for both MEDAS and MDSS questionnaire, using principal component analysis (Table 6). This accounted for 59.3% of the total variance in the Mediterranean dietary pattern assessed by the MEDAS questionnaire, and 60.2% of the total variance assessed by the MDSS questionnaire. Identified factors and their corresponding loading values showed substantial overlap between MEDAS and MDSS index. For example, factor 1 included vegetables and fruit for both MD indexes, factor 2 included olive oil and fish, while factor 3 contained both read and white meat, along with some other foods (Table 6).
Predictive validity
To assess predictive validity and to confirm the initial agreement between MEDAS and MDSS indexes, we included a confirmatory sample of 299 students attending health studies. MEDAS questionnaire yielded slightly higher prevalence of the MD adherence (14.7%) compared to MDSS index (9.4%) (Table 7).
There was no difference according to the gender, while subjects who were adherent to the principles of the MD were on average slightly older. There was no difference between adherent and non-adherent subjects in their BMI, the same as for the number of meals per day, breakfast frequency and smoking habits (Table 7). MD adherent subjects according to MDSS index were more frequently preparing their own food (P = 0.003), and 69.6% of them have been adhering to a weight loss diet at some point in their life compared to 46.9% in non-adherent subjects (P = 0.037), but without such differences for MEDAS index. No differences were found for snacking habits during TV watching and for body appearance satisfaction for either of the MD index. On the other hand, there was a difference in sports and gym-using habits, where subjects adherent to MD according to MEDAS index were more frequently physically active compared to non-adherent subjects (Table 7).
There was a borderline insignificant difference in self-assessed health perception, which was slightly higher in subjects who followed the principles of the MD as measured by MDSS index (P = 0.050), with similar result for the mental well-being score (P = 0.048) (Table 7).
To confirm the validity of the MDSS questionnaire in health studies subjects (confirmatory sample), the agreement analysis yielded a moderate agreement when using the overall score (ICC = 0.510, 95% CI 0.384–0.610; P<0.001), while kappa value for adherence agreement was 0.216 (P<0.001). Furthermore, a statistically significant correlation was found between the MEDAS score and the MDSS score (ρ = 0.486: P<0.001) (Table 8). Additionally, MDSS score was positively correlated with age (ρ = 0.179: P = 0.003), self-assessed health perception (ρ = 0.123; P = 0.047), and mental well-being score (WEMWBS) (ρ = 0.139: P = 0.022), while this was absent for the MEDAS score (Table 8). Self-assessed health perception was positively correlated with the quality of life (ρ = 0.479; P<0.001), while mental well-being score was correlated with both health perception (ρ = 0.285; P<0.001) and the quality of life (ρ = 0.476; P<0.001) (Table 8).
Discussion
We showed a very good reliability of the overall MDSS score, while the reliability of the MD adherence as a binary variable was moderate. Validity of the MDSS index, compared to the MEDAS index as a referent point, was also better when expressed as a total score than adherence. These results were replicated in our confirmatory sample, verifying our findings that the MDSS questionnaire is a reasonably valid instrument for the MD assessment in Croatia.
Differing results obtained for the overall numerical scores and for the binary adherence are in line with previous papers, which suggested that dichotomizing a continuous variable is not the optimal way of handling the data [45, 46]. Indeed, we have shown here that the use of a continuous variable provides much better estimates and should be favored as opposed to categorization.
To the best of our knowledge, this is the first study to compare the MDSS with the MEDAS questionnaire for validation purposes. We have chosen the MEDAS questionnaire as a referent point due to several reasons. Firstly, it includes similar questions and food groups and employs a similar scoring approach to the MDSS questionnaire. Furthermore, it was already shown to be valid in several languages [28–33], and it is quite frequently used in the literature. However, there are some differences between those two indexes. These differences have affected our results, yielding lower agreements and validity estimates within specific food groups. For example, based on the comparison of MDSS questionnaire items with MEDAS items, only sweets, red meat and wine had moderate or better agreement, legumes and fish had fair agreement, while the remaining five food groups had none to only slight agreement. In light of previously mentioned differences between MDSS and MEDAS questionnaire, this was not a surprising finding. However, factor analysis revealed that both questionnaires explained similar proportion of the total variance of the MD pattern, 59.3% for MEDAS and 60.2% for MDSS questionnaire. Furthermore, identified factors and their corresponding loading values showed remarkable overlap between the two indexes. This confirms that both questionnaires are assessing the universal Mediterranean dietary pattern.
Given that we used the MEDAS questionnaire as a referent point, we had to prepare this questionnaire to be used in Croatian language, and we used the same procedures as we did for the MDSS questionnaire. Additionally, we tested the performance of MEDAS questionnaire regarding its reliability. Our results showed that MEDAS questionnaire displayed a close to excellent repeatability in the test-retest procedure, with intra-class correlation coefficient of 0.887, which was very similar to the result obtained for MDSS. This high reliability can be compared to the MEDAS validation study carried out in the UK, where two administrations of the MEDAS produced similar mean total scores and an intra-class correlation coefficient of 0.69 [30]. When we analyzed MEDAS item-by-item test-retest agreement, we found the highest agreement coefficients for wine and white meat, followed by sweetened beverages and olive oil, while all other questions/components showed appropriate, moderate agreement. MDSS questionnaire showed higher test-retest agreement for vegetables, fruits, nuts, legumes, fish, and sweets than the same items in the MEDAS questionnaire, while a slightly lower agreement was recorded only for wine and olive oil and a notably lesser agreement for white meat. Hence, we can conclude that MDSS questionnaire items performed comparably or even better than MEDAS questionnaire items in test-retest repeatability for most of the food groups, except for the white meat.
Brief dietary questionnaires are useful and commonly used for identifying the overall eating patterns as well as for highlighting problems with patient’s eating habits easily and quickly. Unfortunately, there are so many dietary questionnaires in use, particularly those for assessing the MD pattern. For example, a recent study identified as many as 28 different indexes being used in the literature, but only a very few scores fulfilled the applicability parameters and psychometric quality, while the overall level of evidence was scarce [34]. Other reviews have also found similar abundance of indexes used in the literature, and performed comparison of performance of several commonly used dietary indexes and questionnaires [8, 20, 47–52]. These studies have shown that there is no such thing as one ideal instrument, which would objectively measure the adherence to the MD [50]. This represents a certain barrier in both research and practical domains, disabling direct comparisons between studies and across populations, as well as contributing to the lack of indisputable evidence of MD benefits, which could be used for MD endorsement on the larger population scale. For, example, a recent Cochrane systematic review on the MD use for the primary and secondary prevention of cardiovascular diseases pointed out the variety of MD definitions, low to moderate quality of evidence and only modest benefits of the MD [53].
In previous validation studies, MEDAS questionnaire tended to yield a higher MD adherence than the control questionnaires [25, 28, 30]. This was also the case in our study. MEDAS showed a slightly higher rate of MD adherence compared to the MDSS in both of our samples, but overall it was still quite low. According to the MEDAS questionnaire, 19.7% of medical students were compliant with the MD, and as few as 13.6% according to the MDSS questionnaire. In the confirmatory sample of health studies students we recorded 14.7% of MD adherent students based on the MEDAS questionnaire and 9.4% based on MDSS index. This is lower than our expectations, especially when we take into account that our samples consisted of the future healthcare professionals, who are expected to be educated in the matters of disease prevention and to have the prominent role in terms of care and education of patients about healthy lifestyle and health protection. Despite their biomedical educational background, these young people reported similar, low prevalence of MD adherence just as the general young population of Dalmatia [41]. Unfortunately, our results are not an isolate finding [54]. The same pattern of decay of MD lifestyle and diet, being replaced by the Western lifestyle, was found among university students in other countries [55–63]. A recent study found that students who live away from their parents and those from Mediterranean countries deviate from MD towards more unhealthy diet, while future healthcare professionals were neither familiar with the Mediterranean diet nor were following the principles of the MD [64]. On the other hand, the same study found that lower MD adherence in students was associated with poorer health status, while higher MD adherence was associated with lower depression risk and better sleep quality [64]. Our results have confirmed these findings, since we found that students with higher MDSS score had better self-assessed health perception and mental well-being. These findings alone could and should be used in health education and MD promotion in student population, which is clearly needed.
One of the limitations of this study is a cross-sectional design for the part of the study investigating predictive validity of the MD questionnaire. Furthermore, data collection was carried out in such a way that subjects were required to recall their eating habits, which could have resulted in the recall bias. Most importantly, we did not use face to face interviews like previous validation studies did [25, 33], but instead we used a self-administered questionnaire. We believed that our anonymous and self-administering approach would enhance the response rate and facilitate honest responses from students, while not substantially diminishing credibility and reliability of the data (a facilitator was always present and students could inquire about any uncertainties).
It is also important to note that our sample included a younger population comprised exclusively of students, who are mostly healthy, while previous validation studies were largely carried out on a sample of older adults at risk for various chronic diseases [25, 28, 30].
The strengths of the study include a strict methodological framework, two relatively large and independent samples with high response rate (≥80%) from Dalmatia county, which were assumed to have more uniform and traditional eating habits. This is the first study to compare the MDSS with MEDAS questionnaire for validation purposes and the first validation study of the Croatian version of the short MD questionnaire for adult population. The recommendations state that the questionnaires should be linguistically adapted to the country in which they are used in order to ensure reliability and acceptable level of validity of the obtained results [24, 34]. Furthermore, the rationale for adapting different instruments to measure MD adherence in different populations and the comparison of how and why these instruments perform differently are interesting and important questions to explore and warrant further studies. This study described performance of two short MD screeners and it answers to an unmet need of Croatian scientists and clinicians, providing a valid and easy to use instrument for assessing MD adherence. The MDSS questionnaire could be used as a screening tool in the general population for public health surveillance, in clinical settings, and in scientific studies.
Conclusions
We demonstrated that a short version of the MDSS questionnaire is highly reliable and a reasonably valid instrument for the assessment of the adherence to the overall Mediterranean dietary pattern in Croatia. The best performance of MDSS was obtained when used as a numeric score, even in the population with low MD adherence. Despite above-mentioned limitations, the Croatian version of the short 14-items MDSS questionnaire can be used for a rapid assessment of adherence to the MD in Croatia, possibly both in research and in clinical practice.
Supporting information
S1 Table. Croatian and English versions of the MDSS [26] and MEDAS [23] questionnaires.
https://doi.org/10.1371/journal.pone.0247269.s002
(DOCX)
S2 Table. Agreement between classification of the participants into tertiles according to the MEDAS and MDSS questionnaire scores.
https://doi.org/10.1371/journal.pone.0247269.s003
(DOCX)
Acknowledgments
We would like to thank students of the University of Split (University Department of Health Studies, and School of Medicine) for their participation in this study. We are thankful to Marina Lukezic, MD for language editing.
References
- 1. Afshin A, Sur PJ, Fay KA, Cornaby L, Ferrara G, Salama JS, et al. Health effects of dietary risks in 195 countries, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2019;393(10184):1958–72. https://www.ncbi.nlm.nih.gov/pubmed/30954305. pmid:30954305
- 2. Willett W, Rockström J, Loken B, Springmann M, Lang T, Vermeulen S, et al. Food in the Anthropocene: the EAT–Lancet Commission on healthy diets from sustainable food systems. Lancet. 2019;393(10170):447–92. https://www.ncbi.nlm.nih.gov/pubmed/30660336. pmid:30660336
- 3. Sáez-Almendros S, Obrador B, Bach-Faig A, Serra-Majem L. Environmental footprints of Mediterranean versus Western dietary patterns: beyond the health benefits of the Mediterranean diet. Environ Health. 2013;12(1):118. https://www.ncbi.nlm.nih.gov/pubmed/24378069. pmid:24378069
- 4. Dinu M, Pagliai G, Casini A, Sofi F. Mediterranean diet and multiple health outcomes: an umbrella review of meta-analyses of observational studies and randomised trials. Eur J Clin Nutr. 2018;72(1):30–43. https://www.ncbi.nlm.nih.gov/pubmed/28488692. pmid:28488692
- 5. Liyanage T, Ninomiya T, Wang A, Neal B, Jun M, Wong MG, et al. Effects of the Mediterranean Diet on Cardiovascular Outcomes-A Systematic Review and Meta-Analysis. PLoS ONE. 2016;11(8):e0159252. https://www.ncbi.nlm.nih.gov/pubmed/27509006; PubMed Central PMCID: PMC4980102. pmid:27509006
- 6. Estruch R, Ros E, Salas-Salvado J, Covas MI, Corella D, Aros F, et al. Primary Prevention of Cardiovascular Disease with a Mediterranean Diet Supplemented with Extra-Virgin Olive Oil or Nuts. N Engl J Med. 2018;378(25):e34. https://www.ncbi.nlm.nih.gov/pubmed/29897866. pmid:29897866
- 7. La Torre G, Saulle R, Di Murro F, Siliquini R, Firenze A, Maurici M, et al. Mediterranean diet adherence and synergy with acute myocardial infarction and its determinants: A multicenter case-control study in Italy. PLoS ONE. 2018;13(3):e0193360. pmid:29543823
- 8. Panagiotakos DB, Pitsavos C, Stefanadis C. Dietary patterns: a Mediterranean diet score and its relation to clinical and biological markers of cardiovascular disease risk. Nutr Metab Cardiovasc Dis. 2006;16(8):559–68. pmid:17126772
- 9. Esposito K, Maiorino MI, Bellastella G, Panagiotakos DB, Giugliano D. Mediterranean diet for type 2 diabetes: cardiometabolic benefits. Endocrine. 2017;56(1):27–32. Epub 2016/07/11. https://www.ncbi.nlm.nih.gov/pubmed/27395419. pmid:27395419
- 10. Assaf-Balut C, Garcia de la Torre N, Duran A, Fuentes M, Bordiu E, Del Valle L, et al. A Mediterranean diet with additional extra virgin olive oil and pistachios reduces the incidence of gestational diabetes mellitus (GDM): A randomized controlled trial: The St. Carlos GDM prevention study. PLoS ONE. 2017;12(10):e0185873. https://www.ncbi.nlm.nih.gov/pubmed/29049303. pmid:29049303
- 11. Schwingshackl L, Hoffmann G. Adherence to Mediterranean diet and risk of cancer: an updated systematic review and meta-analysis of observational studies. Cancer Med. 2015;4(12):1933–47. https://www.ncbi.nlm.nih.gov/pubmed/26471010. pmid:26471010
- 12. Boden S, Myte R, Wennberg M, Harlid S, Johansson I, Shivappa N, et al. The inflammatory potential of diet in determining cancer risk; A prospective investigation of two dietary pattern scores. PLoS ONE. 2019;14(4):e0214551. https://www.ncbi.nlm.nih.gov/pubmed/30978193. pmid:30978193
- 13. Jacka FN, O’Neil A, Opie R, Itsiopoulos C, Cotton S, Mohebbi M, et al. A randomised controlled trial of dietary improvement for adults with major depression (the ’SMILES’ trial). BMC Med. 2017;15(1):23. https://www.ncbi.nlm.nih.gov/pubmed/28137247. pmid:28137247
- 14. Salvatore FP, Relja A, Filipčić IŠ, Polašek O, Kolčić I. Mediterranean diet and mental distress:“10,001 Dalmatians” study. Br Food J. 2019;121(6):1314–26. https://doi.org/10.1108/BFJ-06-2018-0339.
- 15. Galilea-Zabalza I, Buil-Cosiales P, Salas-Salvado J, Toledo E, Ortega-Azorin C, Diez-Espino J, et al. Mediterranean diet and quality of life: Baseline cross-sectional analysis of the PREDIMED-PLUS trial. PLoS ONE. 2018;13(6):e0198974. https://www.ncbi.nlm.nih.gov/pubmed/29912978. pmid:29912978
- 16. Bach-Faig A, Berry EM, Lairon D, Reguant J, Trichopoulou A, Dernini S, et al. Mediterranean diet pyramid today. Science and cultural updates. Public Health Nutr. 2011;14(12A):2274–84. https://www.ncbi.nlm.nih.gov/pubmed/22166184. pmid:22166184
- 17. Corella D, Coltell O, Macian F, Ordovas JM. Advances in Understanding the Molecular Basis of the Mediterranean Diet Effect. Annu Rev Food Sci Technol. 2018;9:227–49. https://www.ncbi.nlm.nih.gov/pubmed/29400994. pmid:29400994
- 18. Davis C, Bryan J, Hodgson J, Murphy K. Definition of the Mediterranean Diet; a Literature Review. Nutrients. 2015;7(11):9139–53. https://www.ncbi.nlm.nih.gov/pubmed/26556369. pmid:26556369
- 19. Real H, Queiroz J, Graça P. Mediterranean food pattern vs. Mediterranean diet: a necessary approach? Int J Food Sci Nutr. 2019;71(1):1–12. https://www.ncbi.nlm.nih.gov/pubmed/31122086. pmid:31122086
- 20. Bach A, Serra-Majem L, Carrasco JL, Roman B, Ngo J, Bertomeu I, et al. The use of indexes evaluating the adherence to the Mediterranean diet in epidemiological studies: a review. Public Health Nutr. 2006;9(1A):132–46. https://www.ncbi.nlm.nih.gov/pubmed/16512961. pmid:16512961
- 21. Gil A, Martinez de Victoria E, Olza J. Indicators for the evaluation of diet quality. Nutr Hosp. 2015;31 Suppl 3:128–44. https://www.ncbi.nlm.nih.gov/pubmed/25719781. pmid:25719781
- 22. Aoun C, Bou Daher R, El Osta N, Papazian T, Khabbaz LR. Reproducibility and relative validity of a food frequency questionnaire to assess dietary intake of adults living in a Mediterranean country. PLoS ONE. 2019;14(6):e0218541. pmid:31206566
- 23. Martínez-González MA, García-Arellano A, Toledo E, Salas-Salvado J, Buil-Cosiales P, Corella D, et al. A 14-item Mediterranean diet assessment tool and obesity indexes among high-risk subjects: the PREDIMED trial. PLoS ONE. 2012;7(8). https://www.ncbi.nlm.nih.gov/pubmed/22905215. pmid:22905215
- 24. England C, Andrews R, Jago R, Thompson J. A systematic review of brief dietary questionnaires suitable for clinical use in the prevention and management of obesity, cardiovascular disease and type 2 diabetes. Eur J Clin Nutr. 2015;69(9):977–1003. https://www.ncbi.nlm.nih.gov/pubmed/25711954. pmid:25711954
- 25. Schröder H, Fitó M, Estruch R, Martínez‐González MA, Corella D, Salas‐Salvadó J, et al. A short screener is valid for assessing Mediterranean diet adherence among older Spanish men and women. J Nutr. 2011;141(6):1140–5. https://www.ncbi.nlm.nih.gov/pubmed/21508208. pmid:21508208
- 26. Monteagudo C, Mariscal-Arcas M, Rivas A, Lorenzo-Tovar ML, Tur JA, Olea-Serrano F. Proposal of a Mediterranean Diet Serving Score. PLoS ONE. 2015;10(6):e0128594. https://www.ncbi.nlm.nih.gov/pubmed/26035442. pmid:26035442
- 27. Ros E, Martínez-González MA, Estruch R, Salas-Salvadó J, Fitó M, Martínez JA, et al. Mediterranean Diet and Cardiovascular Health: Teachings of the PREDIMED Study. Adv Nutr. 2014;5(3):330S–6S. https://www.ncbi.nlm.nih.gov/pubmed/24829485. pmid:24829485
- 28. Hebestreit K, Yahiaoui-Doktor M, Engel C, Vetter W, Siniatchkin M, Erickson N, et al. Validation of the German version of the Mediterranean Diet Adherence Screener (MEDAS) questionnaire. BMC Cancer. 2017;17(1):341. https://www.ncbi.nlm.nih.gov/pubmed/28521737. pmid:28521737
- 29. Mahdavi-Roshan M, Salari A, Soltanipour S. Reliability and Validity of the 14-point mediterranean diet adherence screener among the Iranian high risk population. Med J Nutrition Metab. 2018;11(3):323–9. https://doi-org.eres.qnl.qa/10.3233/MNM-18205%20%C2%B7.
- 30. Papadaki A, Johnson L, Toumpakari Z, England C, Rai M, Toms S, et al. Validation of the English Version of the 14-Item Mediterranean Diet Adherence Screener of the PREDIMED Study, in People at High Cardiovascular Risk in the UK. Nutrients. 2018;10(2). https://www.ncbi.nlm.nih.gov/pubmed/29382082. pmid:29382082
- 31. Özkan Pehlivanoğlu EF, Balcıoğlu H, Ünlüoğlu İ. [Turkish Validation and Reliability of Mediterranean Diet Adherence Screener]. Osmangazİ Journal of Medicine. 2020;42(2):160–4. [In Turkish]. https://doi.org/10.20515/otd.504188.
- 32. Kwon Y-J, Lee H, Yoon Y, Kim HM, Chu SH, Lee J-W. Development and Validation of a Questionnaire to Measure Adherence to the Mediterranean Diet in Korean Adults. Nutrients. 2020;12(4):1102. pmid:32316107
- 33. Gregório MJ, Rodrigues AM, Salvador C, Dias SS, de Sousa RD, Mendes JM, et al. Validation of the Telephone-Administered Version of the Mediterranean Diet Adherence Screener (MEDAS) Questionnaire. Nutrients. 2020;12(5):1511. pmid:32455971
- 34. Zaragoza-Martí A, Cabañero-Martínez MJ, Hurtado-Sánchez JA, Laguna-Pérez A, Ferrer-Cascales R. Evaluation of Mediterranean diet adherence scores: a systematic review. BMJ Open. 2018;8(2):e019033. https://www.ncbi.nlm.nih.gov/pubmed/29478018. pmid:29478018
- 35. Štefan L, Prosoli R, Juranko D, Čule M, Milinović I, Novak D, et al. The reliability of the mediterranean diet quality index (KIDMED) questionnaire. Nutrients. 2017;9(4):419. pmid:28441742
- 36. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee‐Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient‐reported outcomes (PRO) measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8(2):94–104. https://www.ncbi.nlm.nih.gov/pubmed/15804318. pmid:15804318
- 37. Hren D, Marušić M, Marušić A. Regression of moral reasoning during medical education: combined design study to evaluate the effect of clinical study years. PLoS ONE. 2011;6(3):e17406. https://www.ncbi.nlm.nih.gov/pubmed/21479204. pmid:21479204
- 38. Park MS, Kang KJ, Jang SJ, Lee JY, Chang SJ. Evaluating test-retest reliability in patient-reported outcome measures for older people: A systematic review. Int J Nurs Stud. 2018;79:58–69. https://www.ncbi.nlm.nih.gov/pubmed/29178977. pmid:29178977
- 39. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63. https://www.ncbi.nlm.nih.gov/pubmed/18042300. pmid:18042300
- 40. Trichopoulou A, Kouris-Blazos A, Wahlqvist ML, Gnardellis C, Lagiou P, Polychronopoulos E, et al. Diet and overall survival in elderly people. BMJ. 1995;311(7018):1457–60. https://www.ncbi.nlm.nih.gov/pubmed/8520331. pmid:8520331
- 41. Kolcic I, Relja A, Gelemanovic A, Miljkovic A, Boban K, Hayward C, et al. Mediterranean diet in the southern Croatia—does it still exist? Croat Med J. 2016;57(5):415–24. https://www.ncbi.nlm.nih.gov/pubmed/27815932. pmid:27815932
- 42. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63. https://www.ncbi.nlm.nih.gov/pubmed/27330520. pmid:27330520
- 43. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276–82. https://doi.org/10.11613/BM.2012.031. https://www.ncbi.nlm.nih.gov/pubmed/23092060. pmid:23092060
- 44.
Kline RB. Principles and practice of structural equation modeling 3rd ed. New York, NY, USA The Guilford Press: 2011.
- 45. Altman DG, Lausen B, Sauerbrei W, Schumacher M. Dangers of using "optimal" cutpoints in the evaluation of prognostic factors. Journal of the National Cancer Institute. 1994;86(11):829–35. Epub 1994/06/01. pmid:8182763.
- 46. Altman DG, Royston P. The cost of dichotomising continuous variables. BMJ. 2006;332(7549):1080. pmid:16675816
- 47. Milà-Villarroel R, Bach-Faig A, Puig J, Puchal A, Farran A, Serra-Majem L, et al. Comparison and evaluation of the reliability of indexes of adherence to the Mediterranean diet. Public Health Nutr. 2011;14(12A):2338–45. https://www.ncbi.nlm.nih.gov/pubmed/22166193. pmid:22166193
- 48. D’Alessandro A, De Pergola G. Mediterranean Diet and Cardiovascular Disease: A Critical Evaluation of A Priori Dietary Indexes. Nutrients. 2015;7(9):7863–88. https://www.ncbi.nlm.nih.gov/pubmed/26389950. pmid:26389950
- 49. Hernández Ruiz A, García-Villanova B, Guerra-Hernández E, Amiano P, Azpiri M, Molina Montes E. Description of indexes based on the adherence to the Mediterranean dietary pattern: a review. Nutr Hosp. 2015;32(5):1872–84. https://www.ncbi.nlm.nih.gov/pubmed/26545641. pmid:26545641
- 50. Bamia C, Martimianaki G, Kritikou M, Trichopoulou A. Indexes for assessing adherence to a Mediterranean diet from data measured through brief questionnaires: Issues raised from the analysis of a Greek population study. Curr Dev Nutr. 2017;1(3):e000075. https://www.ncbi.nlm.nih.gov/pubmed/29955694. pmid:29955694
- 51. D’Alessandro A, De Pergola G. The Mediterranean Diet: its definition and evaluation of a priori dietary indexes in primary cardiovascular prevention. Int J Food Sci Nutr. 2018;69(6):647–59. https://www.ncbi.nlm.nih.gov/pubmed/29347867. pmid:29347867
- 52. Olmedo-Requena R, Gonzalez-Donquiles C, Davila-Batista V, Romaguera D, Castello A, Molina de la Torre AJ, et al. Agreement among Mediterranean Diet Pattern Adherence Indexes: MCC-Spain Study. Nutrients. 2019;11(3). https://www.ncbi.nlm.nih.gov/pubmed/30813581. pmid:30813581
- 53. Rees K, Takeda A, Martin N, Ellis L, Wijesekara D, Vepa A, et al. Mediterranean-style diet for the primary and secondary prevention of cardiovascular disease. The Cochrane database of systematic reviews. 2019;3(3):Cd009825. Epub 2019/03/14. https://www.ncbi.nlm.nih.gov/pubmed/30864165. pmid:30864165
- 54. Veronese N, Notarnicola M, Cisternino AM, Inguaggiato R, Guerra V, Reddavide R, et al. Trends in adherence to the Mediterranean diet in South Italy: A cross sectional study. Nutr Metab Cardiovasc Dis. 2020;30(3):410–7. https://www.ncbi.nlm.nih.gov/pubmed/31822430. pmid:31822430
- 55. García-Meseguer MJ, Burriel FC, García CV, Serrano-Urrea R. Adherence to Mediterranean diet in a Spanish university population. Appetite. 2014;78:156–64. pmid:24681406
- 56. Navarro-González I, López-Nicolás R, Rodríguez-Tadeo A, Ros-Berruezo G, Martínez-Marín M, Doménech-Asensi G. Adherence to the Mediterranean diet by nursing students of Murcia (Spain). Nutr Hosp. 2014;30(1):165–72. pmid:25137276
- 57. Fiore M, Ledda C, Rapisarda V, Sentina E, Mauceri C, D’Agati P, et al. Medical school fails to improve Mediterranean diet adherence among medical students. Eur J Public Health. 2015;25(6):1019–23. pmid:26136465
- 58. Baydemir C, Ozgur EG, Balci S. Evaluation of adherence to Mediterranean diet in medical students at Kocaeli University, Turkey. J Int Med Res. 2018;46(4):1585–94. pmid:29444610
- 59. Gianfredi V, Nucci D, Tonzani A, Amodeo R, Benvenuti A, Villarini M, et al. Sleep disorder, Mediterranean Diet and learning performance among nursing students: inSOMNIA, a cross-sectional study. Ann Ig. 2018;30(6):470–81. pmid:30614496
- 60. Zurita-Ortega F, Román-Mata S, Chacón-Cuberos R, Castro-Sánchez M, Muros JJ. Adherence to the Mediterranean Diet is associated with physical activity, self-concept and sociodemographic factors in university student. Nutrients. 2018;10(8):966. pmid:30049976
- 61. Aidoud A, Ziane E, Vara L, Terrón MP, Garrido M, Rodríguez AB, et al. Changes in Mediterranean dietary pattern of university students: a comparative study between Spain and Algeria. Nutrición Clínica y Dietética Hospitalaria. 2019;39(2):26–33. https://doi.org/10.12873/392carrasco.
- 62. de-Mateo-Silleras B, Camina-Martín MA, Cartujo-Redondo A, Carreño-Enciso L, de-la-Cruz-Marcos S, Redondo-del-Río P. Health perception according to the lifestyle of university students. J Community Health. 2019;44(1):74–80. pmid:30014181
- 63. Pavičić Žeželj S, Dragaš Zubalj N, Fantina D, Krešić G, Kenđel Jovanović G. Adherence to Mediterranean diet in University of Rijeka students. Paediatr Croat. 2019;63(1):24–30. https://doi.org/10.13112/PC.2019.5.
- 64. Antonopoulou M, Mantzorou M, Serdari A, Bonotis K, Vasios G, Pavlidou E, et al. Evaluating Mediterranean diet adherence in university student populations: Does this dietary pattern affect students’ academic performance and mental health? Int J Health Plann Manage. 2020;35(1):5–21. pmid:31514237