Background: Much research supports the physical activity (PA) and health-related quality of life (HRQOL) relationship. However, less is known about this association when advanced measurement techniques are used to assess HRQOL. The aim of this study was to use item response theory (IRT) to score HRQOL items and subsequently examine the extent to which PA relates to the new measure. Methods: Data from N = 6,245 adults 18+ years of age participating in the 2019 Montana Behavioral Risk Factor Surveillance System (BRFSS) were used. Four different 3-category HRQOL items were created from survey questions regarding general, physical, mental, and activity health. Two PA variables were created from survey questions regarding PA guidelines and PA quantity. A graded response IRT model (GRM) was used to assess the HRQOL scale and output ability scores. Multinomial logistic regression was used to examine the relationship between PA and HRQOL tertile membership while adjusting for sex, age, race, income, education, marital status, BMI, smoking status, and alcohol consumption. Results: Factor analysis retained a single HRQOL factor (loadings > .68) with ordinal alpha indicating acceptable internal consistency (αordinal = .83). The GRM analysis confirmed all HRQOL items fit a unidimensional construct with adequate discrimination (as: 1.17 to 5.13) and difficulty (bs: -2.052 to -0.07). Fully adjusted regression models showed increased odds of high HRQOL tertile membership (versus low tertile) for adults meeting aerobic PA (APA) (OR = 1.64, 95% CI: 1.28 – 2.09) and adults meeting both APA and muscle strengthening activity (MSA) (OR = 1.73, 95% CI: 1.34 – 2.23) guidelines, compared to those meeting neither APA nor MSA guidelines. Similarly, there was increased odds of high HRQOL tertile membership (versus low tertile) for adults considered sufficiently active (OR = 1.59, 95% CI: 1.16 – 2.19) and adults considered highly active (OR = 2.03, 95% CI: 1.58 – 2.61), compared to those considered inactive. Adults meeting MSA guidelines only and adults insufficiently active were no more likely to see high HRQOL tertile membership than their less active counterparts. Conclusion: The IRT-derived HRQOL score is a novel outcome measure and found to be associated with both PA guidelines and PA quantity among adults in Montana.
Health-related quality of life (HRQOL) is a popular outcome measure used in health and medical disciplines and considered a subjective assessment of a person’s own health status 1. HRQOL has become popular in outcomes investigations, in part, because of its strong predictive relationship with mortality 2. Given this connection, health behaviors that have the ability to change HRQOL can be promoted in susceptible populations, thus increasing longevity. One such health behavior is physical activity (PA). Specifically, evidence supports the direct relationship between PA and HRQOL in both general, rural, and diseased populations 3, 4, 5. Even with this information, there is little agreement regarding which assessment or which set of items is best for measuring HRQOL. Item response theory (IRT), however, has the ability to score a scale measuring a unidimensional construct while remaining item invariant 6. Said differently, regardless of which items are used in a HRQOL assessment, participants will receive the same relative IRT-derived HRQOL score. This attribute of IRT allows for optimal measurement of HRQOL in a given sample and an ideal set of scores in subsequent modeling. Hence, the purpose of this study was to first assess a brief HRQOL scale and second to examine the relationship between PA and the IRT-derived HRQOL scores in a sample of adults from Montana.
Data for this research came from the 2019 Montana Behavioral Risk Factor Surveillance System (BRFSS). Detailed BRFSS methodology can be found elsewhere 7, 8. Briefly, the BRFSS is a state-based annual telephone survey designed to collect prevalence and trends data on health-risk behaviors and health status indicators in United States (U.S.) adults 18+ years of age. In the 2019 survey, the BRFSS assessed health factors ranging from alcohol, tobacco, and e-cigarette use to physical activity, diet, and safety behavior to health care utilization and primary prevention screening. Beginning in 2011, respondents have been recruited randomly using both landline telephones as well as cellular phones. The BRFSS is questionnaire-based and all responses are self-reported. For the current study, Montana participants were extracted from the national dataset.
2.2. Health-related Quality of Life (HRQOL) VariablesFour HRQOL items were created from four different survey questions regarding general, physical, mental, and activity health. The general health item (General_Health) was created from the following question: “Would you say that in general your health is: Excellent, Very good, Good, Fair, Poor.” The following General_Health item coding included: “Excellent” or “Very good” = 2, “Good” = 1, and “Fair” or “Poor” = 0. The physical health item (Physical_Health) was created from the following question: “Now thinking about your physical health, which includes physical illness and injury, for how many days during the past 30 days was your physical health not good?” The following Physical_Health item coding included: “No days” = 2, “1 thru 13 days” = 1, and “14 thru 30 days” = 0. The mental health item (Mental_Health) was created from the following question: “Now thinking about your mental health, which includes stress, depression, and problems with emotions, for how many days during the past 30 days was your mental health not good?” The following Mental_Health item coding included: “No days” = 2, “1 thru 13 days” = 1, and “14 thru 30 days” = 0. The activity health item (Activity_Health) was created from the following question: “During the past 30 days, for about how many days did poor physical or mental health keep you from doing your usual activities, such as self-care, work, or recreation?” The following Activity_Health item coding included: “No days” = 2, “1 thru 13 days” = 1, and “14 thru 30 days” = 0.
2.3. Physical Activity (PA) VariablesTwo PA variables were used in this study to include the meeting of certain PA guidelines and PA quantity. The PA guidelines variable included four (4) mutually exclusive groups where participants were categorized as either 1) meeting both aerobic PA (APA) and muscle strengthening activity (MSA) guidelines, 2) meeting APA guidelines only, 3) meeting MSA guidelines only, or 4) meeting neither guideline. Meeting APA guidelines was defined as engaging in 150+ minutes of moderate (or vigorous equivalent) PA per week. Meeting MSA guidelines was defined as engaging in PA or exercise specifically to strengthen muscles on 2+ days per week. The PA quantity variable included four (4) mutually exclusive groups where participants were categorized as either 1) Highly Active, 2) Active, 3) Insufficiently Active, or 4) Inactive. Participants were considered “highly active” if they reported 300+ minutes of moderate (or vigorous equivalent) APA per week. Participants were considered “active” if they reported 150+ minutes of moderate (or vigorous equivalent) APA per week, but less than 300 minutes. Participants were considered “insufficiently active” if they reported being physically active but less than 150 minutes per week. Finally, participants were considered “inactive” if they reported no PA.
2.4. Demographic and Health VariablesIn order to control for possible health and demographic confounding, body mass index (BMI), smoking, alcohol consumption, sex, age, race, income, education, and marital status variables were used in this study. BMI was used as a numeric variable and assessed from self-reported height and weight as kg/m2. For descriptive purposes, weight status groups were also formed using BMI and consisted of 1) Underweight (BMI < 18.5 kg/m2), 2) Normal weight (18.5 kg/m2 <= BMI < 25.0 kg/m2), 3) Overweight (25.0 kg/m2 <= BMI < 30.0 kg/m2), and 4) Obese (BMI >= 30.0 kg/m2). Smoking status was a categorical variable indicating being a current smoker (smokes every day or some days) or not current smoker. Alcohol consumption status was a categorical variable indicating heavy drinker (> 2 drinks per day for men and of > 1 drink per day for women) or not heavy drinker. Sex was a categorical variable indicating male or female. Age was used as a numeric variable and consisted of ages ranging from 18 to 80+ years. Race was used as a categorical variable and comprised the following four groups: 1) Non-Hispanic White, 2) Non-Hispanic Black, 3) Hispanic, and 4) Other (all other race groups). Income was used as a numeric variable, collected as household income, and comprised eight different income brackets ranging from 1 = $0 to $9,999 to 8 = $75,000 and over. Education was used as a categorical variable and comprised the following three categories: 1) Not a high school graduate, 2) High school graduate, and 3) College graduate. Finally, marital status was used as a categorical variable indicating married or not married.
2.5. Statistical AnalysesFor the measurement portion of the study, both classical and modern techniques were applied. Classical item statistics (means, standard deviations), item-total correlations, and item category frequencies were computed for initial inspection. Polychoric correlation coefficients were evaluated between all items with an exploratory factor analysis and ordinal internal consistency reliability (alpha, α) performed on the correlation matrix 9. The graded response model (GRM) was then run on the 4-item HRQOL scale using a logit function and marginal maximum likelihood estimation. IRT-derived HRQOL person scores (theta, θ) were outputted and converted to a new tertile-based dependent variable. For the modeling portion of the study, both descriptive statistics and regression analyses were performed. Percentages were computed across the IRT-derived HRQOL score tertiles by demographic and health variable categories, with significance tests performed using the Rao-Scott chi-square statistic. Multinomial logistic regression was used to estimate the odds of being in the middle and then the highest HRQOL tertile relative to the lowest HRQOL tertile using the two PA variables as separate predictors. Analyses were weighted to produce generalizations representative of noninstitutionalized adults in Montana. SAS version 9.4 was used for all analyses 10.
A total of N = 6,245 Montana participants had complete data for the measurement portion of the study. The modeling portion of the analyses lost 612, 509, 929, 14, 41, 184, and 268 observations due to missing data on the PA guidelines, PA quantity, income, education, marital status, smoking, and alcohol consumption variables, respectively. Table 1 contains results for the HRQOL scale item statistics. Item means indicate the General_Health item targeted a lower (poorer) HRQOL and the Activity_Health targeted a higher (better) HRQOL. Item-total correlations indicate adequate item associations with all unadjusted and adjusted correlations greater than .64 and .38, respectively. Table 2 displays the polychoric correlation matrix used for the exploratory factor analysis and ordinal alpha reliability analyses. Table 3 displays these results with the factor analysis retaining a single HRQOL factor (loadings > .68) and ordinal alpha indicating acceptable internal consistency (αordinal = .83). Table 4 contains results from the GRM analysis and confirms that all HRQOL items fit a unidimensional construct with adequate discrimination (as: 1.17 to 5.13) and difficulty (bs: -2.052 to -0.07). Figure 1 is a visual representation of these results.
Table 5 and Table 6 contain descriptive statistics for IRT-derived HRQOL score tertile by demographic and health variable categories. Most noteworthy is the significantly (all ps < .05) higher percentage of lower tertile membership among minorities, those with lower income, those with less education, those who are married, those who are inactive, those who met MSA only, those who are either underweight or overweight, those who are a current smoker, and heavy drinkers.
Table 7 and Table 8 contain results from the multinomial logistic regression analyses. Fully adjusted regression models showed increased odds of high HRQOL tertile membership (versus low tertile) for adults meeting APA (OR = 1.64, 95% CI: 1.28 – 2.09) and meeting both APA and MSA (OR = 1.73, 95% CI: 1.34 – 2.23) guidelines, compared to those meeting neither APA nor MSA guidelines. Similarly, there was increased odds of high HRQOL tertile membership (versus low tertile) for adults considered sufficiently active (OR = 1.59, 95% CI: 1.16 – 2.19) and adults considered highly active (OR = 2.03, 95% CI: 1.58 – 2.61), compared to those considered inactive. Those meeting MSA guidelines only and those insufficiently active were no more likely to see high HRQOL tertile membership than their less-active counterparts.
There are a few noteworthy findings from this study worth discussing. For example, both classical methods and IRT were used to validate a brief 4-item HRQOL scale. Both assessment methodologies successfully confirmed a unidimensional HRQOL trait with well-fitting items contributing to its measurement. These findings are particularly significant because the same 4 items are standard in the CDC’s HRQOL-4 Healthy Days Measure and administered in the BRFSS, National Health and Nutrition Examination Survey (NHANES) and Health Outcome Survey (HOS) 11. Additionally, robust findings from the modeling stage of this study indicate PA as a significant predictor of HRQOL. Firstly, increased likelihood of middle HRQOL tertile membership (as compared to the lowest tertile) was seen in the fully adjusted model for those meeting APA guidelines only, compared to those meeting neither APA/MSA. Interestingly, this relationship was not significant among those meeting both APA/MSA nor those meeting MSA only. This suggests that MSA may not necessarily relate to HRQOL variation among those with average to poor HRQOL. Moreover, increased likelihood of middle HRQOL tertile membership (as compared to the lowest tertile) was seen in the fully adjusted model for those considered both “highly active” and those “sufficiently active”, compared to those “inactive”.
Secondly, increased likelihood of high HRQOL tertile membership (as compared to the lowest tertile) was seen in the fully adjusted model for those meeting APA guidelines only as well as those meeting both APA/MSA, compared to those meeting neither APA/MSA. Also, this relationship was not significant among those meeting MSA only. This suggests that MSA by itself does not necessarily relate to HRQOL. Additionally, increased likelihood of high HRQOL tertile membership (as compared to the lowest tertile) was seen in the fully adjusted model for those considered both “highly active” and those “sufficiently active”, compared to those “inactive”. In sum, these findings suggest that APA has a strong relationship with HRQOL variation, across all levels of HRQOL. Furthermore, MSA appears to contribute to HRQOL variation only when combined with APA and only among those with better HRQOL.
One strength regarding this current study is its use of a representative sample of noninstitutionalized adults in Montana. Therefore, the aforementioned findings generalize to civilian adults in Montana. To date, only one published study has presented relationship data on HRQOL and PA in Montana adults. Specifically, physical inactivity was shown to be a significant predictor of poor HRQOL in Montana adults, with physically inactive females having greater risk of poor HRQOL than their physically inactive male counterparts 4. Therefore, the current study corroborates the present body of knowledge regarding the PA and HRQOL relationship among Montana adults. Another strength regarding this current study is its use of modern measurement theory to validate survey items and create psychometrically robust HRQOL scores. To date, only one published study has used IRT to validate a HRQOL survey-based scale and use its factor scores to examine their relationship with PA. Specifically, this study reported that meeting PA guidelines increased the likelihood of reporting good HRQOL in rural adults 3. Thus, the current study also corroborates the present body of knowledge regarding the use of IRT-derived HRQOL scores in modeling PA in Montana adults.
Despite these strengths, there are some limitations worth declaring. Firstly, these findings come from cross-sectional data and therefore in no way imply a cause-and-effect relationship between PA and HRQOL. Secondly, both outcome scale items and predictor variables were assessed via self-report questionnaires. Therefore, there is a possibility for misclassification error due to item and reporting bias. Thus, findings from this study should be considered with caution.
This study found that an IRT-derived HRQOL score is a novel outcome measure that can be assessed using the common CDC HRQOL-4 items. Additionally, the newly developed HRQOL scores were found to be associated with both PA guidelines and PA quantity among adults in Montana. Meeting MSA guidelines only was not a predictor of HRQOL in this population. Health promotion specialists should develop intervention components directed toward meeting both APA and MSA guidelines for improving HRQOL in adults.
[1] | Mao Z, Ahmed S, Graham C, Kind P. The unfolding method to explore health-related quality of life constructs in a Chinese general population. Value in Health. 2021 Jun 1; 24(6): 846-54. | ||
In article | View Article PubMed | ||
[2] | Phyo AZ, Ryan J, Gonzalez-Chica DA, Woods RL, Reid CM, Nelson MR, Murray AM, Gasevic D, Stocks NP, Freak-Poli R. Health-related quality of life and all-cause mortality among older healthy individuals in Australia and the United States: a prospective cohort study. Quality of Life Research. 2021 Apr; 30(4): 1037-48. | ||
In article | View Article PubMed | ||
[3] | Hart PD. Meeting recommended levels of physical activity and health-related quality of life in rural adults. Journal of lifestyle medicine. 2016 Mar; 6(1): 1. | ||
In article | View Article PubMed | ||
[4] | Hart PD. Sex differences in the physical inactivity and health-related quality of life relationship among rural adults. Health promotion perspectives. 2016; 6(4): 185. | ||
In article | View Article PubMed | ||
[5] | Hart PD, Buck DJ. The effect of resistance training on health-related quality of life in older adults: Systematic review and meta-analysis. Health promotion perspectives. 2019; 9(1): 1. | ||
In article | View Article PubMed | ||
[6] | Baker FB, Kim SH. The basics of item response theory using R. New York: Springer; 2017 Apr 25. | ||
In article | View Article | ||
[7] | Centers for Disease Control and Prevention. The BRFSS data user guide. August 15, 2013. | ||
In article | |||
[8] | Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System Overview: BRFSS 2019. July 26, 2019. | ||
In article | |||
[9] | Gadermann AM, Guhn M, Zumbo BD. Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research, and Evaluation. 2012; 17(1): 3. | ||
In article | |||
[10] | SAS Institute Inc. 2015. SAS/STAT® 14.1 User’s Guide. The IRT Procedure. Cary, NC: SAS Institute Inc. | ||
In article | |||
[11] | Zahran HS, Kobau R, Moriarty DG, Zack MM, Holt J, Donehoo R. Health-related quality of life surveillance—United States, 1993-2002. Morbidity and Mortality Weekly Report: Surveillance Summaries. 2005 Oct 28; 54(4): 1-35. | ||
In article | |||
Published with license by Science and Education Publishing, Copyright © 2021 Peter D. Hart
This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit https://creativecommons.org/licenses/by/4.0/
[1] | Mao Z, Ahmed S, Graham C, Kind P. The unfolding method to explore health-related quality of life constructs in a Chinese general population. Value in Health. 2021 Jun 1; 24(6): 846-54. | ||
In article | View Article PubMed | ||
[2] | Phyo AZ, Ryan J, Gonzalez-Chica DA, Woods RL, Reid CM, Nelson MR, Murray AM, Gasevic D, Stocks NP, Freak-Poli R. Health-related quality of life and all-cause mortality among older healthy individuals in Australia and the United States: a prospective cohort study. Quality of Life Research. 2021 Apr; 30(4): 1037-48. | ||
In article | View Article PubMed | ||
[3] | Hart PD. Meeting recommended levels of physical activity and health-related quality of life in rural adults. Journal of lifestyle medicine. 2016 Mar; 6(1): 1. | ||
In article | View Article PubMed | ||
[4] | Hart PD. Sex differences in the physical inactivity and health-related quality of life relationship among rural adults. Health promotion perspectives. 2016; 6(4): 185. | ||
In article | View Article PubMed | ||
[5] | Hart PD, Buck DJ. The effect of resistance training on health-related quality of life in older adults: Systematic review and meta-analysis. Health promotion perspectives. 2019; 9(1): 1. | ||
In article | View Article PubMed | ||
[6] | Baker FB, Kim SH. The basics of item response theory using R. New York: Springer; 2017 Apr 25. | ||
In article | View Article | ||
[7] | Centers for Disease Control and Prevention. The BRFSS data user guide. August 15, 2013. | ||
In article | |||
[8] | Centers for Disease Control and Prevention. Behavioral Risk Factor Surveillance System Overview: BRFSS 2019. July 26, 2019. | ||
In article | |||
[9] | Gadermann AM, Guhn M, Zumbo BD. Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research, and Evaluation. 2012; 17(1): 3. | ||
In article | |||
[10] | SAS Institute Inc. 2015. SAS/STAT® 14.1 User’s Guide. The IRT Procedure. Cary, NC: SAS Institute Inc. | ||
In article | |||
[11] | Zahran HS, Kobau R, Moriarty DG, Zack MM, Holt J, Donehoo R. Health-related quality of life surveillance—United States, 1993-2002. Morbidity and Mortality Weekly Report: Surveillance Summaries. 2005 Oct 28; 54(4): 1-35. | ||
In article | |||