Machine learning with sparse nutrition data to improve cardiovascular mortality risk prediction in the USA using nationally randomly sampled data

BMJ Open. 2019 Nov 28;9(11):e032703. doi: 10.1136/bmjopen-2019-032703.

Abstract

Objectives: We aimed to test whether or not adding (1) nutrition predictor variables and/or (2) using machine learning models improves cardiovascular death prediction versus standard Cox models without nutrition predictor variables.

Design: Retrospective study.

Setting: Six waves of Survey (NHANES) data collected from 1999 to 2011 linked to the National Death Index (NDI).

Participants: 29 390 participants were included in the training set for model derivation and 12 600 were included in the test set for model evaluation. Our study sample was approximately 20% black race and 25% Hispanic ethnicity.

Primary and secondary outcome measures: Time from NHANES interview until the minimum of time of cardiovascular death or censoring.

Results: A standard risk model excluding nutrition data overestimated risk nearly two-fold (calibration slope of predicted vs true risk: 0.53 (95% CI: 0.50 to 0.55)) with moderate discrimination (C-statistic: 0.87 (0.86 to 0.89)). Nutrition data alone failed to improve performance while machine learning alone improved calibration to 1.18 (0.92 to 1.44) and discrimination to 0.91 (0.90 to 0.92). Both together substantially improved calibration (slope: 1.01 (0.76 to 1.27)) and discrimination (C-statistic: 0.93 (0.92 to 0.94)).

Conclusion: Our results indicate that the inclusion of nutrition data with available machine learning algorithms can substantially improve cardiovascular risk prediction.

Keywords: cardiovascular disease; machine learning; nutrition; risk prediction.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Aged
  • Algorithms
  • Cardiovascular Diseases / mortality*
  • Diet Records
  • Female
  • Humans
  • Machine Learning*
  • Male
  • Middle Aged
  • Nutrition Surveys*
  • Proportional Hazards Models
  • Retrospective Studies
  • Risk Assessment / methods*
  • United States / epidemiology