Coronary artery calcium (CAC) scans contain valuable information beyond the Agatston Score which is currently reported for predicting coronary heart disease (CHD) only. We examined whether new artificial intelligence (AI) applied to CAC scans can predict non-CHD events, including heart failure, atrial fibrillation, and stroke. We applied AI-enabled automated cardiac chambers volumetry and calcified plaque characterization to CAC scans (AI-CAC) of 5830 asymptomatic individuals (52.2% women, age 61.7 ± 10.2 years) in the multi-ethnic study of atherosclerosis during 15 years of follow-up, 1773 CVD events accrued. The AUC at 1-, 5-, 10-, and 15-year follow-up for AI-CAC vs. Agatston score was (0.784 vs. 0.701), (0.771 vs. 0.709), (0.789 vs. 0.712) and (0.816 vs. 0.729) (p < 0.0001 for all), respectively. AI-CAC plaque characteristics, including number, location, density, plus number of vessels, significantly improved CHD prediction in the CAC 1-100 cohort vs. Agatston Score. AI-CAC significantly improved the Agatston score for predicting all CVD events.