Diet modification may be a potential contributor in the prevention of age-related cognitive decline. The association between dairy product consumption and cognitive function remains unknown in older people. We investigated whether cheese intake is associated with lower cognitive function (LCF) in community-dwelling older adults. This cross-sectional study included 1503 adults aged over 65 years. Analyzed data were obtained from face-to-face interviews and functional ability measurement. Cognitive function was assessed using mini-mental state examination (MMSE), and a score ≤ 23 was defined as LCF. The prevalence of LCF was 4.6% and this group had smaller calf circumference, slower usual walking speed, and more frequent history of anemia than subjects with MMSE scores ≥ 24. After adjusting for confounding factors, logistic regression analysis revealed cheese intake (odds ratio (OR) = 0.404, 95% confidence interval (CI) = 0.198-0.824), age (OR = 1.170, 95% CI = 1.089-1.256), usual walking speed (OR = 0.171, 95% CI = 0.062-0.472) and calf circumference (OR = 0.823, 95% CI = 0.747-0.908) as significant factors associated with LCF. Although the present study was an analysis of cross-sectional data of Japanese community-dwelling older adults, the results suggest that cheese intake is inversely associated with LCF.