Alzheimer’s Disease (AD) is a debilitating neurodegenerative disease characterized by the accumulation of extracellular amyloid-β peptides (Aβ) within the cerebral parenchyma and vasculature, the latter termed cerebral amyloid angiopathy (CAA). This study utilized confocal imaging to investigate heparan sulfate (HS) within the cerebrovasculature and its potential associations with CAA, gender, and ApoE4 genotype. Our investigation revealed elevated levels of HS in the cerebrovasculature of AD patients with severe CAA. Additionally, these patients exhibited higher colocalization of HS with Aβ in the cerebrovasculature, including both endothelial and vascular smooth muscle cell compartments. Intriguingly, a reversal in the polarized expression of HS within the cerebral vasculature was detected in AD patients with severe CAA, suggesting a potential role in CAA development. Furthermore, male patients exhibited lower levels of both parenchymal and cerebrovascular HS. Additionally, ApoE4 carriers displayed heightened cerebrovascular Aβ expression and a tendency of elevated cerebrovascular HS levels in AD patients with severe CAA. Overall, these findings shed light on the intricate interplay between HS, Aβ, ApoE, and vascular pathology in AD, underscoring the potential roles of cerebrovascular HS in CAA development and AD pathology. Further exploring the underlying mechanisms may present novel therapeutic avenues for AD treatment.