Optical coherence tomography provides volumetric reconstruction of brain structure with micrometer resolution. Gray matter and white matter can be highlighted using conventional and polarization-based contrasts; however, vasculature in ex-vivo fixed brain has not been investigated at large scale due to lack of intrinsic contrast. We present contrast enhancement to visualize the vasculature by perfusing titanium dioxide particles transcardially into the mouse vascular system. The brain, after dissection and fixation, is imaged by a serial optical coherence scanner. Accumulation of particles in blood vessels generates distinguishable optical signals. Among these, the cross-polarization images reveal the vasculature organization remarkably well. The conventional and polarization-based contrasts are still available for probing the gray matter and white matter structures. The segmentation and reconstruction of the vasculature are presented by using a deep learning algorithm. Axonal fiber pathways in the mouse brain are delineated by utilizing the retardance and optic axis orientation contrasts. This is a low-cost method that can be further developed to study neurovascular diseases and brain injury in animal models.