The human brain undergoes substantial developmental changes in the first 5 years of life. Particularly in the white matter, myelination of axons occurs near birth and continues at a rapid pace during the first 2 to 3 years. Diffusion MRI (dMRI) has revolutionized our understanding of developmental trajectories in white matter. However, the mm-resolution of in vivo techniques bears significant limitation in revealing the microstructure of the developing brain. Polarization sensitive optical coherence tomography (PSOCT) is a three-dimensional (3D) optical imaging technique that uses polarized light interferometry to target myelinated fiber tracts with micrometer resolution. Previous studies have shown that PSOCT contributes significantly to the elucidation of myelin content and quantification of fiber orientation in adult human brains. However, the use of PSOCT in developing human brains has not been reported. In this study, we established the feasibility of using the PSOCT technique to reveal brain development during the first 5 years of life, compared with ex vivo dMRI. The results showed that the optical properties of PSOCT quantitatively reveal the myelination process in young children. The imaging contrast of the optic axis orientation is a sensitive measure of fiber orientations in largely unmyelinated brains as young as 3 months old. The micrometer resolution of PSOCT provides substantially enriched information about complex fiber networks and complements submillimeter dMRI. This new optical tool offers great potential to reveal the white matter structures in normal neurodevelopment and developmental disorders in unprecedented detail.