From toddler to late teenager, the macroscopic pattern of axonal projections in the human brain remains largely unchanged while undergoing dramatic functional modifications that lead to network refinement. These functional modifications are mediated by increasing myelination and changes in axonal diameter and synaptic density, as well as changes in neurochemical mediators. Here we explore the contribution of white matter maturation to the development of connectivity between ages 2 and 18 y using high b-value diffusion MRI tractography and connectivity analysis. We measured changes in connection efficacy as the inverse of the average diffusivity along a fiber tract. We observed significant refinement in specific metrics of network topology, including a significant increase in node strength and efficiency along with a decrease in clustering. Major structural modules and hubs were in place by 2 y of age, and they continued to strengthen their profile during subsequent development. Recording resting-state functional MRI from a subset of subjects, we confirmed a positive correlation between structural and functional connectivity, and in addition observed that this relationship strengthened with age. Continuously increasing integration and decreasing segregation of structural connectivity with age suggests that network refinement mediated by white matter maturation promotes increased global efficiency. In addition, the strengthening of the correlation between structural and functional connectivity with age suggests that white matter connectivity in combination with other factors, such as differential modulation of axonal diameter and myelin thickness, that are partially captured by inverse average diffusivity, play an increasingly important role in creating brain-wide coherence and synchrony.