Multi-scale and Multimodal Fusion of Tract-Tracing, Myelin Stain and DTI-derived Fibers in Macaque Brains

Assessment of structural connectivity patterns of brains can be an important avenue for better understanding mechanisms of structural and functional brain architectures. Therefore, many efforts have been made to estimate and validate axonal pathways via a number of techniques, such as myelin stain, tract-tracing and diffusion MRI (dMRI). The three modalities have their own advantages and are complimentary to each other. From myelin stain data, we can infer rich in-plane information of axonal orientation at micro-scale. Tracttracing data is considered as ‘gold standard’ to estimate trustworthy meso-scale pathways. dMRI currently is the only way to estimate global macro-scale pathways given further validation. We propose a framework to take advantage of these three modalities. Information of the three modalities is integrated to determine the optimal tractography parameters for dMRI fibers and identify crossvalidated fiber bundles that are finally used to construct atlas. We demonstrate the effectiveness of the framework by a collection of experimental results.