Despite the importance of pelvic floor muscles, significant controversy still exists about the true structural details of these muscles. We provide an objective analysis of the architecture and orientation of the superficial muscles of the perineum using a novel approach. Magnetic Resonance Diffusion Tensor Images (MR-DTI) were acquired in 10 healthy asymptomatic nulliparous women, and 4 healthy males. Global tractography was then used to generate the architecture of the muscles. Micro-CT imaging of a male cadaver was performed for validation of the fiber tracking results. Results show that muscles fibers of the external anal sphincter, from the right and left side, cross midline in the region of the perineal body to continue as transverse perinea and bulbospongiosus muscles of the opposite side. The morphology of the external anal sphincter resembles that of the number '8' or a "purse string". The crossing of muscle fascicles in the perineal body was supported by micro-CT imaging in the male subject. The superficial muscles of the perineum, and external anal sphincter are frequently damaged during child birth related injuries to the pelvic floor; we propose the use of MR-DTI based global tractography as a non-invasive imaging technique to assess damage to these muscles.