In the dawning era of large-scale biomedical data, multidimensional phenotype vectors will play an increasing role in examining the genetic underpinnings of brain features, behavior and disease. For example, shape measurements derived from brain MRI scans are multidimensional geometric descriptions of brain structure and provide an alternate class of phenotypes that remains largely unexplored in genetic studies. Here we extend the concept of heritability to multidimensional traits, and present the first comprehensive analysis of the heritability of neuroanatomical shape measurements across an ensemble of brain structures based on genome-wide SNP and MRI data from 1,320 unrelated, young and healthy individuals. We replicate our findings in an extended twin sample from the Human Connectome Project (HCP). Our results demonstrate that neuroanatomical shape can be significantly heritable, above and beyond volume, and can serve as a complementary phenotype to study the genetic determinants and clinical relevance of brain structure.