The considerable genome size variation in Arabidopsis thaliana has been shown largely to be due to copy number variation (CNV) in 45S ribosomal RNA (rRNA) genes. Surprisingly, attempts to map this variation by means of genome-wide association studies (GWAS) failed to identify either of the two likely sources, namely the nucleolar organizer regions (NORs). Instead, GWAS implicated a trans-acting locus, as if rRNA CNV was a phenotype rather than a genotype. To explain these results, we investigated the inheritance and stability of rRNA gene copy number using the variety of genetic resources available in A. thaliana — F2 crosses, recombinant inbred lines, the multiparent advanced generation inter-cross population, and mutation accumulation lines. Our results clearly show that rRNA gene CNV can be mapped to the NORs themselves, with both loci contributing equally to the variation. However, NOR size is unstably inherited, and dramatic copy number changes are visible already within tens of generations, which explains why it is not possible to map the NORs using GWAS. We did not find any evidence of trans-acting loci in crosses, which is also expected since changes due to such loci would take very many generations to manifest themselves. rRNA gene copy number is thus an interesting example of “missing heritability” — a trait that is heritable in pedigrees, but not in the general population.