Over 40 years ago, Kempton (Biometrics, 35, 1979, 307) reported significant modification to plant community structure following a long-term fertilization experiment. Many researchers have investigated this phenomenon in the years since. Collectively, these studies have shown consistent shifts in rank abundance relationships among species in communities following fertilization. The previous studies indicated that fertilization affects community structure through several critical processes, including trait-based functional response, reordering of species in rank abundance diagram (RAD), and niche dimensionality, although some questions have remained. How does the species reordering driven by the plant responses cause characteristic trends in temporal changes of RAD? Why are those trends ubiquitous in various systems? To answer those questions, we theoretically investigated the effects of fertilization on community structure based on a colonization model (or Levins model) with competition-fecundity trade-offs, which can result in the coexistence of multiple species under competition. The model represents characteristic RAD, which can be an adequate tool to study community composition. Our theoretical model comprehensively represents observed trends in rank abundance relationships following long-term fertilization and suggests that competitive interactions among species are a critical factor in structuring species diversity in plant communities.