In social animals, body size can be shaped by multiple factors, such as direct genetic effects, maternal effects, or the social environment. In ants, the body size of queens correlates with the social structure of the colony: colonies headed by a single queen (monogyne) generally produce larger queens that are able to found colonies independently, whereas colonies headed by multiple queens (polygyne) tend to produce smaller queens that stay in their natal colony or disperse with workers. We performed a cross-fostering experiment to investigate the proximate causes of queen size variation in the socially polymorphic ant Formica selysi. As expected if genetic or maternal effects influence queen size, eggs originating from monogyne colonies developed into larger queens than eggs collected from polygyne colonies, be they raised by monogyne or polygyne workers. In contrast, eggs sampled in monogyne colonies were smaller than eggs sampled in polygyne colonies. Hence, eggs from monogyne colonies are smaller but develop into larger queens than eggs from polygyne colonies, independently of the social structure of the workers caring for the brood. These results demonstrate that a genetic polymorphism or maternal effect transmitted to the eggs influences queen size, which probably affects the social structure of new colonies.