The phenotype of an individual can be affected by the genes of its conspecifics through indirect genetic effects (IGEs). IGEs have been studied across different organisms including wild and domesticated animals and plants, but little is known about their genetic architecture. Here, in a large-scale intraspecific interaction experiment, we show that the contribution of IGEs to the biomass variation of Arabidopsis thaliana is comparable to values classically reported in animals. Moreover, we identify 11 loci explaining 85.1% of the variability in IGEs. We find that positive IGE alleles (that is, those with positive effects on neighbour biomass) occur both in relict accessions from southern Eurasia and in post-glacial colonizers from northern Scandinavia, and that they are likely to have two divergent origins: for nine loci, they evolved in the post-glacial colonizers independently from the relicts, while the two others were introgressed in the post-glacial colonizer from the relicts. Finally, we find that variation in IGEs probably reflects divergent adaptations to the contrasting environments of the edges and the centre of the native range of the species. These findings reveal a surprisingly tractable genetic basis of IGEs in A. thaliana that is shaped by the ecology and the demographic history of the species.