Forest development following agricultural abandonment concerns extensive areas including the Massif Central region of France where this study was undertaken. This land-use and land-cover change is expected to have effects on biodiversity and ecosystem services, including an increase of carbon sequestration—a major concern in the face of climate change. Nevertheless, uncertainties about carbon stock changes during successions are remaining, especially as to the total stock and the contribution of the different carbon pools. Our work contributes to this field by studying carbon stocks in multiple plots of different successional stages. We measured and estimated carbon stocks in aboveground and belowground vegetation, deadwood, litter and superficial soil, and surveyed plant communities and plot conditions (slope, aspect, soil characteristics). The average total carbon stock increased along the succession from 70.60 at stage 0 to 314.19 tC ha−1 at stage 5. However, the total carbon stocks at the young forest stage (abandoned for 74 years maximum) and the older forest stage (forested for at least 74 years) were not significantly different, and probably reflected strong local heterogeneity in the older forest stage. An increase of the carbon stock was found in all pools, except the soil pool that did not vary significantly between the successional stages. The aboveground carbon stock was found strongly related to the woody species cover, especially the macrophanerophyte cover. This case study supports the view that the succession dynamics of former agricultural plots participates in carbon sequestration, sometimes with great local variations.