Adipose tissue plasticity is orchestrated by molecularly and functionally diverse cells within the stromal vascular fraction (SVF). Although several mouse and human adipose SVF cellular subpopulations have by now been identified, we still lack an understanding of the cellular and functional variability of adipose stem and progenitor cell (ASPC) populations across human fat depots. To address this, we performed single-cell and bulk RNA sequencing (RNA-seq) analyses of >30 SVF/Lin- samples across four human adipose depots, revealing two ubiquitous human ASPC (hASPC) subpopulations with distinct proliferative and adipogenic properties but also depot- and BMI-dependent proportions. Furthermore, we identified an omental-specific, high IGFBP2-expressing stromal population that transitions between mesothelial and mesenchymal cell states and inhibits hASPC adipogenesis through IGFBP2 secretion. Our analyses highlight the molecular and cellular uniqueness of different adipose niches, while our discovery of an anti-adipogenic IGFBP2+ omental-specific population provides a new rationale for the biomedically relevant, limited adipogenic capacity of omental hASPCs.