Hematopoietic stem cells (HSCs) are the most primitive cells in the hematopoietic system and are under tight regulation for self-renewal and differentiation. Notch signals are essential for the emergence of definitive hematopoiesis in mouse embryos and are critical regulators of lymphoid lineage fate determination. However, it remains unclear how Notch regulates the balance between HSC self-renewal and differentiation in the adult bone marrow (BM). Here we report a novel mechanism that prevents HSCs from undergoing premature lymphoid differentiation in BM. Using a series of in vivo mouse models and functional HSC assays, we show that leukemia/lymphoma related factor (LRF) is necessary for HSC maintenance by functioning as an erythroid-specific repressor of Delta-like 4 (Dll4) expression. Lrf deletion in erythroblasts promoted up-regulation of Dll4 in erythroblasts, sensitizing HSCs to T-cell instructive signals in the BM. Our study reveals novel cross-talk between HSCs and erythroblasts, and sheds a new light on the regulatory mechanisms regulating the balance between HSC self-renewal and differentiation.