The eIF4E are a family of initiation factors that bind the mRNA 5' cap, regulating the proteome and the cellular phenotype. eIF4E1 mediates global translation and its activity is controlled via the PI3K/AKT/mTOR pathway. mTOR down-regulation results in eIF4E1 sequestration into an inactive complex with the 4E binding proteins (4EBPs). The second member, eIF4E2, regulates the translatome during hypoxia. However, the exact function of the third member, eIF4E3, has remained elusive. We have dissected its function using a range of techniques. Starting from the observation that it does not interact with 4EBP1, we demonstrate that eIF4E3 recruitment into an eIF4F complex occurs when Torin1 inhibits the mTOR pathway. Ribo-seq studies demonstrate that this complex (eIF4FS) is translationally active during stress and that it selects specific mRNA populations based on 5' TL (UTR) length. The interactome reveals that it associates with cellular proteins beyond the cognate initiation factors, suggesting that it may have 'moon-lighting' functions. Finally, we provide evidence that cellular metabolism is altered in an eIF4E3 KO background but only upon Torin1 treatment. We propose that eIF4E3 acts as a second branch of the integrated stress response, re-programming the translatome to promote 'stress resistance' and adaptation.