This study aims to determine which factors within the first week after a first-ever transient ischemic attack (TIA) or minor ischemic stroke (MIS) are associated with stroke survivors’ ability to return to either partial or full time paid external work (RTpW). In this single-center prospective cohort study, we recruited 88 patients with first-ever TIA or MIS (NIHSS ≤ 5). Bivariate analyses were conducted between patients that did (RTpW) or did not return to paid work (noRTpW) within 7 days after stroke onset and at 3-months follow-up. Then, we conducted multivariate logistic and negative binomial regression analyses assessing (i) which factors are associated with RTpW at 3 months (ii) the likelihood that patients would RTpW at 3 months and (iii) the number of months necessary to RTpW. Overall, 43.2% of the patients did not RTpW at 3 months. At 3-months follow-up, higher anxiety/depression and fatigue-related disabilities were associated with noRTpW. Multivariate analysis showed that higher NIHSS scores at onset and hyperlipidemia (LDL cholesterol > 2.6 mmol/L or statins at stroke onset) were associated with noRTpW at 3 months. Stroke severity and/or newly diagnosed hypercholesterolemia at stroke onset in TIA or MIS patients were associated with not returning to paid work at 3 months.