The rate at which beneficial alleles fix in a population depends on the probability of and time to fixation of such alleles. Both of these quantities can be significantly impacted by population subdivision and limited gene flow. Here, we investigate how limited dispersal influences the rate of fixation of beneficial de novo mutations, as well as fixation time from standing genetic variation. We investigate this for a population structured according to the island model of dispersal allowing us to use the diffusion approximation, which we complement with simulations. We find that fixation may take on average fewer generations under limited dispersal than under panmixia when selection is moderate. This is especially the case if adaptation occurs from de novo recessive mutations, and dispersal is not too limited (such that approximately FST < 0.2). The reason is that mildly limited dispersal leads to only a moderate increase in effective population size (which slows down fixation), but is sufficient to cause a relative excess of homozygosity due to inbreeding, thereby exposing rare recessive alleles to selection (which accelerates fixation). We also explore the effect of meta-population dynamics through local extinction followed by recolonization, finding that such dynamics always accelerate fixation from standing genetic variation, while de novo mutations show faster fixation interspersed with longer waiting times. Finally, we discuss the implications of our results for the detection of sweeps, suggesting that limited dispersal mitigates the expected differences between the genetic signatures of sweeps involving recessive and dominant alleles.