Different host species associate with distinct gut microbes in mammals, a pattern sometimes referred to as phylosymbiosis. However, the processes shaping this host specificity are not well understood. One model proposes that barriers to microbial transmission promote specificity by limiting microbial dispersal between hosts. This model predicts that specificity levels measured across microbes is correlated to transmission mode (vertical vs. horizontal) and individual dispersal traits. Here, we leverage two large publicly available gut microbiota data sets (1490 samples from 195 host species) to test this prediction. We found that host specificity varies widely across bacteria (i.e., there are generalist and specialist bacteria) and depends on transmission mode and dispersal ability. Horizontally-like transmitted bacteria equipped with traits that facilitate switches between host (e.g., tolerance to oxygen) were found to be less specific (more generalist) than microbes without those traits, for example, vertically-like inherited bacteria that are intolerant to oxygen. Altogether, our findings are compatible with a model in which limited microbial dispersal abilities foster host specificity.