During an infection the antigen-nonspecific memory CD8 T cell compartment is not simply an inert pool of cells, but becomes activated and cytotoxic. It is unknown how these cells contribute to the clearance of an infection. We measured the strength of T cell receptor (TCR) signals that bystander-activated, cytotoxic CD8 T cells (BA-CTLs) receive in vivo and found evidence of limited TCR signaling. Given this marginal contribution of the TCR, we asked how BA-CTLs identify infected target cells. We show that target cells express NKG2D ligands following bacterial infection and demonstrate that BA-CTLs directly eliminate these target cells in an innate-like, NKG2D-dependent manner. Selective inhibition of BA-CTL-mediated killing led to a significant defect in pathogen clearance. Together, these data suggest an innate role for memory CD8 T cells in the early immune response before the onset of a de novo generated, antigen-specific CD8 T cell response.