The recognition heuristic assumes that people make inferences based on the output of recognition memory. While much work has been devoted to establishing the recognition heuristic as a viable description of how people make inferences, more work is needed to fully integrate research on the recognition heuristic with research from the broader cognitive psychology literature. In this article, we outline four challenges that should be met for this integration to take place, and close with a call to address these four challenges collectively, rather than piecemeal.