Whole-night sleep electroencephalogram (EEG) is plagued by several types of large-amplitude artifacts. Common approaches to remove them are fraught with issues: channel interpolation, rejection of noisy intervals, and independent component analysis are time-consuming, rely on subjective user decisions, and result in signal loss. Artifact Subspace Reconstruction (ASR) is an increasingly popular approach to rapidly and automatically clean wake EEG data. Indeed, ASR adaptively removes large-amplitude artifacts regardless of their scalp topography or consistency throughout the recording. This makes ASR, at least in theory, a highly-promising tool to clean whole-night EEG. However, ASR crucially relies on calibration against a subset of relatively clean "baseline" data. This is problematic when the baseline changes substantially over time, as in whole-night EEG data. Here we tackled this issue and, for the first time, validated ASR for cleaning sleep EEG. We demonstrate that ASR applied out-of-the-box, with the parameters recommended for wake EEG, results in the dramatic removal of slow waves. We also provide an appropriate procedure to use ASR for automatic and rapid cleaning of whole-night sleep EEG data or any long EEG recording. Our procedure is freely available in Dusk2Dawn, an open-source plugin for EEGLAB.