To better understand the development of SARS-CoV-2-specific immunity over time, a detailed evaluation of humoral and cellular responses is required. Here, we characterize anti-Spike (S) IgA and IgG in a representative population-based cohort of 431 SARS-CoV-2-infected individuals up to 217 days after diagnosis, demonstrating that 85% develop and maintain anti-S responses. In a subsample of 64 participants, we further assess anti-Nucleocapsid (N) IgG, neutralizing antibody activity, and T cell responses to Membrane (M), N, and S proteins. In contrast to S-specific antibody responses, anti-N IgG levels decline substantially over time and neutralizing activity toward Delta and Omicron variants is low to non-existent within just weeks of Wildtype SARS-CoV-2 infection. Virus-specific T cells are detectable in most participants, albeit more variable than antibody responses. Cluster analyses of the co-evolution of antibody and T cell responses within individuals identify five distinct trajectories characterized by specific immune patterns and clinical factors. These findings demonstrate the relevant heterogeneity in humoral and cellular immunity to SARS-CoV-2 while also identifying consistent patterns where antibody and T cell responses may work in a compensatory manner to provide protection.