The COVID-19 pandemic underscored the differential impact of infectious diseases across population groups, with gender and sex identified as important dimensions influencing transmission and health outcomes. Sex-related biological factors, such as differences in immune response and comorbidities, contribute to men's heightened severity risks, while gender norms and roles influence exposure patterns, adherence to prevention measures, and healthcare access, influencing women's higher reported infection rates in certain contexts. Despite widely observed gender/sex disparities, infectious disease models frequently overlook gender and sex as key dimensions, leading to gaps in understanding and potential blind spots in public health interventions. This paper develops a conceptual framework based on the Susceptible-Exposed-Infectious-Recovered/Deceased (SEIR/D) compartmental model to map pathways through which gender and sex may influence susceptibility, exposure, transmission, recovery, and mortality. Using a narrative review of modelling, epidemiological, and clinical studies, this framework identifies and characterises the main social and biological mechanisms on this matter-including gendered occupational exposure, differential adherence to preventive measures, and disparities in healthcare-seeking behaviour-alongside sex-based differences in immune response and disease severity. The framework also examines potential gender-related variations in epidemiological surveillance data, highlighting disparities in testing uptake and hospitalisation referrals that could influence model outputs. By synthesising these insights, this paper provides a theoretical foundation for integrating gender and sex into infectious disease models. It advocates for interdisciplinary collaboration between modellers, social scientists, and clinicians to advance gender- and sex-sensitive modelling approaches. Accounting for gender and sex can enhance predictive accuracy, inform intervention strategies, and promote health equity in pandemic response.