How can critique in responsible innovation (RI) become generative? The anything-but-neutral relations between science, technology and society, at the core of science and technology studies, have led to the development of different repertoires of critique. None of them fitted the configurations in the biomedical practices we came to study. There, biomedical experts presented us with an analysis of the power relations perpetuated through the mainstream practices in their fields and had built socio-material alternatives to the common forms of practicing biomedicine. The paper suggests conceptualising critical observations voiced by experts embedded into socio-material alternatives as ‘critique from within’ yielding collateral goods and bads. Rather than asking how to foster responsibility conditions in RI, the paper suggests modestly reclaiming critique by articulating already existing forms of responsibility practices developed by experts themselves and analysing the ambivalent effects they engender.