Due to the new regulatory guidelines known as Basel II for banking and Solvency 2 for insurance, the financial industry is looking for qualitative approaches to and quantitative models for operational risk. Whereas a full quantitative approach may never be achieved, in this paper we present some techniques from probability and statistics which no doubt will prove useful in any quantitative modelling environment. The techniques discussed are advanced peaks over threshold modelling, the construction of dependent loss processes and the establishment of bounds for risk measures under partial information, and can be applied to other areas of quantitative risk management.