The development and use of chemotherapy for patients with prostate cancer was slow and modest in comparison with other solid tumor sites. While many cytotoxic agents and multiple drug combinations were tested during the 1980, the first recognized drug for men with metastatic castration-resistant prostate cancer (mCRPC) was mitoxantrone combined with prednisone in 1996. Mitoxantrone showed an improvement in quality of life and pain compared to men treated with prednisone alone. In 2004, two randomized controlled trials found docetaxel superior to mitoxantrone in PSA response and survival. Despite the somewhat higher side effect rate, quality of life and pain were also improved with docetaxel. Unfortunately only about every second man benefits from this treatment and there are no approved criteria to select patients with better chances of response. It takes about 3 months of treatment to identify non-responders and all patients will ultimately progress and most of them will die of prostate cancer. Many men with mCRPC were treated with mitoxantrone after progression on docetaxel without a strong evidence for such a choice. More recently, the benefit of a second-line chemotherapy was addressed within a randomized controlled trial. A new taxane, cabazitaxel, was found superior to mitoxantrone in terms of overall survival despite the previous treatment with docetaxel and therefore recently approved in this indication. The most important challenges and opportunities for future studies will be the combination of chemotherapy with hormonal or non-hormonal targeted agents, the establishment of treatment algorithms to best sequence docetaxel and cabazitaxel and non-cytotoxic agents. Patient selection criteria as well as early biomarkers of response or resistance would also be important for patients and clinicians. Toxicity and quality of life are particular important aspects of drug development in current and future studies which aim to improve treatment options in this frequently elderly patient population.