Currently used histopathologic criteria for the diagnosis of pancreatic endocrine tumors are still under discussion as far as to their capacity to identify prognostically different tumor subsets, which are potentially helpful for patient management. A recently developed TNM staging system and a variety of proposed histologic and clinicopathologic parameters still need to be fully validated. One hundred fifty-five pancreatic endocrine tumors encompassing all the main histologic types and stages, operated with intention to cure and then followed up for a median 126 months, were carefully investigated histologically to identify prognostically informative parameters at univariable, bivariable, and multivariable analysis. Ki67 index, mitotic rate, neuroinvasion with or without vascular, peritumoral or stromal infiltrative patterns, as well as tumor size, and association with endocrine syndromes other than insulinoma proved effective in predicting recurrence and disease-specific death among well-differentiated tumors. Poorly differentiated histologic features, more than 10 mitoses/10 high power fields, and necrosis were helpful in the identification of high-grade cancers with an invariably poor prognosis. The TNM system proved to be highly predictive of patient outcome and easy to combine with histologic and clinicopathologic parameters to classify pancreatic endocrine tumors into groups of increasing malignant potential.