Reproducibility of the Paris System in Urine Cytology by Third-Year Pathology Residents

Abstract

<b><i>Introduction:</i></b> Standardized basic morphology and the algorithmic approach make the Paris System (TPS) for Reporting Urinary Cytology understandable and applicable. This study examined how well the TPS categories are understood by pathology residents and how well these criteria are enabling them reaching accurate diagnosis. <b><i>Materials/Methods:</i></b> A hundred consecutive cases representing all categories were selected. Authors reevaluated slides using TPS regardless of their original diagnosis. In the next step, the TPS was explained to four residents and trained them by five optimal urine cytology samples from each category. Then they were asked to diagnose the selected slides according to the TPS. The diagnoses were compared to authors. The agreement was assessed using kappa. Discordant diagnoses were classified as high and low impact based on potential on clinical practice. <b><i>Results:</i></b> The sensitivity of authors was 62.8%, and residents’ were 24–31.8%. The specificity of authors was 98.8%, and residents’ were 82.3–92.8%. Reproducibility of TPS was 40–46%. Kappa values were below 0.40 except for one resident. The highest rate of concordance was for negative for high-grade urothelial carcinoma (NHGUC): authors assigned 38 NHGUC (35 biopsy-proven benign cases). Twenty to twenty-six of them were assigned as NHGUC by residents. While authors assigned 42 cases as suspicious for high-grade urothelial carcinoma (SHGUC) or high-grade urothelial carcinoma (HGUC) (35 biopsy-proven malignant cases), residents assigned 22–29 of them. Discordant diagnosis with high clinical implication was 56–63%. <b><i>Conclusion:</i></b> Diagnostic accuracy rates of junior pathology residents using the TPS were unsatisfactory. The best agreement was observed in NHGUC and HGUC categories. Combining HGUC and SHGUC doubled the sensitivity of residents.