Automated staging of T1 bladder cancer using digital pathologic H&E Images: A deep learning approach
INTRODUCTION
The American Joint Committee on Cancer defines T1 bladder cancer as the invasion of tumor cells into the lamina propria (LP), yet pathologists often struggle to confirm LP and/or muscularis mucosae invasion using H&E stains from bladder biopsies. Accurate reporting of the depth of LP invasion is important because of the worsened clinical outcomes observed in patients with deep invasion. We present an automated image analysis method that can recognize urothelium (U), LP, and muscularis propria (MP) from digital images of H&E-stained slides of bladder tissue. Its future clinical applications include automated risk stratification of T1 bladder cancer patients based on depth of LP invasion.
METHODS
Our method uses transfer learning in conjunction with convolutional neural networks (CNN) to identify different bladder layers from H&E images of bladder biopsies. Transfer learning enables CNN to equip computers with an ability to recognize and apply relevant knowledge from previous learning experiences when they encounter new tasks. Our proposed method is trained, cross-validated, and tested on 50,000 non-overlapping regions of size 64x64 pixels captured at 10x magnification. These regions are labeled for U, LP, MP, red blood cells (RBCs), inflammation (I), and cautery artifacts (C) by a GU pathologist. Each test image is processed by the CNN, producing six confidence heatmaps for each label. The MP and U maps are converted to binary masks, which represent the position of their respective bladder feature with ones and everything else with zeros. Depth of LP invasion is measured by determining the shortest distance from a given tumor nuclei in LP to the closest pixel with value 1 of the U binary mask.
RESULTS
The proposed method has 93.0% agreement with the pathologist in identification of bladder layers when tested on images of bladder cancer biopsies acquired from 86 patients. Additionally, given a set of tumor nuclei within LP, it precisely and accurately determines the depth of LP invasion, opening up the potential to sub stage T1 bladder cancer. When trained on samples from only three classes (U, LP, and MP), the method confuses I for U, RBCs for MP, and C for U, LP, and MP 90.0% of the times. This effect disappears in a six class method, thus a six class method is desirable.
CONCLUSION
Through accurate, automated segmentation of bladder layers from images of H&E biopsies and a given set of tumor nuclei, the depth of LP invasion can be quantified, allowing pathologists to make more informed, expedited, and accurate diagnoses of T1 bladder cancer.
Funding: Pelotonia Idea Grant