Searchable abstracts of presentations at key conferences in endocrinology
Endocrine Abstracts (2023) 98 B9 | DOI: 10.1530/endoabs.98.B9

NANETS2023 Basic Science (28 abstracts)

Machine learning algorithm to classify multiphoton microscopy images of pancreatic neuroendocrine tumors

Noelle Daigle 1 , Suzann Duan 2 , Juanita L. Merchant 2 & Travis W. Sawyer 1,2


1University of Arizona Wyant College of Optical Sciences, 2University of Arizona College of Medicine


Background: Surgery is the preferred method of treatment for most pancreatic neuroendocrine tumors (PNETs), particularly functional PNETs or those greater than 2 cm in largest dimension. Existing techniques include intraoperative ultrasound and manual palpation, both of which have inherent disadvantages such as poor resolution and low contrast against normal pancreatic tissue. This results in surgeons performing more demolitive resections, such as the Whipple procedure, when they may not be strictly necessary in order to ensure total removal of tumors. Therefore, improving surgical localization methods could greatly improve patient outcome and quality of life. Multiphoton microscopy (MPM) is an optical imaging technique capable of visualizing intrinsic biomarkers through two-photon fluorescence, and collagen through second harmonic generation (SHG), notably without the aid of exogenous labels and with increased penetration depth compared to conventional microscopy. Here we test the use of MPM as a new method of microscopic tumor localization by applying this data to novel machine learning algorithms designed to automatically classify tissue types.

Methods: Formalin-fixed paraffin-embedded PNET (n =36) and normal pancreas (n =21) samples were imaged with a multiphoton microscope at five excitation and emission wavelengths corresponding to four endogenous fluorophore and SHG signals. Images covered an area approximately 4 mm by 4 mm. Texture features were then extracted using Haralick’s method, and a computer model trained to classify the samples as tumor or normal tissue using linear discriminant analysis. Sets of one to six features were tested, and models assessed using a leave-one-out-approach. Accuracy of classifiers was evaluated as the ratio of the number of correctly identified samples.

Results: As the number of features increases, accuracy of the classifiers increases until plateauing at n =5 features.

Number of features9;Accuracy of classifier
19;78.9%
29;82.5%
39;89.5%
49;93.0%
59;93.0%

Conclusion: We have demonstrated that using n =4 features, we are able to distinguish between PNETs and normal pancreatic tissue to 93.0% accuracy. By building this model, we can begin to test which imaging wavelengths and texture features are optimal for distinguishing the two tissue types, which in turn provides guidelines for the development of new surgical guidance instruments. This supports the continued investigation of MPM as a clinical imaging technique, and lays the groundwork for the integration of machine learning methods to real time imaging.

Abstract ID 23691

Article tools

My recent searches

No recent searches.