Study on the Consistency Between Automatic Measurement Based on Convolutional Neural Network Technology and Manual Visual Evaluation in Intracavitary Ultrasonic Cine of Anterior Pelvic

Abstract

ObjectivesThis study was to evaluate the application of automatic measurement based on convolutional neural network (CNN) technology in intracavitary ultrasound cine of anterior pelvic.MethodsA total of 500 patients who underwent pelvic floor ultrasound examination at Peking University Shenzhen Hospital from July 2021 to February 2022 were retrospectively retrieved by the picture archiving and communication system (PACS) system, and 300 cases were used as a training set. The training set was labeled by three experienced ultrasound physicians to train CNN models and develop an automatic measurement software. The remaining 200 cases were used as a test set. Automatic measurement software identified relevant anatomical structures frame by frame and determined the two frames with the greatest difference, calculated the bladder neck descent (BND), urethral rotation angle (URA), and retrovesical angle (RA). Meanwhile, two experienced ultrasound physicians evaluated the resting frame and the maximum Valsalva frame on the cines by manual visual evaluation, labeled the anatomical structures in the corresponding frame, such as the inferoposterior margin of pubic symphysis, the mid‐axis of pubic symphysis, bladder contour, and urethra in the front, and calculated BND, URA, and RA. Considering that the residual urine volume (RUV) in the bladder may affect the results, enrolled patients were grouped according to the RUV (10–50 mL, 50–100 mL, and >100 mL). The consistency of the results by automatic measurement and manual visual evaluation was evaluated using the intraclass correlation coefficient (ICC) and the Bland–Altman graph.ResultsOf the 200 cases in the test set, 120 cases were successfully identified by the CNN automatic software with a 60% recognition rate. In the case of successful identification, the ICC of manual visual evaluation measurement and automatic measurement was 0.936 (BND), 0.911 (URA), 0.756 (RA in rest), and 0.877 (RA at maximum Valsalva), respectively. In addition, the RUV had a negligible effect on the consistency. The Bland–Altman plot shows the proportion of samples outside the limit was below 5%.ConclusionsCNN‐based automatic measurement software exhibited high reliability in anterior pelvic measurement, which results in a significantly enhanced measurement efficiency.