Endoscopic virtual ruler based on artificial intelligence technology

Abstract

Figures

Schematic diagram of the endoscopic virtual ruler. The radius of the endoscope is R , the height of the transparent cap above the endoscopy is H 1 , the diameter of the measured object is L , and the increased distance between the tip of the endoscope and the measured object is H 2 (this distance can be obtained from the scale on the endoscope), L = R + H 1 ×( H − H 1 )/ R .

Schematic diagram of the operation process of the endoscopic virtual ruler.

Comparison of the scale of the virtual ruler and that of the physical ruler at different distances.

Full text

Measurement and evaluation of lesion size has always been one of the difficult problems to solve in endoscopy 1 . Recently, we developed a real-time endoscopic virtual ruler measurement technology based on artificial intelligence (AI) technology.

Geometric optics showed that the distance of the object was the only variable affecting the ratio of the size of the object to the size of the image when the focal length was fixed and the lesion was centered (the transverse distance from the main optical axis was zero) 2 . Therefore, to obtain the actual size of the lesion, it is only necessary to measure the distance from the end of the lens to the lesion (object distance) and calculate the ratio of the size of the object to that of the image ( Fig. 1 ). This detection method can now be implemented using the image recognition technology of computer vision.

*Schematic diagram of the endoscopic virtual ruler. The radius of the endoscope is R , the height of the transparent cap above the endoscopy is H 1 , the diameter of the measured object is L , and the increased distance between the tip of the endoscope and the measured object is H 2 (this distance can be obtained from the scale on the endoscope), L

R + H 1 ×( H − H 1 )/ R .*

To do this, first install the transparent cap at the front end of the endoscope (10 mm/13 mm internal diameter) and adjust the distance of the cap end to the lesion until the lesion is fully within the field of view of the transparent endoscope cap, as the size of the inner diameter of the transparent cap is known. At this point, simply enter the distance from the front end of the endoscope to the maximum diameter of the lesion in the measurement system (recorded by an endoscope scale), and the measurement system will analyze the image of the target, forming a ruler that can measure the size of the lesion ( Fig. 2 ).

Schematic diagram of the operation process of the endoscopic virtual ruler.

Various clinical cases were studied ( Video 1 ) after comparing the scale of the virtual ruler with that of the physical ruler at different distances in vitro ( Fig. 3 ). The size of polyps and early cancer lesions could be well evaluated by using the model. Doctors can use virtual ruler measurement technology to measure lesions effectively during endoscopy.

The endoscopic virtual ruler is introduced and its clinical application shown for various types of lesions and at different distances.Video 1

Comparison of the scale of the virtual ruler and that of the physical ruler at different distances.

Endoscopy_UCTN_Code_TTT_1AQ_2AB