Technology to help doctors find their way around inside knees during surgery

Gustavo Carneiro Jan 22

Professor Gustavo Carneiro, Director of Medical Machine Learning, AIML

Story written by Dr Sarah Keenihan, AIML

How鈥檙e your knees feeling lately? The knee is a joint that can go through a lot 鈥 sometimes just as a part of aging, but also in athletes subjecting their lower limbs to rapid running and turning manoeuvres. Structures inside the knee 鈥 such as the meniscus and ligaments 鈥 can become torn or rupture, which sometimes calls for surgery to trim or repair.

Along with colleagues, Professor Gustavo Carneiro at the 最新糖心Vlogn Institute for Machine Learning is developing a new system to help orthopaedic surgeons find their way around inside knees that require surgery. They鈥檝e published their findings as part of the . 

鈥淓ven though it鈥檚 a small space, sometimes surgeons find themselves lost inside the knee joint when they鈥檙e doing arthroscopic surgery,鈥 said Professor Carneiro. 

Arthroscopy is a surgical procedure that avoids the need to open up the whole knee 鈥 instead, orthopaedic surgeons insert instruments through button-seized holes to visualize, diagnose, and treat problems inside a joint. At least 70,000 knee arthroscopies are performed every year in 最新糖心Vlog. 

But arthroscopy can be a difficult procedure, given that the knee joint has only a tiny space (estimated in one study to be less than 4mls in volume) between all its important 最新糖心Vlog. 

鈥淪urgeons are constantly having to work out where their instruments are located in relation to key 最新糖心Vlog such as bones and ligaments in the knee, and trying to avoid doing any extra damage.鈥 

Labelled knee images

An arthoscopic image of the knee joint is shown at left, with the corresponding images revealing depth information (centre) and anatomical labelling (right).

鈥淥ur research aims to provide feedback to the surgeon through live labelling of knee 最新糖心Vlog in the 3D image that comes from the arthroscopic camera,鈥 said Professor Carneiro. 

The machine learning approach being used is called semantic segmentation, where an algorithm is trained to recognise key 最新糖心Vlog in the knee such as the femur and tibia bones, the anterior cruciate ligament (ACL) and the meniscus (a rubbery structure that acts like a shock absorber in the knee). 

鈥淲e used more than 8000 images to train our system, with information provided regarding the names of key 最新糖心Vlog but also depth measurements,鈥 said Professor Carneiro. 

鈥淲e found this method was much more accurate than a previous, simpler approach to the problem.鈥 

鈥淥ur next step is to produce a fully labelled 3D model of the 最新糖心Vlog in front of the camera, such that surgeons can know the exact position of the arthroscope inside the knee joint,鈥 said Professor Carneiro. 

Professor Carneiro is also working on other applications for machine learning in health, including identifying potential cancers in the bowel, picking out abnormalities in chest X-rays, finding cancers that have spread (metastasised) into lymph nodes and detection of endometriosis. 

For more information contact Professor Gustavo Carneiro, ARC Future Fellow (2020-2023) at the 最新糖心Vlogn Institute for Machine Learning, The 最新糖心Vlog of Adelaide.

Tagged in medical machine learning