Skip to main content

Technologies

You are here

Automated evaluation of surgeon technical performance

Print Save as PDF

Overview

The technical skills of a surgical resident are typically evaluated by experienced mentors during training. However, this process is time-consuming, labor-intensive and may involve evaluator biases. In an effort to standardize such technical evaluations, UMB researchers developed an automated, sensor-free method using select parameters such as hand-motion entropy, the time to complete procedures, ratio of idle to active time, and instrument changing.

The system monitors the hands of a surgical operator using a video camera and software to track various parameters. The operator would wear sensor-free gloves of opposing colors to allow automatic tracking of each individual hand during a surgical procedure. Proof of concept studies conducted on cadavers demonstrated the system’s ability to distinguish between experts versus resident surgeons. Experts scored the lowest entropy values, with less idle time and shorter time to complete the procedure (i.e., dividing pectoralis minor), using fewer instruments. Improvement with training for resident surgeons was demonstrated, as well as the deterioration of proficiency 12-18 months later. This technology promises to enable the automated & objective assessment of technical skills.

Applications

The most frequently used surgical performance evaluation is the objective structured assessment of technical skills (OSATS). While useful, this examination may be prolonged and costly due to additional staffing requirements and use of surgical facilities. In addition, the OSATS assessments are conducted by different evaluators, which may introduce variance in scoring techniques. An automated system to evaluate technical performance would undoubtedly be useful as an objective assessment tool for surgical trainees, including for determination of military surgeons’ readiness prior to deployment.

Advantages

  • Objective
  • Automated
  • Less labor intensive

Stage of Development

Published proof-of-concept studies demonstrated system’s effectiveness as tool for the objective assessment of technical competency.

 

(NC Updated 11/2022)

Licensing Potential

 

Contact Info

Office of Technology Transfer
620 W Lexington St., 4th Floor
Baltimore, MD 21201
Email: [email protected]
Phone: (410) 706-2380