Use of the Anesoft Anesthesia Simulator to evaluate resident performance

Ludwig TA, Schwid HA:

Preliminary validation of screen-based simulator for evaluating resident performance

Anesthesiology 2004; 101: A1337

This pilot study investigated whether screen-based simulator performance would a) improve with level or training and b) correlate with standardized test scores and clinical ratings from attending anesthesiologists.

Four standardized scenarios (anaphylaxis, myocardial ischemia, venous air embolism and malignant hyperthermia) were completed by 15 residents (5 CA-1, 5 CA-2, 5 CA-3) on the Anesoft Anesthesia Simulator. Performance was scored and compared to USMLE Step 1, Anesthesia Knowledge Test (AKT) and faculty clinical ratings for each resident.

Simulator scores improved significantly from CA-1 to CA-2 to CA-3 residents. There was moderate and statistically significant correlation between simulator scores and faculty assessments and AKT exam scores. There was weaker correlation between simulator scores and USMLE scores.

This pilot study suggests that a screen-based simulator may be an inexpensive and valid tool to evaluate resident performance.