I read an article on the use of simulation in teaching lumbar puncture (LP) technique to residents by Dr. Simuni and her medicine colleagues at Northwestern University. I thought it was a really interesting article and helps to add data to the idea that a curricular plan in medical education which includes deliberate practice and simulation does a really nice job of teaching learners a new skill. It hints that this deliberate practice in a logical fashion is better than the traditional model.
I'm not so sure this paper really definitively answers the question that this practice is superior to the traditional training model. In brief, the article pits final scores on a mastery checklist of first-year medicine residents who underwent a three-hour educational session including simulation to teach proper LP technique against neurology residents who were asked to simply do the LP simulation while being graded on their performance on the checklist. I think this result may stand over time and additional studies, but I have a few problems with it. First, the neurology residents were not shown the checklist. I think this is a big deal. I don't know the proper place to do that to get adequate controls, but essentially the medicine intern group was taught to the test. It was deliberately pounded into their heads over the three hour session that these are the things they are going to be graded on. That's what deliberate practice is all about. It's about repeating something to get it right. To my mind, that is teaching to the test. The neurology residents weren't given time to familiarize themselves with the simulator (at least it didn't say they were). They also weren't oriented to what they would be evaluated on, so of course they didn't perform as well on the checklist. As they have likely done multiple LP's it might have also been easier to skip to inserting the needle in a simulated environment as it feels artificial, and it feels like this is the ultimate goal. It might have been more useful to go to the bedside of the next LP these residents did and see if the 'real world' performance was different between the PGY-1 group and the neurology residents. I doubt any neurology resident would forget to get informed consent in the 'real world' (but I may be wrong). Maybe the simulation training in part, trains you how to take the final simulation exam. I'm not saying that it was not a good idea to do the simulation training, I do. I'm also not saying the checklist is invalid or has no practical applications, it does. I'm saying that the PGY-1 group had the deck stacked in it's favor.
I would also argue that the way I learned to do LP's was essentially with deliberate practice over time with multiple patient experiences. When I was first starting, I had a senior resident or faculty over my shoulder giving me feedback on my technique. Could this have been improved upon by adding a simulation session at the beginning of my training, absolutely! But I don't know that this study really proves what they say it proves which is that traditional training is inferior to simulation, and neurology residents can easily be schooled by interns fresh from the simulation lab. This is shown by comparing the neurology residents with the interns at baseline. The neurology residents were all better just eyeballing the data. I think if you had put the neurology residents through the training, they also would have achieved a higher level of mastery. *That's a neurologist talking of course :)
I do want to say that I am a bit concerned at some of the mastery items the neurology residents missed (as were the authors). The anatomy questions would have likely been taken care of by brushing up on the anatomy before the test, but you could argue especially a senior neurology resident should know that. The authors were concerned about anesthesia, but that could have been a function of being in a simulator vs 'real world'. It could also show how one of the schools has a local practice which is different from national norms. The setting up of the tubes and manometer in a proper fashion is a bit vague to me, and I'm not sure I'd know what the proper position should be for that. I wouldn't make that a make or break point on this procedure. Not saying how I know this, but one can recover surprisingly well with the one handed method of unscrewing the caps in a pinch.
So this is a long response to the article as the editorial that accompanied it was trying to make the point that the traditional model was inferior and should potentially be reconsidered. I don't think that is what this study showed. I think it did prove that mastery level is attainable with a 3 hour simulation lab for PGY-1. I'm not sure it really proves they are better than neurology residents. They may be, but I don't think this was a fair assessment of that.
The semi-random musings of a neurologist who first trained to be a high school teacher, and never quite left his educator days behind. Views on the blog are my own, and are not specifically endorsed by my employer.
Showing posts with label simulation. Show all posts
Showing posts with label simulation. Show all posts
Wednesday, July 11, 2012
Thursday, April 12, 2012
Virtual hospitals - The future of medical simulation?
I was flipping through Facebook the other day, and saw a video posted by a friend. It was over 17 minutes long which is eternal in the world of Facebook videos, but I thought I'd give it a try as it looked interesting. It ended showing people from 'The Gadget Show' making a simulator which not too long ago would have been pure fantasy. They built a tent with 360 video output capability that also has a 360 degree treadmill to allow you to move in the virtual world by walking as you would in real life. They also hooked up an X-Box Kinnect sensor to pick up other body movements. They through in a few other cool add-ons, and they ended up with a truly immersive environment for a first person shooter game. You can watch the video here.
I got to thinking that this technology is now available, and could be used in medical school to train physicians. It's not yet at the level of being a holodeck, but it is closer than we've ever been before. I could envision a program where there is an ambulatory office building, and the student has their own clinic to run where simulated patients come in be interviewed. The physical examination is done through use of gestures mimicking what the real PE would be, or it could be coupled with a simulation manikin to elicit the physical findings. Then the student has to go back to a virtual staffing room, and dictate the encounter, and order testing. They then move on to the next patient. If you had enough of these built (assuming in the future this type of technology gets cheaper), you could envision having a 'continuity clinic' set up completely in a simulator. This might include seeing some of your regular patients back as they come through the emergency room for acute conditions or even going to the OR. It could be as complex as there is time and money to create the scenarios.
I often thought in residency that it would be interesting to have an immersive simulated hospital where you could spend at least some of your time as a medical student or as a junior resident. There you could have freedom to make some truly independent decisions and see what happens. I think the advantages to something like this are obvious and are akin to the flight simulators that pilots use to train. It will never replace time spent on the wards with skilled clinicians giving supervision and feedback. I don't think the technology is there for a completely realistic medical simulation. But it is getting closer.
I got to thinking that this technology is now available, and could be used in medical school to train physicians. It's not yet at the level of being a holodeck, but it is closer than we've ever been before. I could envision a program where there is an ambulatory office building, and the student has their own clinic to run where simulated patients come in be interviewed. The physical examination is done through use of gestures mimicking what the real PE would be, or it could be coupled with a simulation manikin to elicit the physical findings. Then the student has to go back to a virtual staffing room, and dictate the encounter, and order testing. They then move on to the next patient. If you had enough of these built (assuming in the future this type of technology gets cheaper), you could envision having a 'continuity clinic' set up completely in a simulator. This might include seeing some of your regular patients back as they come through the emergency room for acute conditions or even going to the OR. It could be as complex as there is time and money to create the scenarios.
I often thought in residency that it would be interesting to have an immersive simulated hospital where you could spend at least some of your time as a medical student or as a junior resident. There you could have freedom to make some truly independent decisions and see what happens. I think the advantages to something like this are obvious and are akin to the flight simulators that pilots use to train. It will never replace time spent on the wards with skilled clinicians giving supervision and feedback. I don't think the technology is there for a completely realistic medical simulation. But it is getting closer.
Subscribe to:
Posts (Atom)