[1931] Meaningful Implementation of Computerized Speech Recognition (CSR) in Routine Pathology Reporting Must Be Determined by Its Accuracy and Efficacy.

Zhenhong Qu, Cathrine Jose, Margaret Huynh, Brittany Forcione, Urmila Sivagnanalingam, Shoanae Thomas, Kendra Alexaner. William Beaumont Hospital, Royal Oak, MI; University of Rochester Medical Center, NY

Background: Effective implementation of computerized speech recognition (CSR) has been hampered by the lack of assessment of its effectiveness and shortcomings. We previously presented preliminary results of our objective outcome measurement of CSR. As the final part of our study, we stratify the measurements, and based on the data, propose recommendation for adopting this technology in surgical pathology.
Design: Voice dictation of 2,873 routine surgical pathology cases was simultaneously captured by CSR and routine transcriptionist-assisted documentation (TAD). Five additional participants whose native language is English also used CSR to capture the accession numbers and patient names of these cases. Fifty-two diagnostic templates (including “Note” in some) representative of routinely encountered disease spectrum were repeated in CSR by the participants. The accuracy in each report component (table) by CSR was compared to those by TAD and/or the templates. Dragon Naturally Speaking (v9) by Nuance installed in Dell Precision desktop computers with Microsoft Window-XP was used for the CSR.
Results: The accuracy of CSR for different components in pathology report varies greatly. Highest accuracy rate for the main diagnosis components requires 5-8% reduction in dictation speed from that for TAD.

Table. Accuracy of Different Report Components by CSR
Report ComponentN =N of CSR ParticipantAccuracy rate (%) *Comment
Patient Name2,873631-46 
Accession Number2,873675-82 
Diagnosis2,873191.6-94.4Dictation speed as that for TAD
 52593.7-97.8Dict.speed to maximize accuracy
Report Format2,87310.71-2.2Format pre-defined in CSR
 5254.5-7.9No pre-defined format
* Accuracy range includes low and high ends. All data shows normal distribution. No statistical analysis is used for the data presented here.


Conclusions: Combing our studies, we conclude and recommend: 1) Accuracy rate of CSR for (accession) number and patient name are not acceptable for routine use. Thus, manual input or bar-code method should be used. 2) Formats should be pre-defined by software macro function for consistent report style. 3) Pre-defined diagnosis templates are the most efficient and accurate approach when using CSR. 4) Increased dictation time by pathologists using CRS to achieve acceptable accuracy may likely offset the financial benefit from reducing TAD. The ultimate financial outcome remains to be determined.
Category: Techniques

Monday, February 28, 2011 1:00 PM

Poster Session II # 275, Monday Afternoon

 

Close Window