13 articles
Articles prepublished February 07, 2012
 |
|
Objectifying User Critique
A Means of Continuous Quality Assurance for Physician Discharge Letter Composition
Original Article
M. Oschem (1), V. Mahler (2), H. U. Prokosch (3)
(1) Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany; (2) Department of Dermatology, University Hospital Erlangen, Erlangen, Germany; (3) Chair of Medical Informatics, Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Summary
Objectives: The aim of this study is to objectify user critique rendering it usable for quality assurance. Based on formative and summative evaluation results we strive to promote software improvements; in our case, the physician discharge letter composition process at the Department of Dermatology, University Hospital Erlangen, Germany. Methods : We developed a novel six-step approach to objectify user critique: 1) acquisition of user critique using subjectivist methods, 2) creation of a workflow model, 3) definition of hypothesis and indicators, 4) measuring of indicators, 5) analyzing results, 6) optimization of the system regarding both subjectivist and objectivist evaluation results. In particular, we derived indicators and workflows directly from user critique/narratives. The identified indicators were mapped onto workflow activities, creating a link between user critique and the evaluated system. Results: Users criticized a new discharge letter system as “too slow” and “too labor-intensive” in comparison with the previously used system. In a stepwise approach we collected subjective user critique, derived a comprehensive process model including deviations and deduced a set of five indicators for objectivist evaluation: processing time, system-related waiting time, number of mouse clicks, number of keyboard inputs, and throughput time. About 3500 measurements have been performed to compare the workflow-steps of both systems, regarding 20 discharge letters. Although the difference of the mean total processing time between both systems was statistically insignificant (2011.7 s vs. 1971.5 s; p = 0.457), we detected a significant difference in waiting times (101.8 s vs. 37.2 s; p <0.001) and number of user interactions (77 vs. 69; p <0.001) in favor of the old system, thus objectifying user critique. Conclusions: Our six-step approach enables objectification of user critique, resulting in objective values for continuous quality assurance. To our knowledge no previous study in medical informatics mapped user critique onto workflow steps. Subjectivist analysis prompted us to use the indicator system-related waiting time for the objectivist study, which was rarely done before. We consider combining subjectivist and objectivist methods as a key point of our approach. Future work will concentrate on automated measurement of indicators.
Keywords
Hospital Information Systems, Quality Assurance, health care, evaluation studies, patient discharge, attitude to computers
DOI
http://dx.doi.org/10.3414/ME09-01-0052You may also be interested in...
| 1. | ||
C. Machan, E. Ammenwerth, T. Schabetsberger Methods of Information in Medicine 2006 45 2: 225-233 | ||
| 2. | ||
E. Ammenwerth(1) , N. de Keizer (2) Methods of Information in Medicine 2005 44 1: 44-56 | ||
| 3. | ||
M. J. van der Meijden (1), I. Solen (1), A. Hasman (1), J. Troost (2), H. J. Tange (1) Methods of Information in Medicine 2003 42 4: 423-427 | ||
Preprint Online November 21, 2011
|
|
Objectifying User Critique
A Means of Continuous Quality Assurance for Physician Discharge Letter Composition
Original Article
M. Oschem (1), V. Mahler (2), H. U. Prokosch (3)
(1) Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany; (2) Department of Dermatology, University Hospital Erlangen, Erlangen, Germany; (3) Chair of Medical Informatics, Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Summary
Objectives: The aim of this study is to objectify user critique rendering it usable for quality assurance. Based on formative and summative evaluation results we strive to promote software improvements; in our case, the physician discharge letter composition process at the Department of Dermatology, University Hospital Erlangen, Germany. Methods : We developed a novel six-step approach to objectify user critique: 1) acquisition of user critique using subjectivist methods, 2) creation of a workflow model, 3) definition of hypothesis and indicators, 4) measuring of indicators, 5) analyzing results, 6) optimization of the system regarding both subjectivist and objectivist evaluation results. In particular, we derived indicators and workflows directly from user critique/narratives. The identified indicators were mapped onto workflow activities, creating a link between user critique and the evaluated system. Results: Users criticized a new discharge letter system as “too slow” and “too labor-intensive” in comparison with the previously used system. In a stepwise approach we collected subjective user critique, derived a comprehensive process model including deviations and deduced a set of five indicators for objectivist evaluation: processing time, system-related waiting time, number of mouse clicks, number of keyboard inputs, and throughput time. About 3500 measurements have been performed to compare the workflow-steps of both systems, regarding 20 discharge letters. Although the difference of the mean total processing time between both systems was statistically insignificant (2011.7 s vs. 1971.5 s; p = 0.457), we detected a significant difference in waiting times (101.8 s vs. 37.2 s; p <0.001) and number of user interactions (77 vs. 69; p <0.001) in favor of the old system, thus objectifying user critique. Conclusions: Our six-step approach enables objectification of user critique, resulting in objective values for continuous quality assurance. To our knowledge no previous study in medical informatics mapped user critique onto workflow steps. Subjectivist analysis prompted us to use the indicator system-related waiting time for the objectivist study, which was rarely done before. We consider combining subjectivist and objectivist methods as a key point of our approach. Future work will concentrate on automated measurement of indicators.
Keywords
Hospital Information Systems, Quality Assurance, health care, evaluation studies, patient discharge, attitude to computers
DOI
http://dx.doi.org/10.3414/ME09-01-0052You may also be interested in...
| 1. | ||
C. Machan, E. Ammenwerth, T. Schabetsberger Methods of Information in Medicine 2006 45 2: 225-233 | ||
| 2. | ||
E. Ammenwerth(1) , N. de Keizer (2) Methods of Information in Medicine 2005 44 1: 44-56 | ||
| 3. | ||
M. J. van der Meijden (1), I. Solen (1), A. Hasman (1), J. Troost (2), H. J. Tange (1) Methods of Information in Medicine 2003 42 4: 423-427 | ||
Articles prepublished September 14, 2010
|
|
Objectifying User Critique
A Means of Continuous Quality Assurance for Physician Discharge Letter Composition
Original Article
M. Oschem (1), V. Mahler (2), H. U. Prokosch (3)
(1) Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany; (2) Department of Dermatology, University Hospital Erlangen, Erlangen, Germany; (3) Chair of Medical Informatics, Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Summary
Objectives: The aim of this study is to objectify user critique rendering it usable for quality assurance. Based on formative and summative evaluation results we strive to promote software improvements; in our case, the physician discharge letter composition process at the Department of Dermatology, University Hospital Erlangen, Germany. Methods : We developed a novel six-step approach to objectify user critique: 1) acquisition of user critique using subjectivist methods, 2) creation of a workflow model, 3) definition of hypothesis and indicators, 4) measuring of indicators, 5) analyzing results, 6) optimization of the system regarding both subjectivist and objectivist evaluation results. In particular, we derived indicators and workflows directly from user critique/narratives. The identified indicators were mapped onto workflow activities, creating a link between user critique and the evaluated system. Results: Users criticized a new discharge letter system as “too slow” and “too labor-intensive” in comparison with the previously used system. In a stepwise approach we collected subjective user critique, derived a comprehensive process model including deviations and deduced a set of five indicators for objectivist evaluation: processing time, system-related waiting time, number of mouse clicks, number of keyboard inputs, and throughput time. About 3500 measurements have been performed to compare the workflow-steps of both systems, regarding 20 discharge letters. Although the difference of the mean total processing time between both systems was statistically insignificant (2011.7 s vs. 1971.5 s; p = 0.457), we detected a significant difference in waiting times (101.8 s vs. 37.2 s; p <0.001) and number of user interactions (77 vs. 69; p <0.001) in favor of the old system, thus objectifying user critique. Conclusions: Our six-step approach enables objectification of user critique, resulting in objective values for continuous quality assurance. To our knowledge no previous study in medical informatics mapped user critique onto workflow steps. Subjectivist analysis prompted us to use the indicator system-related waiting time for the objectivist study, which was rarely done before. We consider combining subjectivist and objectivist methods as a key point of our approach. Future work will concentrate on automated measurement of indicators.
Keywords
Hospital Information Systems, Quality Assurance, health care, evaluation studies, patient discharge, attitude to computers
DOI
http://dx.doi.org/10.3414/ME09-01-0052You may also be interested in...
| 1. | ||
C. Machan, E. Ammenwerth, T. Schabetsberger Methods of Information in Medicine 2006 45 2: 225-233 | ||
| 2. | ||
E. Ammenwerth(1) , N. de Keizer (2) Methods of Information in Medicine 2005 44 1: 44-56 | ||
| 3. | ||
M. J. van der Meijden (1), I. Solen (1), A. Hasman (1), J. Troost (2), H. J. Tange (1) Methods of Information in Medicine 2003 42 4: 423-427 | ||
Preprint Online August 05, 2011
|
|
Objectifying User Critique
A Means of Continuous Quality Assurance for Physician Discharge Letter Composition
Original Article
M. Oschem (1), V. Mahler (2), H. U. Prokosch (3)
(1) Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany; (2) Department of Dermatology, University Hospital Erlangen, Erlangen, Germany; (3) Chair of Medical Informatics, Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Summary
Objectives: The aim of this study is to objectify user critique rendering it usable for quality assurance. Based on formative and summative evaluation results we strive to promote software improvements; in our case, the physician discharge letter composition process at the Department of Dermatology, University Hospital Erlangen, Germany. Methods : We developed a novel six-step approach to objectify user critique: 1) acquisition of user critique using subjectivist methods, 2) creation of a workflow model, 3) definition of hypothesis and indicators, 4) measuring of indicators, 5) analyzing results, 6) optimization of the system regarding both subjectivist and objectivist evaluation results. In particular, we derived indicators and workflows directly from user critique/narratives. The identified indicators were mapped onto workflow activities, creating a link between user critique and the evaluated system. Results: Users criticized a new discharge letter system as “too slow” and “too labor-intensive” in comparison with the previously used system. In a stepwise approach we collected subjective user critique, derived a comprehensive process model including deviations and deduced a set of five indicators for objectivist evaluation: processing time, system-related waiting time, number of mouse clicks, number of keyboard inputs, and throughput time. About 3500 measurements have been performed to compare the workflow-steps of both systems, regarding 20 discharge letters. Although the difference of the mean total processing time between both systems was statistically insignificant (2011.7 s vs. 1971.5 s; p = 0.457), we detected a significant difference in waiting times (101.8 s vs. 37.2 s; p <0.001) and number of user interactions (77 vs. 69; p <0.001) in favor of the old system, thus objectifying user critique. Conclusions: Our six-step approach enables objectification of user critique, resulting in objective values for continuous quality assurance. To our knowledge no previous study in medical informatics mapped user critique onto workflow steps. Subjectivist analysis prompted us to use the indicator system-related waiting time for the objectivist study, which was rarely done before. We consider combining subjectivist and objectivist methods as a key point of our approach. Future work will concentrate on automated measurement of indicators.
Keywords
Hospital Information Systems, Quality Assurance, health care, evaluation studies, patient discharge, attitude to computers
DOI
http://dx.doi.org/10.3414/ME09-01-0052You may also be interested in...
| 1. | ||
C. Machan, E. Ammenwerth, T. Schabetsberger Methods of Information in Medicine 2006 45 2: 225-233 | ||
| 2. | ||
E. Ammenwerth(1) , N. de Keizer (2) Methods of Information in Medicine 2005 44 1: 44-56 | ||
| 3. | ||
M. J. van der Meijden (1), I. Solen (1), A. Hasman (1), J. Troost (2), H. J. Tange (1) Methods of Information in Medicine 2003 42 4: 423-427 | ||
Preprint Online July 26, 2011
|
|
Objectifying User Critique
A Means of Continuous Quality Assurance for Physician Discharge Letter Composition
Original Article
M. Oschem (1), V. Mahler (2), H. U. Prokosch (3)
(1) Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany; (2) Department of Dermatology, University Hospital Erlangen, Erlangen, Germany; (3) Chair of Medical Informatics, Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Summary
Objectives: The aim of this study is to objectify user critique rendering it usable for quality assurance. Based on formative and summative evaluation results we strive to promote software improvements; in our case, the physician discharge letter composition process at the Department of Dermatology, University Hospital Erlangen, Germany. Methods : We developed a novel six-step approach to objectify user critique: 1) acquisition of user critique using subjectivist methods, 2) creation of a workflow model, 3) definition of hypothesis and indicators, 4) measuring of indicators, 5) analyzing results, 6) optimization of the system regarding both subjectivist and objectivist evaluation results. In particular, we derived indicators and workflows directly from user critique/narratives. The identified indicators were mapped onto workflow activities, creating a link between user critique and the evaluated system. Results: Users criticized a new discharge letter system as “too slow” and “too labor-intensive” in comparison with the previously used system. In a stepwise approach we collected subjective user critique, derived a comprehensive process model including deviations and deduced a set of five indicators for objectivist evaluation: processing time, system-related waiting time, number of mouse clicks, number of keyboard inputs, and throughput time. About 3500 measurements have been performed to compare the workflow-steps of both systems, regarding 20 discharge letters. Although the difference of the mean total processing time between both systems was statistically insignificant (2011.7 s vs. 1971.5 s; p = 0.457), we detected a significant difference in waiting times (101.8 s vs. 37.2 s; p <0.001) and number of user interactions (77 vs. 69; p <0.001) in favor of the old system, thus objectifying user critique. Conclusions: Our six-step approach enables objectification of user critique, resulting in objective values for continuous quality assurance. To our knowledge no previous study in medical informatics mapped user critique onto workflow steps. Subjectivist analysis prompted us to use the indicator system-related waiting time for the objectivist study, which was rarely done before. We consider combining subjectivist and objectivist methods as a key point of our approach. Future work will concentrate on automated measurement of indicators.
Keywords
Hospital Information Systems, Quality Assurance, health care, evaluation studies, patient discharge, attitude to computers
DOI
http://dx.doi.org/10.3414/ME09-01-0052You may also be interested in...
| 1. | ||
C. Machan, E. Ammenwerth, T. Schabetsberger Methods of Information in Medicine 2006 45 2: 225-233 | ||
| 2. | ||
E. Ammenwerth(1) , N. de Keizer (2) Methods of Information in Medicine 2005 44 1: 44-56 | ||
| 3. | ||
M. J. van der Meijden (1), I. Solen (1), A. Hasman (1), J. Troost (2), H. J. Tange (1) Methods of Information in Medicine 2003 42 4: 423-427 | ||
Preprint Online March 21, 2011
|
|
Objectifying User Critique
A Means of Continuous Quality Assurance for Physician Discharge Letter Composition
Original Article
M. Oschem (1), V. Mahler (2), H. U. Prokosch (3)
(1) Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany; (2) Department of Dermatology, University Hospital Erlangen, Erlangen, Germany; (3) Chair of Medical Informatics, Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Summary
Objectives: The aim of this study is to objectify user critique rendering it usable for quality assurance. Based on formative and summative evaluation results we strive to promote software improvements; in our case, the physician discharge letter composition process at the Department of Dermatology, University Hospital Erlangen, Germany. Methods : We developed a novel six-step approach to objectify user critique: 1) acquisition of user critique using subjectivist methods, 2) creation of a workflow model, 3) definition of hypothesis and indicators, 4) measuring of indicators, 5) analyzing results, 6) optimization of the system regarding both subjectivist and objectivist evaluation results. In particular, we derived indicators and workflows directly from user critique/narratives. The identified indicators were mapped onto workflow activities, creating a link between user critique and the evaluated system. Results: Users criticized a new discharge letter system as “too slow” and “too labor-intensive” in comparison with the previously used system. In a stepwise approach we collected subjective user critique, derived a comprehensive process model including deviations and deduced a set of five indicators for objectivist evaluation: processing time, system-related waiting time, number of mouse clicks, number of keyboard inputs, and throughput time. About 3500 measurements have been performed to compare the workflow-steps of both systems, regarding 20 discharge letters. Although the difference of the mean total processing time between both systems was statistically insignificant (2011.7 s vs. 1971.5 s; p = 0.457), we detected a significant difference in waiting times (101.8 s vs. 37.2 s; p <0.001) and number of user interactions (77 vs. 69; p <0.001) in favor of the old system, thus objectifying user critique. Conclusions: Our six-step approach enables objectification of user critique, resulting in objective values for continuous quality assurance. To our knowledge no previous study in medical informatics mapped user critique onto workflow steps. Subjectivist analysis prompted us to use the indicator system-related waiting time for the objectivist study, which was rarely done before. We consider combining subjectivist and objectivist methods as a key point of our approach. Future work will concentrate on automated measurement of indicators.
Keywords
Hospital Information Systems, Quality Assurance, health care, evaluation studies, patient discharge, attitude to computers
DOI
http://dx.doi.org/10.3414/ME09-01-0052You may also be interested in...
| 1. | ||
C. Machan, E. Ammenwerth, T. Schabetsberger Methods of Information in Medicine 2006 45 2: 225-233 | ||
| 2. | ||
E. Ammenwerth(1) , N. de Keizer (2) Methods of Information in Medicine 2005 44 1: 44-56 | ||
| 3. | ||
M. J. van der Meijden (1), I. Solen (1), A. Hasman (1), J. Troost (2), H. J. Tange (1) Methods of Information in Medicine 2003 42 4: 423-427 | ||
Preprint Online March 04, 2011
|
|
Objectifying User Critique
A Means of Continuous Quality Assurance for Physician Discharge Letter Composition
Original Article
M. Oschem (1), V. Mahler (2), H. U. Prokosch (3)
(1) Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany; (2) Department of Dermatology, University Hospital Erlangen, Erlangen, Germany; (3) Chair of Medical Informatics, Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Summary
Objectives: The aim of this study is to objectify user critique rendering it usable for quality assurance. Based on formative and summative evaluation results we strive to promote software improvements; in our case, the physician discharge letter composition process at the Department of Dermatology, University Hospital Erlangen, Germany. Methods : We developed a novel six-step approach to objectify user critique: 1) acquisition of user critique using subjectivist methods, 2) creation of a workflow model, 3) definition of hypothesis and indicators, 4) measuring of indicators, 5) analyzing results, 6) optimization of the system regarding both subjectivist and objectivist evaluation results. In particular, we derived indicators and workflows directly from user critique/narratives. The identified indicators were mapped onto workflow activities, creating a link between user critique and the evaluated system. Results: Users criticized a new discharge letter system as “too slow” and “too labor-intensive” in comparison with the previously used system. In a stepwise approach we collected subjective user critique, derived a comprehensive process model including deviations and deduced a set of five indicators for objectivist evaluation: processing time, system-related waiting time, number of mouse clicks, number of keyboard inputs, and throughput time. About 3500 measurements have been performed to compare the workflow-steps of both systems, regarding 20 discharge letters. Although the difference of the mean total processing time between both systems was statistically insignificant (2011.7 s vs. 1971.5 s; p = 0.457), we detected a significant difference in waiting times (101.8 s vs. 37.2 s; p <0.001) and number of user interactions (77 vs. 69; p <0.001) in favor of the old system, thus objectifying user critique. Conclusions: Our six-step approach enables objectification of user critique, resulting in objective values for continuous quality assurance. To our knowledge no previous study in medical informatics mapped user critique onto workflow steps. Subjectivist analysis prompted us to use the indicator system-related waiting time for the objectivist study, which was rarely done before. We consider combining subjectivist and objectivist methods as a key point of our approach. Future work will concentrate on automated measurement of indicators.
Keywords
Hospital Information Systems, Quality Assurance, health care, evaluation studies, patient discharge, attitude to computers
DOI
http://dx.doi.org/10.3414/ME09-01-0052You may also be interested in...
| 1. | ||
C. Machan, E. Ammenwerth, T. Schabetsberger Methods of Information in Medicine 2006 45 2: 225-233 | ||
| 2. | ||
E. Ammenwerth(1) , N. de Keizer (2) Methods of Information in Medicine 2005 44 1: 44-56 | ||
| 3. | ||
M. J. van der Meijden (1), I. Solen (1), A. Hasman (1), J. Troost (2), H. J. Tange (1) Methods of Information in Medicine 2003 42 4: 423-427 | ||
Articles
You've 177 Article(s) in your Basket.
Methods News
5 Fachzeitschriften feiern 2012 "runde" Jubiläen
2012 feiern gleich fünf der 21 Fachzeitschriften "runde" Jubiläen, die im Schattauer...
Methods issue 1/2012
Monitoring and analyzing physiological parameters under different conditions of health and disease...
Methods issue 6/2011
This issue of Methods of Information in Medicine celebrates the journal‘s first 50 years. As the...
Call for Papers
We are inviting submissions for a Focus Theme in Methods of Information in Medicine on "Web...
Invitation to Apply for the Student Editorial Board 2012/2013
The Journal Methods of Information in Medicine is now accepting applications from trainees who...
Methods issue 5/2011
In 2008 it was decided that Methods of Information in Medicine will continue the tradition of...