9 articles
Preprint Online November 21, 2011
 |
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
http://dx.doi.org/10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 http://dx.doi.org/10.3415/VCOT-07-04-0031 | ||
| 2. | ||
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 | ||
| 3. | ||
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 http://dx.doi.org/10.1160/TH07-11-0658 | ||
Articles prepublished September 14, 2010
|
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
http://dx.doi.org/10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 http://dx.doi.org/10.3415/VCOT-07-04-0031 | ||
| 2. | ||
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 | ||
| 3. | ||
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 http://dx.doi.org/10.1160/TH07-11-0658 | ||
Preprint Online August 05, 2011
|
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
http://dx.doi.org/10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 http://dx.doi.org/10.3415/VCOT-07-04-0031 | ||
| 2. | ||
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 | ||
| 3. | ||
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 http://dx.doi.org/10.1160/TH07-11-0658 | ||
Preprint Online July 26, 2011
|
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
http://dx.doi.org/10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 http://dx.doi.org/10.3415/VCOT-07-04-0031 | ||
| 2. | ||
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 | ||
| 3. | ||
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 http://dx.doi.org/10.1160/TH07-11-0658 | ||
Preprint Online March 21, 2011
|
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
http://dx.doi.org/10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 http://dx.doi.org/10.3415/VCOT-07-04-0031 | ||
| 2. | ||
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 | ||
| 3. | ||
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 http://dx.doi.org/10.1160/TH07-11-0658 | ||
Preprint Online March 04, 2011
|
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
http://dx.doi.org/10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 http://dx.doi.org/10.3415/VCOT-07-04-0031 | ||
| 2. | ||
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 | ||
| 3. | ||
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 http://dx.doi.org/10.1160/TH07-11-0658 | ||
Articles
You've 7 Article(s) in your Basket.
Methods News
5 Fachzeitschriften feiern 2012 "runde" Jubiläen
2012 feiern gleich fünf der 21 Fachzeitschriften "runde" Jubiläen, die im Schattauer...
Methods issue 1/2012
Monitoring and analyzing physiological parameters under different conditions of health and disease...
Methods issue 6/2011
This issue of Methods of Information in Medicine celebrates the journal‘s first 50 years. As the...
Call for Papers
We are inviting submissions for a Focus Theme in Methods of Information in Medicine on "Web...
Invitation to Apply for the Student Editorial Board 2012/2013
The Journal Methods of Information in Medicine is now accepting applications from trainees who...
Methods issue 5/2011
In 2008 it was decided that Methods of Information in Medicine will continue the tradition of...