Preprint online
36 articles
Preprint Online August 20, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online August 5, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online July 20, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online July 5, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online June 22, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online June 7, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online May 21, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online March 19, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online March 8, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online January 20, 2010
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online December 21, 2009
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online November 20, 2009
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Preprint Online November 5, 2009
|
Intervention Effects in the Case of Heterogeneity between Three Subgroups
Assessment within the Framework of Systematic Reviews
Special Topic: GMDS 2009
G. Skipka (1), R. Bender (1)
(1) Institute for Quality and Efficiency in Health Care, Cologne, Germany
Summary
Background: Usually, statistical tests for interactions are applied to investigate potential effect modifiers. If an effect modifier, consisting of three categories, is found to be statistically significant, the application of pairwise interaction tests is indicated. In this case, the problem of non-transitive relations may occur if the significance level is fixed at 0.05 for all tests. Objective: To develop an algorithm for which non-transitive relations do not occur. Methods: A hierarchical testing procedure is applied, based on the heterogeneity statistic Q . In a first step the interaction will be tested for the three trial subgroups altogether, applying the significance level α = 0.05 (global test). If a significant interaction is proven in the first step, pairwise tests for interaction will be applied in a second step. Theoretical data scenarios will be considered and p-values will be calculated for the pairwise tests. Based on these results the significance level for pairwise testing will be determined. Results: Fixing the significance level at 0.05 for all tests, the problem of non-transitive relations is mostly relevant, if the difference in the effects between the three trial subgroups is approximately 3.5 standard errors and the effect of the ‘middle’ trial subgroup is not close to one of the other two effects. This problem vanishes when the significance level is set to α = 0.22. We propose to select α = 0.20 to get a more ’even’ and simple value. Conclusions: By increasing the significance level for the pairwise tests to 0.20, non-transitive relations are virtually avoidable. The proposed hierarchical testing procedure represents a clear practical guidance to perform subgroup analyses in the framework of systematic reviews.
Keywords
Meta-analysis, Interaction, systematic review, Heterogeneity, Subgroups
DOI
10.3414/ME09-02-0054You may also be interested in...
| 1. | ||
|
R. B. Evans1, W. J. Gordon-Evans1, M. G. Conzemius2 VCOT - Veterinary and Comparative Orthopaedics and Traumatology 2008 21 2: 106-109 10.3415/VCOT-07-04-0031 |
||
| 2. | ||
|
W. Häuser (1) arthritis + rheuma 2010 30 2: 105-108 |
||
| 3. | ||
|
Matus Rehak1,2, Jiri Rehak2, Marc Müller3, Susanne Faude1, Frank Faude1, Annelie Siegemund4, Vera Krcova5, Ludek Slavik5, Dirk Hasenclever6, Markus Scholz6, Peter Wiedemann1 Thrombosis and Haemostasis 2008 99 5: 925-929 10.1160/TH07-11-0658 |
||
Methods News
Methods issue 4/2010
This is an exciting time in clinical natural language processing (NLP). Many of the ideas discussed...
Methods issue 3/2010
Classification, also termed class prediction is one of the major challenges in many areas of...
Methods issue 2/2010
IMIA White Paper on "Recommendations of the International Medical Informatics Association...
Methods issue 1/2010
Even if pervasive healthcare is in the phase of being consolidated as a new research discipline...