Assessing the effectiveness of metaHelper

Abstract

Objectives: To test whether the use of a web application (www.metaHelper.eu) can reduce errors and time needed for statistical transformations commonly performed for meta-analysis. Study Design and Setting: We developed an R package and a corresponding web application to streamline statistical transformations in meta-analysis. A parallel randomized controlled trial following the Consolidated Standards of Reporting Trials guidelines was conducted. The trial was preregistered, and ethical approval was obtained from the University of Krems' ethics committee. We conducted a parallel randomized controlled trial with 26 participants, including researchers and students with varying levels of statistical expertise. Participants performed six statistical calculations commonly used in meta-analysis: computing pooled standard deviations, converting standard errors, and calculating standardized mean differences for both 2-group and 3-arm studies. Performance was evaluated based on accuracy and time taken to complete each task. A Bayesian mixed-effects model was used to analyze the results. Participants were randomly assigned to either the experimental group (metaHelper) or the control group (allowed to use internet sources, the Cochrane Handbook, or Results: Main outcomes were correctness of calculations and time taken to complete tasks. The metaHelper group had a higher probability of providing correct answers (85%) compared to the control group (31%). Additionally, the metaHelper group completed an average Conclusion: MetaHelper effectively enhances the accuracy and efficiency of statistical transformations required for meta-analysis. (c) 2024 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/