Study Validates Rapid Screening Tool for Plastic Surgery Meta-analyses

A newly published study suggests that a simple three-question screening tool may help clinicians quickly identify low-quality meta-analyses without relying on lengthy methodological assessments.

In a study published in the Aesthetic Surgery Journal, investigators evaluated the newly developed Meta-analysis Critique (MAC) Tool against AMSTAR 2, the current gold-standard instrument for assessing the methodological quality of systematic reviews and meta-analyses.

Screening Tool Shows High Specificity Against AMSTAR 2

Researchers searched MEDLINE and EMBASE for plastic surgery meta-analyses published between 2011 and 2023, identifying 283 eligible studies. Two independent reviewers evaluated each study using both the MAC Tool and AMSTAR 2.

Although the number of published meta-analyses increased substantially during the study period—rising from 68 studies (24%) in the first half of the study interval to 215 (76%) in the latter half—the proportion of high-quality publications remained unchanged.

When benchmarked against AMSTAR 2, the MAC Tool demonstrated high specificity across its three screening domains, including research question quality (100.0%; 95% CI, 90.97% to 100.00%), appropriateness of statistical analysis (96.23%; 95% CI, 87.02% to 99.54%), and risk-of-bias assessment (98.97%; 95% CI, 94.39% to 99.97%).

The investigators noted that the MAC Tool is intended to function as a rapid screening instrument rather than a replacement for comprehensive methodological evaluation. Instead, it may help clinicians efficiently identify meta-analyses that warrant closer scrutiny before incorporating findings into clinical decision-making.

"Taken together, we present a novel tool that simplifies assessment of plastic surgery literature and identifies poor quality meta-analyses but is not intended as a confirmatory quality assessment instrument," the authors wrote. "It has a high correlation with the gold-standard AMSTAR 2. Future studies should aim to validate this tool and determine its broader reliability in other specialties."¹

Source

Leveille CF, et al. Aesthet Surg J. Published online July 31, 2026. Doi:10.1093/asj/sjag162