Site Under Construction

Assessing quality of systematic reviews in dermatology from the Philippines using AMSTAR 2

Rowena Natividad S. Flores-Genuino, MD, MSc, FPDS, Maria Christina Filomena R. Batac, MD, MSc, FPDS, Anne Julienne M. Genuino, RPh, MSc, Ian Theodore G. Cabaluna, MD

Abstract

Background

Quality systematic reviews (SRs) are essential in the practice of evidence-based dermatology. We assessed the methodologic quality of SRs in dermatology from the Philippines.

Methods

We searched databases (MEDLINE, CDSR, PROSPERO, HERDIN; from inception until June 30, 2019), and secondary sources. We included SRs, authored by Filipino primary authors, which included clinical trials on any intervention for the treatment or prevention of a dermatologic disease or for maintenance of healthy skin, hair or nails. Two reviewers independently extracted data and appraised the methodological quality of each included SR using the AMSTAR 2. The 16-item AMSTAR 2 has 7 critical items and 9 non-critical items. The number of critical items mainly determine the overall confidence in the results of the review. Descriptive analysis using means and standard deviation for continuous data, and frequency and percentage distribution for categorical data were employed.

 

Results

Twenty SRs were included in this review, and were mostly published in the 2010s. Majority of SRs had three authors, who belonged to a single institution, with at least one dermatologist. The most common topic was infections and both oral and topical interventions were used. Majority had 5 included studies in the SRs, with a median number of 425 participants. The median number of critical flaws in the included SRs was 4.5, and non-critical flaws, 5. Overall confidence was critically low in majority (19/20 ) of included reviews, with only one review rated as low.

 

Conclusion

The methodologic quality of the dermatology SRs from the Philippines based on the AMSTAR 2 tool was poor with a rating of critically low in majority. There is a need to improve quality of conduct and reporting through dissemination of the reporting guidelines such as the PRISMA

References

  1. Naldi L. Chapter 1. The field and its boundaries. In: Williams HC, ed. Evidence-Based Dermatology 3rd Ed. 3rd ed. West Sussex, UK: John Wiley & Sons, Ltd; 2014:3-5.
  2. Randolph JJ, Griffin AE, Zeiger SR, et al. A Methodological Review of the Articles Published in Georgia Educational Researcher from 2003-2010.;
    2011. https://files.eric.ed.gov/fulltext/ED525514.pdf.
  3. Phillips B, Ball C, Sackett D, et al. Levels of Evidence. Oxford Centre for Evidence-based Medicine.
  4. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009;6(7):e1000097. doi:10.1371/journal.pmed.1000097
  5. Ioannidis JPA. The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q. 2016;94(3):485-514.
  6. Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. Br Med J. 2017;358:1-9. doi:10.1136/bmj.j4008
  7. Gates A, Gates M, Duarte G, et al. Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: Protocol for a
    descriptive analytic study. 2018:1-7.
  8. Pussegoda K, Turner L, Garritty C, et al. Systematic review adherence to methodological or reporting quality. Syst Rev. 2017;6(131):1-14. doi:10.1186/s13643-017-0527-2
  9. Adie S, Ma D, Harris IA, Epi MC, Naylor JM, Craig JC. Quality of conduct and reporting of meta-analyses of surgical interventions. Ann Surg. 2015;261(4):685-694. doi:10.1097/SLA.0000000000000836
  10. Almeida MO, Yamato TP, Parreira P do CS, Costa LOP, Kamper S, Saragiotto BT. Overall confidence in the results of systematic reviews on exercise therapy for chronic low back pain: A cross-sectional analysis using the AMSTAR 2 tool. Brazilian J Phys Ther. 2019. doi:10.1016/j.bjpt.2019.04.004
  11. Panic N, Leoncini E, Belvis G De, Ricciardi W, Boccia S. Evaluation of the endorsement of the Preferred Reporting Items for Systematic Reviews and Meta- Analysis ( PRISMA ) Statement on the quality of published systematic review and meta-analyses. PLoS One. 2013;8(12):e83138. doi:10.1371/journal.pone.0083138
  12. Nawijn F, Ham WHW, Houwert RM, Groenwold RHH, Hietbrink F, Smeeing DPJ. Quality of reporting of systematic reviews and metaanalyses
    in emergency medicine based on the PRISMA statement. BMC Emerg Med. 2019;19(19):1-8.
  13. Li J, Ge L, Ma J, et al. Quality of reporting of systematic reviews published in “ evidence-based ” Chinese journals. Syst Rev. 2014;3(58):2-7.
    doi:10.1186/2046-4053-3-58
  14. Collier A, Heilig L, Schilling L, Williams H, Dellavalle RP. Cochrane Skin Group systematic reviews are more methodologically rigorous than
    other systematic reviews in dermatology. Epidemiol Heal Serv Res. 2006;155:1230-1235.
  15. Abalos-Babaran S, Barit J-VjG, Roa FDC. Five percent potassium hydroxide for the treatment of anogenital warts: A systematic review
    and meta-analysis. Acta Med Philipp. 2019;53(2):104-112.
  16. Ang-Tiu CU, Maano CC. Pimecrolimus 1 % cream for the treatment of seborrheic dermatitis: a systematic review of randomized controlled trials. Expert Rev Clin Pharmacol. 2012;5(1):91-97.
  17. Camaclang MLA, Caro-Chang LAM, Frez MLF. Combination of excimer laser and topical treatment for psoriasis: A systematic review and metaanalysis.
    Acta Med Philipp. 2019;53(2):113-121.
  18. Cua VCS, Paolo J, Villena DS, Lizarondo FPJ, Yap-Silva C. Azathioprine for the treatment of extensive forms of alopecia areata: A systematic
    review. Acta Med Philipp. 2019;53(2):132-141.
  19. de las Alas JMG. Pulsed dye laser for the treatment of keloid and hypertrophic scars: a systematic review. Expert Rev Med Devices. 2012;9(6):641-650.
  20. Dimabayu MC, Divino CM, Dorao LB, et al. Effectiveness of probiotics vs placebo as an adjunct therapy for children with atopic dermatitis: A meta-analysis. St Luke’s J Med. 2009;5(1):43-53.
  21. Flores-Genuino RNS, Dofitas BL, Dans LF, Amarillo MLE. Systematic review and meta-analysis on oral azoles for the treatment of pityriasis versicolor. Acta Med Philipp. 2019;53(1):21-30.
  22. Gatmaitan-Dumlao JKG, Sumilang FMP, Ciriaco-Tan CP. Low-dose systemic retinoids in preventing subsequent non-melanoma skin cancers (NMSC) in patients with history of NMSC: A systematic review. Acta Med Philipp. 2017;55(2):1-7.
  23. Intong LRA, Lim-Tiongco JB. Pimecrolimus 1 percent cream in the longterm management of atopic dermatitis in infants and children A metaanalysis. J Phil Dermatol Soc. 2004;13(1):38-42.
  24. Lim-Ong M dLS, Galutera R. Topical calcipotriol in combination with psoralen plus ultraviolet a in the treatment of vitiligo A meta-analysis. J Phil Dermatol Soc. 2002;11(1):51-54.
  25. Meghrajani CF, Co HCS, U CM, Roa FC. Topical corticosteroid therapy for the prevention of acute radiation dermatitis: a systematic review of randomized controlled trials. Expert Rev Clin Pharmacol 6(6),. 2013;6(6):641-649.
  26. Nacianceno PA, Camaclang MLA, Roa FDC. Intralesional measles, mumps, and rubella vaccine for cutaneous warts: A systematic review and meta-analysis. Acta Med Philipp. 2019;53(2):162-170.
  27. Ochoa-Nicolas ME, Tacastacas J, Roa FC. Systemic corticosteroid therapy in post-herpetic neuralgia A meta-analysis of randomized, placebo-controlled trials. J Phil Dermatol Soc. 1998;7(2):95-98.
  28. Pontejos PAZ, Uichanco HM V, Dofitas BL. Blue light for acne vulgaris: A systematic review. J Phil Dermatol Soc. 2009;18(2):2-8.
  29. Santiago BL. Effectiveness and safety of ten medicinal plants among Filipinos: A meta-analysis. Filip Fam Physician. 2004;42(1):9-22.
  30. Seguban JM, Uy-Reyes MA, Lim A, et al. Sulodexide as an adjunct for the management of venous ulcers: A meta-analysis. PJC. 2017;45(1):24-30.
  31. Sison MEGQ, Sumilang FMP, Frez MLF. Combination therapy versus monotherapy for moderate to severe chronic plaque psoriasis in adults. J Phil Dermatol Soc. 2017;26(1):36-45.
  32. Tan JT, Gosiengfiao VF. A meta-analysis on the efficacy of cimetidine for recalcitrant warts.pdf. J Phil Dermatol Soc. 2004;13(1):32-35.
  33. Uy CDC, Tababa EJL, Dofitas BL. Non-MDT treatment for paucibacillary leprosy: A systematic review and meta-analysis of randomized controlled trials. J Phil Dermatol Soc. 2017;26(2):22-29.
  34. Yang MFU, Abadilla JES. BCG vaccination against leprosy: A metaanalysis of all randomized controlled trials. PDS J. 1999:43-50.
  35. Roberts I, Ker K. How systematic reviews cause research waste. Lancet. 2015;386(10003):1536. doi:10.1016/S0140-6736(15)00489-4
  36. Atakpo P, Vassar M, Ph D. Publication bias in dermatology systematic reviews and meta-analyses. J Dermatol Sci. 2016:1-6. doi:10.1016/j.jdermsci.2016.02.005
  37. Dubben H. Systematic review of publication bias in studies on publication bias. 2005;331(AUGUST):433-434. doi:10.1136/bmj.38510.458218.8F
  38. Waffenschmidt S, Knelangen M, Sieben W, Bühn S, Pieper D. Single screening versus conventional double screening for study selection in systematic reviews: A methodological systematic review. BMC Med Res Methodol. 2019;19(132):1-9.
  39. Buscemi N, Hartling L, Vandermeer B, Tjosvold L, Klassen TP. Single data extraction generated more errors than double data extraction in
    systematic reviews. J Clin Epidemiol. 2006;59:697-703. doi:10.1016/j.jclinepi.2005.11.010

REquesting Permission

Assessing quality of systematic reviews in dermatology from the Philippines using AMSTAR 2