Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

The quality of Cochrane systematic reviews of acupuncture: an overview

BMC Complementary Medicine and Therapies volume 20, Article number: 307 (2020) Cite this article

Abstract

Background

Many systematic reviews of clinical trials on acupuncture were performed within the Cochrane Collaboration, the evidence-based medicine (EBM) most recognized organization. Objective of the article was to systematically collect and identify systematic reviews of acupuncture published in the Cochrane Library and assess their quality from a methodological perspective.

Methods

A comprehensive literature search was performed in the Cochrane Database of Systematic Reviews to identify the reviews of acupuncture conducted until June 2019. The methodological quality of the included reviews was assessed using the AMSTAR 2 checklist, an evaluation tool for systematic reviews.

Results

Out of a total of 126 eligible reviews, 50 systematic reviews were included. According to the AMSTAR 2, 52% of Cochrane Systematic Reviews (CSRs) were of low quality, due to the presence of one or more weaknesses in at least one of the domains defined as critical for the methodological quality assessment. The less satisfied critical domain was inadequate investigation and discussion of publication bias. Declaration of potential sources of conflict of interest, and funding of the authors of the review and of the included studies were other important weaknesses.

Conclusions

The main methodological flaws in the included CSRs were related to topics of relatively new concern in the conduction of systematic reviews of the literature. However, both, lack of attention about retrieval of negative studies, and statements about conflict of interests are crucial point for the evaluation of therapeutic interventions according to EBM methodology.

Peer Review reports

Background

Acupuncture represents, together with herbal medicine, the main treatment used in Traditional Chinese Medicine (TCM). TCM has been practiced for thousands of years and is widely used in Western countries. Nevertheless, there is still debate on the efficacy of acupuncture according to the evidence-based medicine (EBM) paradigm. In the literature, different, sometimes conflicting, results have been published for different conditions [1,2,3,4]. Different results might come from different study designs, different interventions, and different settings.

Systematic reviews can provide objective and reliable evidence, which is useful for clinical practice. Cochrane Systematic Reviews (CSRs) are regarded as the highest level of evidence; however, although they represent the best quality systematic reviews, it cannot be excluded that CSRs on acupuncture could present some methodological flaws [5]. Since 1998, the Cochrane Database of Systematic Reviews (CDSR) has included many systematic reviews of acupuncture. The aim of this study was to systematically collect systematic reviews of acupuncture published in the Cochrane Library and to assess their methodological quality.

Methods

All eligible acupuncture-related systematic reviews in CDSR, up to June 2019, were searched. The searching query was “Acupuncture [Mesh] or Acupuncture [title, abstract, keywords]”.

All types of acupuncture were included, such as “acupuncture”, “auricular acupuncture”, “electro acupuncture”, “scalp acupuncture”, “manual acupuncture (needle acupuncture)”, “warming needle (heat needle)”, “laser acupuncture”, “acupressure” and “injection acupuncture”. All outcome measures were eligible for inclusion in this review. Protocols of CSRs and withdrawn systematic reviews were excluded.

The extracted data included: title, author, nationality, year of publication, author’s affiliation, type of disease, type of literature included, interventions, adverse reactions, outcome measures, literature searching database, update, literature quality assessment of clinical trials and study result (positive / negative).

Two reviewers (Zhaochen Ji and Na Li) extracted the data and cross-checked the consistency; disagreements were resolved by discussion with a third researcher (Junhua Zhang).

The methodological quality of CSRs was assessed using the AMSTAR 2 tool (A MeaSurement Tool to Assess Systematic Reviews) [6]. The AMSTAR 2 checklist requires reviewers to answer: 1) yes, 2) no, 3) partial yes or 4) no meta-analysis conducted, on 16 items or domains. Seven of the 16 items are by default labeled as “Critical domains” because they can critically affect the validity of a review and its conclusions, the “Critical domains” 2, 4, 7, 9, 11, 13, and 15 are shown in Table 1. As recommended by AMSTAR 2 authors, we rated the overall quality of each included review on the basis of four levels: High (No or one non-critical weakness: the systematic review provides an accurate and comprehensive summary of the results of the available studies that address the question of interest), Moderate (More than one non-critical weakness: the systematic review has more than one weakness but no critical flaws and it may provide an accurate summary of the results of the available studies that were included in the review), Low (One critical flaw with or without non-critical weaknesses: the review has a critical flaw and may not provide an accurate and comprehensive summary of the available studies that address the question of interest), Critically low (More than one critical flaw with or without non-critical weaknesses: the review has more than one critical flaw and should not be relied on to provide an accurate and comprehensive summary of the available studies) [6].

Table 1 Critical domains of AMSTAR 2
Full size table

Results

Literature search

Using the described searching strategy, we obtained 126 potentially relevant reviews. Sixty-nine reviews were excluded because the intervention was not “acupuncture”. Fifty-seven reviews were identified; of these, 2 reviews were withdrawn by the authors because “new citations are required and conclusions have changed” and because “the authors of this review have been unable to complete the update within the recommended two-year period”; 5 reviews from China were in preparation and only the protocol were present in the database. Finally, 50 CSRs were included (Fig. 1).

Fig. 1
figure 1

Flowchart of CSR selection

Full size image

The characteristics of the included CSRs are described in Table S1 [7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56].

All types of studies included in the CSRs were RCTs. In the 50 concluded reviews, a total of 837 RCTs with 92,903 participants (range 33–7667) were included.

The included CSRs were published from 2002 to June 2019, at an average of 3 published CSRs each year, with a peak of 8 CSRs published in 2018. Regarding the geographical distribution of the first author: 19 (38%) were from China, 13 (26%) were from Australia, 5 (10%) were from UK, and the remaining authors were from United States, Canada, South Korea, and Germany.

With reference to the year of publication in the Cochrane database, only 13 reviews were updated within 5 years after publication [8,9,10,11, 13, 31, 36,37,38, 43, 49, 51, 54].

The number of databases used for literature search in the included CSRs varied from 3 to 28 (mean: 9). All the included systematic reviews searched databases in English, while 31 reviews (62%) also searched Chinese databases. Among the English databases, EMBASE was the most searched (48 reviews), while MEDLINE was searched in 47 reviews. The Chinese databases searched were China National Knowledge Infrastructure [CNKI] (in 18 reviews), Vip Chinese science and technology journal database [VIP] (in 16 reviews), and SinoMed (in 15 reviews). The search frequencies of all the English and Chinese databases are shown in Table 2.

Table 2 English and Chinese databases searched
Full size table

The quality of the RCTs in the included CSRs was evaluated using different tools: 39 reviews referred to the bias risk assessment tool recommended by the Cochrane Handbook for Systematic Reviews, 2 reviews referred to the Jadad scale [17, 37], and one review referred to both [50]. In 8 reviews, the methodological quality assessment tools were not explicitly reported [8, 18, 20,21,22, 28, 54, 55].

Treated conditions

The included CSRs focused on 50 different diseases or conditions. Eight reviews (16%) evaluated acupuncture for joint and muscle pain [8, 18, 20, 22, 23, 25, 34, 36], 5 reviews (9%) for obstetrics [11, 16, 41, 42, 44], 5 reviews (9%) for gynecological diseases [7, 31, 32, 43, 56], 3 reviews (4%) for stroke [51, 52, 54] and 2 reviews (4%) for smoking cessation [21, 48] The other diseases are listed in Table S1.

Acupuncture techniques

Eighteen (35%) CSRs did not define and describe the acupuncture technique used, while in the remaining CSRs, several types of acupuncture were employed. The 19 different acupuncture techniques used were summarized in four categories (Table 3).

Table 3 The types and frequency of acupuncture interventions
Full size table

The first category included traditional acupuncture, which consists of insertion of acupuncture needles in specific body points according to the traditional meridian theory. In clinical practice, small electrical charge and moxibustion are commonly added to traditional acupuncture (electroacupuncture and warm acupuncture). The second category of acupuncture included stimulation of defined body regions and points different from the traditional meridian theory, such as: scalp, dermal, face, tongue and ear. The third category was related to non-penetrated acupoint stimulation (meaning that no needle penetrates into the skin), such as acupressure, surface electrical stimulation, laser needle, magnetic needle, and moxibustion. The fourth category included other stimulations, such as acupoint bloodletting, intradermal needling, acupoint injection and embedding acupuncture. The interventions and controls are shown in Table S2.

Outcomes and safety

In terms of the reported outcomes, different acupuncture types used for different conditions produced different results. The majority of outcomes were related to improvement in quality of life (60%) and pain relief (32%).

The conclusions of included CSRs can be summarized into four categories: 1) thirty-two reviews (64%) concluded that the evidence was not sufficient or the level of evidence was not adequate; 2) seven reviews (14%) reported positive results and found acupuncture to be effective in the treatment of chronic kidney disease [26], induction of labor [42], episodic migraine [32], tension-type headache [33], fibromyalgia [18], pain in childbirth [41], and nausea and vomiting after surgery [30]; 3) ten reviews (20%) reported “potential efficacy” for acute management and rehabilitation of traumatic brain injury [49], endometrial pain [56], osteoarthritis [34], schizophrenia [39], post stroke rehabilitation [52] breech presentation [16], side effects of chemotherapy or radiotherapy in persons with cancer [55], acute stroke [51], induction of labour [44], premenstrual syndrome [7]; and 4) one review reported negative results for irritable bowel syndrome [35].

With regard to acupuncture safety, 24 reviews (48%) reported adverse events in the included RCTs, eleven reviews (22%) did not report information about adverse events [8, 20, 22, 32,33,34, 37, 41, 42, 48, 50], and 15 reviews (30%) reported no adverse events [7, 9, 11, 17, 18, 21, 26, 28, 29, 38,39,40, 43, 49, 56]. Regarding the main adverse events, 9 reviews reported unbearable pain or pain caused by anxiety [12, 13, 15, 16, 36, 47, 51, 52, 54]; 5 reviews reported headache, dizziness or even syncope [14, 16, 23, 35, 51]; 2 reviews reported local infection [10, 23]; 3 reviews reported local fever or swelling [10, 31, 47]; 2 reviews reported blood stasis [19, 31]; one review reported allergy [30]; and one review reported ear irritation [47].

Quality assessment

The evaluation of CSRs using the AMSTAR 2 scale is presented in Table S3.

Almost half of CSRs were of high or medium quality: 8 CSRs (16%) were assessed as high quality, and 16 CSRs (32%) were assessed as medium quality. The highest quality CSRs were related to neuropathic pain in adults [24], glaucoma [29], postoperative nausea and vomiting [30], acute hordeolum [10], premenstrual syndrome [7], carpal tunnel syndrome [15], symptomatic gastroparesis [38] and depression [45].

Analyzing Table S3 by column (Fig. 2), we could discriminate met and unmet items, which highlighted some critical methodological issues.

Fig. 2
figure 2

Percentage of AMSTAR scores by item (N = 50)

Full size image

Six of the 16 AMSTAR 2 items were met by all the CSRs included in our study: critical domain 2 (pre-specification of the review protocol); critical domain 7 (justification for study exclusion); domain 8 (description of the included studies); critical domain 11 (appropriateness of meta-analytical methods); domain 12 (assessing of the potential impact of risk of bias); critical domain 13 (consideration of the risk of bias when interpreting the results of the review). In contrast, four items of the AMSTAR 2 were less commonly met, thus indicating some methodological weaknesses: 1) for domain 3 (explanation for the study design inclusion) (6.0%); 2) for domain 10 (reporting the sources of funding) (38.0%); 3) for critical domain 15 (investigation and discussion of publication bias) (52%); 4) for domain 16 (reporting of potential sources of conflict of interest) (48%).

Discussion

For this overview, we identified and analyzed 50 acupuncture-related CSRs published up to June 2019. Many of the included systematic reviews were updated, starting from 1998 [32, 37]. The methodological quality of the systematic reviews included in the Cochrane library, assessed using the AMSTAR 2 tool, was medium to high in 48% of the included CSRs, according to the rating overall confidence in the results of the reviews. More than half of the reviews were of low quality, due to the presence of one or more weaknesses in at least one critical domain. The less satisfied critical domain of the AMSTAR 2 evaluation tool was the adequate investigation of publication bias (critical domain 15). However, regarding the assessment of publication bias a negative evaluation can be attributed to the year of publication (before 2007 assessment of publication bias was not common) and the number of trials included in the review: a minimum of 10 trials are usually required to perform a funnel plot, a graphical tool used to describe the presence of publication bias. In general, publication bias is a well-known issue in the Chinese literature [57,58,59].

Only 2 reviews resulted of critically low quality, both conducted and published in the early 2000s (2003 and 2005), with the following unmet critical domains of AMSTAR 2: comprehensive literature search; risk of bias, in particular publication bias.

However, the AMSTAR 2 evaluation pointed out some particular issues associated with the CSRs on acupuncture. In 8% of the reviews, authors did not use a comprehensive literature search strategy. Although most of the acupuncture RCTs were published in China, Chinese literature databases were not always searched, likely due to language limitations and accessibility of Chinese databases.

With regard to non-critical domain of the AMSTAR 2, the less met domains were number 10 (38%) and number 16 (48%), related respectively to funding and conflict of interest. In many of the studies included in the reviews, funding sources were not declared, this issue was also not often reported, so as the potential conflict of interest of authors that conducted the reviews.

In order to investigate if there was an improvement in the quality of newer reviews with regard to older ones, two sensitivity analyses were performed evaluating reviews published after 2010 and after 2015. In the first analysis 41 reviews were selected and the percentage of medium to high quality was increased to 56%, with a further increase to 65% in the last 5-year period. However, publication bias still remains the main issue to deal with. Five reviews did not adequately investigate or discuss the risk of publication bias, even if the number of included clinical trials were over the minimum number of 10 studies usually required.

Lack of retrieval of negative studies in the literature is a crucial point for the evaluation of therapeutic interventions according to EBM methodology; thus, more efforts should be put in the retrieval of grey literature and negative results. To advance in science a cultural change is needed, negative results are as important as positive ones to improve knowledge on efficacy of treatments.

Due to the large variety of intervention/control measures and outcomes in each CSR, it is difficult to reach general conclusions about clinical efficacy of acupuncture. However, according to the results of some CSRs, acupuncture seems to produce more positive effects than sham acupuncture or no treatment for pain or quality of life.

Comparing CSRs of acupuncture in the past five years (2015–2019) with CSRs of acupuncture in the preceding years, we can find an increase of more than 10% in the coincidence rate of 9 of 16 items (1, 3, 4, 9, 10, 11, 12, 15, 16); among them, the items 10, 15 and 16 had an increase of more than 35%, and the items 4, 11 and 12 of more than 20%. Meanwhile, the coincidence rate of 3 items (5, 6, 14) has decreased, particularly item 6 with a decrease of more than 30%.

Since the large time span considered in this overview, the low quality rating of early published researches can be explained by the different methodological quality standards required in the preceding years. Improved standards in methodological evaluation can enhance the quality of CSRs and, in fact, the quality of acupuncture CSRs is increasing over time. On the basis of the quality evaluation performed in this article, we believe that some points are worthy of consideration and improvement, in particular:

explanation for the study design inclusion, reporting of the sources of funding, investigation and discussion of publication bias, reporting of potential sources of conflict of interest.

A more comprehensive search strategy including as much databases and languages as possible, especially Chinese, should be encouraged. International and interdisciplinary collaboration should be promoted when dealing with traditional medicines (e.g. Acupuncture) to integrate EBM methodology. Last but not least, the researchers should regularly update systematic reviews with the best methodological standards to improve quality overtime.

Limitation

Since this study conducted a quality assessment of systematic reviews included in the Cochrane Library, it does not consider all the systematic reviews conducted on acupuncture. To avoid a misleading generalization, this limitation should be taken into consideration.

Conclusions

In general, only half of the included CSRs were of medium to high quality according to the AMSTAR 2 evaluation tool, the main flaw being publication bias evaluation and discussion. Publication bias is very common in the Chinese literature and only in more recent years it has started to be considered, together with conflict of interest declarations and funding sources. Improvements in the evaluation of traditional Chinese medicine according to EBM methodology can promote the interdisciplinary collaboration and the quality of the studies.

Availability of data and materials

Please refer to the supporting Information.

Abbreviations

CSR:

Cochrane Systematic Review

EBM:

Evidence-Based Medicine

TCM:

Traditional Chinese Medicine

CDSR:

Cochrane Database of Systematic Reviews

References

  1. Hinman RS, McCrory P, Pirotta M, et al. Acupuncture for chronic knee pain: a randomized clinical trial. JAMA. 2014;312:1313–22. https://doi.org/10.1001/jama.2014.12660.

    Article  CAS  PubMed  Google Scholar 

  2. Baxter GD, Tumilty S. Treating chronic knee pain with acupuncture. JAMA. 2015;313:626–7. https://doi.org/10.1001/jama.2014.18511.

    Article  PubMed  Google Scholar 

  3. Zhao L, Chen J, Li Y, et al. The long-term effect of acupuncture for migraine prophylaxis: a randomized clinical trial. JAMA Intern Med. 2017;177:508–15. https://doi.org/10.1001/jamainternmed.2016.9378.

    Article  PubMed  Google Scholar 

  4. Liu Z, Liu Y, Xu H, et al. Effect of Electroacupuncture on urinary leakage among women with stress urinary incontinence: a randomized clinical trial. JAMA. 2017;317:2493–501. https://doi.org/10.1001/jama.2017.7220.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Hu J, Zhang J, Zhao W, et al. Cochrane systematic reviews of Chinese herbal medicines: an overview. PLoS One. 2011;6:e28696. https://doi.org/10.1371/journal.pone.0028696.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. https://doi.org/10.1136/bmj.j4008.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Armour M, Ee CC, Hao J, et al. Acupuncture and acupressure for premenstrual syndrome. Cochrane Database Syst Rev. 2018;8:CD005290. https://doi.org/10.1002/14651858.CD005290.pub2.

    Article  PubMed  Google Scholar 

  8. Casimiro L, Barnsley L, Brosseau L, et al. Acupuncture and electroacupuncture for the treatment of rheumatoid arthritis. Cochrane Database Syst Rev Published Online First. 2005. https://doi.org/10.1002/14651858.CD003788.pub2.

  9. Chen N, Zhou M, He L, et al. Acupuncture for Bell’s palsy. Cochrane Database Syst Rev Published Online First. 2010. https://doi.org/10.1002/14651858.CD002914.pub5.

  10. Cheng K, Law A, Guo M, et al. Acupuncture for acute hordeolum. Cochrane Database Syst Rev Published Online First. 2017. https://doi.org/10.1002/14651858.CD011075.pub2.

  11. Cheong YC, Dix S, Ng EHY, et al. Acupuncture and assisted reproductive technology. Cochrane Database Syst Rev Published Online First. 2013. https://doi.org/10.1002/14651858.CD006920.pub3.

  12. Cheuk DK, Wong V, Chen WX. Acupuncture for autism spectrum disorders (ASD). Cochrane Database Syst Rev Published Online First. 2011. https://doi.org/10.1002/14651858.CD007849.pub2.

  13. Cheuk DK, Yeung W-F, Chung KF, et al. Acupuncture for insomnia. Cochrane Database Syst Rev Published Online First. 2012. https://doi.org/10.1002/14651858.CD005472.pub3.

  14. Cheuk DK, Wong V. Acupuncture for epilepsy. Cochrane Database Syst Rev Published Online First. 2014. https://doi.org/10.1002/14651858.CD005062.pub4.

  15. Choi G-H, Wieland LS, Lee H, et al. Acupuncture and related interventions for the treatment of symptoms associated with carpal tunnel syndrome. Cochrane Database Syst Rev Published Online First. 2018. https://doi.org/10.1002/14651858.CD011215.pub2.

  16. Coyle ME, Smith CA, Peat B. Cephalic version by moxibustion for breech presentation. Cochrane Database Syst Rev Published Online First. 2012. https://doi.org/10.1002/14651858.CD003928.pub3.

  17. Cui Y, Wang Y, Liu Z. Acupuncture for restless legs syndrome. Cochrane Database Syst Rev Published Online First. 2008. https://doi.org/10.1002/14651858.CD006457.pub2.

  18. Deare JC, Zheng Z, Xue CC, et al. Acupuncture for treating fibromyalgia. Cochrane Database Syst Rev Published Online First. 2013. https://doi.org/10.1002/14651858.CD007070.pub2.

  19. Dodin S, Blanchet C, Marc I, et al. Acupuncture for menopausal hot flushes. Cochrane Database Syst Rev Published Online First. 2013. https://doi.org/10.1002/14651858.CD007410.pub2.

  20. Furlan AD, van Tulder MW, Cherkin D, et al. Acupuncture and dry-needling for low back pain. Cochrane Database Syst Rev Published Online First. 2005. https://doi.org/10.1002/14651858.CD001351.pub2.

  21. Gates S, Smith LA, Foxcroft D. Auricular acupuncture for cocaine dependence. Cochrane Database Syst Rev Published Online First. 2006. https://doi.org/10.1002/14651858.CD005192.pub2.

  22. Green S, Buchbinder R, Barnsley L, et al. Acupuncture for lateral elbow pain. Cochrane Database of Systematic Reviews Published Online First. 2002. https://doi.org/10.1002/14651858.CD003527.

  23. Green S, Buchbinder R, Hetrick SE. Acupuncture for shoulder pain. Cochrane Database of Systematic Reviews Published Online First. 2005. https://doi.org/10.1002/14651858.CD005319.

  24. Ju ZY, Wang K, Cui HS, et al. Acupuncture for neuropathic pain in adults. Cochrane Database Syst Rev Published Online First. 2017. https://doi.org/10.1002/14651858.CD012057.pub2.

  25. Kim T-H, Lee MS, Kim KH, et al. Acupuncture for treating acute ankle sprains in adults. Cochrane Database Syst Rev Published Online First. 2014. https://doi.org/10.1002/14651858.CD009065.pub2.

  26. Kim KH, Lee MS, Kim T-H, et al. Acupuncture and related interventions for symptoms of chronic kidney disease. Cochrane Database Syst Rev Published Online First. 2016. https://doi.org/10.1002/14651858.CD009440.pub2.

  27. Kim KH, Lee MS, Choi T-Y, et al. Acupuncture for symptomatic gastroparesis. Cochrane Database Syst Rev Published Online First. 2018. https://doi.org/10.1002/14651858.CD009676.pub2.

  28. Lan L, Zeng F, Liu GJ, et al. Acupuncture for functional dyspepsia. Cochrane Database Syst Rev Published Online First. 2014. https://doi.org/10.1002/14651858.CD008487.pub2.

  29. Law SK, Li T. Acupuncture for glaucoma. Cochrane Database Syst Rev Published Online First. 2013. https://doi.org/10.1002/14651858.CD006030.pub3.

  30. Lee A, Chan SK, Fan LT. Stimulation of the wrist acupuncture point PC6 for preventing postoperative nausea and vomiting. Cochrane Database Syst Rev Published Online First. 2015. https://doi.org/10.1002/14651858.CD003281.pub4.

  31. Lim CED, Ng RW, Xu K, et al. Acupuncture for polycystic ovarian syndrome. Cochrane Database Syst Rev Published Online First. 2016. https://doi.org/10.1002/14651858.CD007689.pub3.

  32. Linde K, Allais G, Brinkhaus B, et al. Acupuncture for the prevention of episodic migraine. Cochrane Database Syst Rev Published Online First. 2016. https://doi.org/10.1002/14651858.CD001218.pub3.

  33. Linde K, Allais G, Brinkhaus B, et al. Acupuncture for the prevention of tension-type headache. Cochrane Database Syst Rev Published Online First. 2016. https://doi.org/10.1002/14651858.CD007587.pub2.

  34. Manheimer E, Cheng K, Linde K, et al. Acupuncture for peripheral joint osteoarthritis. Cochrane Database Syst Rev. 2010:CD001977. https://doi.org/10.1002/14651858.CD001977.pub2.

  35. Manheimer E, Cheng K, Wieland LS, et al. Acupuncture for treatment of irritable bowel syndrome. Cochrane Database Syst Rev. 2012. https://doi.org/10.1002/14651858.CD005111.pub3.

  36. Manheimer E, Cheng K, Wieland LS, et al. Acupuncture for hip osteoarthritis. Cochrane Database Syst Rev Published Online First. 2018. https://doi.org/10.1002/14651858.CD013010.

  37. McCarney RW, Brinkhaus B, Lasserson TJ, et al. Acupuncture for chronic asthma. Cochrane Database Syst Rev Published Online First. 2003. https://doi.org/10.1002/14651858.CD000008.pub2.

  38. Paley CA, Johnson MI, Tashani OA, et al. Acupuncture for cancer pain in adults. Cochrane Database Syst Rev Published Online First. 2015. https://doi.org/10.1002/14651858.CD007753.pub3.

  39. Shen X, Xia J, Adams CE. Acupuncture for schizophrenia. Cochrane Database Syst Rev Published Online First. 2014. https://doi.org/10.1002/14651858.CD005475.pub2.

  40. Smith CA, Hay PP, MacPherson H. Acupuncture for depression. Cochrane Database Syst Rev Published Online First. 2010. https://doi.org/10.1002/14651858.CD004046.pub3.

  41. Smith CA, Collins CT, Crowther CA, et al. Acupuncture or acupressure for pain management in labour. Cochrane Database Syst Rev Published Online First. 2011. https://doi.org/10.1002/14651858.CD009232.

  42. Smith CA, Crowther CA, Grant SJ. Acupuncture for induction of labour. Cochrane Database Syst Rev Published Online First. 2013. https://doi.org/10.1002/14651858.CD002962.pub3.

  43. Smith CA, Armour M, Zhu X, et al. Acupuncture for dysmenorrhoea. Cochrane Database Syst Rev Published Online First. 2016. https://doi.org/10.1002/14651858.CD007854.pub3.

  44. Smith CA, Armour M, Dahlen HG. Acupuncture or acupressure for induction of labour. Cochrane Database Syst Rev Published Online First. 2017. https://doi.org/10.1002/14651858.CD002962.pub4.

  45. Smith CA, Armour M, Lee MS, et al. Acupuncture for depression. Cochrane Database Syst Rev Published Online First. 2018. https://doi.org/10.1002/14651858.CD004046.pub4.

  46. Wang Y, Zhishun L, Peng W, et al. Acupuncture for stress urinary incontinence in adults. Cochrane Database Syst Rev Published Online First. 2013. https://doi.org/10.1002/14651858.CD009408.pub2.

  47. Wei ML, Liu JP, Li N, et al. Acupuncture for slowing the progression of myopia in children and adolescents. Cochrane Database Syst Rev Published Online First. 2011. https://doi.org/10.1002/14651858.CD007842.pub2.

  48. White AR, Rampes H, Liu JP, et al. Acupuncture and related interventions for smoking cessation. Cochrane Database Syst Rev Published Online First. 2014. https://doi.org/10.1002/14651858.CD000009.pub4.

  49. Wong V, Cheuk DK, Lee S, et al. Acupuncture for acute management and rehabilitation of traumatic brain injury. Cochrane Database Syst Rev Published Online First. 2013. https://doi.org/10.1002/14651858.CD007700.pub3.

  50. Xie Y, Wang L, He J, et al. Acupuncture for dysphagia in acute stroke. Cochrane Database Syst Rev Published Online First. 2008. https://doi.org/10.1002/14651858.CD006076.pub2.

  51. Xu M, Li D, Zhang S. Acupuncture for acute stroke. Cochrane Database Syst Rev Published Online First. 2018. https://doi.org/10.1002/14651858.CD003317.pub3.

  52. Yang A, Wu HM, Tang J-L, et al. Acupuncture for stroke rehabilitation. Cochrane Database Syst Rev Published Online First. 2016. https://doi.org/10.1002/14651858.CD004131.pub3.

  53. Yang J, Chen J, Yang M, et al. Acupuncture for hypertension. Cochrane Database Syst Rev Published Online First. 2018. https://doi.org/10.1002/14651858.CD008821.pub2.

  54. Zhang S, Liu M, Asplund K, et al. Acupuncture for acute stroke. Cochrane Database Syst Rev Published Online First. 2005. https://doi.org/10.1002/14651858.CD003317.pub2.

  55. Zhang HW, Lin ZX, Cheung F, et al. Moxibustion for alleviating side effects of chemotherapy or radiotherapy in people with cancer. Cochrane Database Syst Rev Published Online First. 2018. https://doi.org/10.1002/14651858.CD010559.pub2.

  56. Zhu X, Hamilton KD, McNicol ED. Acupuncture for pain in endometriosis. Cochrane Database Syst Rev Published Online First. 2011. https://doi.org/10.1002/14651858.CD007864.pub2.

  57. Liu Y. Third party evaluation and monitoring of publication bias for meta-analysis in CSCD core library medical journals. Nanchang University 2018;(D).

    Google Scholar 

  58. Fu S, Zhang J, Menniti-Ippolito F, et al. Huangqi injection (a traditional Chinese patent medicine) for chronic heart failure: a systematic review. PLoS One. 2011;6:e19604. https://doi.org/10.1371/journal.pone.0019604.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  59. Zhang JH, Menniti-Ippolito F, Gao XM, et al. Complex traditional Chinese medicine for Poststroke motor dysfunction: a systematic review. Stroke. 2009;40:2797–804. https://doi.org/10.1161/STROKEAHA.109.555227.

    Article  Google Scholar 

Download references

Acknowledgements

The study was conducted in collaboration with researchers of the Italian National Institute of Health in the framework of the Joint Sino-Italian Laboratory on Traditional Chinese Medicine.

Thanks to the authors of the published Cochrane system review of acupuncture to provide primary data.

We would like to express our sincere gratitude to the BMC Complementary Medicine and Therapies Editorial Office for his continued providing services and assistance to the author during the COVID-19 outbreak.

Funding

This overview was funded from the Tianjin Government Youth Talents Project (201504 Junhua Zhang)/ Tianjin Government education commission ‘the 13th five-year plan’ innovation team training plan- Traditional Chinese Medicine Clinical Evaluation Method (TD13–5047 Junhua Zhang), and authors have had full control of all primary data.

Author information

Authors and Affiliations

  1. Evidence-Based Medicine Center, Tianjin University of Traditional Chinese Medicine, Tianjin, China

    Zhaochen Ji, Junhua Zhang, Fengwen Yang & Mingyan Zhang

  2. Italian National Institute of Health, Rome, Italy

    Francesca Menniti-Ippolito, Marco Massari & Alice Josephine Fauci

  3. School of Social and Political Sciences, Institute of health and wellbeing, University of Glasgow, Glasgow, UK

    Na Li

Authors
  1. Zhaochen Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junhua Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Francesca Menniti-Ippolito
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marco Massari
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alice Josephine Fauci
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Na Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Fengwen Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Mingyan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ZJ, JZ, NL, FY, MZ: Retrieved, read and evaluated the literature and draft the manuscript. FMI, MM, AJF: Revised the findings, validated the AMSTAR 2 evaluation and wrote the final version of the article. All authors have read and approved this manuscript.

Corresponding authors

Correspondence to Junhua Zhang or Francesca Menniti-Ippolito.

Ethics declarations

Ethics approval and consent to participate

This study is an overview of the literature, thus, ethics approval was not needed.

Consent for publication

The study group consented to publish.

Competing interests

We declare that we have no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1 Table S1

. Characteristics of the 50 included Cochrane Systematic Reviews [1,2,3,4,5,6]. Table S2. The interventions and controls table. Table S3. AMSTAR-2 scale (*) [table fully updated no track changes used].

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ji, Z., Zhang, J., Menniti-Ippolito, F. et al. The quality of Cochrane systematic reviews of acupuncture: an overview. BMC Complement Med Ther 20, 307 (2020). https://doi.org/10.1186/s12906-020-03099-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12906-020-03099-9

Keywords

BMC Complementary Medicine and Therapies

ISSN: 2662-7671

Contact us