Skip to main content
Download PDF

Reporting items for systematic reviews and meta-analyses of acupuncture: the PRISMA for acupuncture checklist

BMC Complementary and Alternative Medicine volume 19, Article number: 208 (2019) Cite this article

Abstract

Background

Acupuncture is widely used worldwide, and systematic reviews on acupuncture are increasingly being published. Although acupuncture systematic reviews share several essential elements with other systematic reviews, some essential information for the application of acupuncture is not covered by the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement. Considering this, we aimed to develop an extension of the PRISMA statement for acupuncture systematic reviews.

Methods

We used the PRISMA statement as a starting point, and conducted this study referring to the development strategy recommended by the EQUATOR network. The initial items were collected through a wide survey among evidence users and a review of relevant studies. We conducted a three-round Delphi survey and one-day face-to-face meeting to select items and formulate the checklist. After the consensus meeting, we drafted the manuscript (including the checklist) and sent it to our advisory experts for comments, following which the checklist was refined and circulated to a group of acupuncture systematic review authors for pilot test. We also selected a sample of acupuncture systematic reviews published in 2017 to test the checklist.

Results

A checklist of five new sub-items (including sub items) and six modified items was formulated, involving content related to title, rationale, eligibility criteria, literature search, data extraction, and study characteristics. We clarified the rationales of the items and provided examples for each item for additional guidance.

Conclusion

The PRISMA for Acupuncture checklist is developed for improving the reporting of systematic reviews of acupuncture interventions.

Trial registration

We have registered the study on the EQUATOR network (http://www.equator-network.org/library/reporting-guidelines-under-development/#91).

Peer Review reports

Background

Having been applied for thousands of years for prevention, treatment and rehabilitation for various diseases, acupuncture is currently used in more than 140 countries worldwide [1,2,3]. With a large number of randomized controlled trials and systematic reviews of acupuncture published every year, the importance to improve reporting quality of acupuncture studies has been highlighted by stakeholders including both researchers and users of acupuncture evidence. The reporting quality of clinical trials of acupuncture has improved after the implementation of STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA) [4, 5], but no reporting standards for acupuncture systematic reviews have been established yet.

The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) has been developed and is used by academic institutions and journals worldwide to promote the reporting quality of systematic reviews and meta-analyses [6, 7]. Extensions of PRISMA, such as PRISMA for Harms (for reviews including harm outcomes), Protocols, Equity, Abstracts, Individual Patient Data, and Network meta-analyses [8,9,10,11,12], are continuously being developed and published for reporting important aspects in these reviews. Systematic reviews of acupuncture share some essential elements with reviews of other topics. Some areas, such as the types of acupuncture, the selection of acupoints, depth and duration, are however not covered by PRISMA, although they are vital for evidence users to understand the intervention process, for guideline developers to formulate practical recommendations, and for clinical professionals to implement acupuncture in practice [13,14,15,16]. We therefore aimed to develop a reporting checklist for acupuncture systematic reviews and meta-analyses (PRISMA for Acupuncture) based on the PRISMA statement.

Aim and scope

The aim of the PRISMA for Acupuncture checklist is to optimize reporting of systematic reviews focusing on acupuncture interventions for specific conditions. The main group of target users of PRISMA for Acupuncture are authors of systematic reviews on acupuncture, journal editors, peer reviewers and methodologists. We hope this checklist is a useful and practical tool for these audiences and will improve reporting and usability of systematic reviews on acupuncture.

Methods

The PRISMA for Acupuncture working group registered the project on the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network [17]. We used the PRISMA statement as a starting point, and conducted this study referring to the EQUATOR guidance for developing health research reporting guidelines [18]. The selection of items consisted of three steps: 1) collecting and framing the initial items, 2) scoring and selecting the items by experts through Delphi consensus; and 3) discussing and approving the checklist in a face-to-face meeting. The advisory experts provided comments to revise the checklist and manuscript, and pilot tests were applied to seek feedback to refine the final checklist. (Fig. 1).

Fig. 1
figure 1

The development process of the PRISMA for Acupuncture checklist

Full size image

Selection of the initial items

After establishing the PRISMA for Acupuncture working group, we conducted a review of systematic reviews for acupuncture [19] and a survey for end users of acupuncture evidence [16] to identify the initial set of items for consideration. For the survey, we collected the ideas of respondents about importance of the proposed eight items from the review, after which they could also suggest further items. In order to improve the representativeness of this survey, we conducted a multi-center questionnaire survey in five cities (Beijing, Shanghai, Nanjing, Chengdu, and Lanzhou) located in different parts of China. To ensure sufficient number of responses, two members of the working group visited these places in person between April and June 2014, where they distributed and collected the questionnaires, without influence the response process. Respondents included acupuncture practitioners, researchers and methodologists working on acupuncture research, and postgraduates with more than 1 year of experience of practicing acupuncture. A total of 269 stakeholders participated in this survey. The survey received ethical approval from the Research Ethics Committee of the first hospital of Lanzhou University, Lanzhou, China. Details of the survey and results have been published before [16].

Delphi consensus process

Based on the results from the first step, we selected the potential items for reporting in acupuncture systematic reviews. The initial items focused mainly on details of the acupuncture intervention. We also considered items relevant to other aspects of systematic reviews on acupuncture, such as sources for literature search and selection of studies. We then assembled a multidisciplinary group of experts based on their specialties and experience, and balanced the numbers of clinicians, researchers and healthcare providers when forming the panel. We invited 32 experts, of whom 29 agreed to participate, including senior acupuncture practitioners, methodologists of reporting guidelines and systematic reviews, epidemiologists, journal editors and statisticians.

We conducted a three-round Delphi process from October 2015 to July 2016, aiming to achieve consensus on essential items that should be included in the PRISMA for Acupuncture checklist and to identify items that required discussion at the face-to-face meeting. All 29 participants responded during the three rounds of the Delphi survey. In the Delphi survey, participants were asked to score each item using a 5-point Likert scale ranging from “of no importance” to “very important” [20, 21]. In the first round, the Delphi experts were invited to score all initially included items as well as suggest any additional potentially relevant items. The second round included any items that did not reach consensus and any new items from the first round. The third round involved items that did not reach consensus during the previous rounds. We conducted the Delphi surveys through emailing every expert separately and sent the summary of the previous round of survey in every next round, without mentioning any identical information of the other experts.

After each round, the score was calculated with the below formula, where Ni represents the number of respondents who gave the score. We consulted with the leading authors as well as the statistician in the Reporting Items for practice Guidelines in HealThcare (RIGHT) working group and used the same scale and formula from the RIGHT statement, where both the consensus level and the weight of responses were considered. Ni means the number of experts who chose specific “i” in the Likert scale (1 to 5), and items with a score greater than or equal to 75% were included [22]. An anonymized summary of the results of each round was sent to all participants through email. The survey was sent and collected through one specific email account, and one member of the working group (XW) monitored this email account.

$$ 100\%\ast \left({N}_5+0.75\ast {N}_4+0.5\ast {N}_3+0.25\ast {N}_2\right)/\left({N}_5+{N}_4+{N}_3+{N}_2+{N}_1\right) $$

Face-to-face meeting

After the Delphi process, we created a draft checklist with the included items. Ten experts, including acupuncture practitioners, methodologists, reporting guideline developers, journal editors and a statistician, attended a one-day face-to-face meeting in Lanzhou, China, on 12th October 2016. During the meeting, the results of the Delphi process were presented, followed by a discussion and refinement of each item. The participants then voted about the inclusion of each proposed item and decided the precise wording. We present only the aggregated results to maintain the anonymity of the participants. At the end of the meeting, the ten experts reviewed the checklist again to confirm that their comments were appropriately understood and considered.

The checklist was then developed in accordance with the EQUATOR template and presented in line with the PRISMA checklist.

Consultation with advisors

After the face-to-face meeting, we circulated the manuscript to advisory experts for additional comments. During consultations, the wording and presentation of the checklist and manuscript were further revised. Following this, the checklist was pilot tested.

Pilot tests

To identify practical challenges with any of the items, members of the PRISMA for Acupuncture working group applied the checklist to investigate the reporting condition of a sample of acupuncture systematic reviews published in 2017. In addition, we also conducted an online survey to corresponding authors of systematic reviews on acupuncture to obtain further comments on the utility and clarity of the checklist. Feedback from all pilot tests were used to refine the wording and presentation of the final checklist.

Results

Delphi process

Based on the results of the collection of initial items, we included seven items for the first round of the Delphi process. The Delphi results were as follows (Fig. 2):

  1. 1)

    Two items that scored greater than 75% were included after the first round. The experts gave their feedback for revising the remaining items. No additional items were suggested by the panel.

  2. 2)

    For the remaining items, we combined or split some items into sub-items, and revised the wording according to feedback from the first round. A total of 15 items were surveyed in the second round, and the results showed a high consensus on twelve items with no more major changes. While the remaining three items were modified according to comments and entered into the third round.

  3. 3)

    By analyzing the feedback from the third round of the Delphi process, one item was added from the third round of the Delphi process.

Fig. 2
figure 2

The result of the Delphi process

Full size image

The results of the 3-round Delphi process are shown in Additional file 1.

Consensus meeting, consultation with advisors and the pilot test

Experts attending the face-to-face meeting discussed each item to improve their practicability and accuracy and approved all the 15 items included in the Delphi stage. The two items excluded in the Delphi survey were confirmed for removal.

The advisory experts reviewed the checklist and manuscript, provided comments about the wording of items, as well as if the item should be considered as new, or as an elaboration of an existing PRISMA item to enhance the relevance, as done in other extensions of PRISMA [23]. At the same time, we simplified some items about the description of acupuncture interventions by referencing to the Template for Intervention Description and Replication (TIDieR) checklist and guide, instead of clarifying the details in sub-items.

We then formulated a checklist for a pilot test, where a sample of 27 systematic reviews on acupuncture published in 2017 were assessed. Thirteen out of 56 authors (23%) of acupuncture systematic reviews from the US, Australia, Taiwan, and Mainland China replied and commented on the checklist (Additional file 2). After integrating the feedback from the pilot test, one item about De-qi under the Data abstraction domain was moved to the Study characteristics domain, and several minor modifications were made to improve the wording of the items. Finally, a checklist of five new items (marked with‡) and six modified items (marked with*) was formulated (Table 1). The rationale of each item is presented below. The serial numbers correspond to the items of the original PRISMA statement.

Table 1 PRISMA for acupuncture checklist
Full size table

Title

1* Identify the report as a systematic review, meta-analysis, or both; if applicable, state the specific type of acupuncture treatment, such as manual acupuncture or electroacupuncture.

The title should clearly reflect the objectives of the systematic review and ideally allow the readers and users to identify the population, intervention, comparison, outcome and study design [24]. If the study investigates the effect of a specific style of acupuncture on a particular condition, it should be stated in the title. If a systematic review is planned to examine a large category of interventions including acupuncture (e.g. non-pharmacological interventions [25]), it will be not necessary to mention acupuncture in the title

Rationale

3* Describe the rationale for what is already known about acupuncture for the target condition in the background; if applicable, state what is already known about the specific types of acupuncture to be studied, and describe whether there is any difference of the effects among different types of acupuncture.

As recommended by the Cochrane Handbook [26], the current state of the guideline’s application, significance, and the specific methods of acupuncture for the target disease, as well as the hypothesis and theoretical basis (e.g. the likely physiological mechanisms of acupuncture stimulation), should be clearly described in the Background/Introduction section. The authors could consider including a mini-review of existing systematic reviews on the chosen topic, summarizing the strengths and weaknesses of existing reviews and explain how the newly proposed review will address the weaknesses if applicable. If such reviews do not exist, this should be stated in the background section.

Inclusion and exclusion criteria

6 † Specify study characteristics (e.g., PICOS, length of follow-up) and report characteristics (e.g., years considered, language, publication status) used as criteria for eligibility, giving rationale.

6a.1‡ Describe the diagnostic criteria of the target condition in Western medicine.

Diagnostic criteria are important to define a disease, and thus to clarify the population of interest. As there may be different diagnostic criteria for one condition, and the diagnostic criteria may change over time, this may result in different inclusion criteria of the participants. For example, a systematic review on acupuncture for hypertension used a blood pressure above 140/90 as inclusion criteria, which is the threshold for high blood pressure according to the editions of the American Heart Association guidelines published during the past 14 years [27]. But in 2017, AHA changed its threshold as 130/80 [28]. Reporting the diagnostic criteria with supporting literature being referred can help to clarify the scope of the systematic review.

6a.2‡ If applicable, describe the diagnostic criteria in terms of traditional medicine, such as traditional Chinese medicine.

Acupuncture is a type of traditional medicine, and therefore research in acupuncture sometimes uses diagnostic criteria and syndrome classification in terms of traditional medicine, which often differ from those in Western medicine. This information is however often omitted in the final report. Authors should report the diagnostic criteria according to traditional medicine when using these classifications to include patients.

6b‡ Describe the types of acupuncture to be included, such as traditional acupuncture, electroacupuncture, or fire acupuncture.

The types of acupuncture interventions are diverse, including traditional acupuncture (i.e. manual acupuncture with classical needle manipulation), electroacupuncture, ear acupuncture, scalp acupuncture, wrist-ankle acupuncture, and others [29]. The effect of different types of acupuncture can differ from each other [30, 31], and the effect of acupuncture interventions may change by stage of the disease [32]. Systematic reviewers should clarify which types of acupuncture will be included for analysis. In addition, the adjunctive therapies including moxibustion, cupping, herbal injections, heat lamps or guasha should also be clarified if used as eligible criteria.

6c‡ If applicable, report measures for therapeutic effects using the terminology of either traditional medicine (e.g. syndrome score for syndrome remission) or Western medicine (e.g. scales for pain intensity).

Measures for therapeutic effects in both traditional medicine [33] and Western medicine are important to understand how acupuncture works. If authors took such outcomes as eligibility criteria, they should describe the possible measurements of such outcomes in the inclusion and exclusion criteria, because many outcomes can be defined with varying measurements. For example, pain intensity has four commonly used measurement scales [34].

Information sources

7* Describe all sources of information (e.g., databases with dates of coverage, contact with study authors to identify additional studies) in the search, and report the date of the last search. If applicable, report the databases or complementary search methods for acupuncture or traditional medicine.

Many databases focusing specifically on acupuncture or traditional medicine have become increasingly mature, and they can provide a considerable amount of information for Traditional Chinese Medicine (TCM), Korean medicine and Japanese traditional medicine [35]. Additionally, in some non-English-speaking countries, especially in China, abundant acupuncture-related research continues to be published in local language, and this literature can usually be found in country-based databases only. It is therefore necessary to provide the source when used [36].

Literature searches

8* Present full electronic search strategy for at least one commonly used database (e.g. MEDLINE), including any limits used, such that it could be repeated. If applicable, include the full search strategy for at least a Western and a traditional medicine database for each systematic review where both were used.

The search strategy is an indispensable part of a systematic review. Currently, there are only few studies on how to search literature on acupuncture in specific TCM databases. The authors of the systematic reviews should develop search strategies that are rigorous and repeatable and provide a clear description for at least one commonly used database (like MEDLINE) and, when applicable, one acupuncture- or traditional medicine-tailored source, like the Allied and Complementary Medicine Database (AMED) and AcuTrials® (http://acutrials.ocom.edu).

Data items

11* List and define all variables for which data were sought (e.g., PICOS, funding sources) and any assumptions and simplifications made; describe data items about details of the acupuncture interventions and controls (e.g. sham acupuncture) referring to TIDieR when applicable.

In acupuncture, the effect is associated with several details of intervention, such as the type of needle and angle and depth of inserting, number of needles, duration of treatment, and acupoints, which vary between diseases [37, 38]. In addition, many researchers used sham acupuncture as a control to avoid nonspecific placebo effect and bias caused by the lack of blinding [39]and the design essentially depends on three factors: position, depth of the needle, and auxiliary tools [40,41,42]. The TIDieR checklist [43] provided a detailed guideline of intervention reporting, acupuncture systematic review authors could define the extraction items of acupuncture interventions referring to TIDieR.

Study characteristics (one extended item)

18* For each study, present characteristics that were extracted (e.g., study size, PICOS, follow-up period) and provide the citations of the included studies. Summarize details of the acupuncture intervention for each study in a table referring to TIDieR

This information corresponds to the item on data extraction, and should be presented with corresponding results referring to TIDieR items. If the information is insufficiently reported and cannot be obtained by contacting authors of the included studies, then authors should describe this information as “not reported” in their review.

18a ‡ Describe details to refer to typical sensations associated with needling after acupuncture reported in the included studies.

"De-qi" refers to the sensations typically associated with needling including soreness, numbness, heaviness, distension and aching at the insert position when the needle is inserted into acupoints of a certain depth during needling [44]. Seeking De-qi, as well as the time and strength of Qi feeling, affects the clinical efficacy of acupuncture [45, 46]. The current research on De-qi is getting increasingly mature with a growing number of studies being conducted. Systematic reviews should therefore extract and report this information together with how De-qi sensation was measured (e.g. specific scales) from the included studies if available, because there are different scales to quantify De-qi sensations, of which the rationales may not completely agree with each other [47]. Considering the controversies on the relation of De-qi and therapeutic effect, to provide De-qi details could provide future researchers with needed information to further exploration.

In addition to present the checklist, we also provided examples for each item from existing acupuncture systematic reviews and meta-analyses in Additional file 3.

Discussion

With the aim to optimize reporting of systematic reviews focusing on acupuncture interventions for specific conditions, the PRISMA for Acupuncture checklist can be used for systematic reviews studying specific acupuncture, as well as a large category of interventions that include acupuncture, such as non-pharmacological interventions. The PRISMA for Acupuncture are developed for authors of systematic reviews on acupuncture, journal editors, peer reviewers and methodologists. Besides reporting, PRISMA for Acupuncture can also be used to evaluate the current condition of reporting, and to help journals identify acupuncture systematic reviews of higher quality. PRISMA for Acupuncture can also assist with the early design and development of protocols of acupuncture systematic reviews as other reporting guidelines do [48].

As with other extension of reporting guidelines, the PRISMA for Acupuncture checklist should be used together with the original PRISMA checklist, because some items in PRISMA are universally applicable for systematic reviews for different interventions. Referring to both, where relevant, and other PRISMA guidance (e.g. PRISMA for Protocols [9] can effectively ensure the rigor, transparency and integrity of reporting in acupuncture systematic reviews. To make it easier to use, we created an integrated checklist including both the new or modified items and the unchanged PRISMA items, so that users could refer to one combined checklist.

The implementation of PRISMA for Acupuncture requires continuous promotion of its use. We will continue to share the PRISMA for Acupuncture by presenting our results of international conferences and seminars, and contacting journals for endorsement. This reporting guideline will be published in both Chinese and English to promote its spread and increase its applicability, and additional translations are also encouraged as necessary, which will hopefully improve the accessibility. All the documents will be available on the PRISMA website (http://prisma-statement.org/), and the working group welcomes and collects comments and feedback from those in research or practice in order to revise PRISMA for Acupuncture and keep it up to date. We will also monitor the application and evaluate the effect of PRISMA for Acupuncture continuously, and when necessary, update it according to users’ feedback and the latest evidence.

Conclusion

Ultimately, a checklist for the reporting of systematic review on acupuncture were formed. Although several extensions of PRISMA have been developed, covering aspects of study design, type of data, population, intervention, and outcome, PRISMA for Acupuncture supplements the relevant items for reporting issues specific for acupuncture interventions that were not considered in PRISMA and other extensions. Developed following recommendations for the development of reporting guidelines and integrated and extensive survey of evidence users, we believe the PRISMA for Acupuncture checklist will be a useful tool to promote the transparent reporting on acupuncture in systematic review, thus to achieve a better use in practice.

Availability of data and materials

All data generated or analysed during this study are included in this article and its supplementary files.

Abbreviations

EQUATOR:

Enhancing the QUAlity and Transparency Of health Research

PICOS:

Population, Intervention, Outcome, Study design

PRISMA:

Preferred Reporting Items for Systematic reviews and Meta-Analyses

RIGHT:

Reporting Items for practice Guidelines in HealThcare

STRICTA:

STandards for Reporting Interventions in Clinical Trials of Acupuncture

TCM:

Traditional Chinese Medicine

TIDieR:

Template for Intervention Description and Replication

References

  1. White A, Ernst E. A brief history of acupuncture. Rheumatology (Oxford). 2004;43(5):662–3.

    Article  CAS  Google Scholar 

  2. Hao JJ, Mittelman M. Acupuncture: past, present, and future. Glob Adv Health Med. 2014;3(4):6–8.

    Article  Google Scholar 

  3. Kung YY, Hwang SJ, Li TF, Ko SG, Huang CW, Chen FP. Trends in global acupuncture publications: an analysis of the web of science database from 1988 to 2015. J Chin Med Assoc. 2017;80(8):521–5.

    Article  Google Scholar 

  4. Prady SL, Richmond SJ, Morton VM, Macpherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS One. 2008;3(2):e1577.

    Article  Google Scholar 

  5. Ma B, Chen ZM, Xu JK, et al. Do the CONSORT and STRICTA checklists improve the reporting quality of acupuncture and Moxibustion randomized controlled trials published in Chinese journals? A systematic review and analysis of trends. PLoS One. 2016;11(1):e0147244.

    Article  Google Scholar 

  6. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12.

    Article  Google Scholar 

  7. The PRISMA Group. PRISMA Endorsers; [cited 2018 June 10]. Available from: http://www.prisma-statement.org/ Endorsement/PRISMAEndorsers.aspx.

  8. Zorzela L, Loke YK, Ioannidis JP, et al. PRISMA harms checklist: improving harms reporting in systematic reviews. BMJ. 2016;352:i157.

    Article  Google Scholar 

  9. Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. Bmj. 2015;350:g7647.

    Article  Google Scholar 

  10. Beller EM, Glasziou PP, Altman DG, et al. PRISMA for abstracts: reporting systematic reviews in journal and conference abstracts. PLoS Med. 2013;10(4):e1001419.

    Article  Google Scholar 

  11. Stewart LA, Clarke M, Rovers M, et al. Preferred reporting items for systematic review and meta-analyses of individual participant data: the PRISMA-IPD statement. Jama. 2015;313(16):1657–65.

    Article  Google Scholar 

  12. Hutton B, Catala-Lopez F, Moher D. The PRISMA statement extension for systematic reviews incorporating network meta-analysis: PRISMA-NMA. Med Clin (Barc). 2016;147(6):262–6.

    Article  Google Scholar 

  13. Qaseem A, Wilt TJ, McLean RM, Forciea MA. Noninvasive treatments for acute, subacute, and chronic low Back pain: a clinical practice guideline from the American College of Physicians. Ann Intern Med. 2017;166(7):514–30.

    Article  Google Scholar 

  14. Guo Y, Zhao H, Wang F, et al. Recommendations for acupuncture in clinical practice guidelines of the national guideline clearinghouse. Chin J Integr Med. 2017;23(11):864–70.

    Article  Google Scholar 

  15. Kim KH, Kang JW, Lee MS, Lee JD. Assessment of the quality of reporting for treatment components in Cochrane reviews of acupuncture. BMJ Open. 2014;4(1):e004136.

    Article  Google Scholar 

  16. Shi X, Wang X, Liu Y, et al. A survey of evidence users about the information need of acupuncture clinical evidence. BMC Complement Altern Med. 2016;16(1):455.

    Article  Google Scholar 

  17. Equator Network. Reporting guidelines under development; [cited 2018 may 23]. Available from: http://www.equator-network.org/library/reporting-guidelines-under-devlopment/#91.

  18. Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med. 2010;7(2):e1000217.

    Article  Google Scholar 

  19. Liu Y, Zhang R, Huang J, et al. Reporting quality of systematic reviews/meta-analyses of acupuncture. PLoS One. 2014;9(11):e113172.

    Article  Google Scholar 

  20. Norman G. Likert scales, levels of measurement and the "laws" of statistics. Adv Health Sci Educ Theory Pract. 2010;15(5):625–32.

    Article  Google Scholar 

  21. A. CR, E. G. Why we should not use 5-point Likert scales: the case for subjective quality of life measurement. Proceedings, second international conference on quality of life in cities. 2000:74–93.

  22. Chen Y, Yang K, Marusic A, et al. A reporting tool for practice guidelines in health care: the RIGHT statement. Ann Intern Med. 2017;166(2):128–32.

    Article  Google Scholar 

  23. Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med. 2006;144(5):364–7.

    Article  Google Scholar 

  24. Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. Bmj. 2009;339:b2700.

    Article  Google Scholar 

  25. Manyande A, Cyna AM, Yip P, Chooi C, Middleton P. Non-pharmacological interventions for assisting the induction of anaesthesia in children. Cochrane Database Syst Rev. 2015;(7):Cd006447.

  26. JPT. H, (editors). GS. Chapter 4: Guide to the contents of a Cochrane protocol and review. In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Intervention. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration. 2011:4:5–4:6.

  27. Leem J. Acupuncture to treat hypertension: a recent systematic review and implications for subsequent research. Integr Med Res. 2016;5(1):69–71.

    Article  Google Scholar 

  28. Qaseem A, Wilt TJ, Rich R, Humphrey LL, Frost J, Forciea MA. Pharmacologic treatment of hypertension in adults aged 60 years or older to higher versus lower blood pressure targets: a clinical practice guideline from the American College of Physicians and the American Academy of family physicians. Ann Intern Med. 2017;166(6):430–7.

    Article  Google Scholar 

  29. Liu T, Yu JN, Cao BY, Peng YY, Chen YP, Zhang L. Acupuncture for primary dysmenorrhea: a meta-analysis of randomized controlled trials. Altern Ther Health Med. 2017;23(7):36–43.

  30. Aranha MF, Muller CE, Gaviao MB. Pain intensity and cervical range of motion in women with myofascial pain treated with acupuncture and electroacupuncture: a double-blinded, randomized clinical trial. Braz J Phys Ther. 2015;19(1):34–43.

    Article  Google Scholar 

  31. Tsui P, Leung MC. Comparison of the effectiveness between manual acupuncture and electro-acupuncture on patients with tennis elbow. Acupunct Electrother Res. 2002;27(2):107–17.

    Article  Google Scholar 

  32. Chen X, Li Y, Zheng H, et al. A randomized controlled trial of acupuncture and moxibustion to treat Bell's palsy according to different stages: design and protocol. Contemp Clin Trials. 2009;30(4):347–53.

    Article  Google Scholar 

  33. World Health Organization. Traditional, complementary and integrative medicine; [cited 2017 Nov 15]. Available from: http://www.who.int/traditional-complementary-integrative-medicine/about/en/.

  34. Ferreira-Valente MA, Pais-Ribeiro JL, Jensen MP. Validity of four pain intensity rating scales. Pain. 2011;152(10):2399–404.

    Article  Google Scholar 

  35. Chen HY, Chang SS, Chan YC, Chen CY. Discovery of novel insomnia leads from screening traditional Chinese medicine database. J Biomol Struct Dyn. 2014;32(5):776–91.

    Article  CAS  Google Scholar 

  36. Wu XY, Tang JL, Mao C, Yuan JQ, Qin Y, Chung VC. Systematic reviews and meta-analyses of traditional chinese medicine must search chinese databases to reduce language bias. Evid Based Complement Alternat Med. 2013;2013:812179.

    PubMed  PubMed Central  Google Scholar 

  37. MacPherson H, Maschino AC, Lewith G, Foster NE, Witt CM, Vickers AJ. Characteristics of acupuncture treatment associated with outcome: an individual patient meta-analysis of 17,922 patients with chronic pain in randomised controlled trials. PLoS One. 2013;8(10):e77438.

    Article  CAS  Google Scholar 

  38. Zhang C, Wen Y, Fan XN, et al. Therapeutic effects of different durations of acupuncture on rats with middle cerebral artery occlusion. Neural Regen Res. 2015;10(1):159–64.

    Article  Google Scholar 

  39. Chen H, Ning Z, Lam WL, et al. Types of control in acupuncture clinical trials might affect the conclusion of the trials: a review of acupuncture on pain management. J Acupunct Meridian Stud. 2016;9(5):227–33.

    Article  Google Scholar 

  40. Takakura N, Yajima H. A double-blind placebo needle for acupuncture research. BMC Complement Altern Med. 2007;7:31.

    Article  Google Scholar 

  41. Zhu D, Gao Y, Chang J, Kong J. Placebo acupuncture devices: considerations for acupuncture research. Evid Based Complement Alternat Med. 2013;2013:628907.

    PubMed  PubMed Central  Google Scholar 

  42. Chen ZX, Li Y, Zhang XG, et al. Sham Electroacupuncture methods in randomized controlled trials. Sci Rep. 2017;7:40837.

    Article  CAS  Google Scholar 

  43. Hoffmann TC, Glasziou PP, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Bmj. 2014;348:g1687.

    Article  Google Scholar 

  44. Lundeberg T. To be or not to be: the needling sensation (de qi) in acupuncture. Acupunct Med. 2013;31(2):129–31.

    Article  Google Scholar 

  45. Yang XY, Shi GX, Li QQ, Zhang ZH, Xu Q, Liu CZ. Characterization of deqi sensation and acupuncture effect. Evid Based Complement Alternat Med. 2013;2013:319734.

    PubMed  PubMed Central  Google Scholar 

  46. Hu NJ, Lin C, Li J, et al. Remarks on the relationship between deqi and effect of acupuncture. Zhongguo Zhen Jiu. 2014;34(4):413–6.

    PubMed  Google Scholar 

  47. Yu DT, Jones AY, Pang MY. Development and validation of the Chinese version of the Massachusetts General Hospital acupuncture sensation scale: an exploratory and methodological study. Acupunct Med. 2012;30(3):214–21.

    Article  Google Scholar 

  48. Mannocci A, Saulle R, Colamesta V, et al. What is the impact of reporting guidelines on public health journals in Europe? The case of STROBE, CONSORT and PRISMA. J Public Health (Oxf). 2015;37(4):737–40.

    Google Scholar 

Download references

Acknowledgements

We acknowledge the support of David Moher and Hitoshi Yamashita for serving as scientific advisors; the authors of acupuncture systematic reviews who provided valuable comments for refining the checklist; and Delphi and face to face meeting participants. We also thank Jianjian Wang, Xiao Liu, Huijuan Li and Meixuan Li for helping with collecting data from the acupuncture systematic reviews for pilot test.

Funding

This study is supported by the National Natural Science Foundation of China (General Program, ID: 81373882) and the Fundamental Research Funds for the Central Universities (16LZUJBWTD013, 18LZUJBWZX006): Evidence-based Social Sciences Research. The funders had no role in study design, collection, analysis and interpretation of data, writing of the report, and decision to submit the article for publication.

Author information

Authors and Affiliations

  1. Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China

    Xiaoqin Wang, Yaolong Chen, Yali Liu, Jinhui Tian, Bin Ma & Kehu Yang

  2. Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China

    Xiaoqin Wang, Yaolong Chen, Yali Liu, Jinhui Tian, Bin Ma & Kehu Yang

  3. Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China

    Xiaoqin Wang, Yaolong Chen, Yali Liu, Jinhui Tian, Bin Ma & Kehu Yang

  4. WHO Collaborating Centre for Guideline Implementation and Knowledge Translation, Lanzhou, China

    Xiaoqin Wang, Yaolong Chen, Yali Liu, Jinhui Tian, Bin Ma & Kehu Yang

  5. Clinical Division, School of Chinese Medicine, Hong Kong Baptist University, Kowloon Tong, Hong Kong

    Liang Yao & Zhaoxiang Bian

  6. Institute of Global Health, University of Geneva, Geneva, Switzerland

    Janne Estill

  7. Institute of Mathematical Statistics and Actuarial Science, University of Genewa, Geneva, Switzerland

    Janne Estill

  8. Chinese Cochrane Centre, Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China

    Taixiang Wu

  9. Dongzhimen Hospital of Beijing University of Chinese Medicine, Beijing, China

    Hongcai Shang & Guihua Tian

  10. Korea Institute of Oriental Medicine, Daejeon, South Korea

    Myeong Soo Lee

  11. Department of Public Health Sciences, Karolinska Institute, Stockholm, Sweden

    Dang Wei

  12. Gansu University of Chinese Medicine, Lanzhou, China

    Yongfeng Wang

Authors
  1. Xiaoqin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yaolong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yali Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liang Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Janne Estill
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zhaoxiang Bian
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Taixiang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Hongcai Shang
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Myeong Soo Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Dang Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Jinhui Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Bin Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Yongfeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Guihua Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Kehu Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

XW, YC, KY and YL conceptualised the study design. XW, DW, LY, JT and BM collected the data and organized the consensus process. JE, HS, TW, ZB, MSL, GT and YW reviewed and revised the manuscript. All authors provided input on the direction of the study and content of the checklist. All authors approved the final version of the manuscript.

Corresponding authors

Correspondence to Yaolong Chen or Kehu Yang.

Ethics declarations

Ethics approval and consent to participate

This project was approved by the Research Ethics Committee of the first hospital of Lanzhou University, Lanzhou, China (LDYYL2013–0007). The informed consent was obtained of all the participants before the survey.

Consent for publication

Not applicable.

Competing interests

All authors have completed the Unified Competing Interest form. KY reports a grant from the National Natural Science Foundation of China (NNSFC) during the conduct of the study. YC reports a grant from NNSFC for another project, which has no role for this study. There were no other relationships or activities that could appear to have influenced the submitted work.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Results of the Delphi process. (DOCX 27 kb)

Additional file 2:

Results of the pilot test of the PRISMA for Acupuncture checklist. (DOCX 27 kb)

Additional file 3:

Examples of reporting items in systematic reviews for Acupuncture. (DOCX 278 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wang, X., Chen, Y., Liu, Y. et al. Reporting items for systematic reviews and meta-analyses of acupuncture: the PRISMA for acupuncture checklist. BMC Complement Altern Med 19, 208 (2019). https://doi.org/10.1186/s12906-019-2624-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12906-019-2624-3

Keywords

  • PRISMA
  • Acupuncture intervention
  • Systematic review

BMC Complementary Medicine and Therapies

ISSN: 2662-7671

Contact us