Skip to main content
Download PDF

Factors influencing the quality of acupuncture clinical trials: a qualitative interview of stakeholders

BMC Complementary Medicine and Therapies volume 23, Article number: 326 (2023) Cite this article

Abstract

Objective

To investigate the influencing factors on the quality of acupuncture clinical trials from the stakeholders, and to provide references for improving the quality of acupuncture clinical trials.

Methods

A qualitative study based on semi-structured interviews was performed. Experts, acupuncturists, editors, and patients were interviewed. The interview results were thematically analyzed from transcribed audio recordings.

Results

A total of 38 stakeholders were interviewed, including 12 experts, 14 acupuncturists, 2 editors, and 10 patients. There were 25 tree nodes and 106 sub-nodes, with 1141 reference points. The key factors influencing the quality of acupuncture clinical trials could be divided into five core theme frameworks: a) trial design, b) trial conduction, c) research results reporting and publication, d) research evidence dissemination, and e) research evidence transformation and application.

Conclusions

The results reveal that to improve the quality of acupuncture trials, it should consider each step of trial design, trial conduction, research results reporting and publication, research evidence dissemination, and research evidence transformation and application. A guideline for quality control of the whole process of acupuncture clinical trials is needed.

Peer Review reports

Introduction

Acupuncture has become one of the most widely used forms of traditional medicine in the world [1], and numerous countries and regions endorsed acupuncture therapy and incorporated it into their health systems [2, 3]. The “internationalization” of acupuncture has greatly promoted the development of acupuncture research, with an explosive growth in the number of studies [4]. Since 2010, a number of acupuncture clinical trials were published in high-impact journals such as JAMA, BMJ, and Annals of Internal Medicine [5,6,7], which provided evidence of acupuncture therapy in clinical practice, and strengthened its international influence [8].

Except for a few high-impact clinical trials, numerous clinical trials could only be published in low-impact journals and some clinical trials were even not published. In the past 10 years, many studies suggested acupuncture might be a potential intervention for diseases, however, only a few conditions were included in practice guidelines [9] and the quality of acupuncture clinical trials was still needed to be improved. Moreover, most clinically effective acupuncture therapies were not supported by high-quality evidence [10]. Several trials in high-impact journals revealed different results [11]. There were still gaps in knowledge transfer between acupuncture trials and acupuncture clinical practice [12, 13]. These factors limited the promotion of acupuncture in clinical practice, and it was urgent to improve the quality.

There have been several methods to improve the quality of acupuncture clinical trials, such as using reporting guidelines, using quality control methods, and performing systematic reviews. Since acupuncture trial was a complex process that spanned a long period of time and involved a large number of people and processes, it was difficult to control the quality [14]. Previously studies only provided opinions from trial’s stakeholders and did not provide opinions from authors’ or other stakeholders. In addition, the previously methods were separately from each other in different aspects. And, no study was conducted in consideration all aspects together, thus, it was needed to perform a new study based on stakeholders and consider the whole process of the acupuncture trials. Thus, we performed the current study, and we hoped the study could help to improve the quality of acupuncture clinical trials.

Methods

Study design and ethics approval

The qualitative study aimed to analyze stakeholders involved in the whole process of acupuncture clinical trials, and thus purposefully sampled with semi-structured interview outlines [15, 16]. The interview conducted from August 2021 to November 2021. The results of interviews were transcribed verbatim then anonymized, and thematic content analysis was performed by NVivo 12 software. The study was reported following the Consolidated Criteria for Reporting Qualitative Research (COREQ) guidelines [17]. The structured process of the study is shown in the Fig. 1. This study followed the Declaration of Helsinki and the four basic principles of medical ethics. Ethical approval was obtained from Ethics Committee on Biomedical Research of West China Hospital of Sichuan University (No. 2021 Annual Review (1188)). Informed consent was obtained from the interviewees who agreed to participate in the study.

Fig. 1
figure 1

Process of the study

Full size image

Selection of participants

The inclusion criteria for the interviewees were as follows: stakeholders involved in the quality of acupuncture clinical trials; interviewees consented to record interviews and voluntary signing of informed consent. Exclusion criteria: interviewees who asked to leave in the middle of the interview; those who did not answer all questions; those who gave perfunctory answers. The following four types of stakeholders were interviewed: acupuncture experts (who had participated in acupuncture clinical trials for at least 5 years, and had participated in the design of at least one clinical trial), acupuncturists (who had participated in acupuncture clinical trials for at least 3 years and participated in writing papers related to acupuncture clinical trials), editors (editors of journals related to the publication of clinical trials in acupuncture), and patients (the subjects who had participated in at least one acupuncture clinical trial). Interviewees were also selected based on geography, work background, and etc.

Research team and reflexivity

The interview was carried out by two postgraduate students (one in acupuncture field and the other in evidence-based medicine field). They were involved throughout the design, optimization, and conduction of the research, and were familiar with all aspects of the research. They were trained in a qualitative research course and had experience in conducting interviews. They were able to extract and interpret the valid information.

Sampling and sample size

A stratified purposive sampling method was used to select representatives of different stakeholders for the interview [18]. Because the current study was a qualitative study, the methods of the sample size was consistent with previous studies [19, 20], which meant the recruitment of interviewees ended when the study reached information saturation, which occurred when the interviews with the participants in each role no longer generated new coding information [19, 20]. Otherwise, the interview would continue.

Non-participation

Respondents were allowed to withdraw at any time during the process of the research. The researchers recorded the reason for withdrawal and destroyed the recordings and transcriptions accordingly. No one withdrew from the study except that one acupuncturist who declined to be interviewed with the concern that he would not be able to answer the questions well.

Data collection

The interview was conducted online and face-to-face. Face-to-face interview was conducted with interviewees in Sichuan province, China. It was in a quiet doctor's office and cell phones were turned off during the interview to avoid interference from bystanders as much as possible. Interviewees outside Sichuan province were interviewed online by Tencent Meeting. Depending on the situation, we contacted the interviewees in advance, we sent them an invitation link to the interview, and we explained the background, purpose and significance of the interview, and the format of the interview to them. After obtaining the consent of the interviewees with their signed informed consent form, we sent them the interview guideline and arranged on the time for the interview. For each interview, the interview time, location, and basic information of the interviewees were collected. Interview forms were designed based on the occupations of the interviewees (four types in total). During the interviews, we engaged in conversations with the interviewees regarding the quality of acupuncture clinical trials to establish a broad description of the issue. We asked them each question according to the interview guideline. All interviews were conducted by memos and audio recorded. The information collected from the recording materials was transcribed verbatim within 24 hours after the interview. Interviews were audio taped and transcribed verbatim and all potentially identifiable texts were anonymized, so that participants’ details were kept confidential, and all interviewees were allocated pseudonyms to maintain anonymity.

Data analysis

The techniques from thematic analysis was used to analyze the data [21]. We analyzed all interview transcription by using qualitative analysis software NVivo 12. Data collection was conducted through semi-structured interviews, as well as field notes and memos [22]. The iterative process continued with data collection, coding, and analysis, followed by further data collection and analysis until saturation was reached, which occurred when the last few interviews fitted existing patterns and did not generate new information. The data analysis was carried out in the following steps: both two researchers firstly read all transcription to familiarize with the data and developed a structured coding tree that started with an open coding. The transcription and open codings were initially coded individually by two researchers. To ensure consistency and reliability of the process, themes were sought, reviewed, defined, and named. In case of disagreement, a third researcher (ZYG) would be consulted to discuss the results until they reached an agreement.

Quality control of the study

We selected one random respondent from each kind of occupation for a pre-interview before starting the interview, to familiarize with the interview process, revise any issues that arose during the pre-interview, and refine the interview guidelines after discussion the research group. In addition, questions were asked to the interviewees according to a prepared interview guideline, the researcher could be flexible according to the interviewees' responses. In the final stage of interview, participants confirmed what he or she had said, and no new information or themes emerged, so it was decided that enough data had been generated to answer the question. To ensure authenticity, we checked all transcription. We also took notes during and after each interview to record any non-verbal issues which could inform the analysis. We conducted a ‘pre-coding’ exercise to familiarize with the coding process and procedures. Also, to ensure consistency and reproducibility, two researchers coded the interview texts back-to-back, and we invited a third person to consult judgments when disputes arose. The lead researchers oversighted every stage of the analytical process and ensured that findings were representative of the data as a whole.

Results

Interviewees’ information

A total of 38 interviewees were included in this study, including 12 experts, 14 acupuncturists, 2 editors and 10 patients. The interview time of experts was 14–56 min, with an average of 37.33 ± 11.72 min, and the interview time of acupuncturists was 17–54 min, with an average of 38.79 ± 8.76 min. Two editors were from the Journal of Acupuncture and Tuina Science and the Chinese Journal of Integrative Medicine, and the interview time was 29 min and 43 min, respectively. The patients’ interview time was between 9 min and 23 min, with an average of 14.80±4.47 min. The interviewees were from Sichuan, Chongqing, Beijing, Shanghai, Jiangsu, Guizhou, Tianjin, etc. The demographics of the participants are shown in Table 1.

Table 1 Summary of study participants’ characteristics
Full size table

Thematic analysis of the influencing factors

We conducted an open-ended coding of all interview transcripts using qualitative analysis software NVivo 12 line-by-line. It resulted in five main themes, under which 25 tree nodes and 106 sub-nodes were constructed, with 1141 reference point numbers. The main themes appeared in the study is shown in Fig. 2.

Fig. 2
figure 2

The main themes appeared in the study*. * The key factors influencing the quality of acupuncture clinical trials could be divided into five core theme frameworks: trial design, trial conduction, research results reporting and publication, research evidence dissemination, and research evidence transformation and application

Full size image

The following main themes emerged from the interviewees' sharing of key factors influencing the quality of acupuncture clinical trials during the interviews: a) trial design, b) trial conduction, c) research results reporting and publication, d) research evidence dissemination, and e) research evidence transformation and application. These main themes were interlinked. Some interviewees noted that designing the trial, conducting the trial, reporting and publishing the research findings were the main influencing factors throughout research process, and both trial design and trial conduction were the most important influencing factors.

The tree nodes and sub-nodes under each thematic framework are shown in Table 2. There were 4 tree nodes, 14 sub-nodes, and 366 reference points under the “trial design” theme. There were 9 tree nodes, 50 sub-nodes, and 586 reference points under the “trial conduction” theme. There were 2 tree nodes, 11 sub-nodes, and 103 reference points under the “research results reporting and publication” theme. There were 5 tree nodes, 16 sub-nodes, and 24 reference points under the “research evidence dissemination” theme. 5 tree points, 15 sub-nodes, and 62 reference points were under the “research evidence transformation and application” theme. Brief interview quotations are presented below with unique interviewee IDs.

  1. (1)

    Theme 1: Trial design

Table 2 Thematic information on factors affecting the quality of acupuncture clinical trials
Full size table

Before an acupuncture clinical trial was conducted, the main task was design the trial, revised and refined it. A rigorous and scientific design was the cornerstone and core of trial. In the acupuncture clinical trial, the initial phase quality of the project depended on ‘designed’, and each aspect and element of the pilot program affected the conduction of subsequent trial [23].

"The second factor that affects the quality of acupuncture clinical trials is the design of the trial, and this is a central influencing factor on the quality. If the trial is not designed properly, it may affect the overall quality." (ID 06-Expert).

  1. (2)

    Theme 2: Trial conduction

Acupuncture clinical trials were unique and they required both rigorous trial protocols and strict quality control during the conduction phase. It was needed to standardize clinical trials in acupuncture to ensure the authenticity and reproducibility. Whereas there were many factors influencing the conduction phase of acupuncture clinical trials, they could be categorized into the following main areas: Characteristics of acupuncture, research platform and environment, coordinated management of the research team, the factors of the acupuncture practitioners, the factors of outcome evaluator, the factors of statistician, the factors of monitoring, the factors of trial assistants, and the factors of patients.

"The third factor that affects the quality of acupuncture clinical trials is quality control during the conduction of the study after you've designed the trial protocol, and I think it is probably the key to the high quality of the trial." (ID 06-Expert).

"The trial can be designed perfectly, however, it is often not rigorous enough in its conduction, which can easily lead to the separation of design and conduction." (ID 01-Expert).

  1. (3)

    Theme 3: Research results reporting and publication

The quality control of acupuncture clinical trials was carried out at every process of clinical research, including every step of trial design, conduction, and reporting and publishing the results. It could ensure the credibility of the whole process of acupuncture clinical trials. This study proposed that factors in the reporting and publication of research findings were divided into two main components: authors and editors (or journals).

"There's a big problem with the reporting. For example, some researchers didn't strictly follow the reporting guideline to report the results of study." (ID 09-Expert).

"From the design of the trial to the publication of the paper, it must follow a series of sandards." (ID 01-Editor).

  1. (4)

    Theme 4: Research evidence dissemination

Acupuncture clinical trials had been developing rapidly in recent years. However, most of the trials were from China, leading to less applicability of the findings when generalized to other populations. The reasons for this situation included the characteristics of acupuncture, health policy makers, research teams, evidence users, the public, and etc.

“First of all, one of the main reasons was that many physicians, especially primary acupuncturists, may not pay much attention to the literatures (even if it was published in JAMA, the New England Journal of Medicine). The fact that the primary acupuncturist has not read the literatures resulted in the ignorance of evidence from these trials, causing him not applying these therapeutic strategies. (I think) it is the main reason(less applicability of the findings when generalized to other populations).” (ID 08-Expert).

  1. (5)

    Theme 5: Research evidence transformation and application

The ultimate purpose of producing and disseminating evidence was to apply. The transformation and application of high-quality acupuncture evidence was the basis of a new wave of acupuncture clinical trial, and it had guided significance to produce high-quality acupuncture clinical evidence. However, the current lack of generalizability of acupuncture clinical research results had resulted in a low transformation rate of research evidence. The current study identified several factors that influence the transformation of evidence from acupuncture clinical research, including the platform for transformation, the characteristics of acupuncture, the proposal, the research team, and the selection and characteristics of participants (patients).

“Because we have many different schools of traditional Chinese medicine (acupuncture), and there is a lot of variability in different regions, and this may also be one of the reasons why we cannot transform on a large scale.” (ID 06-Expert).

Discussion

In this study, a qualitative interview was performed to analyze the factors that influence the quality of acupuncture clinical trials. A total of 38 stakeholders were interviewed, the results found that the stakeholders all suggested that quality control should be paid attention throughout the trials, and all steps were important for quality control. The factors could be divided into 5 points, including a) trial design, b) trial conduction, c) research results reporting and publication, d) research evidence dissemination, and e) research evidence transformation and application. Identifying these factors would help improve the quality of acupuncture clinical trials.

Improve quality of acupuncture clinical trials might be different from that in drug trials, because the scientific design was different, and it was also difficult to design the most scientific trials in acupuncture field [23], thus, strengthening the quality was very important [24]. The current study extended the findings of previous studies and highlighted that rigorous, scientific, and standardized study design was the primary guarantee for high quality trial. Therefore, it was needed to standardize the management of Standard Operating Procedure (SOP) of acupuncture clinical trials at all steps. Previous studies reported that design and pre-registration were important strategy to improve quality [25, 26]; in the current study, the stakeholders also suggested that early stage of the trials was very important, and “prevention in advance” would help improving quality of trials.

Conduction was another key in the whole process of acupuncture trials [27]. Since acupuncture practicing needed technology and personality, acupuncture clinical trials had specific properties, and thus, the quality control in this phase would be different from the drug trials. The quality control should also measure trials’ generality and specialty. The current study suggested a lack of consistent management and training in conduction of acupuncture trials, although previous studies suggested the importance of GCP principles and protocol-specific training [28, 29]. Because, the adaptable of acupuncture intervention in work, the inner motivation of the medical staffs, and the conduction process were all critical, enhance training to improve skills was important for quality of the current stage.

The methodology and quality of reporting were also suggested in the current study to improve the acupuncture clinical trials, which was consistent with previous study in which high-quality research required standardized reporting [30]. However, it did not play the key role from the authors’ aspect [31]. For this aspect, the journals could play more roles, because they could say “no” to papers those did not report well. Therefore, editors should also be crucial in measuring the quality of the acupuncture paper’s “output” [32], which would help improve the quality of acupuncture clinical trials.

The study suggested that dissemination of evidence of acupuncture clinical trials was also an important step, because it facilitated the generalization of results and conclusions into clinical practice [33]. Citation and speed of dissemination were the two main criteria for evaluating the quality of a paper. A high-quality paper represented high-level scientific research [34]. There were many factors which contribute to the quality control, such as the publicity and promotion of the research team, the allocation of research resources by health policy makers, and the trust of users of evidence and the public. Thus, the dissemination of evidence of acupuncture trials should provide more attention for these factors. Evidence transformation and application was the ultimate ‘measure’ of the quality of acupuncture clinical trials, as well as the source and reference for new studies [35]. The transformation and application of research evidence was of great significance in clinical practice [36]. Currently, there were known gaps between trials and clinical practice [37], and the reasons included the research contexts, selection and characteristics of participants, the conversion platform, and investigators, and low quality of evidence [10]. Thus, it was also needed to focus on the research evidence transformation and application in future.

There were several strengthens of the study. First, using a qualitative method was the major strength. Second, stakeholders in different locations and disciplines provided more reliable results. Third, the interviewers had experience and training in conducting qualitative research and strictly followed the research steps and methods. However, there were also several limitations. First, inherently subjective was  the main problem. Second, international experts were not involved in the current study. Third, the sample size was  relatively small, and future studies should be performed to validate these results.

In conclusion, the results reveal that to improve the quality of acupuncture, trial design, trial conduction, research results reporting and publication, research evidence dissemination, and research evidence transformation and application should be all considered. Thus, it is needed to develop a guideline for the quality control of the whole process of acupuncture clinical trials.

Availability of data and materials

Statement Data are available upon reasonable request from corresponding author. Study protocol and original data are available on request by emailing the corresponding authors.

Abbreviations

JAMA:

The Journal of the American Medical Association

BMJ:

British Medical Journal

COREQ:

Consolidated Criteria for Reporting Qualitative Research

SOP:

Standard Operating Procedure

CONSORT:

Consolidated standards of reporting trials

GCP:

Good Clinical Practice

References

  1. Smith M, Burton A, Falkenberg T. World Health Organization Traditional Medicine Strategy 2014–2023. HerbalGram 2014.

  2. Health AGDO. Australian Government Department of Health. Medicare Benefits Schedule. In., vol. 2022. 2014.

  3. Rubin R. Medicare proposes coverage of acupuncture for lower back pain. JAMA. 2019;322(8):716.

  4. Lee I, Chae Y. A bibliometric analysis of acupuncture research trends inAcupuncture in Medicine. Acupunct Med. 2019;37(6):375–7.

  5. Hershman DL, Unger JM, Crew K. Acupuncture for aromatase inhibitor-related joint pain among breast cancer patients. JAMA. 2018;320(21):2270–1.

  6. Xu S, Yu L, Luo X, Wang M, Chen G, Zhang Q, Liu W, Zhou Z, Song J, Jing H, et al. Manual acupuncture versus sham acupuncture and usual care for prophylaxis of episodic migraine without aura: multicentre, randomised clinical trial. BMJ. 2020;368:m697.

  7. Yang JW, Wang LQ, Zou X, Yan SY, Wang Y, Zhao JJ, Tu JF, Wang J, Shi GX, Hu H, et al. Effect of acupuncture for postprandial distress syndrome: a randomized clinical trial. Ann Intern Med. 2020;172(12):777–85.

  8. Birch S, Lee MS, Alraek T, Kim T. Overview of treatment guidelines and clinical practical guidelines that recommend the use of acupuncture: a bibliometric analysis. J Altern Complement Med. 2018;24(8):752–69.

  9. Tang X, Shi X, Zhao H, Lu L, Chen Z, Feng Y, Liu L, Duan R, Zhang P, Xu Y, et al. Characteristics and quality of clinical practice guidelines addressing acupuncture interventions: a systematic survey of 133 guidelines and 433 acupuncture recommendations. BMJ Open. 2022;12(2):e58834.

  10. Lu L, Zhang Y, Tang X, Ge S, Wen H, Zeng J, Wang L, Zeng Z, Rada G, Ávila C, et al. Evidence on acupuncture therapies is underused in clinical practice and health policy. BMJ. 2022;376:e67475.

  11. Baoyan L, Chen B, Yi G, Lixin T. Acupuncture-a national heritage of china to the world: international clinical research advances from the past decade. Acupunct Herbal Med. 2021;1(02):65–73.

  12. Zhang Y, Lu L, Xu N, Tang X, Shi X, Carrasco-Labra A, Schünemann H, Chen Y, Xia J, Chen G, et al. Increasing the usefulness of acupuncture guideline recommendations. BMJ. 2022;376:e70533.

  13. Sales AE, Wilson PM, Wensing M, Aarons GA, Armstrong R, Flottorp S, Hutchinson AM, Presseau J, Rogers A, Sevdalis N, et al. Implementation Science and Implementation Science Communications: our aims, scope, and reporting expectations. IMPLEMENT SCI. 2019;14(1):77.

  14. Fei Y, Cao H, Xia R, Chai Q, Liang C, Feng Y, Du Y, Yu M, Guyatt G, Thabane L, et al. Methodological challenges in design and conduct of randomised controlled trials in acupuncture. BMJ. 2022;376:e64345.

  15. Tenny S, Brannan GD, Brannan JM, Sharts-Hopko NC. Qualitative Study: Treasure Island (FL): StatPearls Publishing; 2022.

  16. Jordan J, Clarke SO, Coates WC. A practical guide for conducting qualitative research in medical education: Part 1-How to interview. AEM Educ Train. 2021;5(3):e10646.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health C. 2007;19(6):349–57.

    Article  Google Scholar 

  18. Korstjens I, Moser A. Series: Practical guidance to qualitative research. Part 2: Context, research questions and designs. Eur J Gen Pract. 2017;23(1):274–9.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Fusch P, Ness L. Are we there yet? data saturation in qualitative research. Qualitative report. 2015;20(9):1408.

    Google Scholar 

  20. Malterud K, Siersma VD, Guassora AD. Sample Size in Qualitative Interview Studies: Guided by Information Power. Qual Health Res. 2016;26(13):1753–60.

    Article  PubMed  Google Scholar 

  21. Coates WC, Jordan J, Clarke SO. A practical guide for conducting qualitative research in medical education: Part 2-Coding and thematic analysis. AEM Educ Train. 2021;5(4):e10645.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Phillippi J, Lauderdale J. A guide to field notes for qualitative research: context and conversation. Qual Health Res. 2018;28(3):381–8.

    Article  PubMed  Google Scholar 

  23. Moradi H, Schneider M, Streja E, Cooper D. Feasibility and acceptability of a structured quality by design approach to enhancing the rigor of clinical studies at an academic health center. J Clin Transl Sci. 2021;5(1): e175.

    Article  PubMed  PubMed Central  Google Scholar 

  24. He Y, Li J, Li Y, Jin R, Wen Q, Li N, Zhang Y. Strengthening the quality of clinical trials of acupuncture: a guideline protocol. BMJ Open. 2022;12(1):e53312.

    Article  Google Scholar 

  25. Bradley SH, Lloyd KE, DeVito NJ. Automatic registration for UK trials. BMJ. 2022;376:o41.

    Article  PubMed  Google Scholar 

  26. Liu Y, Chen W, Tan Y, Yang X, Liu J, Lu T, Yan S, He L, Liu B. Analysis of the registration information on interventions of acupuncture and Moxibustion trials in the international clinical trials registry platform. Evid-Based Compl Alt. 2018;2018:1–12.

    Article  Google Scholar 

  27. Wolfenden L, Foy R, Presseau J, Grimshaw JM, Ivers NM, Powell BJ, Taljaard M, Wiggers J, Sutherland R, Nathan N, et al. Designing and undertaking randomised implementation trials: guide for researchers. BMJ. 2021;372:m3721.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Groves T. Enhancing the quality and transparency of health research. BMJ. 2008;337(7661):a718.

    Article  PubMed  Google Scholar 

  29. Bechtel J, Chuck T, Forrest A, Hildebrand C, Panhuis J, Pattee SR, Comic-Savic S, Swezey T. Improving the quality conduct and efficiency of clinical trials with training: Recommendations for preparedness and qualification of investigators and delegates. Contemp Clin Trials. 2020;89:105918.

    Article  PubMed  Google Scholar 

  30. Svenkerud S, MacPherson H. The impact of STRICTA and consort on reporting of Randomised control trials of acupuncture: a systematic methodological evaluation. Acupunct Med. 2018;36(6):349–57.

    Article  PubMed  Google Scholar 

  31. Zeng J, Lin G, Li L, Lu L, Chen C, Lu L. Assessment of reporting quality in Randomised controlled trials of acupuncture for post-stroke rehabilitation using the consort statement and STRICTA guidelines. Acupunct Med. 2017;35(2):100–6.

    Article  PubMed  Google Scholar 

  32. Lee KP, Schotland M, Bacchetti P, Bero LA. Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002;287(21):2805–8.

    Article  PubMed  Google Scholar 

  33. Harden SM, Steketee A, Glasgow T, Glasgow RE, Estabrooks PA. Suggestions for advancing pragmatic solutions for dissemination: potential updates to evidence-based repositories. Am J Health Promot. 2021;35(2):289–94.

    Article  PubMed  Google Scholar 

  34. Leppin AL, Mahoney JE, Stevens KR, Bartels SJ, Baldwin LM, Dolor RJ, Proctor EK, Scholl L, Moore JB, Baumann AA, et al. Situating dissemination and implementation sciences within and across the translational research spectrum. J Clin Transl Sci. 2019;4(3):152–8.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Volk ML. Implementation science: Accelerating translation of clinical evidence into practice. Hepatology. 2022;76:298–9.

    Article  PubMed  Google Scholar 

  36. Wang Q, Li N, Li J, He Y, Li Y, Zhong D, Liu X, Fan J, Jin R, Kang D, et al. A protocol of a guideline to establish the evidence ecosystem of acupuncture. Front Med (Lausanne). 2021;8:711197.

    Article  PubMed  Google Scholar 

  37. Vandvik PO, Brandt L. Future of evidence ecosystem series: evidence ecosystems and learning health systems: why bother? J Clin Epidemiol. 2020;123:166–70.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank all individuals who took the time to participate in our interviews.

Rights and permissions

This article is published under license to Qualitative Health Research. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, with the original work properly cited.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Science Foundation of China (82004213) and the Project of Sichuan Provincial Department of Science and Technology (2021YFH0191).

Author information

Author notes

  1. Ying He and Nian Li contributed equally to this work.

Authors and Affiliations

  1. Division of Internal Medicine, Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China

    Ying He, Qian Wen & Ning Li

  2. Department of Medical Administration, West China Hospital, Sichuan University, Chengdu, China

    Nian Li & Ying Wang

  3. Department of Evidence Based Medicine and Clinical Epidemiology, West China Hospital, Sichuan University, Chengdu, Sichuan, China

    Qin Wang & Yonggang Zhang

  4. Division of Head & Neck Tumor Multimodality Treatment, Cancer Center, West China Hospital, Sichuan University, Chengdu, 610041, China

    Zelei Dai

  5. International Medical Center, General Practice Unit, West China Hospital, Sichuan University, Chengdu, China

    Miaomiao Wu & Haiqi Song

  6. Department of Periodical Press, West China Hospital, Sichuan University, Chengdu, 610041, China

    Yonggang Zhang

Authors
  1. Ying He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nian Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ying Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zelei Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Miaomiao Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Haiqi Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Qian Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ning Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Yonggang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Yonggang Zhang: study concept and design, analysis and interpretation of data, drafting of the manuscript, critical revision of the manuscript for important intellectual content, statistical analysis, technical or material support, and study supervision. Ning Li: critical revision of the manuscript for important intellectual content, technical or material support, and study supervision. Ying He: acquisition of data, analysis and interpretation of data, drafting of the manuscript, critical revision of the manuscript for important intellectual content, statistical analysis, and technical and material support. Nian Li: analysis and interpretation of data and critical revision of the manuscript for important intellectual content. Qin Wang and Ying Wang: statistical analysis. Zelei Dai, Qian Wen, Miaomiao Wu and Haiqi Song: critical revision of the manuscript for important intellectual content. All authors have read and approved the final manuscript, and each meets the criteria for authorship established by the International Committee of Medical Journal Editors and verifies the validity of the results reported.

Corresponding authors

Correspondence to Ning Li or Yonggang Zhang.

Ethics declarations

Ethics approval and consent to participate

Ethical approvals was were obtained from Ethics Committee on Biomedical Research of West China Hospital of Sichuan University Institutional Review board (No. 2021 Annual Review (1188)). Informed consent was obtained from the interviewees who agreed to participate in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Other information

The study is the basis to develop a guideline, and the guideline was registered on the Global Practice Guidelines Registry Platform (registration number: IPGRP-2021CN093).

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, Y., Li, N., Wang, Q. et al. Factors influencing the quality of acupuncture clinical trials: a qualitative interview of stakeholders. BMC Complement Med Ther 23, 326 (2023). https://doi.org/10.1186/s12906-023-04020-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12906-023-04020-w

Keywords

BMC Complementary Medicine and Therapies

ISSN: 2662-7671

Contact us