Safety of acupuncture by Korean Medicine Doctors: a prospective, practice-based survey of 37,490 consultations

Abstract

Background

To evaluate safety of acupuncture treatment by Korean Medicine Doctors (KMDs), a prospective, practice-based survey on adverse events (AEs) associated with acupuncture was conducted.

Methods

From July 2016 to October 2017, KMDs were invited to participate in an online survey. Frequency was calculated as the number of AEs per 10,000 treatments; severity was assessed with the Common Terminology Criteria for Adverse Events Grading (Severity) Scale; and causality was evaluated using the World Health Organisation-Uppsala Monitoring Centre system for standardised case causality assessment. Associations between AE occurrence and KMDs’ type of practice/clinical experience and patient age/gender/current medication(s) were analysed.

Results

Data on 37,490 acupuncture treatments were collected from 222 KMDs. At least one AE was reported from 4,518 acupuncture treatments, giving a frequency rate of 1,205 per 10,000 acupuncture treatments; this increased to 4,768 treatments when administrative problems related to defective devices or medical negligence were added, for a rate of 1,272 per 10,000 acupuncture treatments. Commonly reported AEs were bleeding, needle site pain, and bruising. Approximately 72.9% of AEs/administrative problems were assessed as they certainly occurred by acupuncture treatment in causality assessment. Most AEs/administrative problems were considered mild in severity and two life-threatening AEs were resolved with no sequelae. Compared to males, female patients were more likely to experience AEs and KMDs’ clinical experience was not associated with reported AE occurrence.

Conclusions

Although acupuncture-associated AEs occur commonly, they are largely transient and mild. Acupuncture performed by qualified KMDs may serve as a reliable medical treatment with acceptable safety profiles.

Background

Acupuncture, as one of the most commonly used complementary and alternative medicine therapeutic modalities, is increasingly popular across the globe [1]. While evidence of the efficacy of acupuncture has accumulated over decades, mainly from studies of chronic pain [2], its safety has been less extensively investigated. Although previous large-scale studies from the UK [3], Germany [4], and Japan [5] reported an acceptable safety profile for acupuncture treatment, outcomes may differ according to the clinical and cultural context where it is performed.

In South Korea, acupuncture is among the most common treatment modalities in Korean Medicine practice, is legally practised only by Korean Medicine Doctors (KMDs) and is routinely reimbursed by the national health insurance system. Common acupuncture-related techniques include manual acupuncture, electroacupuncture, moxibustion, cupping, auricular acupuncture, and pharmacopuncture [6, 7]. Previous studies of acupuncture and pharmacopuncture reported that these treatments are a relatively safe option when performed by qualified KMDs [8, 9]. These studies were retrospectively conducted in one or two hospitals, such that they may not be entirely free from recall bias and may lack applicability to small private practices that account for >97% of Korean Medicine institutions [8,9,10]. While a prospective study involving 13 KMDs reported on 99 AEs from among 89 patients [11], its sample size was smaller compared with previous studies from the UK [3], Germany [4] or Australia [12], making it virtually impossible to detect rare AEs. However, rare but serious AEs do occur judging by reports from emergency departments of tertiary hospitals [13] and the Korea Medical Dispute Mediation and Arbitration Agency [14]; thus, a larger-scale prospective evaluation of acupuncture safety when performed by KMDs is warranted.

In this context, we conducted a practice-based online survey to establish the safety of acupuncture as currently practised in real-world settings.

Methods

A prospective study was performed using a previously developed survey form [15] and was approved by the ethics committee of Kyung Hee University (KHSIRB-16-032).

Based on Hanley’s rule of three, we calculated that 30,000 acupuncture treatments were required to identify any AE that occurred more frequently than once per 10,000 treatments [16], which was considered the probability of pneumothorax [17, 18], a rare but serious AE of acupuncture.

From July 2016 to October 2017, KMDs who attained national licensure through state examination after a six-year medical education and were practising at the time of the study were invited by email and text messaging to participate in this study. Participation was not limited by location or type of practice as data were collected via an online system. Those who volunteered to participate provided informed consent. To achieve consistency in data collecting and reporting, we distributed manuals containing instructions on how to fill out survey items to minimise under- or over-reporting and requested participants to complete survey for more than 5 consecutive working days to minimise variances between weekdays and selective reporting. The online survey system was secured so that neither participating KMDs nor study investigators had access to data once submitted.

Information about KMDs, patients' comorbidities and current medications, acupuncture treatment, administrative problems, and local/systemic AEs was collected. Administrative problems included problems due to defective devices and/or incidents that were process-related and deviated from standard practices, e.g., doctor negligence [19]. Because not all administrative problems lead to AEs, KMDs were asked to report whether this occurred. Details regarding data collection [15] are available as online Supplemental Appendix 1.

AEs were analysed in terms of frequency, severity, and causality. Two independent researchers reviewed and classified AE data for severity and causality assessment and any case of disagreement was arbitrated by a panel of drug and intervention safety experts.

Following the Council for International Organisations of Medical Sciences (CIOMS) guidelines [20], we categorised the frequency of administrative problems, local AEs, and systemic AEs as very common (≥1/10), common (≥1/100 and <1/10), uncommon (≥1/1,000 and <1/100), rare (≥1/10,000 and <1/1,000), or very rare (<1/10,000). Frequency data were expressed as number of AEs per 10,000 acupuncture treatments.

AE severity was classified based on the Common Terminology Criteria for Adverse Events (CTCAE) grading scale [21] as mild, moderate, severe, life-threatening, or death (Supplemental Table 1).

AE causality was evaluated using the World Health Organisation-Uppsala Monitoring Centre (WHO-UMC) system for standardised case causality scale [22] as certain, probable/likely, possible, unlikely, conditional/unclassified, or unassessable/unclassifiable (Supplemental Table 2).

All analyses were conducted using SAS 9.4 statistical software (SAS Institute, Cary, NC, USA). Data regarding doctors, patients, acupuncture treatment type, administrative problems, and local/systemic AEs were presented in a descriptive manner. Continuous variables (e.g., patient age) were reported as mean ± standard deviation (SD) and categorical variables were reported as number (percentage).

When analysing associations between AEs and various risk factors, correlation of observations within the same cluster, i.e., individual KMDs was considered using intraclass correlation coefficient (ICC). ICC values between 0.5 and 0.75 were considered indicative of moderate inter-rater reliability and values between 0.75 and 0.9 indicative of good reliability [23]. We implemented a population-averaged model using a generalised estimating equation (GEE) [24, 25] method fitted with the logit link and exchangeable working correlation structure. The GEE model was utilised to test associations between the odds of any kind of local and/or systemic AEs and KMDs’ years of experience, type of practice, and with patients’ gender and age. It was also used to determine relationships between the odds of experiencing AEs due to doctor negligence and KMDs’ years of experience (practice <5 years vs ≥5 years) [26]. Bleeding and bruising, the two most frequently reported AEs in previous prospective studies [3, 4, 27, 28], were also analysed post-hoc using GEE to determine whether they were linked to patient factors such as gender, age, and use of anticoagulants.

An odds ratio (OR) for respective variables was presented with a 95% robust confidence interval (CI).

Results

In total, 278 KMDs consented to participate in the study; of these, 222 (1.2% of the Association of Korean Medicine members invited to participate) provided data on 37,490 acupuncture treatments (median enrolment period: 129 days; interquartile range: 102-204.5 days). Approximately one-half of participating KMDs (46.8%) had ≥ 5 years of experience; participants practised in private clinics (n=103; 46.4%), community health centres (n=74; 33.3%), and hospitals (n=45; 20.3%). The average age of patients was 59.3 ± 18.5 (mean ± SD) years and 62.5% were female. The most common comorbidity was cardiovascular disease (n=11,727; 31.3%) (Table 1).

Table 1 Characteristics of Participating KMDs and Patients (N = 37,490 acupuncture treatments)

The most common conditions for which acupuncture was performed in 37,490 treatments were musculoskeletal disorders (n=31,971; 85.3%). Manual acupuncture (n=35,781; 95.4%), electroacupuncture (n=11,110; 29.6%), moxibustion (n=8,916; 23.8%), and pharmacopuncture (n=3,398; 9.1%) were the most frequently used modalities ( Supplemental Table 3).

A total of 6,645 events (6,199 local or systemic AEs among 4,518 treatments and 446 administrative problems among 434 treatments) were reported. That is, at least one AE was reported in 4,518 out of 37,490 acupuncture treatments, giving a frequency rate of 1,205 per 10,000 acupuncture treatments (95% CI [1,172, 1,238]), classified as “very common.” The four most frequently reported AEs classified as “common” by CIOMS criteria were bleeding, needle site pain, bruising, and redness.

A total of 446 administrative problems due to defective devices or doctor negligence was reported from 434 acupuncture treatments. Of them, the number of acupuncture treatments where only administrative problems without AEs were reported was 250. Of 434 acupuncture treatments with one or more administrative problems, 110 treatments (25.3% of 434 treatments) were reported to have resulted in one or more AEs.

Altogether, the number of acupuncture treatments with at least one AE or administrative problem was 4,768 (4,518 treatments with AEs plus 250 treatments with administrative problems) for a frequency of 1,272 per 10,000 (95% CI [1,238, 1,306]), considered as “very common” (Table 2).

Table 2 Frequency of Administrative Problems and AEs Associated with Acupuncture Treatments (N = 37,490)

The majority of AEs/administrative problems were mild in severity (n=6,497; 97.8% of 6,645). Moderate AEs (n=125, 1.9%) included burn due to negligence (n=41), burn for treatment purpose (n=38), blister for treatment purpose (n=25), systemic inflammation (n=15), nerve injury (n=2), fainting as an autonomic nervous system symptom (n=1), paresthesia (n=1), and other local AEs including mouth dryness after taking herbal medicine containing prepared aconite (n=1) and convulsion with chills (n=1). Cases of systemic inflammation were not considered serious AEs because they spontaneously disappeared without additional treatment. There were two life-threatening AEs, one of which was anaphylaxis following bee venom pharmacopuncture treatment (the patient was given pheniramine, dexamethasone and epinephrine injection and recovered) and the other was cellulitis in the wrist after manual acupuncture, moxibustion, and cupping treatment (the patient did not take prescribed antibiotics and - following long-distance travel - pain, swelling, and fever worsened, eyesight declined, and patient was hospitalized; following antibiotic treatment, all symptoms resolved and eyesight was normal in 6 weeks) (Supplemental Table 4).

Among 6,645 AEs and administrative problems, 72.9% (n=4,843) were determined as certainly associated with acupuncture treatment; these included bleeding, pain at needling site, bruising, burns and blisters for treatment purpose, delayed needle removal, forgotten needles, and/or defective needles. AEs and/or administrative problems assessed as probably/likely or possibly associated with acupuncture accounted for 25.6% (n=1,702). It was not possible to determine a causal relationship between acupuncture treatment and some AEs (n=94; 1.4%) due to lack of medical information or documentation, e.g., emotional complaints or sleep disturbance following treatment (Supplemental Table 5). Of two life-threatening AEs, anaphylaxis was determined to be possibly associated with bee venom pharmacopuncture treatment and cellulitis was assessed to have a probable association with manual acupuncture needling (Supplemental Table 4).

We examined whether pre-defined factors were associated with AE occurrence in 4,518 acupuncture treatments where at least one local or systemic AE was reported (Table 3). Likelihood of an AE was clustered among KMDs with moderate correlation (ICC: 0.60). KMDs’ clinical experience, type of practice, and patient age did not significantly affect the frequency of overall AE occurrence. The likelihood of local and/or systemic AEs was significantly higher in female patients (adjusted OR: 1.09, 95% CI [1.03-1.16]). KMDs’ clinical experience (<5 years vs ≥5 years) was not associated with incidents (OR: 1.98, 95% CI [0.90-4.35]).

Table 3 Factors Associated with AEs, Doctor Negligence, and Bleeding and/or Bruising (N=37,490 acupuncture treatments)

Female patients were more likely to experience bleeding/bruising compared with males. The adjusted model showed that female gender (adjusted OR: 1.12, 95% CI [1.02-1.22]) and use of anticoagulants (adjusted OR: 1.26, 95% CI [1.06-1.50]) had a significant impact on the likelihood of experiencing bleeding and/or bruising and a significant interaction between gender and use of anticoagulants was observed (Table 3).

DISCUSSION

In this large-scale, prospective practice-based survey study in which 222 KMDs participated, at least one AE was reported in 4,518 out of a total of 37,490 acupuncture treatments (frequency rate: 1,205 per 10,000). The frequency increases to 1,272 per 10,000 (4,768 out of 37,490) when administrative problems were added, regardless of whether patient harm occurred. Although AEs occurred very commonly, most were mild or moderate in severity. Common AEs included bleeding, needle site pain, and bruising, all of which were classified as certainly associated with acupuncture treatment. Two life-threatening AEs were reported and both patients recovered following treatment with no negative sequelae.

The frequency of AEs and/or administrative problems in the current study is substantially higher compared with previous reports: 14/10,000 treatments in Japan [5]; 111/10,000 treatments in Germany [4]; 320/10,000 treatments in Korea [11]; and 684/10,000 consultations in the UK among medical doctors and physiotherapists [3, 26]. One exception was the UK acupuncturist survey, which reported 1,316 AEs/10,000 acupuncture treatments [29]. This discrepancy may be due partly to differences in: provider training, clinical expertise, and years in practice; patient age/gender, bleeding tendency, and underlying diseases; acupuncture technique such as trigger point/dry needling/Toyohari, or inclusion of bee venom pharmacopuncture or moxibustion; inclusion of problems caused by defective needles or doctors’ negligence; and data collection methods such as intensive monitoring or online survey.

Commonly reported AEs in the present study included bleeding, needle site pain, and bruising, which are similar to previous prospective studies [3, 4, 8, 11, 28, 29]. However, direct comparison may be inappropriate because safety profiles varied greatly in terms of applied acupuncture modalities, types of participating patients and practitioners, and definition of AEs and/or administrative problems [4, 30, 31]. An international consensus of how and what AEs are measured and how they should be reported would make it easier to directly compare acupuncture safety studies across countries.

Although most AEs and administrative problems in this study were mild to moderate in severity, rare but serious AEs should not be ignored. One life-threatening AE was anaphylactic shock after bee venom pharmacopuncture treatment. Judging from previous studies [8, 32] documenting an association between use of bee venom and AEs, it is critically important for KMDs to adhere to current first aid training as in the curriculum of colleges of Korean Medicine to insure patient safety.

A second life-threatening AE was cellulitis with uveitis after acupuncture treatment following a traffic accident. Although local infection and/or systemic inflammation were very rare or rare and were typically mild (and the link between acupuncture needling and uveitis was not clear), it can be prevented almost entirely by enhancing preexisting hygiene training and clean needle technique education, not only in the regular curriculum of Korean Medicine but also in continuing education programmes.

Pneumothorax has been reported in previous studies as a rare but serious acupuncture-associated AE [18, 30, 31, 33, 34], but was not observed in this study. A recent study [8] of safety of acupuncture treatment by KMDs also reported that pneumothorax was very rare (incidence rate 0.005%) and symptoms were transient. While the possibility of underreporting serious AEs cannot be completely excluded, absence of pneumothorax in the present study may be partly attributed to improved training in anatomy and meridian/acupoints in colleges of Korean Medicine in recent years [35, 36].

When KMDs’ clinical experience/type of practice and patients’ age were adjusted, female patients were found to be significantly more likely to experience AEs (OR: 1.09, 95% CI [1.03-1.16]) compared with males, similar to previous findings [37]. Bleeding/bruising accounted for more than half of all AEs, and female patients were at considerably higher risk for these events compared with male patients, which may explain their higher odds. With regard to KMDs’ competence, years of practice, or clinical experience, these factors did not appear related to AE occurrence. Administrative problems due to doctor negligence also appeared unlikely to produce significantly more AEs, consistent with the UK study in which no association between AE frequency and acupuncture training or clinical experience was found [26].

To our knowledge this is the first and largest practice-based study on acupuncture safety in Korea. Survey questions were simple and intuitive, answered by ticking checkboxes online. A total of 222 KMDs voluntarily participated in the survey, resulting in a substantial volume of data on 37,490 treatments [15]. Data were collected without any modification of usual acupuncture practice, such that results reflect current real-world Korean Medicine practice to ensure the validity of study findings. KMD participants represent different practice types and reported on modalities that included not only manual acupuncture, but also techniques such as pharmacopuncture, bee venom pharmacopuncture, warm needling, and cupping, some of which may be infrequently used in other countries. In addition, we collected data related to administrative problems due to defective devices or negligence to comprehensively assess safety issues.

Nevertheless, our study has some limitations. Despite efforts to recruit participants, only 222 of 18,654 KMDs (response rate 1.2%) voluntarily participated in the study. Given that 300-600 KMDs usually respond to a one-time survey and the present study required participants to input data over a period of five consecutive days [38, 39], the enrolment rate is understandable but nonetheless may be considered low.

Another limitation is the possibility of non-response bias. Due to the web-based survey design, KMDs with undependable internet access or those with limited computer skills may have been excluded; further, doctors working in health community centres (33.3% in this study) may represent a younger cohort as they are typically engaged in post-graduate military service compared with the nationwide proportion (4.9%) [36], which could affect study results. However, practice type did not seem to significantly impact AE frequency (Table 3).

This study could be prone to participant reporting bias [40]. While findings are similar to those of previous studies [3, 4, 8, 11, 28, 29], underreporting of serious AEs and/or overreporting of minor/transient AEs such as bleeding and needle site pain may occur. Future surveys should consider having an independent observer report and assess the AEs.

Some may argue that this study is not entirely free from non-negligible availability bias [41] because a majority of reported acupuncture modalities were manual acupuncture (95.4%). However, according to Korean Medicine statistical data [36], manual acupuncture is the most commonly used method, and our results do reflect everyday acupuncture practice.

Lastly, because severity and causality were analysed by independent researchers and experts based on information provided by KMDs, assessment results may not be consistent with participating KMDs’ evaluations. In the future, it would be informative to investigate whether or not practitioners reporting AEs and independent researchers/experts’ assessments of severity and causality may disagree.

It is important to share our findings with KMDs to help them reflect on their current acupuncture practices and to modify them if necessary to improve patient safety. Informing them of actions that might be taken to reduce potentially avoidable adverse incidents such as burns and blisters for treatment purpose, delayed needle removal, or forgotten needles, can be helpful.

Of note, some KMDs reported AEs more often than others, producing a “clustering” effect. Given that this phenomenon was reported in previous studies [11, 37], further research of provider characteristics beyond clinical experience or duration of acupuncture training (that were not associated with increased AE reporting in this study) is required to ascertain what, if any, other factors such as types of acupuncture modalities/styles or stimulation/manipulation methods might contribute.

If issues of overreporting minor AEs and underreporting serious AEs occur based solely on data collected from doctors, as in the present study, the addition of qualitative investigation of patients’ experiences and perspectives on acupuncture-related AEs could help to balance this potential limitation [37].

Previous studies of acupuncture safety used various definitions and criteria for AEs, making direct comparison difficult; for instance, some studies included incidents due to doctor’s negligence [4, 29] whereas others did not [42], and the definition of bleeding varied [15, 28, 31]. Development and implementation of a standardised data collection form could facilitate comparison of AEs across countries or different acupuncture styles/techniques. As frequency, type, and consequences of AEs may vary among different patient subpopulations, e.g., pregnant women, further studies of acupuncture-associated AEs by subgroups are justifiable.

Conclusions

Although frequency of overall AEs associated with acupuncture treatment performed by KMDs were very common, they were transient and mostly mild. Acupuncture treatment provided by qualified KMDs may be considered a safe treatment.