Primary dysmenorrhea (PD), one of the most common diseases in women, is known to be effective with object-separated moxibustion. However, because there is no large sample size for comparison, it is difficult to choose the best method for the clinical treatment of these different treatments. Therefore, our aim was to compare and rank different moxibustion methods to determine the most effective treatment method for PD.A systematic search was carried out in PubMed, Cochrane Central Register of Controlled Trials, China National Knowledge Infrastructure, Wanfang Database, and Chinese Biomedical Literature, to identify the randomized controlled trials (RCTs) investigated the object-separated moxibustion is associated with dysmenorrhea, as well as we also manually checked the bibliographies of eligible studies and topic-related reviews, RCTs from their inception to May 1, 2020. Three investigators read the citations and excluded quasi-randomized trials and trials that were incomplete. We extracted data following a predefined hierarchy. We assessed the studies' risk of bias in accordance with the Cochrane Handbook for Systematic Reviews of Interventions and certainty of evidence using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework. The primary outcomes were efficacy (response rate) and dysmenorrhea scores. We estimated the summary odds ratio (OR) and mean difference (MD) using pairwise and network meta-analyses with random effects. STATA software version 16.0, ADDIS software version 1.16.5, and R software version 3.6.1 were used to statistically analyze all data.Fifty-six RCTs with 5550 patients were included, comparing 6 object-separated moxibustion therapies with acupuncture or oral medicine. All moxibustions were more effective than ibuprofen, with OR ranging between 6.75 (95%CI: 3.58 to 13.22) for moxibustion at the navel. For relieving pain which uses dysmenorrhea score to evaluate, mild moxibustion (MD = -1.42, -4.24 to 0.85) was more effective than others. A total of 24 (42.8%) of 56 trials were rated as having a high risk of bias, 31(55.4%) as moderate, and 1(1.8%) as low, and the certainty of the evidence was moderate.Mild moxibustion cannot only effectively treat PD but also relieve pain in comparison with ibuprofen. Although GRADE evidence indicate low to moderate for most comparisons, mild moxibustion seems to be an advisable option for PD treatment to relieve symptoms.Copyright © 2021 the Author(s). Published by Wolters Kluwer Health, Inc.