Acupuncture has been widely used for acute low back pain (LBP), yet there remains continued controversy regarding its efficacy. Therefore, we aimed to critically evaluate the evidence for acupuncture as an effective treatment for acute LBP. English and Chinese databases were searched for randomized controlled trials (RCTs) that involved acupuncture for acute LBP published up to May 2020. Data on the outcomes of pain intensity, functional status, and analgesic use were extracted. The meta-analysis was performed using the Cochrane Collaboration's RevMan 5.3, and pooled data were expressed as mean differences (MD) with 95% confidence intervals (CIs). Of the 13 eligible RCTs identified, 11 RCTs (involving 707 patients) provided moderate-quality evidence that acupuncture has a statistically significant association with improvements in VAS (visual analog scale) score [MD: -1.75 (95% CI: -2.39, -1.12)]. Two studies indicated that acupuncture did not influence the RMDQ (Roland-Morris Disability Questionnaire) scores more than the control treatment [MD: -2.34 (95% CI: -5.34, 0.67)]. Three studies suggested that acupuncture influenced the ODI (Oswestry Disability Index) scores more than the control treatment [MD: -12.84 (95% CI: -23.94, -1.74)]. Two studies suggested that acupuncture influenced the number of pills more than the control treatment [MD: -3.19 (95% CI: -3.45, -2.92)]. Acupuncture treatment of acute LBP was associated with modest improvements in the VAS score, ODI score, and the number of pills, but not the RMDQ score. Our findings should be considered with caution due to the low power original studies. High-quality trials are needed to assess further the role of acupuncture in the treatment of acute LBP.