N-linked glycans on immunoglobulin G (IgG) have been associated with pathogenesis of diseases and the therapeutic functions of antibody-based drugs; however, low-abundance species are difficult to detect. Here we show a glycomic approach to detect these species on human IgGs using a specialized microfluidic chip. We discover 20 sulfated and 4 acetylated N-glycans on IgGs. Using multiple reaction monitoring method, we precisely quantify these previously undetected low-abundance, trace and even ultra-trace N-glycans. From 277 patients with rheumatoid arthritis (RA) and 141 healthy individuals, we also identify N-glycan biomarkers for the classification of both rheumatoid factor (RF)-positive and negative RA patients, as well as anti-citrullinated protein antibodies (ACPA)-positive and negative RA patients. This approach may identify N-glycosylation-associated biomarkers for other autoimmune and infectious diseases and lead to the exploration of promising glycoforms for antibody therapeutics.