Atmospheric nitrogen (N) deposition has been substantially reduced due to declines in the reactive N emission in major regions of the world. Nevertheless, the impact of reduced N deposition on soil microbial communities and the mechanisms by which they are regulated remain largely unknown. Here, we examined the effects of N addition and cessation of N addition on plant and soil microbial communities through a 17-year field experiment in a temperate grassland. We found that extreme N input did not irreversibly disrupt the ecosystem, but ceasing high levels of N addition led to greater resilience in bacterial and fungal communities. Fungi exhibited diminished resilience compared to bacteria due to their heightened reliance on changes in plant communities. Neither bacterial nor fungal diversity fully recovered to their original states. Their sensitivity and resilience were mainly steered by toxic metal ions and soil pH differentially regulating on functional taxa. Specifically, beneficial symbiotic microbes such as N-fixing bacteria and arbuscular mycorrhizal fungi experienced detrimental effects from toxic metal ions and lower pH, hindering their recovery. The bacterial functional groups involved in carbon decomposition, and ericoid mycorrhizal and saprotrophic fungi were positively influenced by soil metals, and demonstrated gradual recovery. These findings could advance our mechanistic understanding of microbial community dynamics under ongoing global changes, thereby informing management strategies to mitigate the adverse effects of N enrichment on soil function.