A large body of research has examined people’s attitudes toward mandatory vaccination to cope with the COVID-19 pandemic. However, studies have yet to explore how Chinese people view the COVID-19 vaccine mandates, let alone placing such views in the country’s highly politicized context. On the other hand, facing the high pressure of loosening its zero-COVID policies amidst the worldwide practices of co-existing with the COVID-19 virus, the country has to improve its vaccination coverage quickly. In this situation, it is more than necessary to systematically investigate the Chinese public’s attitude to mandatory vaccination against the virus and the underlying determinants. The current study utilizes data from a national survey adopting quota sampling to analyze the Chinese public’s medical and non-medical considerations when judging compulsory COVID-19 vaccination. The study reveals that thanks to China’s successful lockdown policies, personal risk, and benefit perceptions did not dominate their views regarding vaccination mandates. Instead, conspiracy beliefs regarding the pandemic outbreaks, conspiratorial thinking, and nationalism more strongly predicted their willingness to accept mandatory vaccination. Given the potentially massive impacts of the COVID-19 infection, if China opens its door and loosens its strict quarantine restrictions, the Chinese public needs to be educated with more medically valuable and relevant information to improve their vaccination protection against COVID-19.