Pneumonia is a leading cause of death worldwide, and one of the most significant approaches to diagnose pneumonia is Chest X-ray (CXR) since it was used in clinical scenes. Convolutional neural networks (CNNs) have been widely used in computer vision community. Along with the development of CNNs, we want to make use of CNNs to recognize CXR of people who get pneumonia and make classification. It is important, especially during epidemic period. In this paper, we present a new type of residual learning framework, PEPX-Resnet, which makes use of a type of lightweight residual, and apply this network to CXR dataset. The result shows that PEPX-Resnet is easier to optimize and can have better results, especially for COVID-19 cases. PEPX-Resnet could reach higher accuracy, f1 score and some other evaluations for CXR dataset.