Quantitative differential phase contrast (qDPC) imaging has become an important method of optical measurement and life science research in microscopy because of its high reconstruction resolution and non-invasive, high-contrast and quantitative imaging of biological samples. Despite the continuous development of the principle and algorithm, the frame rate of the existing qDPC algorithm is still much lower than that of camera acquisition, so it is hardly applied to real-time image the fast-moving biological samples. In this paper, based on color-coded multiplexing strategy, a compact real-time quantitative phase imaging system is designed to realize multi-mode imaging. The system employs a programmable LED array to illuminate directly, and the phase reconstruction algorithm is deployed in the graphics processing unit (GPU) of the laptop to accelerate the calculation. The system can achieve high-speed quantitative phase imaging of non-stained biological samples, and the frame rate can reach 60fps. The device has the advantages of compact structure, low cost and portability. Thus, it is suitable for mobile medical applications.