Accurate detection of players and teams in ice hockey games is crucial to the tracking of individual players on court and team tactical decisions, which is therefore becoming an important task for coaches and other analysts. However, hockey is a fluid sport due to complex dynamics and frequent substitutions by both teams, resulting in various body positions of players. Few traditional player detection models from other team sports take these characteristics into account, especially for the detection of teams without prior annotations. Here, we design a two-phase cascaded Convolutional Neural Network (CNN) model coupling between individual players position information and team uniform colors to hierarchically detect players in ice hockey games. Our model filters most of disturbing information, such as audience and sideline advertising bars, in Phase I, and refines the detection of targeted players in Phase II, which is efficient and accurate with a precision rate of 91.30% and a recall rate of 95.60% for individual players detection, and an average accuracy of 93.05% in team classification from a self-built dataset of collected images in the 2018 Winter Olympics. Meanwhile, we also present results based on the images and real-time detection from broadcasting videos of 2019-20 NHL regular games covering all 31 teams to show the robustness of our model.