Welfare assessment for the endangered red panda (Ailurus fulgens) in captivity requires systematic behaviour monitoring, yet traditional direct observation is often limited by observer subjectivity and time constraints. This study evaluates the feasibility of employing machine learning (ML) to automate behavioural monitoring of a red panda in a complex, mixed-species enclosure at Aalborg Zoo, Denmark. Using video data from cameras in the enclosure of the red panda, and the machine learning model LabGym for animal detection and behavioural categorisation, models were trained to analyse activity patterns of the red panda. The results demonstrate that while the behaviour categorizer is a promising tool with high classification confidence, the overall system effectiveness is currently limited by the object detector’s performance in a naturalistic environment. Challenges such as environmental obstructions such as rocks, foliage, and trees, and the animal’s camouflage contributed to a significant amount of unclassified time, which may affect the overall assessment of behavioural distribution. We conclude that while ML holds potential for non-invasive behaviour monitoring, its application in complex zoo settings requires improved detection capabilities to be fully reliable. Future iterations of this system could be enhanced by complementing standard object detection with pose estimation frameworks. Implementing alternative labelling strategies or background subtraction methods could additionally mitigate the detection challenges posed by environmental obstruction.