Achieving the thermal conductivity required for efficient heat management in semiconductors and other devices requires the integration of thermally conductive ceramic fillers at concentrations of 60 vol% or higher. However, the increased filler content often negatively affects the mechanical properties of the composite matrix, limiting its practical applicability. To address this issue, in this paper, we present a new strategy to reduce the required ceramic filler content: the use of a thermally conductive ceramic composite filler with carbon nanotubes (CNT) grown on aluminum nitride (AlN). We have combined catalyst coating technology with vacuum filtration to ensure that the catalyst is uniformly applied to micrometer-sized AlN particles, followed by efficient and uniform synthesis of CNTs using a water-assisted process in a vertical furnace. By carefully controlling the number of vacuum filtration cycles and the growth time of the CNTs, we demonstrate precise control over the number and length of the CNT layers, thereby adjusting the properties of the composite to the intended specifications. When AlN/CNT hybrid fillers are incorporated into silicone rubber, while maintaining the mechanical properties of rubber, the thermal diffusivity achieved at reduced filler levels exceeds that of composites using AlN-only or simultaneous AlN and CNTs formulations. This demonstrates the critical role of CNTs on AlN surfaces. Our study represents a significant advancement in the design of thermally conductive materials with potential implications for a wide range of applications.