Hyperspectral anomaly detection is to recognize anomalies from complex scene in an unsupervised way. Currently, many spectral-spatial detection methods have been proposed with a cascaded manner. However, they often neglect complementary characteristics between spectral and spatial dimensions, which easily leads to yield high false alarm rate. To alleviate this issue, a spectral-spatial information fusion (SSIF) method is designed for hyperspectral anomaly detection. First, an isolation forest is exploited to obtain spectral anomaly map, in which the object-level feature is constructed with entropy rate segmentation algorithm. Then, a local spatial saliency detection scheme is proposed to produce spatial anomaly result. Finally, the spectral and spatial anomaly scores are integrated together followed by a domain transform recursive filtering to generate the final detection result. Experiments on five hyperspectral datasets prove that the proposed SSIF produces superior detection result over other state-of-the-art detection techniques.