Machine learning methods have widely been applied to detect anomalies in machine and cutting tool behavior during lathe or milling. However, detecting anomalies in the workpiece itself did not get the same attention by researchers. That is why in this article, the authors present a pub-licly available multivariate time series dataset which was recorded during milling of 16MnCr5. Due to artificially introduced, though realistic anomalies in the workpiece the dataset can be ap-plied for anomaly detection. By using a convolutional autoencoder as a first model good results in detecting the location of the anomalies in the workpiece were achieved. Furthermore, milling tools with two different diameters where used which led to a dataset eligible for transfer learn-ing. The objective of this article is to provide researchers with a real-world time series dataset of the milling process which is suitable for modern machine learning research topics like anomaly detection and transfer learning.