This contribution shows the possibilities of a low-cost multipurpose data logger that was built around an Arduino Mega 2560 single board computer. To transform the Arduino Mega into such a data logger, a sensor shield was designed that contains an SD-card, real-time clock, and different kinds of connectors so that sensors can easily be attached to the device. The software considers a wide range of predefined sensors from which a user can choose. To assess the performance of such a device, short-term monitoring campaigns in relation to outdoor air quality, human activity in an office, motion of a journey on a bike, and exhaust gas monitoring of a diesel generator were realized. Besides the possibilities to apply the data logger in different kinds of applications, a method is proposed to assess the credibility of such a system. The assessment based on the various short-term campaigns showed that the system scores positively on most of the performance indicators, but that unexpected (black swan) events affect the assessment over the longer term. This makes the development of low-cost scientific instruments harder than expected. The stability and long-term performance of this type of design requires continuous evaluation and engineering correction.