In this paper, feasibility of the initial alignment of the gyro-free inertial navigation system (GF-INS) is investigated. Initial roll and initial pitch are obtained as the conventional INS since centripetal acceleration is very small. Relation between initial heading and accelerometers’ outputs of the gyro-free inertial measurement unit (GF-IMU) is derived. It is determined from the relation whether initial heading can be obtained in 15 GF-IMUs which have been presented in research literatures. The relationship between the accelerometer errors of GF-IMU and the initial heading error is derived. When gyros are additionally attached in one axis or two axes of the body frame, it is investigated that initial heading can be obtained. The initial heading error is also calculated from the accelerometer errors and the gyroscope errors. The results show that the initial heading from only accelerometer outputs of the GF-IMU cannot be used in the GF-INS since the error is too large. It can also be seen from the results that the initial heading can be used in the GF-INS if two gyroscopes are additionally attached to the roll and pitch axes of the body frame.