Most IoT systems meant for implementing mission-critical systems are multi-layered based. The majority of the computing is done in the services and gateway layer. The Gateway layer connects the Internal section of the IoT to the cloud through the Internet. The failure of any node between the services servers and the gateways will isolate the entire network leading to zero tolerance. A networking topology is required to connect the service servers to the gateways, yielding 100% fault tolerance. Empirical formulation of the model chosen to connect the service’s servers to gateways through routers is required to compute the fault tolerance of the network. Rectangular and Interstitial Mesh have been proposed in this paper to connect the service servers to the gateways through the servers that yield 0.999 fault tolerance of the IoT network. An empirical formulation is also presented using which the Fault tolerance of the IoT network can be computed. An enhancement of 11% in the fault tolerance capability of an IoT network has been achieved by implementing Rectangular and Interstitial Mesh in the gateway layer of the network.