Version 1
: Received: 5 July 2023 / Approved: 5 July 2023 / Online: 6 July 2023 (07:54:48 CEST)
How to cite:
Ibarra-Carrillo, M.A.; Molina-Lozano, H.; Montiel-Pérez, J.Y. Short hybrid floating-point formats based on 16-bit for FPGA-based arithmetic implementations. Preprints2023, 2023070374. https://doi.org/10.20944/preprints202307.0374.v1
Ibarra-Carrillo, M.A.; Molina-Lozano, H.; Montiel-Pérez, J.Y. Short hybrid floating-point formats based on 16-bit for FPGA-based arithmetic implementations. Preprints 2023, 2023070374. https://doi.org/10.20944/preprints202307.0374.v1
Ibarra-Carrillo, M.A.; Molina-Lozano, H.; Montiel-Pérez, J.Y. Short hybrid floating-point formats based on 16-bit for FPGA-based arithmetic implementations. Preprints2023, 2023070374. https://doi.org/10.20944/preprints202307.0374.v1
APA Style
Ibarra-Carrillo, M.A., Molina-Lozano, H., & Montiel-Pérez, J.Y. (2023). Short hybrid floating-point formats based on 16-bit for FPGA-based arithmetic implementations. Preprints. https://doi.org/10.20944/preprints202307.0374.v1
Chicago/Turabian Style
Ibarra-Carrillo, M.A., Herón Molina-Lozano and Jesús Yaljá Montiel-Pérez. 2023 "Short hybrid floating-point formats based on 16-bit for FPGA-based arithmetic implementations" Preprints. https://doi.org/10.20944/preprints202307.0374.v1
Abstract
Nowadays, there are implemented devices whose purpose is to perform massive computations by saving resources at the time they reduce the latency of arithmetic operations. These devices are usually GPUs, FPGAs and other specialised devices such as "Coral". Neural networks, digital filters and numerical simulators take advantage of the massively parallel operations of such devices. One way to reduce the amount of resources used is to limit the size of the registers that store data. This has led to the proliferation of numeric formats with a length of less than 32 bits, known as short floating point or SFP. We have developed several SFP’s for use in our neural network accelerator design, allowing for different levels of accuracy. We use a 16-bit format for data transfer and different formats can be used simultaneously for internal operations. The internal operations can be performed in 16-bit, 20-bit and 24-bit. The use of registers larger than 16-bit allows the preservation of fractional information while increasing precision. By leveraging some of the FPGA’s arithmetic resources, our design outperforms designs implemented from scratch and is competitive with specialized arithmetic circuits already implemented in the FPGA.
Keywords
Floating point, hybrid floating point, FPGA, numerical precision, accuracy, mixed-precision
Subject
Computer Science and Mathematics, Hardware and Architecture
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
