Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Vision Acuity Index. A Novel Metric to Select the Best Fit Computer Vision Algorithm for Smart Cities and Industry 4.0

Roberto Contreras-Masse
* ORCID logo ,
Carlos Alberto Ochoa-Zezzatti
ORCID logo ,
Vianey Torres-Arguelles
,
Vicente García
ORCID logo ,
Mayra Elizondo
,
Luis Perez-Dominguez
ORCID logo ,
Jose Mejia
ORCID logo
Version 1 : Received: 14 December 2020 / Approved: 16 December 2020 / Online: 16 December 2020 (10:37:47 CET)

How to cite: Contreras-Masse, R.; Ochoa-Zezzatti, C.A.; Torres-Arguelles, V.; García, V.; Elizondo, M.; Perez-Dominguez, L.; Mejia, J. Vision Acuity Index. A Novel Metric to Select the Best Fit Computer Vision Algorithm for Smart Cities and Industry 4.0. Preprints 2020, 2020120403. https://doi.org/10.20944/preprints202012.0403.v1 Contreras-Masse, R.; Ochoa-Zezzatti, C.A.; Torres-Arguelles, V.; García, V.; Elizondo, M.; Perez-Dominguez, L.; Mejia, J. Vision Acuity Index. A Novel Metric to Select the Best Fit Computer Vision Algorithm for Smart Cities and Industry 4.0. Preprints 2020, 2020120403. https://doi.org/10.20944/preprints202012.0403.v1

Abstract

Computer vision is considered as an ally to solve business problems that require human intervention, intelligence and criteria. This topic of research has evolved in XXI century at faster peace, delivering various alternatives from open source until commercial platforms. With so many options and market growing, it result difficult to make a decision on which one to use, or even worse, realize it was not suited for different scenarios. In this paper we analyze five options selected arbitrarily and tested on a dataset of 755 images to detect persons in an image, using object detectors. We analyze elapsed time to process an image, error with observations by humans, number of persons detected, correlation of time and person density, object detected size and F1 Score, considering precision and recall. As we found there are score ties and similar behaviors among options available, we introduce a novel index that takes in consideration the number of persons and their pixel size, to propose the Vision Acuity Index of Computer Vision. The results demonstrate this is a good option to serve as indicator to make decisions. Also, this index proposed have a potential to be expanded for different business use cases, and to measure new proposed algorithms in the future along with the traditional metrics used previously.

Keywords

Computer vision; performance metrics; Yolo3; AWS Rekognition; Azure Computer Vision

Subject

Computer Science and Mathematics, Algebra and Number Theory

Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Download PDF

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0
Get PDF Cite Share 0
Bookmark BibSonomy Mendeley Reddit Delicious
×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.