Validation of an Independent Web-Based Tool for Measuring Visual Acuity and Refractive Error (the Manifest versus Online Refractive Evaluation Trial): Prospective Open-Label Noninferiority Clinical Trial

Robert P L Wisse, Marc B Muijzer, Francesco Cassano, Daniel A Godefrooij, Yves F D M Prevoo, Nienke Soeters, Robert P L Wisse, Marc B Muijzer, Francesco Cassano, Daniel A Godefrooij, Yves F D M Prevoo, Nienke Soeters

Abstract

Background: Digital tools provide a unique opportunity to increase access to eye care. We developed a Web-based test that measures visual acuity and both spherical and cylindrical refractive errors. This test is Conformité Européenne marked and available on the Easee website. The purpose of this study was to compare the efficacy of this Web-based tool with traditional subjective manifest refraction in a prospective open-label noninferiority clinical trial.

Objective: The aim of this study was to evaluate the outcome of a Web-based refraction compared with a manifest refraction (golden standard).

Methods: Healthy volunteers from 18 to 40 years of age, with a refraction error between -6 and +4 diopter (D), were eligible. Each participant performed the Web-based test, and the reference test was performed by an optometrist. An absolute difference in refractive error of <0.5 D was considered noninferior. Reliability was assessed by using an intraclass correlation coefficient (ICC). Both uncorrected and corrected visual acuity were measured.

Results: A total of 200 eyes in 100 healthy volunteers were examined. The Web-based assessment of refractive error had excellent correlation with the reference test (ICC=0.92) and was considered noninferior to the reference test. Uncorrected visual acuity was similar with the Web-based test and the reference test (P=.21). Visual acuity was significantly improved using the prescription obtained by using the Web-based tool (P<.01). The Web-based test provided the best results in participants with mild myopia (ie, <3 D), with a mean difference of 0.02 (SD 0.49) D (P=.48) and yielding a corrected visual acuity of >1.0 in 90% (n=77) of participants.

Conclusions: Our results indicate that Web-based eye testing is a valid and safe method for measuring visual acuity and refractive error in healthy eyes, particularly for mild myopia. This tool can be used for screening purposes, and it is an easily accessible alternative to the subjective manifest refraction test.

Trial registration: Clinicaltrials.gov NCT03313921; https://ichgcp.net/clinical-trials-registry/NCT03313921.

Keywords: digital refraction; easee; medical informatics; refractive error; telemedicine.

Conflict of interest statement

Conflicts of Interest: YP is founder and shareholder of Easee BV. FC is employed by Easee BV. RW is employed by the UMC Utrecht and medical advisor and shareholder of Easee BV. MBM is employed by the UMC Utrecht and a consultant for Easee BV. NS and DG have no potential conflicts of interest, and they supervised the medical and statistical contents of the manuscript.

©Robert P L Wisse, Marc B Muijzer, Francesco Cassano, Daniel A Godefrooij, Yves F D M Prevoo, Nienke Soeters. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 08.11.2019.

Figures

Figure 1
Figure 1
Optics of the eye. A: With no refractive error, the image is focused properly on the retina, providing perfect uncorrected visual acuity. B and D: In hyperopia (far-sightedness; B) and myopia (nearsightedness; D) the image falls either behind or in front of the retina, respectively. C and E: Lenses can be used to re-focus the image on the retina, restoring visual acuity.
Figure 2
Figure 2
An impression of the online refraction exam and its comparator the manifest refraction.
Figure 3
Figure 3
The difference between the refractive error measurement of the first (red) and second generation (blue) online refraction test compared to the outcome of the manifest refraction with respect to the non-inferiority limit (green area) and 95% confidence interval (dashed lines).
Figure 4
Figure 4
Refractive error measured using the online test was plotted against refractive error measured using manifest refraction; each symbol represents an individual eye measured in a participant who was tested using the first-generation algorithm (red squares) or the second-generation algorithm (blue circles). The 45° dashed line represents an ideal fit. Outliers are identified particularly in the high-myopia group (bottom-left), and these differences are reduced in the second generation cohort. SEQ: spherical equivalent.

References

    1. Vitale S, Ellwein L, Cotch MF, Ferris 3rd FL, Sperduto R. Prevalence of refractive error in the United States, 1999-2004. Arch Ophthalmol. 2008 Aug;126(8):1111–9. doi: 10.1001/archopht.126.8.1111.
    1. Pascolini D, Mariotti SP. Global estimates of visual impairment: 2010. Br J Ophthalmol. 2012 May;96(5):614–8. doi: 10.1136/bjophthalmol-2011-300539.
    1. Williams KM, Bertelsen G, Cumberland P, Wolfram C, Verhoeven VJ, Anastasopoulos E, Buitendijk GH, Cougnard-Grégoire A, Creuzot-Garcher C, Erke MG, Hogg R, Höhn R, Hysi P, Khawaja AP, Korobelnik J, Ried J, Vingerling JR, Bron A, Dartigues J, Fletcher A, Hofman A, Kuijpers RW, Luben RN, Oxele K, Topouzis F, von Hanno T, Mirshahi A, Foster PJ, van Duijn CM, Pfeiffer N, Delcourt C, Klaver CC, Rahi J, Hammond CJ, European Eye Epidemiology (E(3)) Consortium Increasing prevalence of myopia in Europe and the impact of education. Ophthalmology. 2015 Jul;122(7):1489–97. doi: 10.1016/j.ophtha.2015.03.018.
    1. Pan CW, Ramamurthy D, Saw SM. Worldwide prevalence and risk factors for myopia. Ophthalmic Physiol Opt. 2012 Jan;32(1):3–16. doi: 10.1111/j.1475-1313.2011.00884.x.
    1. Resnikoff S, Pascolini D, Mariotti SP, Pokharel GP. Global magnitude of visual impairment caused by uncorrected refractive errors in 2004. Bull World Health Organ. 2008 Jan;86(1):63–70. doi: 10.2471/blt.07.041210.
    1. Vitale S, Cotch MF, Sperduto R, Ellwein L. Costs of refractive correction of distance vision impairment in the United States, 1999-2002. Ophthalmology. 2006 Dec;113(12):2163–70. doi: 10.1016/j.ophtha.2006.06.033.
    1. de Fauw J, Ledsam JR, Romera-Paredes B, Nikolov S, Tomasev N, Blackwell S, Askham H, Glorot X, O'Donoghue B, Visentin D, van den Driessche G, Lakshminarayanan B, Meyer C, Mackinder F, Bouton S, Ayoub K, Chopra R, King D, Karthikesalingam A, Hughes CO, Raine R, Hughes J, Sim DA, Egan C, Tufail A, Montgomery H, Hassabis D, Rees G, Back T, Khaw PT, Suleyman M, Cornebise J, Keane PA, Ronneberger O. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat Med. 2018 Sep;24(9):1342–50. doi: 10.1038/s41591-018-0107-6.
    1. Norgeot B, Glicksberg BS, Butte AJ. A call for deep-learning healthcare. Nat Med. 2019 Jan;25(1):14–5. doi: 10.1038/s41591-018-0320-3.
    1. Elliott DB. What is the appropriate gold standard test for refractive error? Ophthalmic Physiol Opt. 2017 Mar;37(2):115–7. doi: 10.1111/opo.12360.
    1. Bullimore MA, Fusaro RE, Adams CW. The repeatability of automated and clinician refraction. Optom Vis Sci. 1998 Aug;75(8):617–22. doi: 10.1097/00006324-199808000-00028.
    1. Wood IC. A review of autorefractors. Eye (Lond) 1987;1(Pt 4):529–35. doi: 10.1038/eye.1987.80.
    1. Pesudovs K, Weisinger HS. A comparison of autorefractor performance. Optom Vis Sci. 2004 Jul;81(7):554–8. doi: 10.1097/00006324-200407000-00018.
    1. Nguyen MT, Berntsen DA. Aberrometry repeatability and agreement with autorefraction. Optom Vis Sci. 2017 Sep;94(9):886–93. doi: 10.1097/OPX.0000000000001107.
    1. Hervella L, Villegas EA, Prieto PM, Artal P. Assessment of subjective refraction with a clinical adaptive optics visual simulator. J Cataract Refract Surg. 2019 Jan;45(1):87–93. doi: 10.1016/j.jcrs.2018.08.022.
    1. ISO - International Organization for Standardization. 2017. [2019-09-12]. Ophthalmic Optics -- Visual Acuity Testing -- Standard and Clinical Optotypes and Their Presentation .
    1. Raasch T. Clinical refraction in three-dimensional dioptric space revisited. Optom Vis Sci. 1997 Jun;74(6):376–80. doi: 10.1097/00006324-199706000-00020.
    1. Thibos LN, Wheeler W, Horner D. Power vectors: an application of Fourier analysis to the description and statistical analysis of refractive error. Optom Vis Sci. 1997 Jun;74(6):367–75. doi: 10.1097/00006324-199706000-00019.
    1. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, Lijmer JG, Moher D, Rennie D, de Vet HC, Kressel HY, Rifai N, Golub RM, Altman DG, Hooft L, Korevaar DA, Cohen JF, STARD Group STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Br Med J. 2015 Oct 28;351:h5527. doi: 10.1136/bmj.h5527.
    1. Yanof M, Duker JS. Ophthalmology: Expert Consult. Third Edition. Maryland Heights: Mosby Elsevier; 2009.
    1. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016 Jun;15(2):155–63. doi: 10.1016/j.jcm.2016.02.012.
    1. Goss DA, Grosvenor T. Reliability of refraction--a literature review. J Am Optom Assoc. 1996 Oct;67(10):619–30.
    1. Macaya F, Ryan N, Salinas P, Pocock SJ. Challenges in the design and interpretation of noninferiority trials: insights from recent stent trials. J Am Coll Cardiol. 2017 Aug 15;70(7):894–903. doi: 10.1016/j.jacc.2017.06.039.
    1. Tideman JW, Snabel MC, Tedja MS, van Rijn GA, Wong KT, Kuijpers RW, Vingerling JR, Hofman A, Buitendijk GH, Keunen JE, Boon CJ, Geerards AJ, Luyten GP, Verhoeven VJ, Klaver CC. Association of axial length with risk of uncorrectable visual impairment for Europeans with myopia. JAMA Ophthalmol. 2016 Dec 1;134(12):1355–63. doi: 10.1001/jamaophthalmol.2016.4009.
    1. Park KA, Kim SM, Oh SY. The maximal tolerable reduction in hyperopic correction in patients with refractive accommodative esotropia: a 6-month follow-up study. Am J Ophthalmol. 2011 Mar;151(3):535–41.e2. doi: 10.1016/j.ajo.2010.09.023.
    1. van der Staak B. Consumentenbond. 2018. [2019-03-01]. Opticiens Vergeleken: Resultaten Oogmetingen Heel Wisselend .
    1. Cisco. 2019. [2019-09-12]. Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2017–2022 .
    1. Deloitte US | Audit, Consulting, Advisory, and Tax Services. 2013. [2019-09-12]. Global Mobile Consumer Survey 2013 - Addicted to Connectivity: The Dutch Mobile Consumer Perspectiv .
    1. Bastawrous A, Rono HK, Livingstone IA, Weiss HA, Jordan S, Kuper H, Burton MJ. Development and validation of a smartphone-based visual acuity test (Peek Acuity) for clinical practice and community-based fieldwork. JAMA Ophthalmol. 2015 Aug;133(8):930–7. doi: 10.1001/jamaophthalmol.2015.1468.

Source: PubMed

3
Abonnieren