Reliability of a Manual Procedure for Marking the EZ Endpoint Location in Patients with Retinitis Pigmentosa

Rithambara Ramachandran, Cindy X Cai, Dongwon Lee, Benjamin C Epstein, Kirsten G Locke, David G Birch, Donald C Hood, Rithambara Ramachandran, Cindy X Cai, Dongwon Lee, Benjamin C Epstein, Kirsten G Locke, David G Birch, Donald C Hood

Abstract

Purpose: We developed and evaluated a training procedure for marking the endpoints of the ellipsoid zone (EZ), also known as the inner segment/outer segment (IS/OS) border, on frequency domain optical coherence tomography (fdOCT) scans from patients with retinitis pigmentosa (RP).

Methods: A manual for marking EZ endpoints was developed and used to train 2 inexperienced graders. After training, an experienced grader and the 2 trained graders marked the endpoints on fdOCT horizontal line scans through the macula from 45 patients with RP. They marked the endpoints on these same scans again 1 month later.

Results: Intragrader agreement was excellent. The intraclass correlation coefficient (ICC) was 0.99, the average difference of endpoint locations (19.6 μm) was close to 0 μm, and the 95% limits were between -284 and 323 μm, approximately ±1.1°. Intergrader agreement also was excellent. The ICC values were 0.98 (time 1) and 0.97 (time 2), the average difference among graders was close to zero, and the 95% limits of these differences was less than 350 μm, approximately 1.2°, for both test times.

Conclusions: While automated algorithms are becoming increasingly accurate, EZ endpoints still have to be verified manually and corrected when necessary. With training, the inter- and intragrader agreement of manually marked endpoints is excellent.

Translational relevance: For clinical studies, the EZ endpoints can be marked by hand if a training procedure, including a manual, is used. The endpoint confidence intervals, well under ±2.0°, are considerably smaller than the 6° spacing for the typically used static visual field.

Keywords: ellipsoid zone (EZ); optical coherence tomography; receptors; retinitis pigmentosa.

Conflict of interest statement

R. Ramachandran, None; C.X. Cai, None; D. Lee, None; B.C. Epstein, None; K.G. Locke, None; D.G. Birch, None; D.C. Hood, None

Figures

Figure 1
Figure 1
(A) Patient breakdown. (B) Horizontal midline fdOCT scan with three borders manually segmented. Inset: Enlargement of the region within the orange rectangle with EZ EP identified.
Figure 2
Figure 2
(A) Horizontal midline fdOCT scan with EP identified by graders A (red), B (blue), and C (green) at time 1. Inset: Enlargement of the region within the orange rectangle. (B) Horizontal midline fdOCT scan with EP identified by graders A (red), B (blue), and C (green) at time 2. Inset: Enlargement of the region within the orange rectangle.
Figure 3
Figure 3
(A) Scatterplot of EP markings at time 1 and time 2 for graders A (left), B (center), and C (right). Best-fit line and identity line are shown as the solid and the dashed line respectively. (B) Bland-Altman plot demonstrating agreement between EP markings at time 1 and time 2. EP, endpoint; ΔEPintra, measure of intragrader agreement.
Figure 4
Figure 4
(A) Scatterplot of EP markings of each grader (EPgrader) and the average marking of the other two graders (EPothers) at time 1. (B) Scatterplot of EP markings of each grader (EPgrader) and the average marking of the other two graders (EPothers) at time 2.
Figure 5
Figure 5
Plots of ΔEPinter as a function of the mean EPall at time 1 (A) and time 2 (B). EP, endpoint; ΔEPinter, measure of intergrader agreement.

References

    1. Hartong DT,, Berson EL,, Dryja TP. Retinitis pigmentosa. Lancet. 2006; 368: 1795–1809.
    1. Berson EL. Retinitis pigmentosa. The Friedenwald Lecture. Invest Ophthalmol Vis Sci. 1993; 34: 1659–1676.
    1. Sandberg MA,, Rosner B,, Weigel-DiFranco C,, Dryja TP,, Berson EL. Disease course of patients with X-linked retinitis pigmentosa due to RPGR gene mutations. Invest Ophthalmol Vis Sci. 2007; 48: 1298–1304.
    1. Grover S,, Fishman GA,, Brown J,, Jr. Patterns of visual field progression in patients with retinitis pigmentosa. Ophthalmology. 1998; 105: 1069–1075.
    1. Birch DG,, Anderson JL,, Fish GE. Yearly rates of rod and cone functional loss in retinitis pigmentosa and cone-rod dystrophy. Ophthalmology. 1999; 106: 258–268.
    1. Pearlman JT. Mathematical models of retinitis pigmentosa: a study of the rate of progress in the different genetic forms. Trans Am Ophthalmol Soc. 1979; 77: 643–656.
    1. Aleman TS,, Cideciyan AV,, Sumaroka A,, et al. Inner retinal abnormalities in X-linked retinitis pigmentosa with RPGR mutations. Invest Ophthalmol Vis Sci. 2007; 48: 4759–4765.
    1. Hood DC,, Lin CE,, Lazow MA,, Locke KG,, Zhang X,, Birch DG. . Thickness of receptor and post-receptor retinal layers in patients with retinitis pigmentosa measured with frequency-domain optical coherence tomography. Invest Ophthalmol Vis Sci. 2009; 50: 2328–2336.
    1. Witkin AJ,, Ko TH,, Fujimoto JG,, et al. Ultra-high resolution optical coherence tomography assessment of photoreceptors in retinitis pigmentosa and related diseases. Am J Ophthalmol. 2006; 142: 945–952.
    1. Zawadzki RJ,, Choi SS,, Jones SM,, Oliver SS,, Werner JS. Adaptive optics-optical coherence tomography: optimizing visualization of microscopic retinal structures in three dimensions. J Opt Soc Am A Opt Image Sci Vis. 2007; 24: 1373–1383.
    1. Jonnal RS,, Kocaoglu OP,, Zawadzki RJ,, Lee SH,, Werner JS,, Miller DT. The cellular origins of the outer retinal bands in optical coherence tomography images. Invest Ophthalmol Vis Sci. 2014; 55: 7904–7918.
    1. Lu RW,, Curcio CA,, Zhang Y,, et al. Investigation of the hyper-reflective inner/outer segment band in optical coherence tomography of living frog retina. J Biomed Opt. 2012; 060504.
    1. Spaide RF,, Curcio CA. Anatomical correlates to the bands seen in the outer retina by optical coherence tomography: literature review and model. Retina. 2011; 31: 1609–1619.
    1. Curcio CA,, Sloan KR,, Kalina RE,, Hendrickson AE. Human photoreceptor topography. J Comp Neurol. 1990; 292: 497–523.
    1. Hood DC,, Ramachandran R,, Holopigian K,, Lazow M,, Birch DG,, Greenstein VC. Method for deriving visual field boundaries from OCT scans of patients with retinitis pigmentosa. Biomed Opt Express. 2011; 2: 1106–1114.
    1. Hood DC,, Lazow MA,, Locke KG,, Greenstein VC,, Birch DG. The transition zone between healthy and diseased retina in patients with retinitis pigmentosa. Invest Ophthalmol Vis Sci. 2011; 52: 101–108.
    1. Birch DG,, Wen Y,, Locke K,, Hood DC. Rod sensitivity, cone sensitivity, and photoreceptor layer thickness in retinal degenerative diseases. Invest Ophthalmol Vis Sci. 2011; 52: 7141–7147.
    1. Rangaswamy NV,, Patel HM,, Locke KG,, Hood DC,, Birch DG. A comparison of visual field sensitivity to photoreceptor thickness in retinitis pigmentosa. Invest Ophthalmol Vis Sci. 2010; 51: 4213–4219.
    1. Birch DG,, Locke KG,, Wen Y,, Locke KI,, Hoffman DR,, Hood DC. Spectral-domain optical coherence tomography measures of outer segment layer progression in patients with X-linked retinitis pigmentosa. JAMA Ophthalmol. 2013; 131: 1143–1150.
    1. Birch DG,, Locke KG,, Felius J,, et al. Rates of decline in regions of the visual field defined by frequency-domain optical coherence tomography in patients with RPGR-mediated X-linked retinitis pigmentosa. Ophthalmology. 2015; 122: 833–839.
    1. Ramachandran R,, Zhou L,, Locke KG,, Birch DG,, Hood DC. A comparison of methods for tracking progression in X-Linked retinitis pigmentosa using frequency domain OCT. Transl Vis Sci Technol. 2013; 2: 5.
    1. Cai CX,, Locke KG,, Ramachandran R,, Birch DG,, Hood DC. A comparison of progressive loss of the ellipsoid zone (EZ) band in autosomal dominant and X-linked retinitis pigmentosa. Invest Ophthalmol Vis Sci. 2014; 55: 7417–7422.
    1. Wen Y,, Klein M,, Hood DC,, Birch DG. Relationships among multifocal electroretinogram amplitude, visual field sensitivity, and SD-OCT receptor layer thicknesses in patients with retinitis pigmentosa. Invest Ophthalmol Vis Sci. 2012; 53: 833–840.

Source: PubMed

3
Prenumerera