Human Auditory Detection and Discrimination Measured with the Pupil Dilation Response

Avinash D S Bala, Elizabeth A Whitchurch, Terry T Takahashi, Avinash D S Bala, Elizabeth A Whitchurch, Terry T Takahashi

Abstract

In the standard Hughson-Westlake hearing tests (Carhart and Jerger 1959), patient responses like a button press, raised hand, or verbal response are used to assess detection of brief test signals such as tones of varying pitch and level. Because of its reliance on voluntary responses, Hughson-Westlake audiometry is not suitable for patients who cannot follow instructions reliably, such as pre-lingual infants (Northern and Downs 2002). As an alternative approach, we explored the use of the pupillary dilation response (PDR), a short-latency component of the orienting response evoked by novel stimuli, as an indicator of sound detection. The pupils of 31 adult participants (median age 24 years) were monitored with an infrared video camera during a standard hearing test in which they indicated by button press whether or not they heard narrowband noises centered at 1, 2, 4, and 8 kHz. Tests were conducted in a quiet, carpeted office. Pupil size was summed over the first 1750 ms after stimulus delivery, excluding later dilations linked to expenditure of cognitive effort (Kahneman and Beatty 1966; Kahneman et al. 1969). The PDR yielded thresholds comparable to the standard test at all center frequencies tested, suggesting that the PDR is as sensitive as traditional methods of assessing detection. We also tested the effects of repeating a stimulus on the habituation of the PDR. Results showed that habituation can be minimized by operating at near-threshold stimulus levels. At sound levels well above threshold, the PDR habituated but could be recovered by changing the frequency or sound level, suggesting that the PDR can also be used to test stimulus discrimination. Given these features, the PDR may be useful as an audiometric tool or as a means of assessing auditory discrimination in those who cannot produce a reliable voluntary response.

Keywords: audiometry; auditory detection; auditory discrimination; habituation; human; involuntary response; oddball; oddball paradigm; orienting; orienting reflex; orienting response; pupil dilation; pupillometry; recovery.

Conflict of interest statement

The authors declare that they have no conflict of interest.

Figures

Fig. 1
Fig. 1
PDR apparatus. The subject, wearing insert earphones, was seated facing a computer monitor (95 cm), keyboard, IR LED array, and IR sensitive camera. The subject’s head was stabilized by chin and forehead rests. The monitor displayed a fixation point (red circle) which turned into a question mark, prompting the subject to press one key if a sound was detected and a different key if no sound was detected. The subject’s left pupil was monitored by the camera which was interfaced to Eyelink software that provided pupillary areas at a rate of 1000 samples/s
Fig. 2
Fig. 2
Sequence of events during a trial. Upon fixating on a small circle on the computer monitor, the subject’s pupil was video imaged (green) and the pupil sizes were readout by Eyelink software. A sound (blue) was presented 1.5 s (+/− 0.5 s) after the onset of video imaging. The sound’s delivery was jittered to prevent pupillary responses in anticipation of a sound. The circle turned into a question mark, which prompted the subject to respond within 2 s (purple) if they detected a sound
Fig. 3
Fig. 3
PDR time course and latency. aSolid curve: PDR averaged across 1673 test trials presented at the highest sound level used for four center frequencies (43 dBA; 1, 2, 4, 8 kHz center frequencies), drawn from 84 sessions across 21 subjects. Stimulus onset is at 0 s on the abscissa. Dashed curve: PDR averaged across 4191 catch trials from all 84 sessions across 21 subjects. b First derivative of the PDR trace from (a) shows the average latency of the PDR (arrow) and reveals the two-phase dynamics of pupil dilation in response to sound presentation
Fig. 4
Fig. 4
Detectable sounds elicit a larger PDR. a–c Data from 3 typical subjects (AF, AL, AX). Pupil size traces were pooled across 100 sound trials and 50 catch trial presentations in a single session for each subject. Sound trials were pooled across all center frequencies tested (1, 2, 4, and 8 kHz) at the 4 standard sounds levels. The PDRs were later classified according to subjects’ button presses in the DRT conducted while the pupil was monitored: Hit (sound was present, subject pressed “yes” button), Miss (sound was present; subject pressed “no” button), and Correct Rejection (CR; subject pressed the “no” button during a catch trial). A dilation is seen only when the subjects reported a sound (solid line), while sounds that were undetectable yielded a pupil size trace (dashed line) that was similar to responses during catch trials (dotted line). Each trace is the average of all trials of its type in the session (Hits, Misses, CRs respectively: a: 24, 61, 43; b: 30, 68, 50; c: 16, 82, 50). Dilation responses were compared using unpaired t tests (two-tailed; p = 0.05): responses during Hits were significantly different from that during CRs, while responses during CRs and Miss trials were statistically indistinguishable. d PDR averaged across all trials and subjects. As with the individual subjects (ac), a large dilation was observed only when a sound was detected. Traces are averages of 2233 Hits, 6141 Misses, and 4191 CRs, pooled across all 23 subjects and 85 sessions. Dilation responses in the pooled data were easily discriminable when comparing Hits to Misses (p < 10–97), while responses between Miss and CR trials were indiscriminable (p = 0.32)
Fig. 5
Fig. 5
PDR magnitude vs SPL. Average magnitude of the PDR vs SPL across all 85 sessions from 21 subjects for center frequencies of 1 (a), 2 (b), 4 (c), and 8 kHz (d). Each point represents the average PDR sizes expressed as a z-score relative to PDRs obtained in catch trials (n = 4191). Each data point is the average of > 400 trials—trial numbers for each frequency at sound levels of 13, 23, 33, and 43 dB, respectively, are as follows: a: 421, 419, 419, and 414 trials; b: 412, 421, 417, and 419 trials; c: 415, 413, 413, and 415 trials; d: 408, 411, 414, and 415 trials. Asterisks indicate PDRs that are statistically greater (p < 0.05) in magnitude than those obtained in catch trials. Error bars represent the SEM
Fig. 6
Fig. 6
Comparison of PDR and DRT in individual subjects. a Average psychometric functions derived from PDR (pupil size; solid lines) and DRT (button press; dashed lines) data. Example curves are shown for 2 kHz (black lines and diamonds) and 4 kHz (red lines and squares). Bars are SEM. b–e Distribution of thresholds obtained with PDR (black bars) and DRT (unfilled bars) for 1, 2, 4, and 8 kHz test stimuli. PDR and DRT data were simultaneously gathered in each subject. Overall PDR thresholds are lower than DRT thresholds but PDR variances are wider. Details of the results are given in Tables 1 and 2. Thresholds extracted from psychometric functions for individual sessions—the averages of which are shown in a—was used to construct histograms in subfigures be. Thus, thresholds extracted from pooled data represented by black lines (a) was used to construct histograms in c, and thresholds from pooled data represented by red lines (a) was used to construct the histograms in d
Fig. 7
Fig. 7
PDR habituation. Mean PDR magnitude (ordinate) vs trial number (abscissa). Data are based on 36 sessions (100 trials/session) in 12 subjects. After a large dilation on the first stimulus presentation, the dilations rapidly decline, but a small dilation remains for another 32 trials. The later trials (> 32; dashed vertical line) have larger variances that fluctuate around the mean PDR size (z-score = 0) computed across all trials. Comparison of the first 30 and last 70 trials show that the first 30 trials are significantly more positive than the last 70 trials (p < 0.001; t test: Two-Sample Assuming Unequal Variances)
Fig. 8
Fig. 8
Distribution of PDR magnitudes during habituation and recovery. a Distribution of PDR magnitudes during habituating trials. (mean = − 0.048; sd = 0.51; n = 561 trials). b Distribution of PDR magnitudes when the SPL is changed. (“SPL oddball”; mean = 0.96; sd = 0.35; n = 63 trials). The PDRs evoked by oddball stimuli (2 kHz gammatone; 38 dBA) are statistically significantly larger (p < 0.005; t test: Two-Sample Assuming Unequal Variances) than those in the habituating trials (1 kHz gammatone; 52 dBA). c Distribution of PDR magnitudes during habituating trials (12 subjects, mean = 0.002; sd = 0.23; n = 1750 trials) and frequency oddball trials. d Distribution of PDR magnitudes when the center frequency is changed (“Freq oddball”; mean = 0.54; sd = 0.30; n = 146 trials). The PDRs evoked by oddball stimuli (2 kHz gammatone; 52 dBA) are statistically significantly larger (p < 0.01; t test: Two-Sample Assuming Unequal Variances) than those from habituating trials (1 kHz gammatone; 52 dBA)
Fig. 9
Fig. 9
Recovered PDR to Oddball stimuli. Recovery elicited by oddball sounds at different SPL (a) and center frequency (b). Habituating stimuli, consisted of the 1-kHz gammatone at 52 dBA stimulus in both a and b, while the oddballs differed in sound level (a: 38 vs 52 dB), or in center frequency (b: 2 vs 1 kHz), as detailed in Table 1. The first oddball was presented during trial 49, and succeeding oddballs were separated by 21 ± 3 habituating stimuli. The PDR habituated to the lower-SPL oddball stimuli (a: red line and circles) or different center frequency (b: magenta line and circles) over the course of 6 trials. The magnitude of the PDR to the first presentation of the oddball in both cases was similar to the magnitude of the PDR elicited by the first habituating sound in each session (t test, p = 0.05). However, responses to subsequent presentations of the oddball stimulus were smaller, indicating habituation to the oddball stimuli. By the third repetition, responses to oddball stimuli were significantly smaller than responses to the first habituating trial of each session. While the response to oddball stimuli decreased over the course of the session, it still remained larger than responses to habituating stimuli (blue and black lines in a and b). Further, the recovery was specific to the oddball stimuli: the magnitude of habituating trials flanking the oddballs remained low. The PDR magnitude of habituating trials immediately preceding (black dotted line, upright triangles) and following (blue dashed line, inverted triangles) shows that responses to habituating stimuli were unaffected by the larger response to the oddball. Data in a are based on 63 oddball trials from 6 subjects in 11 sessions. (sessions with subjects AE and AH had 5 and 4 oddball trials respectively; the rest of the subjects had 6 oddballs). Data in b are based on 146 oddball trials from 12 subjects (one session for subject AQ had 5 oddball trials, while one for subject AE had only 3)
Fig. 10
Fig. 10
Trial order effect at near-threshold SPL. PDR sizes (ordinate) evoked by five repetitions (abscissa) of a 1-, 2-, 4-, and 8-kHz gammatone, each at one of four SPLs (13, 23, 33, 43 dBA). Each iteration of a sound-level combination was separated from the next one by ≈ 240 s. There is no systematic, statistically significant change in response magnitude (t test, p = 0.05) to later presentations of the sounds at any frequency, in contrast to the evidence of rapid habituation shown in Figs. 7 and 9

References

    1. Bala ADS, Takahashi TT. Pupillary dilation response as an indicator of auditory discrimination in the barn owl. J Comp Physiol [A] 2000;186:425–434. doi: 10.1007/s003590050442.
    1. Bala ADS, Spitzer MW, Takahashi TT. Prediction of auditory spatial acuity from neural images on the owl’s auditory space map. Nature. 2003;424:771–774. doi: 10.1038/nature01835.
    1. Bala ADS, Spitzer MW, Takahashi TT. Auditory spatial acuity approximates the resolving power of space-specific neurons. PLoS One. 2007;2:e675. doi: 10.1371/journal.pone.0000675.
    1. Bala ADS, Keller CH, Takahashi TT (2018) Infant hearing assessed using the Pupil Dilation Response. In: Assoc. Res. Otolaryngol. Abs, p 353
    1. Britten KH, Shadlen MN, Newsome WT, Movshon JA. The analysis of visual motion: a comparison of neuronal and psychophysical performance. J Neurosci. 1992;12:4745–4765. doi: 10.1523/JNEUROSCI.12-12-04745.1992.
    1. Carhart R, Jerger J. Preferred method for clinical determination of pure-tone thresholds. J Speech Hear Disord. 1959;24:330–345. doi: 10.1044/jshd.2404.330.
    1. Coombs Clyde H. Adaptation of the galvanic response to auditory stimuli. Journal of Experimental Psychology. 1938;22(3):244–268. doi: 10.1037/h0063313.
    1. Egan JP (1975) Signal detection theory and ROC-analysis. Academic Press, NY
    1. Einhäuser W, Stout J, Koch C, Carter O. Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry. Proc Natl Acad Sci U S A. 2008;105:1704–1709. doi: 10.1073/pnas.0707727105.
    1. Geer JH. Effect of interstimulus intervals and rest-period length upon habituation of the orienting response. J Exp Psychol. 1966;72:647–619. doi: 10.1037/h0023760.
    1. Granholm E, Morris SK, Sarkin AJ, et al. Pupillary responses index overload of working memory resources in schizophrenia. J Abnorm Psychol. 1997;106:458–467. doi: 10.1037/0021-843X.106.3.458.
    1. Gutschalk A, Micheyl C, Oxenham AJ. Neural correlates of auditory perceptual awareness under informational masking. PLoS Biol. 2008;6:1156–1165. doi: 10.1371/journal.pbio.0060138.
    1. Hakerem G, Sutton S. Pupillary response at visual threshold. Nature. 1966;212:485–448. doi: 10.1038/212485a0.
    1. Hartmann Matthias, Fischer Martin H. Pupillometry: The Eyes Shed Fresh Light on the Mind. Current Biology. 2014;24(7):R281–R282. doi: 10.1016/j.cub.2014.02.028.
    1. Hicks CB, Tharpe AM, Ashmead DH. Behavioral auditory assessment of young infants: methodological limitations or natural lack of auditory responsiveness? Am J Audiol. 2000;9:124–130. doi: 10.1044/1059-0889(2000/015.
    1. Hochmann J-R, Papeo L. The invariance problem in infancy. Psychol Sci. 2014;25:2038–2046. doi: 10.1177/0956797614547918.
    1. Jackson JC. Amplitude and habituation of the orienting reflex as a function of stimulus intensity. Psychophysiology. 1974;11:647–659. doi: 10.1111/j.1469-8986.1974.tb01133.x.
    1. Johnson DA. Pupillary responses during a short-term memory task: cognitive processing, arousal, or both? J Exp Psychol. 1971;90:311–318. doi: 10.1037/h0031562.
    1. Kahneman D. A perspective on judgment and choice: mapping bounded rationality. Am Psychol. 2003;58:697–720. doi: 10.1037/0003-066X.58.9.697.
    1. Kahneman D, Beatty J. Pupil diameter and load on memory. Science 80- 1966;154:1583–1585. doi: 10.1126/science.154.3756.1583.
    1. Kahneman D, Tursky B, Shapiro D, Crider A. Pupillary, heart rate, and skin resistance changes during a mental task. J Exp Psychol. 1969;79:164–167. doi: 10.1037/h0026952.
    1. Koelewijn T, Zekveld AA, Festen JM, Kramer SE. Pupil dilation uncovers extra listening effort in the presence of a single-talker masker. Ear Hear. 2012;33:291–300. doi: 10.1097/AUD.0b013e3182310019.
    1. Koelewijn T, Shinn-Cunningham BG, Zekveld AA, Kramer SE. The pupil response is sensitive to divided attention during speech processing. Hear Res. 2014;312:114–120. doi: 10.1016/j.heares.2014.03.010.
    1. Levine FM, Whitney N. Absolute auditory threshold and threshold of unpleasantness of chronic schizophrenic patients and normal controls. J Abnorm Psychol. 1970;75:74–77. doi: 10.1037/h0028809.
    1. Liberman AE, et al. Some new data on the pupillary component in man. In: Voronin LG, Leontiev AN, Luria AR, et al., editors. Orienting reflex and exploratory behavior. Moscow: The Academy of Pedagogical Sciences of the RSFSR; 1958. pp. 187–194.
    1. McLaren JW, Erie JC, Brubaker RF (1992) Computerized analysis of pupillograms in studies of alertness. Investig Ophthalmol Vis Sci 33:671-676
    1. Northern J, Downs M. Hearing in children. 5. Philadelphia: Lippincott Williams & Wilkins; 2002.
    1. O’Gorman JG. The orienting reflex: novelty or significance detector? Psychophysiology. 1979;16:253–262. doi: 10.1111/j.1469-8986.1979.tb02988.x.
    1. Olsho LW, Koch EG, Halpin CF, Carter EA. An observer-based psychoacoustic procedure for use with young infants. Dev Psychol. 1987;23:627–640. doi: 10.1037/0012-1649.23.5.627.
    1. Raisig S, Welke T, Hagendorf H, van der Meer E. I spy with my little eye: detection of temporal violations in event sequences and the pupillary response. Int J Psychophysiol. 2010;76:1–8. doi: 10.1016/j.ijpsycho.2010.01.006.
    1. Richer F, Silverman C, Beatty J. Response selection and initiation in speeded reactions: a pupillometric analysis. J Exp Psychol Hum Percept Perform. 1983;9:360–370. doi: 10.1037/0096-1523.9.3.360.
    1. Shakhar GB, Lieblich I, Kugelmass S. Detection of information and GSR habituation: an attempt to derive detection efficiency from two habituation curves. Psychophysiology. 1975;12:283–288. doi: 10.1111/j.1469-8986.1975.tb01291.x.
    1. Simon EB. Primacy effect in orienting responses to auditory stimuli of tones and music. Percept Mot Ski. 1976;42:919–928. doi: 10.2466/pms.1976.42.3.919.
    1. Sokolov EN, et al. The orienting reflex, its structure and mechanisms. In: Voronin LG, Leontiev AN, Luria AR, et al., editors. Orienting reflex and exploratory behavior. Moscow: Publishing House of The Academy of Pedagogical Sciences of RSFR; 1958. pp. 141–153.
    1. Sokolov EN. Higher nervous functions: the orienting reflex. Annu Rev Physiol. 1963;25:545–580. doi: 10.1146/annurev.ph.25.030163.002553.
    1. Spitzer MW, Bala ADS, Takahashi TT. Auditory spatial discrimination by barn owls in simulated echoic conditions. J Acoust Soc Am. 2003;113:1631–1645. doi: 10.1121/1.1548152.
    1. Steel Morrison M., Papsin Blake C., Gordon Karen A. Binaural Fusion and Listening Effort in Children Who Use Bilateral Cochlear Implants: A Psychoacoustic and Pupillometric Study. PLOS ONE. 2015;10(2):e0117611. doi: 10.1371/journal.pone.0117611.
    1. Unsworth N, Robison MK. Individual differences in the allocation of attention to items in working memory: evidence from pupillometry. Psychon Bull Rev. 2015;22:757–765. doi: 10.3758/s13423-014-0747-6.
    1. van Olst E. The orienting reflex. The Hague: Mouton & Co.; 1971.
    1. Winn MB, Edwards JR, Litovsky RY. The impact of auditory spectral resolution on listening effort revealed by pupil dilation. Ear Hear. 2015;36:e153–e165. doi: 10.1097/AUD.0000000000000145.
    1. Zekveld AA, Heslenfeld DJ, Johnsrude IS, et al. The eye as a window to the listening brain: neural correlates of pupil size as a measure of cognitive listening load. Neuroimage. 2014;101:76–86. doi: 10.1016/j.neuroimage.2014.06.069.

Source: PubMed

3
Subscribe