Commentary: Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content
Celia Andreu-Sánchez1*, Miguel Ángel Martín-Pascual1, 2, Agnès Gruart3, José María Delgado-García3
1Neuro-Com Research Group, Department of Audiovisual Communication and Advertising, Universitat Autònoma de Barcelona, Barcelona, Spain
2Instituto Radio Televisión Española, RTVE, Barcelona, Spain
3División de Neurociencias, Universidad Pablo de Olavide, Sevilla, Spain
Media perception is commonly analyzed in different research areas such as communication sciences, psychology, and sociology. In the past few years, scientists have started using neuroscience for analyzing the perception of media content. In this regard, we think that the use of a neuroscientific tool, electroencephalography, when combined with a high-quality video recording of participants’ faces, can give a good insight into viewers’ brain activity and even eye-blink behavior while viewers watch media content.
According to previous studies, eye blinks have physiological1,2 and psychological3,4 functions, and can be analyzed as attentional markers4–6. While protecting the cornea from mechanical and chemical threats and wetting it, eye blinks hide visual contents for 150-400 ms7,8; however viewers of media content do not report having lost that information. Although viewers somehow have the cognitive impression that they still see what they are looking at, this is impossible because the pupil is covered by the lids for the mentioned period of time. We are so used to blinking that it seems not to have an important role in the perception of media content, and yet it has. For example, viewers’ eye-blink rate depends on their media experience and on the style of edition of the audiovisual content9, 10.
In a recent article11, we proposed the use of a dual protocol for detecting eye blinks, with the aim of analyzing viewers’ visual perception of media content. The dual protocol consisted in monitoring the electroencephalographic/electromyographic (EEG/EMG) activity of participants and recording their visual behavior with an HD video system while they were watching media stimuli. With a rigorous system where presentation of video content is synchronized with the EEG/EMG device used for recording brain activity and with the HD video camera, we can obtain viewers’ eye blinks at the specific moments when they took place. With a detailed list, data analysis can be done using professional statistical tools.
The basic steps to be accomplished are as follows:
1. The creation and presentation of visual stimuli. Stimuli should be designed, created, and presented according to the specific interest of the investigation. They are going to control the variables of analysis, so special attention should be paid to this step.
2. Selection of participants. As in many investigations, making two or more groups of analysis can bring out differences between populations.
3. Set-up preparation. Since this is a dual protocol, the preparation of the session has to be focused on managing the acquisition of both data acquisition system proposed. A correct management of both data sources will make a triangulation of results possible.
4. Data acquisition. As mentioned, each system used for acquiring data (EEG and HD video) should be synchronized and properly connected to the following steps.
5. Post-experimental session. After each session of EEG/EMG, specific cleaning protocols have to be carried out with regard to both participant and recording devices.
6. Data analysis. After carefully analyzing data from both sources—EEG/EMG and HD video—a final list of each participant’s eye blinks should be obtained. A proper statistical analysis should be performed, depending on the variables used.
The explained protocol11 allows researchers to study viewers’ perception of media content without asking their opinion or thoughts. The purpose is to determine differences in eye-blink rates of viewers watching media content. Eye blinks can be treated as markers of levels of attention, and although no specific questionnaire or interview is necessary, it is always desirable to complete results from as many sources as possible. The paper entitled “Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content” includes an explanatory video with the following chapters:
1. Title, with a brief introduction to the eye blink, the proposed technique, and the media content studies.
2. Set-up design, with a practical demonstration of how to prepare an experimental session.
3. Analysis of collected data, including the statistical approach.
4. Representative examples of collected results.
The advantage of using EEG/EMG analysis for detecting eye blinks is the high temporal resolution (of the order of milliseconds) and the possibility of, in necessary cases, adjusting the algorithm to automatically detect participants’ eye blinks. The advantage of using a dual protocol is to match results from the EEG acquired data: recording viewers’ faces with an HD video camera allows researchers to manually count blinks and contrast results. Thus, we double-check each eyeblink. As a result of using both systems, a very accurate matrix is obtained, on which posterior statistical analysis can easily be performed.
With the use of EEG/EMG procedures, we also have access to analyzing brain activity at different frequencies during the watching of media content. The main advantage of this method is to have a highly synchronized response of the electrical brain activity to the presentation of the selected stimuli.
Conflict of interest statement
The authors declare that no competing interests exist.
The present study has been supported by a Spanish Ministry of Economy and Competitiveness (BFU2014-56692-R and BFU2017-82375-R) grants.
- Bour LJ, Aramideh M, de Visser BW, et al. Neurophysiological aspects of eye and eyelid movements during blinking in humans. J Neurophysiol. 2000; 83(1): 166–176.
- Delgado-García JM, Gruart A, Múnera A. Neural organization of eyelid responses. Mov Disord. 2002; 17 Suppl 2: S33-6.
- Wiseman R, Nakano T. Blink and you’ll miss it: the role of blinking in the perception of magic tricks. PeerJ. 2016; (4): e1873.
- Fogarty C, Stern JA. Eye movements and blinks: their relationship to higher cognitive processes. Int J Psychophysiol. 1989; 8(1): 35–42.
- Fukuda K. Analysis of eyeblink activity during discriminative tasks. Percept Mot Skills. 1994; 79(3 Pt 2): 1599–1608.
- Hall A. The origin and purposes of blinking. Br J Ophthalmol September. 1945; 445–467.
- Shapiro KL, Raymond JE. The attentional blink: temporal constraints on consciousness. Attention and Time, eds Nobre AC, Coull JT (Oxford University Press, Oxford). 2008; 35–48.
- VanderWerf F, Brassinga P, Reits D, et al. Eyelid movements: behavioral studies of blinking in humans under different stimulus conditions. J Neurophysiol. 2003; 89(5): 2784–2796.
- Andreu-Sánchez C, Martín-Pascual MÁ, Gruart A, et al. Eyeblink rate watching classical Hollywood and post-classical MTV editing styles, in media and non-media professionals. Sci Reports. 2017; 7: 43267.
- Andreu-Sánchez C, Martín-Pascual MÁ, Gruart A, et al. Looking at reality versus watching screens: Media professionalization effects on the spontaneous eyeblink rate. PLoS One. 2017; 12(5): e0176030.
- Martín-Pascual MÁ, Andreu-Sánchez C, Delgado-García JM, et al. Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content. JoVE - J Vis Exp. 2018; (135): e57321.