Xiaoming Wang
A new type of eye movement model based on recurrent neural networks for simulating the gaze behavior of human reading.
Wang, Xiaoming; Zhao, Xinbo; Ren, Jinchang
Abstract
Traditional eye movement models are based on psychological assumptions and empirical data that are not able to simulate eye movement on previously unseen text data. To address this problem, a new type of eye movement model is presented and tested in this paper. In contrast to conventional psychology-based eye movement models, ours is based on a recurrent neural network (RNN) to generate a gaze point prediction sequence, by using the combination of convolutional neural networks (CNN), bidirectional long short-term memory networks (LSTM), and conditional random fields (CRF). The model uses the eye movement data of a reader reading some texts as training data to predict the eye movements of the same reader reading a previously unseen text. A theoretical analysis of the model is presented to show its excellent convergence performance. Experimental results are then presented to demonstrate that the proposed model can achieve similar prediction accuracy while requiring fewer features than current machine learning models.
Citation
WANG, X., ZHAO, X. and REN, J. 2019. A new type of eye movement model based on recurrent neural networks for simulating the gaze behavior of human reading. Complexity [online], 2019: complex deep learning and evolutionary computing models in computer vision, article ID 8641074. Available from: https://doi.org/10.1155/2019/8641074
Journal Article Type | Article |
---|---|
Acceptance Date | Feb 27, 2019 |
Online Publication Date | Mar 24, 2019 |
Publication Date | Apr 1, 2019 |
Deposit Date | May 6, 2022 |
Publicly Available Date | Jun 7, 2022 |
Journal | Complexity |
Print ISSN | 1076-2787 |
Electronic ISSN | 1099-0526 |
Publisher | Hindawi |
Peer Reviewed | Peer Reviewed |
Volume | 2019 |
Article Number | 8641074 |
DOI | https://doi.org/10.1155/2019/8641074 |
Keywords | Eye movement; Eye movement models; Recurrent neural network (RNN); Convolutional neural networks (CNN); Long short-term memory networks (LSTM); Conditional random fields (CRF) |
Public URL | https://rgu-repository.worktribe.com/output/1085584 |
Files
WANG 2019 A new type of eye (VOR)
(2.1 Mb)
PDF
Publisher Licence URL
https://creativecommons.org/licenses/by/4.0/
Copyright Statement
Copyright © 2019 Xiaoming Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
You might also like
PWDformer: deformable transformer for long-term series forecasting.
(2023)
Journal Article
Siamese residual neural network for musical shape evaluation in piano performance assessment.
(2023)
Conference Proceeding
Hyperspectral imaging based corrosion detection in nuclear packages.
(2023)
Journal Article
Downloadable Citations
About OpenAIR@RGU
Administrator e-mail: publications@rgu.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search