[Back]

N. Alinaghi, M. Kattenbeck, A. Golab, I. Giannopoulos:
"Will You Take This Turn? Gaze-Based Turning Activity Recognition During Navigation";
Talk: 11th International Conference on Geographic Information Science (GIScience 2021), Poznan, Polen; 2021-09-27 - 2021-09-30; in: "11th International Conference on Geographic Information Science (GIScience 2021)", K Janowicz, J. Verstegen (ed.); Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Dagstuhl (2021), ISBN: 978-3-95977-208-2; Paper ID 5, 16 pages.

Decision making is an integral part of wayfinding and people progressively use navigation systems to facilitate this task. The primary decision, which is also the main source of navigation error, is about the turning activity, i.e., to decide either to turn left or right or continue straight forward. The fundamental step to deal with this error, before applying any preventive approaches, e.g., providing more information, or any compensatory solutions, e.g., pre-calculating alternative routes, could be to predict and recognize the potential turning activity. This paper aims to address this step by predicting the turning decision of pedestrian wayfinders, before the actual action takes place, using primarily gaze-based features. Applying Machine Learning methods, the results of the presented experiment demonstrate an overall accuracy of 91% within three seconds before arriving at a decision point. Beyond the application perspective, our findings also shed light on the cognitive processes of decision making as reflected by the wayfinder´s gaze behaviour: incorporating environmental and user-related factors to the model, results in a noticeable change with respect to the importance of visual search features in turn activity recognition.

Decision making is an integral part of wayfinding and people progressively use navigation systems to facilitate this task. The primary decision, which is also the main source of navigation error, is about the turning activity, i.e., to decide either to turn left or right or continue straight forward. The fundamental step to deal with this error, before applying any preventive approaches, e.g., providing more information, or any compensatory solutions, e.g., pre-calculating alternative routes, could be to predict and recognize the potential turning activity. This paper aims to address this step by predicting the turning decision of pedestrian wayfinders, before the actual action takes place, using primarily gaze-based features. Applying Machine Learning methods, the results of the presented experiment demonstrate an overall accuracy of 91% within three seconds before arriving at a decision point. Beyond the application perspective, our findings also shed light on the cognitive processes of decision making as reflected by the wayfinder´s gaze behaviour: incorporating environmental and user-related factors to the model, results in a noticeable change with respect to the importance of visual search features in turn activity recognition.

Activity Recognition, Wayfinding, Eye Tracking, Machine Learning

http://dx.doi.org/10.4230/LIPIcs.GIScience.2021.II.5