research-article

Effect of performance feedback (or lack thereof) on driver calibration

Authors:

Shannon C. Roberts,

William J. Horrey,

Yulan LiangAuthors Info & Claims

AutomotiveUI '12: Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Pages 67 - 74

https://doi.org/10.1145/2390256.2390266

Published: 17 October 2012 Publication History

Abstract

Many drivers are miscalibrated, i.e. they think they are better or worse than they actually are at multitasking situations. Recent studies focused on calibration while driving show that drivers are miscalibrated, either over confident or under confident, and that this effect changes under different conditions. Previous work has demonstrated behavioral and performance benefits of feedback, yet these studies have not explicitly examined the issue of calibration. Therefore, the main goal of this study was to examine effect of feedback on calibration using an instrumented van and test track, employing a well-defined method to assess calibration. Twenty-four drivers completed a series of driving tasks on a test track. Half of the participants received performance feedback while the other half received no feedback. Calibration was assessed through comparison of drivers' subjective ratings of performance and confidence to objective performance measures. Results indicated that participants' calibration improved over time, but there was no consistent effect of feedback. In some cases, the Feedback group performed worse than those who did not receive feedback.

References

[1]

Wogalter, M. S. and Mayhorn, C. B. Perceptions of Driver Distraction by Cellular Phone Users and Nonusers. Human Factors: The Journal of the Human Factors and Ergonomics Society, 472005), 455--467.

[2]

AAA Foundation for Traffic Safety 2009 Traffic Safety Culture Index. AAA Foundation for Traffic Safety, City, 2009.

[3]

McEvoy, S. P., Stevenson, M. R., McCartt, A. T., Woodward, M., Haworth, C., Palamara, P. and Cercarelli, R. Role of mobile phones in motor vehicle crashes resulting in hospital attendance: a case-crossover study. BMJ, 331, 7514 (August 20, 2005 2005), 428.

[4]

Olson, R. L., Hanowski, R. J., Hickman, J. S. and Bocanegra, J. Driver Distraction in Commerical Vehicle Operations. FMCSA-RRR-09-042, Federal Motor Carrier Safety Administration, Washington, DC, 2009.

[5]

Svenson, O. Are we all less risky and more skillful than our fellow drivers? Acta Psychologica, 47, 2 1981), 143--148.

[6]

McKenna, F. P., Stanier, R. A. and Lewis, C. Factors underlying illusory self-assessment of driving skill in males and females. Accident Analysis & Prevention, 23, 1 1991), 45--52.

[7]

Horrey, W. J., Lesch, M. F. and Garabet, A. Assessing the awareness of performance decrements in distracted drivers. Accident Analysis & Prevention, 40, 2 2008), 675--682.

[8]

Kidd, D. G. and Horrey, W. J. Do drivers' estimates of distraction become calibrated to their actual distracted driving performance with greater exposure? In Proceedings of the 88th Annual Meeting of the Transportation Research Board (Washington, DC, 2009). National Academy of Sciences.

[9]

Lesch, M. F. and Hancock, P. A. Driving performance during concurrent cell-phone use: are drivers aware of their performance decrements? Accident Analysis & Prevention, 36, 3 2004), 471--480.

[10]

Kidd, D. G. and Monk, C. A. Are unskilled drivers aware of their deficiencies? How driving skills influence the accuracy of driving performance estimates. City, 2009.

[11]

Murphy, A. H. and Winkler, R. L. Can weather forecasters formulate reliable probability forecasts of precipitation and temperatures? National Weather Digest, 21977), 2--9.

[12]

Hattie, J. and Timperley, H. The Power of Feedback. Review of Educational Research, 77, 1 (March 1, 2007 2007), 81--112.

[13]

Evans, L. Speed estimation from a moving automobile. Ergonomics, 13, 2 1970), 219--230.

[14]

Evans, L. Automobile-speed estimation using movie-film simulation. Ergonomics, 13, 2 1970), 231--237.

[15]

de Waard, D., van der Hulst, M. and Brookhuis, K. A. Elderly and young drivers' reaction to an in-car enforcement and tutoring system. Applied Ergonomics, 30, 2 1999), 147--157.

[16]

Larson, L. D., Schnelle, J. F., Kirchner Jr., R., Carr, A. F., Domash, M. and Risley, T. R. Reduction of police vehicle accidents through mechanically aided supervision. Journal of Applied Behavior Analysis, 13, 4 1980), 571--581.

[17]

Van Houten, R. and Nau, P. A. Feedback Interventions and Driving Speed: A Parametric and Comparitive Analysis. Journal of Applied Behavior Analysis, 16, 3 1983), 253--281.

[18]

Malenfant, L., Wells, J. K., Van Houten, R. and Williams, A. F. The use of feedback signs to increase observed daytime seat belt use in two cities in North Carolina. Accident Analysis & Prevention, 28, 6 1996), 771--777.

[19]

Shinar, D. and Schechtman, E. Headway Feedback Improves Intervehicular Distance: A Field Study. Human Factors: The Journal of the Human Factors and Ergonomics Society, 44, 3 (Fall 2002 2002), 474--481.

[20]

Walker, G. H., Stanton, N. A. and Young, M. S. Easy rider meets knight rider: an on-road exploratory study of situation awareness in car drivers and motorcyclists. International Journal of Vehicle Design, 45, 3 2007), 307--322.

[21]

Walker, G. H., Stanton, N. A. and Young, M. S. What's happened to car design? An exploratory study into the effect of 15 years of progress on driver situation awareness. International Journal of Vehicle Design, 45, 1--2 2007), 266--282.

[22]

Donmez, B., Boyle, L. N. and Lee, J. D. Safety implications of providing real-time feedback to distracted drivers. Accident Analysis & Prevention, 39, 3 2007), 581--590.

[23]

Donmez, B., Boyle, L. N. and Lee, J. D. Mitigating driver distraction with retrospective and concurrent feedback. Accident Analysis & Prevention, 40, 2 2008), 776--786.

[24]

Brier, G. W. Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78, 1 1950), 1--3.

[25]

Kumar, M., Moorthy, U. and Perraudin, W. Predicting emerging market currency crashes. Journal of Empirical Finance, 10, 4 2003), 427--454.

[26]

Lichtenstein, S. and Fischhoff, B. Training for calibration. Organizational Behavior and Human Performance, 26, 2 1980), 149--171.

[27]

Mackillop, W. J. and Quirt, C. F. Measuring the accuracy of prognostic judgments in oncology. Journal of Clinical Epidemiology, 50, 1 1997), 21--29.

[28]

Lichtenstein, S. and Fischhoff, B. Do those who know more also know more about how much they know? Organizational Behavior and Human Performance, 20, 2 1977), 159--183.

[29]

Murphy, A. H. A New Vector Partition of the Probability Score. Journal of Applied Meteorology, 12, 4 1973), 595--600.

[30]

R Development Core Team R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, City, 2011.

Cited By

Salminen KFarooq ARantala JSurakka VRaisamo R(2019)Unimodal and Multimodal Signals to Support Control Transitions in Semiautonomous VehiclesProceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3342197.3344522(308-318)Online publication date: 21-Sep-2019
https://dl.acm.org/doi/10.1145/3342197.3344522
Kun AWachtel JMiller WSon PLavallière MBurnett GGabbard JGreen POsswald SEren AAntrobus V(2015)User interfaces for first responder vehiclesProceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/2799250.2799289(163-170)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1145/2799250.2799289

Index Terms

Effect of performance feedback (or lack thereof) on driver calibration
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Driver behavior analysis during ACC activation and deactivation in a real traffic environment

For the development of a traffic-simulation model to estimate the effect of adaptive cruise control (ACC) systems on traffic safety, throughput, and environment, data of a field operational test (FOT) were analyzed, in which vehicles were equipped with ...
Context-Dependent Force-Feedback Steering Wheel to Enhance Drivers' On-Road Performances
FAC '09: Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International 2009

In this paper the topic of the augmented cognition applied to the driving task, and specifically to the steering maneuver, is discussed. We analyze how the presence of haptic feedback on the steering wheel could help drivers to perform a visually-guided ...
Fuzzy modelling and inference for physics-aware road vehicle driver behaviour model calibration
Abstract
Traffic simulation is a crucial tool for testing and evaluating hypotheses in both the design of autonomous driving systems and the optimization of urban transportation, where modelling and calibrating driver behaviour is key. In this article, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AutomotiveUI '12: Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

October 2012

280 pages

ISBN:9781450317511

DOI:10.1145/2390256

General Chair:
Andrew L. Kun
University of New Hampshire
,
Program Chairs:
Linda Boyle
University of Washington
,
Bryan Reimer
Massachusetts Institute of Technology
,
Andreas Riener
University of Linz
,
Jennifer Healey
Intel Corporation
,
Wei Zhang
Tsinghua University
,
Publications Chairs:
Bastian Pfleging
University of Stuttgart
,
Marc Kurz
University of Linz

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AutomotiveUI '12

AutomotiveUI '12: International Conference on Automotive User Interfaces and Interactive Vehicular Applications

October 17 - 19, 2012

New Hampshire, Portsmouth

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
221
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Salminen KFarooq ARantala JSurakka VRaisamo R(2019)Unimodal and Multimodal Signals to Support Control Transitions in Semiautonomous VehiclesProceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3342197.3344522(308-318)Online publication date: 21-Sep-2019
https://dl.acm.org/doi/10.1145/3342197.3344522
Kun AWachtel JMiller WSon PLavallière MBurnett GGabbard JGreen POsswald SEren AAntrobus V(2015)User interfaces for first responder vehiclesProceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/2799250.2799289(163-170)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1145/2799250.2799289

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents