Poole B and Lee M.
(2024). Towards interactive reinforcement learning with intrinsic feedback. Neurocomputing. 587:C. Online publication date: 28-Jun-2024.
Hong M, Sunberg Z and Szafir D. Cieran: Designing Sequential Colormaps via In-Situ Active Preference Learning. Proceedings of the CHI Conference on Human Factors in Computing Systems. (1-15).
Schrage-Prent N, Preciado Vanegas D and Baraka K. Interactive Robot Programming Inspired by Dog Training: An Exploratory Study. Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction. (965-969).
Phaijit O, Sammut C and Johal W. User Interface Interventions for Improving Robot Learning from Demonstration. Proceedings of the 11th International Conference on Human-Agent Interaction. (152-161).
Tarakli I and Di Nuovo A. User Perception of Teachable Robots: A Comparative Study of Teaching Strategies, Task Complexity and User Characteristics. Social Robotics. (357-370).
Benthall S and Shekman D. Designing Fiduciary Artificial Intelligence. Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization. (1-15).
Aliasghari P, Ghafurian M, Nehaniv C and Dautenhahn K.
(2023). How Do We Perceive Our Trainee Robots? Exploring the Impact of Robot Errors and Appearance When Performing Domestic Physical Tasks on Teachers’ Trust and Evaluations. ACM Transactions on Human-Robot Interaction. 12:3. (1-41). Online publication date: 30-Sep-2023.
Chen S, Qiu S, Li H, Zhang J, Wu X, Zeng W and Huang F.
(2023). An integrated model for predicting pupils’ acceptance of artificially intelligent robots as teachers. Education and Information Technologies. 28:9. (11631-11654). Online publication date: 1-Sep-2023.
Bignold A, Cruz F, Dazeley R, Vamplew P and Foale C.
(2023). Human engagement providing evaluative and informative advice for interactive reinforcement learning. Neural Computing and Applications. 35:25. (18215-18230). Online publication date: 1-Sep-2023.
Harnack D, Pivin-Bachler J and Navarro-Guerrero N.
(2022). Quantifying the effect of feedback frequency in interactive reinforcement learning for robotic tasks. Neural Computing and Applications. 35:23. (16931-16943). Online publication date: 1-Aug-2023.
Mathewson K, Parker A, Sherstan C, Edwards A, Sutton R and Pilarski P.
(2022). Communicative capital: a key resource for human–machine shared agency and collaborative capacity. Neural Computing and Applications. 35:23. (16805-16819). Online publication date: 1-Aug-2023.
Ashktorab Z, Desmond M, Johnson J, Pan Q, Dugan C, Brachman M and Spina C. SME-in-the-loop: Interaction Preferences when Supervising Bots in Human-AI Communities. Proceedings of the 2023 ACM Designing Interactive Systems Conference. (2281-2303).
Hedlund-Botti E and Gombolay M. Investigating Learning from Demonstration in Imperfect and Real World Scenarios. Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. (769-771).
Zhang Q, Narcomey A, Candon K and Vázquez M. Self-Annotation Methods for Aligning Implicit and Explicit Human Feedback in Human-Robot Interaction. Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. (398-407).
Phaijit O, Sammut C and Johal W. Let’s Compete! The Influence of Human-Agent Competition and Collaboration on Agent Learning and Human Perception. Proceedings of the 10th International Conference on Human-Agent Interaction. (86-94).
Candello H, Pinhanez C, Muller M and Wessel M.
(2022). Unveiling Practices of Customer Service Content Curators of Conversational Agents. Proceedings of the ACM on Human-Computer Interaction. 6:CSCW2. (1-33). Online publication date: 7-Nov-2022.
Rosen E, Hsiung E, Chi V and Malle B. Norm Learning with Reward Models from Instructive and Evaluative Feedback. 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). (1634-1640).
Singh B, Kumar R and Singh V.
(2022). Reinforcement learning in robotic applications: a comprehensive survey. Artificial Intelligence Review. 55:2. (945-990). Online publication date: 1-Feb-2022.
Losey D, Bajcsy A, O’Malley M and Dragan A.
(2022). Physical interaction as communication. International Journal of Robotics Research. 41:1. (20-44). Online publication date: 1-Jan-2022.
Zhang R, Torabi F, Warnell G and Stone P.
(2021). Recent advances in leveraging human guidance for sequential decision-making tasks. Autonomous Agents and Multi-Agent Systems. 35:2. Online publication date: 1-Oct-2021.
Wallkötter S, Tulli S, Castellano G, Paiva A and Chetouani M.
(2021). Explainable Embodied Agents Through Social Cues. ACM Transactions on Human-Robot Interaction. 10:3. (1-24). Online publication date: 30-Sep-2021.
Juan R, Huang J, Gomez R, Nakamura K, Sha Q, He B and Li G. Shaping Progressive Net of Reinforcement Learning for Policy Transfer with Human Evaluative Feedback. 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (1281-1288).
Wu T, Martelaro N, Stent S, Ortiz J and Ju W.
(2021). Learning When Agents Can Talk to Drivers Using the INAGT Dataset and Multisensor Fusion. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 5:3. (1-28). Online publication date: 9-Sep-2021.
Vasylkiv Y, Ma Z, Li G, Brock H, Nakamura K, Pourang I and Gomezv R. Shaping Affective Robot Haru’s Reactive Response. 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN). (989-996).
Ramaraj P, Ortiz C and Mohan S. Unpacking Human Teachers’ Intentions for Natural Interactive Task Learning. 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN). (1173-1180).
Kim H and Lim Y. Teaching-Learning Interaction: A New Concept for Interaction Design to Support Reflective User Agency in Intelligent Systems. Proceedings of the 2021 ACM Designing Interactive Systems Conference. (1544-1553).
Li Z, Shi L, Cristea A and Zhou Y. A Survey of Collaborative Reinforcement Learning: Interactive Methods and Design Patterns. Proceedings of the 2021 ACM Designing Interactive Systems Conference. (1579-1590).
Huang G, Qian X, Wang T, Patel F, Sreeram M, Cao Y, Ramani K and Quinn A. AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented Reality. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. (1-15).
Li G, Dibeklioğlu H, Whiteson S and Hung H. Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework. Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems. (1735-1737).
Sanchez T, Caramiaux B, Françoise J, Bevilacqua F and Mackay W.
(2021). How do People Train a Machine?. Proceedings of the ACM on Human-Computer Interaction. 5:CSCW1. (1-26). Online publication date: 13-Apr-2021.
Najar A, Sigaud O and Chetouani M. Training a robot with evaluative feedback and unlabeled guidance signals. 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). (261-266).
Ramaraj P. Robots that Help Humans Build Better Mental Models of Robots. Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction. (595-597).
Scurto H, Kerrebroeck B, Caramiaux B and Bevilacqua F.
(2021). Designing Deep Reinforcement Learning for Human Parameter Exploration. ACM Transactions on Computer-Human Interaction. 28:1. (1-35). Online publication date: 1-Feb-2021.
Baothman F and Gupta D.
(2021). A Machine Learning Approach for Improving the Movement of Humanoid NAO’s Gaits. Wireless Communications & Mobile Computing. 2021. Online publication date: 1-Jan-2021.
Papageorgiou D and Doulgeri Z. A control scheme for haptic inspection and partial modification of kinematic behaviors*. 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (9752-9758).
Blanchet K, Bouzeghoub A, Kchir S and Lebec O. How to Guide Humans Towards Skills Improvement in Physical Human-Robot Collaboration Using Reinforcement Learning?. 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC). (4281-4287).
Arzate Cruz C and Igarashi T. A Survey on Interactive Reinforcement Learning. Proceedings of the 2020 ACM Designing Interactive Systems Conference. (1195-1209).
Xiao Z, Zhou M, Liao Q, Mark G, Chi C, Chen W and Yang H.
(2020). Tell Me About Yourself. ACM Transactions on Computer-Human Interaction. 27:3. (1-37). Online publication date: 30-Jun-2020.
Suppakun N and Maneewarn T.
(2020). Coaching: accelerating reinforcement learning through human-assisted approach. Progress in Artificial Intelligence. 9:2. (155-169). Online publication date: 1-Jun-2020.
Ramesh D, Liu A, Echeverria A, Song J, Waytowich N and Lasecki W. Yesterday's Reward is Today's Punishment. Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems. (1090-1097).
Hong J, Lee K, Xu J and Kacorri H. Crowdsourcing the Perception of Machine Teaching. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. (1-14).
Wang G, Trimbach C, Lee J, Ho M and Littman M. Teaching a Robot Tasks of Arbitrary Complexity via Human Feedback. Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. (649-657).
Li G, Dibeklioğlu H, Whiteson S and Hung H.
(2020). Facial feedback for reinforcement learning: a case study and offline analysis using the TAMER framework. Autonomous Agents and Multi-Agent Systems. 34:1. Online publication date: 9-Mar-2020.
Papageorgiou D, Kastritsi T and Doulgeri Z.
(2020). A passive robot controller aiding human coaching for kinematic behavior modifications. Robotics and Computer-Integrated Manufacturing. 61:C. Online publication date: 1-Feb-2020.
Legg P, Smith J and Downing A.
(2019). Visual analytics for collaborative human-machine confidence in human-centric active learning tasks. Human-centric Computing and Information Sciences. 9:1. (1-25). Online publication date: 26-Dec-2019.
Candello H, Pichiliani M, Wessel M, Pinhanez C and Muller M. Teaching Robots to Act and Converse in Physical Spaces: Participatory Design Fictions with Museum Guides. Proceedings of the Halfway to the Future Symposium 2019. (1-4).
Nageshrao S, Tseng H and Filev D. Autonomous Highway Driving using Deep Reinforcement Learning. 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). (2326-2331).
Doering M, Liu P, Glas D, Kanda T, Kulić D and Ishiguro H.
(2019). Curiosity Did Not Kill the Robot. ACM Transactions on Human-Robot Interaction. 8:3. (1-24). Online publication date: 30-Sep-2019.
Alonso M. Learning User Preferences via Reinforcement Learning with Spatial Interface Valuing. Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments. (403-418).
Parker A, Edwards A and Pilarski P. Exploring the Impact of Machine-Learned Predictions on Feedback from an Artificial Limb. 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR). (1239-1246).
Krening S and Feigh K. Effect of Interaction Design on the Human Experience with Interactive Reinforcement Learning. Proceedings of the 2019 on Designing Interactive Systems Conference. (1089-1100).
Krening S and Feigh K. Newtonian Action Advice. Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems. (720-727).
Gillies M.
(2019). Understanding the Role of Interactive Machine Learning in Movement Interaction Design. ACM Transactions on Computer-Human Interaction. 26:1. (1-34). Online publication date: 28-Feb-2019.
Krening S and Feigh K.
(2018). Interaction Algorithm Effect on Human Experience with Reinforcement Learning. ACM Transactions on Human-Robot Interaction. 7:2. (1-22). Online publication date: 31-Oct-2018.
Faulkner T, Short E and Thomaz A. Policy Shaping with Supervisory Attention Driven Exploration. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (842-847).
Li G, He B, Gomez R and Nakamura K. Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback. 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). (1156-1162).
Roy S, Crick C, Kieson E and Abramson C. A Reinforcement Learning Model for Robots as Teachers<sup>*</sup>. 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). (294-299).
Smith J, Legg P, Matovic M and Kinsey K.
(2018). Predicting User Confidence During Visual Decision Making. ACM Transactions on Interactive Intelligent Systems. 8:2. (1-30). Online publication date: 30-Jun-2018.
Kokku R, Sundararajan S, Dey P, Sindhgatta R, Nitta S and Sengupta B. Augmenting Classrooms with AI for Personalized Education. 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). (6976-6980).
Jevti A, Colom A, Aleny G and Torras C.
(2018). Robot motion adaptation through user intervention and reinforcement learning. Pattern Recognition Letters. 105:C. (67-75). Online publication date: 1-Apr-2018.
Roy S, Kieson E, Abramson C and Crick C. Using Human Reinforcement Learning Models to Improve Robots as Teachers. Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. (225-226).
Bajcsy A, Losey D, O'Malley M and Dragan A. Learning from Physical Human Corrections, One Feature at a Time. Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. (141-149).
Racca M and Kyrki V. Active Robot Learning for Temporal Task Models. Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. (123-131).
Alshiekh M, Bloem R, Ehlers R, Könighofer B, Niekum S and Topcu U. Safe reinforcement learning via shielding. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence. (2669-2678).
Li G, Whiteson S, Knox W and Hung H.
(2018). Social interaction for efficient agent learning from human reward. Autonomous Agents and Multi-Agent Systems. 32:1. (1-25). Online publication date: 1-Jan-2018.
Senft E, Baxter P, Kennedy J, Lemaignan S and Belpaeme T.
(2017). Supervised autonomy for online learning in human-robot interaction. Pattern Recognition Letters. 99:C. (77-86). Online publication date: 1-Nov-2017.
Elliott S, Xu Z and Cakmak M. Learning generalizable surface cleaning actions from demonstration. 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). (993-999).
Senft E, Lemaignan S, Baxter P and Belpaeme T. Leveraging Human Inputs in Interactive Machine Learning for Human Robot Interaction. Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. (281-282).
Liu R and Zhang X.
(2016). Context-Specific grounding of web natural descriptions to human-centered situations. Knowledge-Based Systems. 111:C. (1-16). Online publication date: 1-Nov-2016.
Li G, Whiteson S, Knox W and Hung H.
(2016). Using informative behavior to increase engagement while learning from human reward. Autonomous Agents and Multi-Agent Systems. 30:5. (826-848). Online publication date: 1-Sep-2016.
Moerland T, Broekens J and Jonker C. Fear and hope emerge from anticipation in model-based reinforcement learning. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. (848-854).
Li G, Dibeklioglu H, Whiteson S and Hung H. Towards Learning from Implicit Human Reward. Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems. (1353-1354).
Akgun B and Thomaz A.
(2016). Simultaneously learning actions and goals from demonstration. Autonomous Robots. 40:2. (211-227). Online publication date: 1-Feb-2016.
Nikolaidis S, Lasota P, Ramakrishnan R and Shah J.
(2015). Improved human–robot team performance through cross-training, an approach inspired by human team training practices. International Journal of Robotics Research. 34:14. (1711-1730). Online publication date: 1-Dec-2015.
Daniel C, Kroemer O, Viering M, Metz J and Peters J.
(2015). Active reward learning with a novel acquisition function. Autonomous Robots. 39:3. (389-405). Online publication date: 1-Oct-2015.
Knox W and Stone P.
(2015). Framing reinforcement learning from human reward. Artificial Intelligence. 225:C. (24-50). Online publication date: 1-Aug-2015.
Cederborg T, Grover I, Isbell C and Thomaz A. Policy shaping with human teachers. Proceedings of the 24th International Conference on Artificial Intelligence. (3366-3372).
Gil Y.
(2015). Human Tutorial Instruction in the Raw. ACM Transactions on Interactive Intelligent Systems. 5:1. (1-29). Online publication date: 25-Mar-2015.
Jensen L, Fischer K, Shukla D and Piater J. Negotiating Instruction Strategies during Robot Action Demonstration. Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts. (143-144).
Oudah M, Babushkin V, Chenlinangjia T and Crandall J. Learning to Interact with a Human Partner. Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. (311-318).
Senft E, Baxter P and Belpaeme T. Human-guided learning of social action selection for robot-assisted therapy. Proceedings of the 4th International Conference on Machine Learning for Interactive Systems - Volume 43. (15-20).
García J and Fernández F.
(2015). A comprehensive survey on safe reinforcement learning. The Journal of Machine Learning Research. 16:1. (1437-1480). Online publication date: 1-Jan-2015.
Grizou J, Iturrate I, Montesano L, Oudeyer P and Lopes M. Interactive learning from unlabeled instructions. Proceedings of the Thirtieth Conference on Uncertainty in Artificial Intelligence. (290-299).
Griffith S, Subramanian K, Scholz J, Isbell C and Thomaz A. Policy shaping. Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2. (2625-2633).
Knox W, Stone P and Breazeal C. Training a Robot via Human Feedback. Proceedings of the 5th International Conference on Social Robotics - Volume 8239. (460-470).
Cuayáhuitl H, van Otterlo M, Dethlefs N and Frommberger L. Machine learning for interactive systems and robots. Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication. (19-28).
Calinon S, Kormushev P and Caldwell D.
(2013). Compliant skills acquisition and multi-optima policy search with EM-based reinforcement learning. Robotics and Autonomous Systems. 61:4. (369-379). Online publication date: 1-Apr-2013.
Knox W, Stone P and Breazeal C. Teaching agents with human feedback. Proceedings of the companion publication of the 2013 international conference on Intelligent user interfaces companion. (65-66).
Knox W and Stone P. Learning non-myopically from human-generated reward. Proceedings of the 2013 international conference on Intelligent user interfaces. (191-202).
Harutyunyan V, Manohar V, Gezehei I and Crandall J.
(2013). Cognitive telepresence in human-robot interactions. Journal of Human-Robot Interaction. 1:2. (158-182). Online publication date: 28-Jan-2013.
Salah A, Ruiz-del-Solar J, Meriçli Ç and Oudeyer P. Human behavior understanding for robotics. Proceedings of the Third international conference on Human Behavior Understanding. (1-16).
Mast M, Burmester M, Krüger K, Fatikow S, Arbeiter G, Graf B, Kronreif G, Pigini L, Facal D and Qiu R.
(2012). User-centered design of a dynamic-autonomy remote interaction concept for manipulation-capable robots to assist elderly people in the home. Journal of Human-Robot Interaction. 1:1. (96-118). Online publication date: 28-Jul-2012.
Young J, Ishii K, Igarashi T and Sharlin E. Style by demonstration. Proceedings of the 2012 ACM international conference on Intelligent User Interfaces. (41-50).
Walsh T, Hewlett D and Morrison C. Blending autonomous exploration and apprenticeship learning. Proceedings of the 24th International Conference on Neural Information Processing Systems. (2258-2266).
Kaochar T, Peralta R, Morrison C, Fasel I, Walsh T and Cohen P. Towards understanding how humans teach robots. Proceedings of the 19th international conference on User modeling, adaption, and personalization. (347-352).
Mason M and Lopes M. Robot self-initiative and personalization by learning through repeated interactions. Proceedings of the 6th international conference on Human-robot interaction. (433-440).
Leyzberg D, Avrunin E, Liu J and Scassellati B. Robots that express emotion elicit better human teaching. Proceedings of the 6th international conference on Human-robot interaction. (347-354).
Fritz C and Gil Y. A formal framework for combining natural instruction and demonstration for end-user programming. Proceedings of the 16th international conference on Intelligent user interfaces. (237-246).
Kartoun U, Stern H and Edan Y.
(2010). A Human-Robot Collaborative Reinforcement Learning Algorithm. Journal of Intelligent and Robotic Systems. 60:2. (217-239). Online publication date: 1-Nov-2010.
Cakmak M, Depalma N, Arriaga R and Thomaz A.
(2010). Exploiting social partners in robot learning. Autonomous Robots. 29:3-4. (309-329). Online publication date: 1-Nov-2010.
Judah K, Roy S, Fern A and Dietterich T. Reinforcement learning via practice and critique advice. Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence. (481-486).
Chao C, Cakmak M and Thomaz A. Transparent active learning for robots. Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction. (317-324).
Jie Sun , Moore J, Bobick A and Rehg J.
(2010). Learning Visual Object Categories for Robot Affordance Prediction. International Journal of Robotics Research. 29:2-3. (174-197). Online publication date: 1-Feb-2010.
Thomaz A and Cakmak M. Learning about objects with human teachers. Proceedings of the 4th ACM/IEEE international conference on Human robot interaction. (15-22).
Thomaz A and Breazeal C.
(2008). Experiments in socially guided exploration. Connection Science. 20:2-3. (91-110). Online publication date: 1-Jun-2008.
Cha E, Kronander K and Billard A. Combined kinesthetic and simulated interface for teaching robot motion models. 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). (83-88).