Might as Well Be on Mars: Insights on the Extraterrestrial Applicability of Interaction Design Frameworks from Earth
Authors: 
Jean Vanderdonckt, 
Radu-Daniel Vatavu, 
Julie Manon, Michael Saint-Guillain, Philippe Lefevre, Jessica J. MarquezAuthors Info & Claims
Jean Vanderdonckt, Radu-Daniel Vatavu, Julie Manon, Michael Saint-Guillain, Philippe Lefevre, Jessica J. MarquezAuthors Info & ClaimsArticle No.: 239, Pages 1 - 8
Abstract
As humanity expands its reach into the Cosmos, the imagination-sparkling prospect of colonizing other planets, such as Mars, becomes increasingly tangible. However, establishing livable environments on Mars necessitates robust and efficient computer systems, and thus design knowledge for highly usable interactions that match users’ abilities under the unique challenges posed by other planets’ environments. In this work, we connect to current interaction design frameworks, such as Ability-based Design, Reality-based Interaction, and Sensorimotor Realities, to assess their suitability beyond Earth. Furthermore, we present insights from the user experience of interactive systems on Mars through observations collected during a mission at the Mars Desert Research Station. We use our findings to propose future research on interaction frameworks with extraterrestrial and interplanetary applicability.
Supplemental Material
MP4 File
Talk Video
- Download
- 19.20 MB
- Transcript
References
[1]
Leonie Bensch, Tommy Nilsson, Paul de Medeiros, Florian Dufresne, Andreas Gerndt, Flavie Rometsch, Georgia Albuquerque, Frank Flemisch, Oliver Bensch, Michael Preutenborbeck, and Aidan Cowley. 2023. Towards Balanced Astronaut-Oriented Design for Future EVA Space Technologies. In Proceedings of SpaceCHI 3.0, A Conference on Human-Computer Interaction for Space Exploration(SpaceCHI 3.0). MIT Media Lab, MA, USA, 10 pages. https://spacechi.media.mit.edu/spacechi-2023-program
[2]
Gaĕlle Calvary, Joĕlle Coutaz, David Thevenin, Quentin Limbourg, Laurent Bouillon, and Jean Vanderdonckt. 2003. A Unifying Reference Framework for multi-target user interfaces. Interacting with Computers 15, 3 (06 2003), 289–308. https://doi.org/10.1016/S0953-5438(03)00010-9
[3]
Charles L.A. Clarke, Gordon V. Cormack, Jimmy Lin, and Adam Roegiest. 2017. Ten Blue Links on Mars. In Proceedings of the 26th International Conference on World Wide Web (Perth, Australia) (WWW ’17). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 273–281. https://doi.org/10.1145/3038912.3052625
[4]
Joëlle Coutaz, James L. Crowley, Simon Dobson, and David Garlan. 2005. Context is key. Commun. ACM 48, 3 (mar 2005), 49–53. https://doi.org/10.1145/1047671.1047703
[5]
Ariel Ekblaw, Juliana Cherston, Fangzheng Liu, Irmandy Wicaksono, Don Derek Haddad, Valentina Sumini, and Joseph A. Paradiso. 2023. From UbiComp to Universe-Moving Pervasive Computing Research Into Space Applications. IEEE Pervasive Computing 22, 2 (2023), 27–42. https://doi.org/10.1109/MPRV.2023.3242667
[6]
Sands Fish. 2018. How To Design Interplanetary Apps. Medium. https://sandsfish.medium.com/how-to-design-interplanetary-apps-22ebefec097d
[7]
Sands Fish. 2022. Orientation-Responsive Displays for Microgravity. In Proceedings of the SpaceCHI 2.0 Workshop, Advancing Human-Computer Interaction for Space Exploration at CHI 2022(SpaceCHI 2.0). MIT Media Lab, MA, USA, 5 pages. https://drive.google.com/open?id=1BUQDkbt6tSCJ759Z00FuaEmm6Af5h2z9
[8]
Sands Fish and Nicole L’Huillier. 2018. Telemetron: A Musical Instrument for Performance in Zero Gravity. In Proceedings of the International Conference on New Interfaces for Musical Expression(NIME ’18). NIME Community, 3 pages. https://www.nime.org/proceedings/2018/nime2018_paper0066.pdf
[9]
Marcin Fra̧ckiewicz. 2023. The Role of Human Augmentation in Space Exploration. LIM Center. https://ts2.pl/en/the-role-of-human-augmentation-in-space-exploration/
[10]
John D. Gould and Clayton Lewis. 1985. Designing for usability: key principles and what designers think. Commun. ACM 28, 3 (mar 1985), 300–311. https://doi.org/10.1145/3166.3170
[11]
Linda Hirsch, Jingyi Li, Sven Mayer, and Andreas Butz. 2022. A Survey of Natural Design for Interaction. In Proceedings of Mensch Und Computer 2022(MuC ’22). ACM, New York, NY, USA, 240–254. https://doi.org/10.1145/3543758.3543773
[12]
Sandra Häuplik-Meusburger and Sheryl Bishop. 2021. Space Habitats and Habitability: Designing for Isolated and Confined Environments on Earth and in Space. Springer Nature, Cham. https://doi.org/10.1007/978-3-030-69740-2
[13]
Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’08). ACM, New York, NY, USA, 201–210. https://doi.org/10.1145/1357054.1357089
[14]
Lik-Hang Lee, Carlos Bermejo Fernandez, Ahmad Alhilal, Tristan Braud, Simo Hosio, Esmée Henrieke Anne de Haas, and Pan Hui. 2022. Beyond the Blue Sky of Multimodal Interaction: A Centennial Vision of Interplanetary Virtual Spaces in Turn-based Metaverse. In Proceedings of the 2022 International Conference on Multimodal Interaction(ICMI ’22). ACM, New York, NY, USA, 648–652. https://doi.org/10.1145/3536221.3558174
[15]
Shu-Yu Lin and Katya Arquilla. 2022. Quantifying Proprioceptive Experience in Microgravity. In Proceedings of the SpaceCHI 2.0 Workshop, Advancing Human-Computer Interaction for Space Exploration at CHI 2022(SpaceCHI 2.0). MIT Media Lab, MA, USA, 5 pages. https://drive.google.com/open?id=14adCKB1U5m2-0kiL9BL02rD6-uUkoavd
[16]
Adrian Lubitz, Octavio Arriaga, Teena Hassan, Nina Hoyer, and Elsa Andrea Kirchner. 2022. A Bayesian Approach to Context-based Recognition of Human Intention for Context-Adaptive Robot Assistance in Space. In Proceedings of the SpaceCHI 2.0 Workshop, Advancing Human-Computer Interaction for Space Exploration at CHI 2022(SpaceCHI 2.0). MIT Media Lab, MA, USA, 5 pages. https://drive.google.com/open?id=1OMi3vs8VNtFSbRXNvV8PH-vsXzZu75ub
[17]
Jessica J. Márquez and Mary L. Cummings. 2008. Design and Evaluation of Path Planning Decision Support for Planetary Surface Exploration. Journal of Aerospace Computing, Information, and Communication 5, 3 (2008), 57–71. https://doi.org/10.2514/1.26248
[18]
Jessica J. Márquez, Lauren Blackwell Landon, and Eduardo Salas. 2023. The Next Giant Leap for Space Human Factors: The Opportunities. Human Factors 65, 6 (2023), 1279–1288. https://doi.org/10.1177/00187208231174955
[19]
Kaitlin R. McTigue, Megan E. Parisi, Tina L. Panontin, Shu-Chieh Wu, and Alonso H. Vera. 2023. How to Keep Your Space Vehicle Alive: Maintainability Design Principles for Deep-Space Missions. In Proceedings of SpaceCHI 3.0, A Conference on Human-Computer Interaction for Space Exploration(SpaceCHI 3.0). MIT Media Lab, MA, USA, 8 pages. https://human-factors.arc.nasa.gov/publications/SpaceCHI2023_Maintainability.pdf
[20]
National Aeronautics and Space Administration (NASA). 2014. Human Integration Design Handbook (HIDH). Revision 1. https://www.nasa.gov/organizations/ochmo/human-integration-design-handbook
[21]
Tommy Nilsson, Leonie Bensch, Florian Dufresne, Flavie Rometsch, Paul de Medeiros, Enrico Guerra, Florian Saling, Andrea Casini, and Aidan Cowley. 2023. Out of this World Design: Bridging the Gap between Space Systems Engineering and Participatory Design Practices. In Proceedings of SpaceCHI 3.0, A Conference on Human-Computer Interaction for Space Exploration(SpaceCHI 3.0). MIT Media Lab, MA, USA, 9 pages. https://spacechi.media.mit.edu/spacechi-2023-program
[22]
Tommy Nilsson, Flavie Rometsch, Leonie Becker, Florian Dufresne, Paul Demedeiros, Enrico Guerra, Andrea Emanuele Maria Casini, Anna Vock, Florian Gaeremynck, and Aidan Cowley. 2023. Using Virtual Reality to Shape Humanity’s Return to the Moon: Key Takeaways from a Design Study. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems(CHI ’23). ACM, New York, NY, USA, Article 305, 16 pages. https://doi.org/10.1145/3544548.3580718
[23]
Amelie Nolte, Jacob Wobbrock, Torben Volkmann, and Nicole Jochems. 2022. Implementing Ability-Based Design: A Systematic Approach to Conceptual User Modeling. ACM Trans. Access. Comput. 15, 4, Article 34 (oct 2022), 26 pages. https://doi.org/10.1145/3551646
[24]
Marianna Obrist, Yunwen Tu, Lining Yao, and Carlos Velasco. 2019. Space Food Experiences: Designing Passenger’s Eating Experiences for Future Space Travel Scenarios. Frontiers in Computer Science 1 (2019), 17 pages. https://doi.org/10.3389/fcomp.2019.00003
[25]
Laurent Opsomer, F. Crevecoeur, J-L. Thonnard, J. McIntyre, and P. Lefèvre. 2021. Distinct adaptation patterns between grip dynamics and arm kinematics when the body is upside-down. Journal of Neurophysiology 125, 3 (2021), 862–874. https://doi.org/10.1152/jn.00357.2020
[26]
Paul Parsons, Zixu Zhang, and Jackson Murray. 2022. Adaptive Performance: A Generative Theory for HCI Design in Extraterrestrial Habitats. In Proceedings of the SpaceCHI 2.0 Workshop, Advancing Human-Computer Interaction for Space Exploration at CHI 2022(SpaceCHI 2.0). MIT Media Lab, MA, USA, 4 pages. https://drive.google.com/open?id=1vYNe4HXcDVmMeNn0X_lXWn7hCUXIDOKU
[27]
Pat Pataranutaporn, Valentina Sumini, Ariel Ekblaw, Melodie Yashar, Sandra Häuplik-Meusburger, Susanna Testa, Marianna Obrist, Dorit Donoviel, Joseph Paradiso, and Pattie Maes. 2021. SpaceCHI: Designing Human-Computer Interaction Systems for Space Exploration. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems(CHI EA ’21). ACM, New York, NY, USA, Article 96, 6 pages. https://doi.org/10.1145/3411763.3441358
[28]
Pat Pataranutaporn, Valentina Sumini, Melodie Yashar, Susanna Testa, Marianna Obrist, Scott Davidoff, Amber M. Paul, Dorit Donoviel, Jimmy Wu, Sands A Fish, Ariel Ekblaw, Albrecht Schmidt, Joe Paradiso, and Pattie Maes. 2022. SpaceCHI 2.0: Advancing Human-Computer Interaction Systems for Space Exploration. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems(CHI EA ’22). ACM, New York, NY, USA, Article 77, 7 pages. https://doi.org/10.1145/3491101.3503708
[29]
Michael Saint-Guillain, Jean Vanderdonckt, Nicolas Burny, Vladimir Pletser, Tiago Vaquero, Steve Chien, Alexander Karl, Jessica Marquez, Cyril Wain, Audrey Comein, Ignacio S. Casla, Jean Jacobs, Julien Meert, Cheyenne Chamart, Sirga Drouet, and Julie Manon. 2023. Enabling astronaut self-scheduling using a robust advanced modelling and scheduling system: An assessment during a Mars analogue mission. Advances in Space Research 72, 4 (2023), 1378–1398. https://doi.org/10.1016/j.asr.2023.03.045
[30]
Martin Schrepp and Jŏrg Thomaschewski. 2019. Design and Validation of a Framework for the Creation of User Experience Questionnaires. International Journal of Interactive Multimedia and Artificial Intelligence 5, 7 (2019), 88–95. https://doi.org/10.9781/ijimai.2019.06.006
[31]
Shivang Shelat, John A. Karasinski, Erin E. Flynn-Evans, and Jessica J. Marquez. 2022. Evaluation of User Experience of Self-scheduling Software for Astronauts: Defining a Satisfaction Baseline. In Engineering Psychology and Cognitive Ergonomics, Don Harris and Wen-Chin Li (Eds.). Springer International Publishing, Cham, 433–445. https://doi.org/10.1007/978-3-031-06086-1_34
[32]
David Smitherman and Andrew Schnell. 2020. Gateway Lunar Habitat Modules as the Basis for a Modular Mars Transit Habitat. In Proceedings of the 2020 IEEE Aerospace Conference. IEEE, USA, 1–12. https://doi.org/10.1109/AERO47225.2020.9172540
[33]
Andrew Terhorst and Jason A. Dowling. 2022. Terrestrial Analogue Research to Support Human Performance on Mars: A Review and Bibliographic Analysis. Space: Science & Technology 2022 (2022). https://doi.org/10.34133/2022/9841785
[34]
Radu-Daniel Vatavu. 2017. Characterizing gesture knowledge transfer across multiple contexts of use. Journal on Multimodal User Interfaces 11, 4 (2017), 301–314. https://doi.org/10.1007/s12193-017-0247-x
[35]
Radu-Daniel Vatavu. 2022. Sensorimotor Realities: Formalizing Ability-Mediating Design for Computer-Mediated Reality Environments. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality(ISMAR ’22). IEEE, USA, 685–694. https://doi.org/10.1109/ISMAR55827.2022.00086
[36]
Radu-Daniel Vatavu. 2023. From Natural to Non-Natural Interaction: Embracing Interaction Design Beyond the Accepted Convention of Natural. In Proceedings of the 25th International Conference on Multimodal Interaction(ICMI ’23). ACM, New York, NY, USA, 684–688. https://doi.org/10.1145/3577190.3616122
[37]
Radu-Daniel Vatavu. 2023. Leveraging Sensorimotor Realities for Assistive Technology Design Bridging Smart Environments and Virtual Worlds. In Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments(PETRA ’23). ACM, New York, NY, USA, 247–253. https://doi.org/10.1145/3594806.3594834
[38]
Jacob O. Wobbrock, Krzysztof Z. Gajos, Shaun K. Kane, and Gregg C. Vanderheiden. 2018. Ability-based design. Commun. ACM 61, 6 (may 2018), 62–71. https://doi.org/10.1145/3148051
[39]
Jacob O. Wobbrock, Shaun K. Kane, Krzysztof Z. Gajos, Susumu Harada, and Jon Froehlich. 2011. Ability-Based Design: Concept, Principles and Examples. ACM Trans. Access. Comput. 3, 3, Article 9 (apr 2011), 27 pages. https://doi.org/10.1145/1952383.1952384
[40]
World Health Organization. 2023. Disability. WHO. https://www.who.int/news-room/fact-sheets/detail/disability-and-health
[41]
Jimin Zheng, Shivang M. Shelat, and Jessica J. Marquez. 2023. Facilitating Crew-Computer Collaboration During Mixed-Initiative Space Mission Planning. In Proceedings of SpaceCHI 3.0, A Conference on Human-Computer Interaction for Space Exploration(SpaceCHI 3.0). MIT Media Lab, MA, USA, 7 pages. https://ntrs.nasa.gov/citations/20230008619
Index Terms
- Might as Well Be on Mars: Insights on the Extraterrestrial Applicability of Interaction Design Frameworks from Earth
Recommendations
Earth departure stage technology requirements for the Mars DRM
AERO '11: Proceedings of the 2011 IEEE Aerospace ConferenceMars Design Reference Architecture 5.01(Mars DRA5.0) 2, released in 2009, presented a method for sustained human exploration of Mars using either Nuclear-Thermal Propulsion or Chemical Propulsion along with a Heavy-Lift Launch Vehicle such as the Ares ...
A Simulation Method for Autonomous Navigation during Cruise Trajectory of Mars Mission
ICEICE '12: Proceedings of the 2012 Second International Conference on Electric Information and Control Engineering - Volume 03In an effort to reduce the time and cost of spacecraft mission analysis, it is necessary to simulate and evaluate the autonomous navigation performance. A simulation integrating the function of design, simulation and analysis is proposed in this paper. ...
Video Prototyping for Interaction Design Across Multiple Displays in the Commercial Flight Deck
DIS '17: Proceedings of the 2017 Conference on Designing Interactive SystemsThe commercial flight deck is a workspace with more than a century of knowledge in human-machine interaction, pioneering the transition from direct analog displays to computerized screens. The flight deck is a collaborative workplace where pilots ...
Comments
Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Data Availability
Funding Sources
- F.S.R. Fund («Fonds Spéciaux de Recherche», Belgium)
- Fonds de la Recherche Scientifique-FNRS
- European Innovation Council - European Union - Symbiotik
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 126Total Downloads
- Downloads (Last 12 months)126
- Downloads (Last 6 weeks)9
Reflects downloads up to
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format