research-article

A Study of Human–AI Symbiosis for Creative Work: Recent Developments and Future Directions in Deep Learning

Authors:

Bernard FongAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications and Applications, Volume 20, Issue 2

Article No.: 47, Pages 1 - 21

https://doi.org/10.1145/3542698

Published: 26 September 2023 Publication History

Abstract

Recent advances in Artificial Intelligence (AI), particularly deep learning, are having an enormous impact on our society today. Record numbers of jobs previously held by people have been automated, from manufacturing to transportation to customer services. The concerns of AI replacing humans by taking over people's jobs need to be urgently addressed. This article investigates some promising different directions of AI development: Instead of using AI to replace people, we should use AI to team up with people so that both can work better and smarter. Human–AI symbiosis refers to people and AI working together to jointly solve problems and perform specific tasks. The recent developments in deep learning models and frameworks have significantly improved the efficiency and performance of human and AI collaborations. In this article, some research work on human–AI collaborative environments has been extensively studied and analyzed to reveal the progress in this field. Although the teaming of humans and machines includes many complex tasks, the development has been very promising. One of the main goals in this field is to develop additional capabilities in machines capable of being successful teammates with a human partner. The correctness of the outcomes is often determined by the underlying technology and how performance and human satisfaction are measured through the collaborative nature of the system. We conclude that the teaming of humans and AI, particularly deep learning, has the advantage of combining the power of AI with the human domain expertise to improve performance and create value. Human–AI symbiosis could be a promising future direction for AI's continuing integration into the world.

References

[1]

Z. Lv, L. Qiao, A. Kumar Singh, and Q. Wang. 2021. AI-empowered IoT (internet of things) security for smart cities. ACM Trans. Internet Technol. 21, 4 (July 2021), 99. DOI:

Digital Library

[2]

D. Jiang, L. Huo, P. Zhang, and Z. Lv. 2021. Energy-Efficient heterogeneous networking for electric vehicles networks in smart future cities. IEEE Trans. Intell. Transp. Syst. 22, 3 (March 2021), 1868–1880. DOI:

Digital Library

[3]

M. Tanveer et al. 2020. Machine learning techniques for the diagnosis of alzheimer's disease. ACM Trans. Multimed. Comput. Commun. Appl. 16, 1s (April 2020), 30. DOI:

Digital Library

[4]

Z. Lv, D. Chen, and J. Li. 2021. Novel system design and implementation for the smart city vertical market. IEEE Commun. Mag. 61, 4 (April 2021), 126–131.

[5]

B. U. Mahmud and A. A. Sharmin. 2021. Deep insights of deepfake technology: A review. DOI:

[6]

Z. Lv, L. Qiao, and Q. Wang. 2021. Cognitive robotics on 5g networks. ACM Trans. Internet Things 21, 4 (July 2021), 92. DOI:

Digital Library

[7]

P. Chopade, S. Khan, K. Stoeffler, D. Edwards, Y. Rosen, and A. Von Davier. 2018. Framework for effective teamwork assessment in collaborative learning and problem solving. In CEUR Workshop Proc. 2153, 48–59.

[8]

O. C. Santos and J. G. Boticario. 2014. Involving users to improve the collaborative logical framework. Sci. World J., (January, 2014). DOI:

[9]

P. Burggräf, J. Wagner, B. Koke, and M. Bamberg. 2020. Performance assessment methodology for AI-supported decision-making in production management. Proc. CIRP 93 (2020), 891–896. DOI:

[10]

D. Wang et al. 2019. Human-AI collaboration in data science. Proc. ACM Hum.-Comput. Interact. 3, CSCW (November 2019), 24. DOI:

Digital Library

[11]

A. T. Nguyen et al. 2018. Believe it or not: Designing a human-Ai partnership for mixed-initiative fact-checking. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST’18). 189–199. DOI:

Digital Library

[12]

PAI Staff. 2019. Human-AI Collaboration Framework and Case Studies. Retrieved Oct. 15, 2021 from https://partnershiponai.org/paper/human-ai-collaboration-framework-case-studies/.

[13]

H. James Wilson and Paul R. Daugherty. 2018. Humans and machines can enhance each other's strengths. Retrieved February 2, 2022 from https://hbr.org/2018/07/collaborative-intelligence-humans-and-ai-are-joining-forces.

[14]

J. Heard, R. Heald, C. Harriott, and J. Adams. 2019. A diagnostic human workload assessment algorithm for collaborative and supervisory human–robot teams. ACM Trans. Hum.-Robot Interact. 8, 2 (2019), 1–30.

Digital Library

[15]

M. Gombolay, A. Bair, C. Huang, and J. Shah. 2017. Computational design of mixed-initiative human– robot teaming that considers human factors: situational awareness, workload, and workflow preferences. Int. J. Robot. Res. 36 (2017), 597–617.

Digital Library

[16]

P. Lasota, T. Fong, and J. Shah. 2017. A survey of methods for safe human-robot interaction. Found. Trends Robot. 5, 4 (2017), 261–349

Digital Library

[17]

D. Gorecky, M. Schmitt, M. Loskyll, and D. Zühlke. 2014. Human-machine-interaction in the industry 4.0 era. In Proceedings of the 12th IEEE International Conference on Industrial Informatics (INDIN’14). 289–294.

[18]

V. Groom and C. Nass. 2007. Can robots be teammates? Interact. Stud. Soc. Behav. Commun. Biol. Artif. Syst. 8, 3 (November 2007), 483–500. DOI:

[19]

N. J. McNeese, M. Demir, N. J. Cooke, and C. Myers. 2018. Teaming with a synthetic teammate: Insights into human-autonomy teaming. Hum. Factors 60, 2 (2018), 262–273. DOI:

[20]

RC. O'Reilly, R. Bhattacharyya, M. D. Howard, and N. Ketz. 2011. Complementary learning systems. Cogn. Sci. 38, 6 (2014 Aug), 1229–48. DOI:. x. Epub 2011 Dec 5. 22141588.

[21]

Stephanie Kanowitz. 2021. Human-AI Teaming for DC-based Emergency Response. Retrieved February 2, 2022 from https://gcn.com/data-analytics/2021/04/human-ai-teaming-for-dc-based-emergency-response/315332/.

[22]

I. Seeber et al. 2020. Machines as teammates: A research agenda on AI in team collaboration. Inf. Manag. 57, 2 (March 2020), 103174. DOI:

Digital Library

[23]

J. Schmidt, M. R. G. Marques, S. Botti et al. 2019. Recent advances and applications of machine learning in solid-state materials science. npj Comput. Mater. 5 (2019), 83.

[24]

B. U. Mahmud, S. S. Bose, M. M. R. Majumder, M. S. Arefin, and A. Sharmin. 2020. Ecommerce product rating system based on senti-lexicon analysis. Int. J. Innov. Technol. Explor. Eng. 9, 8 (2020). 369–373. DOI:

[25]

M. R. Majumder, B. U. Mahmud, B. Jahan, and M. Alam. 2019. Offline optical character recognition (OCR) method: An effective method for scanned documents. In Proceedings of the 22nd International Conference on Computer and Information Technology (ICCIT’19). IEEE, 1–5.

[26]

B. U. Mahmud and A. Sharmin. 2022. Impact analysis of harassment against women using association rule mining approaches: Bangladesh prospective. arXiv:2202.01308. https://arXiv.org/abs/2202.01308.

[27]

S. Corbett-Davies, E. Pierson, A. Feller, S. Goel, and A. Huq. 2017. Algorithmic decision making and the cost of fairness. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Part F1296. 797–806. DOI:

Digital Library

[28]

H. Lakkaraju, J. Kleinberg, J. Leskovec, J. Ludwig, and S. Mullainathan. 2017. The selective labels problem: Evaluating algorithmic predictions in the presence of unobservables. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'17). 275–284.

Digital Library

[29]

N. Kilbertus, M. Rojas Carulla, G. Parascandolo, M. Hardt, D. Janzing, and B. Schölkopf. 2017. Avoiding discrimination through causal reasoning. In Advances in Neural Information Processing Systems. 30.

[30]

D. Wei. 2020. Optimal policies for the homogeneous selective labels problem. DOI:

[31]

L. Matheson, F. M. Lacey, and J. Jesson. 2011. Doing Your Literature Review: Traditional and Systematic Techniques. SAGE Publications.

[32]

F. Weidt and R. L. Silva. 2016. Systematic Literature Review in Computer Science—A Practical Guide.

[33]

Frâncila Weidt Neiva, José Maria N. David, Regina Braga, and Fernanda Campos. 2016. Towards pragmatic interoperability to support collaboration: A systematic review and mapping of the literature. Inf. Softw. Technol. 72 (2016), 137–150.

Digital Library

[34]

D. Adiwardana, M. T. Luong, D. R. So, J. Hall, N. Fiedel, R. Thoppilan, and Q. V. Le. 2020. Towards a human-like open-domain chatbot. arXiv:2001.09977. Retrieved from https://arxiv.org/abs/2001.09977.

[35]

D. R. So, C. Liang, and Q. V. Le. 2019. The evolved transformer. In Proceedings of the 36th International Conference on Machine Learning (ICML’19). 10315–10328.

[36]

L. F. D'Haro et al. 2015. A neural conversational model (Seq-to-Seq on Chatbot). Nat. Lang. Dialog Syst. Intell. Assist. 37 (2015), 233–239.

[37]

W. Yin. 2020. Meta-learning for few-shot natural language processing: A survey. CoRR2007.09604, (2020).

[38]

Y. Wang, Q. Yao, J. T. Kwok, and L. M. Ni. 2020. Generalizing from a few examples: A survey on few-shot learning. ACM Comput. Surv. 53, 3 (2020), 1–34. DOI:

Digital Library

[39]

N. Akoury, S. Wang, J. Whiting, S. Hood, N. Peng, and M. Iyyer. 2020. STORIUM: A dataset and evaluation platform for machine-in-the-loop story generation. arXiv:2010.01717. Retrieved from https://arxiv.org/abs/2010.01717.

[40]

M. Iyyer, A. Guha, S. Chaturvedi, J. Boyd-Graber, and H. D. Iii. 2021. Feuding Families and Former Friends: Unsupervised Learning for Dynamic Fictional Relationships. Retrieved October 26, 2021 from http://github.com/.

[41]

Better Language Models and Their Implications. Retrieved October 26, 2021 from https://openai.com/blog/better-language-models/.

[42]

Chin-Yew Lin. 2004. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out. Association for Computational Linguistics, 74–81.

[43]

R. Sennrich, B. Haddow, and A. Birch. 2016. Neural machine translation of rare words with subword units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. 1715–1725.

[44]

T. Zhao, R. Zhao, and M. Eskenazi. 2017. Learning discourse-level diversity for neural dialog models using conditional variational autoencoders. In Proceedings of the 55th Annual Meeting of the Association Computer Linguistics (ACL’17). 654–664. DOI:

[45]

Steven Levy. 2015. Inside Deep Dreams: How Google Made Its Computers Go Crazy. Retrieved October 01, 2021 from https://www.wired.com/2015/12/inside-deep-dreams-how-google-made-its-computers-go-crazy/.

[46]

Alexander Mordvintsev et al. 2015. Google AI Blog: Inceptionism: Going Deeper into Neural Networks. Retrieved October 01 2021 from https://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html.

[47]

N. Davis, C.-P. Hsiao, K. Yashraj Singh, L. Li, and B. Magerko. 2016. Empirically studying participatory sense-making in abstract drawing with a co-creative cognitive agent. In Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI'16). 196–207.

Digital Library

[48]

P. Karimi, M. Lou Maher, N. Davis, and K. Grace. 2019. Deep learning in a computational model for conceptual shifts in a co-creative design system. In Proceedings of the 10th International Conference on Computational Creativity (ICCC’19). 17–24.

[49]

J. E. Fan, M. Dinculescu, and D. Ha. 2019. Collabdraw: An environment for collaborative sketching with an artificial agent. In Proceedings of the ACM Conference on Creativity & Cognition (CC’19). 556–561. DOI:

Digital Library

[50]

M. Cooney and P. Berck. 2019. Designing a robot which paints with a human: Visual metaphors to convey contingency and artistry. In ICRA-X Robotic Art Forum.

[51]

C. Oh, J. Song, J. Choi, S. Kim, S. Lee, and B. Suh. 2018. I lead, you help but only with enough details: Understanding the user experience of co-creation with artificial intelligence. In Proceedings of the Conference on Human Factors in Computer Systems. DOI:

Digital Library

[52]

David Ha et al. 2017. Draw Together with a Neural Network. Retrieved October 05, 2021 from https://magenta.tensorflow.org/sketch-rnn-demo/.

[53]

I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. 2014. Generative adversarial networks. In Proceedings of the Conference and Workshop on Neural Information Processing Systems (NIPS’14).

[54]

Simon Chandler. 2020. Why Deepfakes Are a Net Positive for Humanity. Retrieved December 2 2021, from https://www.forbes.com/sites/simonchandler/2020/.

[55]

Geraint Rees. 2019. Here's how deepfake technology can actually be a good thing. Retrieved December 1, 2021 from https://www.weforum.org/agenda/2019/11/advantages-ofartificial-intelligence/.

[56]

Patrick L. Plaisance. 2019. Ethics and “Synthetic Media.” Retrieved December 5, 2021 from https://www.psychologytoday.com/sg/blog/virtue-in-themedia-world/201909/ethics-and-syntheticmedia.

[57]

David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, and Antonio Torralba. 2019. GAN dissection: Visualizing and understanding generative adversarial networks. In Proceedings of the International Conference on Learning Representations (ICLR’19).

[58]

Z. Cheng, H. Sun, M. Takeuchi, and J. Katto. 2019. Energy compaction-based image compression using convolutional autoencoder. IEEE Trans. Multimedia. DOI:

Digital Library

[59]

A. Dickson and E. J. Dickson. 2021. Deepfake porn is still a threat, particularly for K-Pop stars. Retrieved December 2, 2021 from https://www.rollingstone.com/culture/culturenews/deepfakes-nonconsensual-porn-study-kpop895605/.

[60]

James Vincent. 2019. New AI deepfake app creates nude images of women in seconds. Retrieved December 5, 2021 from https://www.theverge.com/2019/6/27/18760896/deepfakenude-ai-app-women-deepnude-non-consensualpornography.

[61]

Joseph Foley. 2021. 10 Deepfake Example That Terrified and Amused the Internet. Retrieved December 3, 2021 from https://www.creativebloq.com/features/deepfake-videosexamples.

[62]

D. Williams. 2016. The History of Augmented Reality. Retrieved February 5, 2022 from https://www.huffpost.com/entry/the-history-of-augmented-_b_9955048.

[63]

T. Alldieck, M. Magnor, B. L. Bhatnagar, C. Theobalt, and G. Pons-Moll. 2019. Learning to reconstruct people in clothing from a single RGB camera. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1175–1186.

[64]

B. U. Mahmud, R. D. Shuva, S. S. Bose, M. M. R. Majumder, B. Jahan, and M. M. Alam. 2019. A proposed method for recognizing complex hand drawn graphs using digital geometric techniques. In Proceedings of the International Conference on Sustainable Technologies for Industry 4.0 (STI’19). IEEE, 1–6. DOI:

[65]

Bahar Uddin Mahmud, Shib Shankar Bose, and Afsana Sharmin. 2020. Image histogram equalization using parallel processing (GPU computation) in open CL to correct the contrast of images. J. Comput. Aid. Parallel Program. 5, 1 (2020), 1–18.

[66]

Z. Lähner, D. Cremers, and T. Tung. 2018. DeepWrinkles: Accurate and realistic clothing modeling. In Lecture Notes in Computer Science. 698–715.

Digital Library

[67]

G. Tiwari, B. L. Bhatnagar, T. Tung, and G. Pons-Moll. 2020. SIZER: A dataset and model for parsing 3D clothing and learning size sensitive 3D clothing. In Lecture Notes in Computer Science. 1–18.

Digital Library

[68]

B. Deng, J. P. Lewis, T. Jeruzalski, G. Pons-Moll, G. Hinton, M. Norouzi, and A. Tagliasacchi. 2020. NASA neural articulated shape approximation. In Proceedings of the European Conference on Computer Vision. Springer, Cham. 612–628.

Digital Library

[69]

G. Tiwari, N. Sarafianos, T. Tung, and G. Pons-Moll. 2021. Neural-GIF: Neural generalized implicit functions for animating people in clothing. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 11708–11718.

[70]

S. Saito, J. Yang, Q. Ma, and M. J. Black. 2021. SCANimate: Weakly supervised learning of skinned clothed avatar networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2886–2897.

[71]

M. Mihajlovic, Y. Zhang, M. J. Black, and S. Tang, 2021. LEAP: Learning articulated occupancy of people. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10461–10471.

[72]

Stan Sclaroff and Alex Pentland. 1991. Generalized implicit functions for computer graphics. SIGGRAPH Comput. Graph. 25, 4 (July 1991), 247–250. DOI:

Digital Library

[73]

Q. Ma, J. Yang, A. Ranjan, S. Pujades, G. Pons-Moll, S. Tang, and M. J. Black. 2020. Learning to dress 3d people in generative clothing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6469–6478.

[74]

F. Bogo, J. Romero, G. Pons-Moll, and M. Black. 2017. Dynamic FAUST: Registering human bodies in motion. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR’17).

[75]

D. Xiang, F. Prada, T. Bagautdinov, W. Xu, Y. Dong, H. Wen, ... and C. Wu. 2021. Modeling clothing as a separate layer for an animatable human avatar. ACM Trans. Graph. 40, 6 (2021), 1–15.

Digital Library

[76]

M. Arjovsky and L. Bottou. 2017. Towards principled methods for training generative adversarial networks. arXiv:1701.04862. Retrieved from https://arxiv.org/abs/1701.04862.

[77]

N. Cooke, J. Gorman, C. Myers, and J. Duran. 2013. Interactive team cognition. Cogn. Sci. 37, 2 (2013), 255–285

[78]

Min Hun Lee, Daniel P. Siewiorek, Asim Smailagic, Alexandre Bernardino, and Sergi Bermúdez i Badia. 2021. A Human-AI collaborative approach for clinical decision making on rehabilitation assessment. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI'21). ACM, New York, NY.

Digital Library

[79]

D. Bennett, S. Bode, M. Brydevall, H. Warren, and C. Murawski. 2016. Intrinsic valuation of information in decision making under uncertainty. PLoS Comput. Biol. 12, 7.

[80]

A. Landrum, B. Eaves, and P. Shafto. 2015. Learning to trust and trusting to learn: A theoretical framework. Trends Cogn. Sci. 19, 3 (2015), 109–111.

Cited By

Hai-Jew S(2024)Crafting Seeding Imagery for Artmaking Generative AI ToolsComputational Practices and Applications for Digital Art and Crafting10.4018/979-8-3693-2927-6.ch002(21-46)Online publication date: 30-Jun-2024
https://doi.org/10.4018/979-8-3693-2927-6.ch002
Mahmud BHong GMamun APing EWu Q(2023)Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural AnalysisSensors10.3390/s2305264023:5(2640)Online publication date: 27-Feb-2023
https://doi.org/10.3390/s23052640

Index Terms

A Study of Human–AI Symbiosis for Creative Work: Recent Developments and Future Directions in Deep Learning
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools

Recommendations

"An Ideal Human": Expectations of AI Teammates in Human-AI Teaming
CSCW

Driven by state-of-the-art AI technologies, human-AI collaboration has become an important area in computer-supported teamwork research. While human-AI collaboration has been investigated in various domains, more research is needed to explore human ...
Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation
A consensus is beginning to emerge that the next phase of artificial intelligence (AI) induction in business organizations will require humans to work with AI in a variety of work arrangements. This article explores the issues related to human ...
We study how humans make decisions when they collaborate with an artificial intelligence (AI) in a setting where humans and the AI perform classification tasks. Our experimental results suggest that humans and AI who work together can outperform the AI ...
Hybrid collective intelligence in a human–AI society
Abstract
Within current debates about the future impact of Artificial Intelligence (AI) on human society, roughly three different perspectives can be recognised: (1) the technology-centric perspective, claiming that AI will soon outperform humankind in all ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 20, Issue 2

February 2024

548 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/3613570

Editor:
Abdulmotaleb El Saddik
Mohamed Bin Zayed University of Artificial Intelligence, UAE and University of Ottawa, Canada

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2023

Online AM: 28 July 2022

Accepted: 06 May 2022

Revised: 15 March 2022

Received: 12 December 2021

Published in TOMM Volume 20, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
2,837
Total Downloads

Downloads (Last 12 months)2,203
Downloads (Last 6 weeks)158

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hai-Jew S(2024)Crafting Seeding Imagery for Artmaking Generative AI ToolsComputational Practices and Applications for Digital Art and Crafting10.4018/979-8-3693-2927-6.ch002(21-46)Online publication date: 30-Jun-2024
https://doi.org/10.4018/979-8-3693-2927-6.ch002
Mahmud BHong GMamun APing EWu Q(2023)Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural AnalysisSensors10.3390/s2305264023:5(2640)Online publication date: 27-Feb-2023
https://doi.org/10.3390/s23052640

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents