research-article

GPT-3: Its Nature, Scope, Limits, and Consequences

Authors:

Luciano Floridi,

Massimo ChiriattiAuthors Info & Claims

Minds and Machines, Volume 30, Issue 4

Pages 681 - 694

https://doi.org/10.1007/s11023-020-09548-1

Published: 01 December 2020 Publication History

Abstract

In this commentary, we discuss the nature of reversible and irreversible questions, that is, questions that may enable one to identify the nature of the source of their answers. We then introduce GPT-3, a third-generation, autoregressive language model that uses deep learning to produce human-like texts, and use the previous distinction to analyse it. We expand the analysis to present three tests based on mathematical, semantic (that is, the Turing Test), and ethical questions and show that GPT-3 is not designed to pass any of them. This is a reminder that GPT-3 does not do what it is not supposed to do, and that any interpretation of GPT-3 as the beginning of the emergence of a general form of artificial intelligence is merely uninformed science fiction. We conclude by outlining some of the significant consequences of the industrialisation of automatic and cheap production of good, semantic artefacts.

References

[1]

Adams, R. (2019). Artificial Intelligence has a gender bias problem—just ask Siri. The Conversation.

[2]

Baker, G. (2020). Microsoft is cutting dozens of MSN news production workers and replacing them with artificial intelligence. The Seattle Times.

[3]

Balaganur, S. (2019). Top videos created by Artificial Intelligence in 2019. Analytics India Magazine.

[4]

Burgess, M. (2016). Google’s AI has written some amazingly mournful poetry. Wired.

[5]

Davis, E. (2019). Schubert’s ‘Unfinished’ Symphony completed by artificial intelligence. Classic fM.

[6]

Dickson, B. (2020). The Guardian’s GPT-3-written article misleads readers about AI. Here’s why. TechTalks.

[7]

Elkins K and Chun J Can GPT-3 pass a writer’s Turing Test? Journal of Cultural Analytics 2020 2371 4549

[8]

Floridi L The 4th revolution: How the infosphere is reshaping human reality 2014 Oxford Oxford University Press

[9]

Floridi L The onlife manifesto—being human in a hyperconnected era 2014 New York Springer

[10]

Floridi L Digital’s cleaving power and its consequences Philosophy & Technology 2017 30 2 123-129

[11]

Floridi L Artificial Intelligence, Deepfakes and a future of ectypes Philosophy & Technology 2018 31 3 317-321

[12]

Floridi L What the near future of Artificial Intelligence could be Philosophy & Technology 2019 32 1 1-15

[13]

Floridi L AI and its new winter: From myths to realities Philosophy & Technology 2020 33 1 1-3

[14]

Floridi L, Taddeo M, and Turilli M Turing’s imitation game: Still a challenge for any machine and some judges Minds and Machines 2009 19 1 145-150

[15]

GPT-3. (2020). A robot wrote this entire article. Are you scared yet, human? The Guardian.

[16]

Heaven, W.D. (2020). OpenAI’s new language generator GPT-3 is shockingly good—and completely mindless. MIT Technology Review.

[17]

Lacker, K. (2020). Giving GPT-3 a Turing Test. Bloghttps://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html.

[18]

LaGrandeur, K. (2020). How safe is our reliance on AI, and should we regulate it? AI and Ethics: 1-7.

[19]

Levesque HJ Common sense, the Turing test, and the quest for real AI 2017 Cambridge MIT Press

[20]

Levesque, H. J., Davis, E., & Morgenstern, L. (2012). The Winograd schema challenge.” Proceedings of the Thirteenth International Conference on Principles of Knowledge Representation and Reasoning, Rome, Italy.

[21]

McAteer, M. (2020). Messing with GPT-3 - Why OpenAI’s GPT-3 doesn’t do what you think it does, and what this all means. Bloghttps://matthewmcateer.me/blog/messing-with-gpt-3/.

[22]

McGuffie, K., & Newhouse, A. (2020). The radicalization risks of GPT-3 and advanced neural language models. arXiv preprintarXiv:2009.06807.

[23]

OpenAI. (2019). Microsoft Invests In and Partners with OpenAI to Support Us Building Beneficial AGI. OpenAI Official Blog.

[24]

Perumalla KS Introduction to reversible computing, Chapman & Hall/CRC computational science series 2014 Boca Raton CRC Press

[25]

Puiu, T. (2018). Artificial intelligence can write classical music like a human composer. It’s the first non-human artist whose music is now copyrighted. ZME Science.

[26]

Reynolds, E. (2016). This fake Rembrandt was created by an algorithm. Wired.

[27]

Rudra, S. (2019). An AI completes an unfinished composition 115 years after composer’s death. Vice.

[28]

Scott, K. (2020). Microsoft teams up with OpenAI to exclusively license GPT-3 language model. Official Microsoft Blog.

[29]

Stokes, R. (2020). The problem of gendered language is universal’—how AI reveals media bias. The Guardian.

[30]

Turing AM Computing machinery and intelligence Mind 1950 59 236 433-460

[31]

Vincent, J. (2020). ThisPersonDoesNotExist.com uses AI to generate endless fake faces. The Verge.

[32]

Weizenbaum J Computer power and human reason: from judgment to calculation 1976 San Francisco W.H. Freeman

[33]

Wiggers, K. (2020). OpenAI’s massive GPT-3 model is impressive, but size isn’t everything. VentureBeat.

Cited By

Niu TZhang WZhao RDastani MSichman JAlechina NDignum V(2024)Solution-oriented Agent-based Models Generation with Verifier-assisted Iterative In-context LearningProceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems10.5555/3635637.3663007(1473-1481)Online publication date: 6-May-2024
https://dl.acm.org/doi/10.5555/3635637.3663007
Hu HQiu JWang HLiang BZou S(2024)DIDS: Double Indices and Double Summarizations for Fast Similarity SearchProceedings of the VLDB Endowment10.14778/3665844.366585117:9(2198-2211)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.14778/3665844.3665851
Mcintosh TLiu TSusnjak TWatters PHalgamuge M(2024)A Reasoning and Value Alignment Test to Assess Advanced GPT ReasoningACM Transactions on Interactive Intelligent Systems10.1145/367069114:3(1-37)Online publication date: 2-Aug-2024
https://dl.acm.org/doi/10.1145/3670691
Show More Cited By

Index Terms

GPT-3: Its Nature, Scope, Limits, and Consequences
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
  2. Machine learning
    1. Machine learning approaches
      1. Neural networks
2. Theory of computation

Index terms have been assigned to the content through auto-classification.

Recommendations

How Would You Know if You Synthesized a Thinking Thing?

We confront the following popular views: that mind or life are algorithms; that thinking, or more generally any process other than computation, is computation; that anything other than a working brain can have thoughts; that anything other than a ...
The Turing Triage Test

If, as a number of writers have predicted, the computers of the future will possess intelligence and capacities that exceed our own then it seems as though they will be worthy of a moral respect at least equal to, and perhaps greater than, human beings. ...
Meaning–thinking–AI
Abstract
This paper makes the case for a sharper terminology regarding AIs cognitive abilities. In arguing that thinking requires more than content production, I offer a definition of meaning drawing on a clear distinction between living and machine ...

Comments

Information & Contributors

Information

Published In

cover image Minds and Machines

Minds and Machines Volume 30, Issue 4

Dec 2020

229 pages

ISSN:0924-6495

Issue’s Table of Contents

© The Author(s) 2020.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 December 2020

Author Tags

Qualifiers

Research-article

Funding Sources

University of Oxford

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

187
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Niu TZhang WZhao RDastani MSichman JAlechina NDignum V(2024)Solution-oriented Agent-based Models Generation with Verifier-assisted Iterative In-context LearningProceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems10.5555/3635637.3663007(1473-1481)Online publication date: 6-May-2024
https://dl.acm.org/doi/10.5555/3635637.3663007
Hu HQiu JWang HLiang BZou S(2024)DIDS: Double Indices and Double Summarizations for Fast Similarity SearchProceedings of the VLDB Endowment10.14778/3665844.366585117:9(2198-2211)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.14778/3665844.3665851
Mcintosh TLiu TSusnjak TWatters PHalgamuge M(2024)A Reasoning and Value Alignment Test to Assess Advanced GPT ReasoningACM Transactions on Interactive Intelligent Systems10.1145/367069114:3(1-37)Online publication date: 2-Aug-2024
https://dl.acm.org/doi/10.1145/3670691
Wu XDeng HBao LCui HLiu W(2024)News text continuation based on Topic Similarity Evaluation ModuleProceedings of the 2024 5th International Conference on Computing, Networks and Internet of Things10.1145/3670105.3670143(228-233)Online publication date: 24-May-2024
https://dl.acm.org/doi/10.1145/3670105.3670143
Liu RHu YRen YYin XLi HCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Generative Expressive Conversational Speech SynthesisProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681697(4187-4196)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681697
Li JZhou XJiang KHong LGuo PChen ZGe WZhang WCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)TagOOD: A Novel Approach to Out-of-Distribution Detection via Vision-Language Representations and Class Center LearningProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680579(1225-1234)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680579
Yu ZMa MZhang CQin SKang YBansal CRajmohan SDang YPei CPei DLin QZhang Dd'Amorim M(2024)MonitorAssistant: Simplifying Cloud Service Monitoring via Large Language ModelsCompanion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering10.1145/3663529.3663826(38-49)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3663529.3663826
Zeng KJin HLv XZhu FHou LZhang YPang FQi YLiu DLi JFeng L(2024)XLORE 3: A Large-Scale Multilingual Knowledge Graph from Heterogeneous Wiki Knowledge ResourcesACM Transactions on Information Systems10.1145/366052142:6(1-47)Online publication date: 19-Aug-2024
https://dl.acm.org/doi/10.1145/3660521
Buonaiuto GGuarasci REsposito MPavone AViola C(2024)Quantum Transfer Learning for Sentiment Analysis: an experiment on an Italian corpusProceedings of the 2024 Workshop on Quantum Search and Information Retrieval10.1145/3660318.3660325(25-30)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3660318.3660325
Kovačević NHolz CGross MWampfler R(2024)The Personality Dimensions GPT-3 Expresses During Human-Chatbot InteractionsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596268:2(1-36)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659626
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents