There are some not well known risks associated with the program of SETI—the Search for Extra-Terrestrial Intelligence. One of them is the scenario of possible vulnerability from downloading hostile AI with “virus-style” behavior. The proportion of dangerous ET-signals to harmless ones can be dangerously high because of selection effects and evolutionary pressure.
Alexey Turchin was born in Moscow, Russia in 1973. Alexey studied Physics and Art History at Moscow State University and actively participated in the Russian Transhumanist Movement. He has translated many foreign Transhumanist works into Russian, including N. Bostrom and E.Yudkowsky. He is an expert in Global Risks and wrote the book “Structure of the Global Catastrophe: Risks of Human Extinction in the XXI Century,” as well as several articles on the topic. Since 2010, he has worked at Science Longer Life where he is writing a book on futurology.
5. Search for Extra-Terrestrial Intelligence
Years: Stars checked:
1960s 2
1970s 100
1990s near 5000
2010s (projected) millions
Exponential Growth of SETI Research
6. 1961: Fred Hoyle
“A for Andromeda”
Scheme of a computer sent through SETI
AI
It tries to take over the world
7. “Mind Children”,
chapter “A Caveat for SETI”
“Virus behavior” of SETI-attack
It spreads like infection in the Universe
1988: Hans Moravec
8. “Do potential SETI signals need to be decon-
taminated?”, Acta Astronautica
First scientific article about SETI-attack
SETI-attack message could have a
trick
2004: Richard Carrigan
10. Current technologies
allow to send gigabytes in
interstellar distances
Amount of information
that can be transmitted
11. Human genome is less then
1 gigabyte
Conscious memory is
2.5 gigabytes
Seed AI could have the same
size and could be sent in
interstellar distances
Size of the Seed AI
12. Seed AI can evolve extremely
quickly
It could easily outsmart humans
and take over the world
Risks of AI are underestimated
It is impossible to keep AI in the
“black box”
It is impossible to recognize
dangerous intentions of an AI in
advance
E. Yudkowsky
18. Images Allow to Send Messages
and Schemes
Arecibo message,
1974,
Puerto-Rico.
23 x 73 bits.
Contains main information
about the Earth, DNA and the
humans.
29. Alien AI creates new lighthouse
and starts to transmit itself to
the Universe
Dyson sphere
as a new
beacon
It uses all the material of the Solar
system to build large transmitters
35. Alien AI will destroy humanity
less risks of resistance
use of the material of the Earth crust
36. My Estimation of Probability
ET exist: 1 %
AI as program is possible: 90%
SETI-attacks are typical: 50%
SETI-attack will reach success: 50 %
SETI-attack lead to the human extinction: 50 %
Extinction probability from the
SETI-attack: 0.12 %
37. Necessary Actions
To rise awareness about the problem
To change the guidelines for the SETI research
To consider the prohibition of SETI before we get our
own AI
38. Read More
Alexei Turchin
Is SETI dangerous?
Jr. Richard A. Carrigan
The Ultimate Hacker: SETI signals may
need to be decontaminated