Deep Web
Deep Web
Deep Web
By
In the last several years, some of the more comprehensive search engines have written
algorithms to search the deeper portions of the world wide web by attempting to find files
such as .pdf, .doc, .xls, ppt, .ps. and others. These files are predominately used by
businesses to communicate their information within their organization or to disseminate
information to the external world from their organization. Searching for this information
using deeper search techniques and the latest algorithms allows researchers to obtain a
vast amount of corporate information that was previously unavailable or inaccessible.
Research has also shown that even deeper information can be obtained from these files by
searching and accessing the “properties” information on these files!
This report and guide is designed to give you the resources you need to better understand
your search through the currently available web to find those key sources of information
nuggets only found by utilizing how to search the “deep web”.
10 Things You Should Know About Dark Web Websites by Josh Fruhlinger –
November 23, 2018
https://www.csoonline.com/article/3322134/cyber-attacks-espionage/10-things-you-
should-know-about-dark-web-websites.html
Accessing the Deep Web and Dark Web with Tor by Jack Jones
https://mobile.audible.com/search.htm?narrator=Dan+Gralick
All of OCLC’s WorldCat Heading Toward the Open Web by Barbara Quint
http://newsbreaks.infotoday.com/nbreader.asp?ArticleID=16353
A Primer on Staying Secure and Anonymous on the Dark Web by Mark Turner
http://www.techspot.com/guides/1292-web-security-anonymizer-primer/
Big Data and AI: 30 Amazing (And Free) Public Data Sources for 2018 by Bernard
Marr
https://www.forbes.com/sites/bernardmarr/2018/02/26/big-data-and-ai-30-amazing-and-
free-public-data-sources-for-2018/
BrightPlanet Launches Deep Web Data Feeds: Global News Data Feed Is First
Available Data Feed
http://www.brightplanet.com/2015/01/brightplanet-launches-deep-web-data-feeds-global-
news-data-feed-first-available-data-feed/
DarkReading
https://www.darkreading.com/
Dark Web Data Theft May Have Finally Met Its Match by Vaughn Highfield
http://www.alphr.com/security/1009340/dark-web-data-theft-fujitsu-intsights
Dark Web Version of Facebook Shows a New Way to Secure the Web by Tom
Simonite
https://www.technologyreview.com/s/532256/dark-web-version-of-facebook-shows-a-
new-way-to-secure-the-web/
Deep Web Links – Massive Deep Websites Links and URL by Martin Grossner
https://www.airsassociation.org/services-new/airs-knowledge-network-n/airs-
articles/item/19104-deep-web-links-massive-deep-websites-links-and-url
Deep Web Search Engines to Explore the Hidden Internet by Rakesh Krishnan
https://cdn.ampproject.org/c/s/amp.thehackernews.com/thn/2016/02/deep-web-search-
engine.html
Deep Web: The Mysterious Side of the Internet and How To Access It by Michael
Lowry
https://factschronicle.com/deep-web-the-mysterious-side-of-the-internet-and-how-to-
access-it-14770.html
Deep Web vs Dark Web: A Q&A with Internet Pioneer Marcus Zillman by Mason
Lerner
https://community.spiceworks.com/topic/2081638-deep-web-vs-dark-web-a-q-a-with-
internet-pioneer-marcus-zillman
Deep Web: What Is It and How To Access it? – The Ultimate Guide by Samantha
Carter
https://darkwebnews.com/deep-web/
Everything You Need To Know About the Deep Web In One Simple Infographic
http://www.businessinsider.com/everything-you-need-to-know-about-the-deep-web-in-
one-simple-infographic-2015-2
Here Are the 10 Best Deep Web Search Engines by Kristen Hubby
http://www.dailydot.com/layer8/best-deep-web-search-engines/
How To Access the Dark Web: What Is Tor and How Do I Access Dark Websites?
By Victoria Woollaston
http://www.alphr.com/technology/1002667/how-to-access-the-dark-web-what-is-tor-and-
how-do-i-use-it
How To Do a Deep Web Search and Why You Should by Kelli Uhrich of
Komando.com
http://www.komando.com/tips/396770/how-to-do-a-deep-web-search-and-why-you-
should
How to Mine the Invisible Wev: The Ultimate Guide by Jerri Collins
https://www.lifewire.com/mine-invisible-web-3482495
If Your Data Is Found On the Dark Web, Firefox Monitor Will Let You Know by
Chuong Nyguyen
https://www.digitaltrends.com/computing/firefox-monitor-lets-your-know-if-youve-been-
pwned/
Information Retrieval and the Semantic Web by Tim Finin, James Mayfield, Clay
Fink, Anupam Joshi, and R. Scott Cost
http://ebiquity.umbc.edu/paper/html/id/185/
Is the Tor Browser Safe? Why Should You Use It? By Mohammed Mujtab
https://technocodex.com/is-tor-browser-safe-why-should-you-use-it/
Journey Into the Hidden Web: A Guide for New Researchers by Ryan Dube
http://www.makeuseof.com/tag/journey-into-the-hidden-web-a-guide-for-new-
researchers/
Just the Tip of the Iceberg: Why You Should Be Monitoring the Deep Web
http://www.information-age.com/technology/security/123461668/just-tip-iceberg-why-
you-should-be-monitoring-deep-web
Lessons from the Deep Web That Could Lead To a More Secure IoT by Revathl
Subramanian
http://blogs.ca.com/2015/04/02/lessons-from-the-deep-web-that-could-lead-to-a-more-
secure-iot/?mrm=425878&cid=GLOB-SMM-ABUS-AAR-000002-00000571
Mining the Deep Web: Search Strategies That Work by Lee Ratzan
http://www.computerworld.com/s/article/9005757/Mining_the_Deep_Web_Search_strate
gies_that_work?pageNumber=1
10
Publications about Web Analysis, Web Search, Citation Indexing, Digital Libraries,
Machine Learning, Neural Networks
http://research.google.com/
11
Searching the Internet 2018 – The Primer - 2019 Guide to Searching the Internet
http://www.SearchingTheInternet.info/
12
Stop Talking About the Dark Web: Tor Project CoFounder Roger Dingledine
https://technical.ly/philly/2017/05/15/dark-web-roger-dingledine/
The 10 Best Deep Web Search Engines to Explore the Hidden Web by Michelle
Fuchs
https://www.airsassociation.org/services-new/airs-knowledge-network-n/airs-
articles/item/17217-top-10-best-deep-web-search-engines-to-explore-hidden-web
13
The Dark Web and Remote Communication – November 10, 2018 – Tech Talk
Radio
http://federalnewsnetwork.com/stratford-universitys-tech-talk/2018/11/the-dark-web-and-
remote-communication-november-10-2018/
The Dark Web: What Every Parent Should Know by Cybermum Australia
https://securingtomorrow.mcafee.com/consumer/family-safety/dark-web-what-every-
parent-should-know/
The Dark Web? Why Small Businesses Should Concern Themselves With the
Threat by Jim Anderson
https://www.entrepreneur.com/article/320347
The Deep Web May Be 500 Times Bigger Than the Normal Web
https://www.cnbc.com/2018/09/06/beyond-the-valley-understanding-the-mysteries-of-
the-dark-web.html
The Deep Web: What’s Lurking in the Underbelly of the Internet? By Michelle
Alvarez
http://securityintelligence.com/the-deep-web-whats-lurking-in-the-underbelly-of-the-
internet/#.VUIUNmfD9D8
14
The Growing Force That Will Soon Reshape The Entire Internet by Frank Minite
https://www.forbes.com/sites/frankminiter/2017/12/30/the-growing-force-that-will-soon-
reshape-the-entire-internet/
The Invisible Web: What it is, Why it exists, How to find it, and Its Inherent
Ambiguity
http://www.newworldencyclopedia.org/entry/Deep_Web
The Most Amazing Deep Web Search Engines Finally Introduced To the World
Called: OnlindLandSearchEngines.com .
http://m.digitaljournal.com/pr/3928224
The New Search Engines Shining a Light On the Deep Web by Carola Frediani
http://kernelmag.dailydot.com/issue-sections/features-issue-sections/10376/how-to-
search-deep-web-tor/
The Super-Private Tor Browser Get a Huge Update, But Should You Switch From
Chrome?
https://gizmodo.com/the-super-private-tor-browser-gets-a-huge-update-but-s-
1828879886
15
The Virtual Private Library™ and The Deep Web Video by Melissa Barker
http://zillman.blogspot.com/2009/07/virtual-private-library-and-deep-web.html
Things You Can Do On the Dark Web That Aren’t Illegal by Jacob Kleinman
https://lifehacker.com/things-you-can-do-on-the-dark-web-that-arent-illegal-1819790298
This Tool Lets You Scan the Dark Web for Your (stolen) Personal Data by Anna K.
Sasaki
https://www.airsassociation.org/services-new/airs-knowledge-network-n/airs-
articles/item/17251-this-tool-lets-you-scan-the-dark-web-for-your-stolen-personal-data
Toward the Semantic Deep Web by James Geller, Soon Ae Chun, and Yoo Jung An
http://www.mendeley.com/catalog/toward-semantic-deep-web/
16
Travel Industry and Deep Web: Exclusive Interview with Marcus P. Zillman
http://plrplr.com/90014/deep-web-and-travel-industry-exclusive-interview-with-marcus-
p-zillman/
UMBC - AgentNews
http://agents.umbc.edu/
Using the Internet As a Dynamic Resource Tool for Knowledge Discovery 2018
http://www.zillman.us/white-papers/using-the-internet-as-a-dynamic-resource-tool-for-
knowledge-discovery/
Web Pages Search Engine Based on DNS by Wang Liang, Guo Yi-Ping, and Fang
Ming
http://arxiv.org/pdf/cs.NI/0403035
17
What Happens When You Spend a Week Fishing on the Dark Web? By Anthony
Cuthbertson
https://www.independent.co.uk/news/long_reads/dark-web-search-drugs-weapons-
crimes-illegal-a8524341.html
What Is the Dark Web and How To Access This Scary Part of Internet by
Karandeep Singh
https://www.mobipicker.com/what-is-the-dark-web-how-to-access-the-dark-web/
What is the Dark Web> Our Guide to the Dark Web by Laurie Clarke
https://www.techworld.com/security/what-is-dark-web-3645157/
What Is the Deep Web and How Can You Access It? By Adam Rowe
https://tech.co/what-is-the-deep-web-2018-05
What Is the Deep Web? A WhatIs Podcast 15 Minute Interview with Marcus P.
Zillman
http://zillman.blogspot.com/2006/10/what-is-deep-web.html
What Happens When You Spend a Week Fishing On the Dark Web?
https://www.independent.co.uk/news/long_reads/dark-web-search-drugs-weapons-
crimes-illegal-a8524341.html
18
What It Looks Like On the Dark Side of the Web by Felix Simon
https://medium.com/@FelixSimon/what-it-looks-like-on-the-dark-side-of-the-web-
f53ff9f4ef3c
Where Your Stolen Personal Details Go Online by Nicholas and Matthew Dunn
https://www.news.com.au/technology/online/security/inside-the-dark-web-where-your-
stolen-personal-details-go-online/news-story/1f13c214950187d6412ce4b89bfe42fe
Why the Dark Web Could Be a Growing Threat to Your Small Business by Ben
Lobel
http://smallbusiness.co.uk/why-the-dark-web-could-be-a-growing-threat-to-your-small-
business-2545071/
Copernic
http://www.copernic.com/
MetaLib
http://www.exlibrisgroup.com/category/MetaLibOverview
MetaSearch Initiative
http://www.niso.org/workrooms/mi
MuseGlobal
http://www.museglobal.com/
20
BigChampagne
http://www.bigchampagne.com/
21
P2P and the Future of Private Copying by Peter K. Yu, Michigan State University
College of Law
http://papers.ssrn.com/sol3/papers.cfm?abstract_id=578568
Peer-To-Peer Wikipedia
http://en.wikipedia.org/wiki/Peer-to-peer
Port Knocking
http://www.portknocking.org/
Skype
http://www.skype.com/
23
ToPeer
http://www.2peer.com/
TrustyFiles
http://www.trustyfiles.com/
YaCy - Distributed P2P Based Web Indexing and Anonymous Search Engine
http://www.yacy.net/
24
PRESENTATIONS
Deep Web
http://whatis.techtarget.com/definition/deep-Web
Searching the Internet 2018 – The Primer – 2019 Guide to Searching the Internet
http://www.SearchingTheInternet.info/
The Virtual Private Library™ and The Deep Web Video by Melissa Barker
http://zillman.blogspot.com/2009/07/virtual-private-library-and-deep-web.html
25
26
CyberGhost - One of the World's Most Trusted and Secure Virtual Private
Networks
http://www.cyberghostvpn.com/
Dark Reading
https://www.darkreading.com/
Deep.Dot.Web
http://www.DeepDotWeb.com/
Deep Web - Discover Resources That Help You Mine the Deep or Invisible Web
Instead of Just Searching the Surface
http://libguides.msubillings.edu/c.php?g=242182&p=1610131
27
Digital Shadows
https://www.digitalshadows.com/
ENDECA
http://www.oracle.com/us/products/applications/commerce/endeca/overview/index.html
Engineering Village
http://www.engineeringvillage.com
28
Firefox Monitor
https://monitor.firefox.com/
Google Scholar
http://scholar.google.com/
Healthdata.gov
https://www.healthdata.gov/
Indiegogo Datasets
https://webrobots.io/indiegogo-dataset/
Internet Archive
http://www.archive.org/
Invisible Library
http://invislib.blogspot.com/
Kickstarter Datasets
https://webrobots.io/kickstarter-datasets/
MagPortal
http://www.magportal.com/
Mappa.Mundi Magazine
http://mappa.mundi.net/
OAIster
http://www.oclc.org/oaister.en.html
Open Datasets
http://www.DataPortals.org/
https://github.com/caesar0301/awesome-public-datasets
https://www.kaggle.com/datasets
https://www.data.gov/
https://www.quora.com/Where-can-I-find-large-datasets-open-to-the-public
https://aws.amazon.com/public-datasets/
https://data.world/
http://data.worldbank.org/
http://www.OpenDataSets.info/
reSearcher
http://researcher.sfu.ca/
Science Commons
http://creativecommons.org/science
32
SciTech Connect
http://www.osti.gov/scitech/
Scrapy Webcrawler
http://scrapy.org/
SIMILE Widgets - Free, Open-Source Data Visualization Web Widgets and More
http://simile-widgets.org/
SWRC Ontology
http://ontoware.org/swrc/
33
The 10 Best Deep Web Search Engines to Explore the Hidden Web by Michelle
Fuchs
https://www.airsassociation.org/services-new/airs-knowledge-network-n/airs-
articles/item/17217-top-10-best-deep-web-search-engines-to-explore-hidden-web
The Deep Web: Shutdowns, New Sites, New Tools by Vincenzo Ciancaglini
http://blog.trendmicro.com/trendlabs-security-intelligence/the-deep-web-shutdowns-new-
sites-new-tools/
Top 10 Best Deep Web Search Engines To Explore the Hidden Web
https://www.airsassociation.org/services-new/airs-knowledge-network-n/airs-
articles/item/18749-top-10-best-deep-web-search-engines-to-explore-hidden-web
Tor Project
https://www.torproject.org/
34
Twitter/Search #deepweb
https://twitter.com/search?q=%23deepweb
35
Deep Search, Wide Search and Everything Else You Should Know About Semantic
Search
http://www.dataversity.net/deep-search-wide-search-everything-else-know-semantic-
search/
36
KnowledgeNets
http://wissensnetze.ag-nbi.de/
Language Engineering for the Semantic Web: A Digital Library for Endangered
Languages
http://informationr.net/ir/9-3/paper176.html
Magpie - The Samatic Filter and Tool For the Semantic Web
http://projects.kmi.open.ac.uk/magpie/main.html
MetaData at W3C
http://www.w3.org/Metadata/
Rules and Rule Markup Languages for the Semantic Web - RuleML-2003
http://www.informatik.uni-trier.de/~ley/db/conf/semweb/ruleml2003.html
38
Simile Widgets – Free, Open-Source Data Visualization Web Widgets and More
http://simile-widgets.org/
The Authoritative Resource List for the Semantic Web by Kaila Strong
http://www.verticalmeasures.com/search-optimization/the-authoritative-resource-list-for-
the-semantic-web/
The Semantic Web By Tim Berners-Lee, James Hendler and Ora Lassila
https://www.scientificamerican.com/magazine/sa/2001/05-01/#article-the-semantic-web
Web Semantics: Science, Services and Agents on the World Wide Web
http://www.sciencedirect.com/science/journal/15708268
XML.org
http://www.xml.org/
80legs - Powerful and Economical Service Platform for Crawling and Processing
Web Content
http://www.80legs.com/
40
ALICEBot
http://www.alicebot.org/
Botometer
https://botometer.iuni.iu.edu/
41
ChatBottle Search
https://chatbottle.co/
Common Crawl - Open Repository of Web Crawl Data Composed Of Over 5 Billion
Freely Available Web Pages
http://www.CommonCrawl.org/
42
Google Guide
http://www.googleguide.com/
Healthdata.gov
https://www.healthdata.gov/
Imagination Engines
http://www.imagination-engines.com/
Import.io - Turn the Web Into Data With Extractors, Crawlers and Connectors
https://import.io/
Indiegogo Datasets
https://webrobots.io/indiegogo-dataset/
45
Kickstarter Datasets
https://webrobots.io/kickstarter-datasets/
Lurchr - I Keep Track of What’s Shared by Your Team So You Can Stay Focused
On Work
https://lurchr.com/
46
MySpiders
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.21.3013
Robo Brain - Large Scale Computational System That Learns from Publicly
Available Internet Resources
http://robobrain.me/
Semantic Web
http://www.semanticweb.org/
ShoppingBots 2019
http://www.ShoppingBots.info/
SocialBuzzBot 2019- The Business and Social Intelligence Search Engine for
Information Discovery from Social Communities
http://www.SocialBuzzBot.com/
48
49
UMBC AgentWeb
http://agents.umbc.edu/
UMBC eBiquity
http://ebiquity.umbc.edu/
Web IR & IE
https://groups.yahoo.com/neo/groups/webir/info
http://www.webir.org/
50
Accessibility Resources
http://www.AccessibilityResources.info/
Agriculture Resources
http://www.AgricultureResources.info/
AnswerSpot
http://www.AnswerSpot.us/
Astronomy Resources
http://www.AstronomyResources.info/
Auction Resources
http://www.AuctionResources.info/
Biological Informatics
http://www.BiologicalInformatics.info/
Biotechnology Resources
http://www.BiotechnologyResources.info/
Bot Research
http://www.BotResearch.info/
51
Directory Resources
http://www.DirectoryResources.info/
eCommerce Resources
http://eCommerceResources.info/
Elder Resources
http://www.ElderResources.info/
Employment Resources
http://www.EmploymentResources.info/
Entrepreneurial Resources
http://www.EntrepreneurialResources.info/
Financial Sources
http://www.FinancialSources.info/
Finding People
http://www.FindingPeople.info/
Games Resources
http://www.GamesResources.info/
Genealogy Resources
http://www.GenealogyResources.info/
52
Green Files
http://www.GreenFiles.info/
Healthcare Resources
http://www.HealthcareResources.info/
Internet Alerts
http://www.InternetAlerts.info/
Internet Demographics
http://www.InternetDemographics.info/
Internet Experts
http://www.InternetExperts.info/
Internet Hoaxes
http://www.InternetHoaxes.info/
Intrapreneurial Resources
http://www.IntrapreneurialResources.info/
Journalism Resources
http://www.JournalismResources.info/
Knowledge Discovery
http://www.KnowledgeDiscovery.info/
53
Privacy Resources
http://www.PrivacyResources.info/
Reference Resources
http://www.ReferenceResources.info/
Research Resources
http://www.ResearchResources.info/
RestStress™
http://www.RestStress.com/
Script Resources
http://www.ScriptResources.info/
ShoppingBots
http://www.ShoppingBots.info/
Social Informatics
http://www.SocialInformatics.info/
Student Research
http://www.StudentResearch.info/
Theology Resources
http://www.TheologyResources.info/
Tutorial Resources
http://www.TutorialResources.info/
54
55
Internet MiniGuides™
http://www.InternetMiniguide.com/
LinkSeries Publications
http://www.LinkSeries.com/
Links By Marcus™
http://www.LinksByMarcus.com/
Workshops By Marcus™
http://www.WorkshopsByMarcus.com/
Deep Web Research and Discovery Resources 2019 Online White Paper
http://DeepWeb.us/
Searching the Internet 2018 – The Primer - 2019 Guide to Searching the Internet
http://www.SearchingTheInternet.info/
57
58
59
60