
What you see when you do a basic Web search is only the tip of the iceberg. Most of the information is buried in the “Deep Web.” JPL is collaborating on a DARPA initiative called Memex, which explores the connections between bits of information hidden in this vast ocean of content. Image credit: NASA/JPL-Caltech
When you do a simple Web search on a topic, the results that pop up aren’t the whole story. The Internet contains a vast trove of information — sometimes called the “Deep Web” — that isn’t indexed by search engines: information that would be useful for tracking criminals, terrorist activities, sex trafficking and the spread of diseases. Scientists could also use it to search for images and data from spacecraft.
The Defense Advanced Research Projects Agency (DARPA) has been developing tools as part of its Memex program that access and catalog this mysterious online world. Researchers at NASA’s Jet Propulsion Laboratory in Pasadena, California, have joined the Memex effort to harness the benefits of deep Web searching for science. Memex could, for example, help catalog the vast amounts of data NASA spacecraft deliver on a daily basis.
“We’re developing next-generation search technologies that understand people, places, things and the connections between them,” said Chris Mattmann, principal investigator for JPL’s work on Memex.
Memex checks not just standard text-based content online but also images, videos, pop-up ads, forms, scripts and other ways information is stored to look at how they are interrelated.
“We’re augmenting Web crawlers to behave like browsers — in other words, executing scripts and reading ads in ways that you would when you usually go online. This information is normally not catalogued by search engines,” Mattmann said.
Additionally, a standard Web search doesn’t get much information from images and videos, but Memex can recognize what’s in this content and pair it with searches on the same subjects. The search tool could identify the same object across many frames of a video or even different videos.
The video and image search capabilities of Memex could one day benefit space missions that take photos, videos and other kinds of imaging data with instruments such as spectrometers. Searching visual information about a particular planetary body could greatly facilitate the work of scientists in analyzing geological features. Scientists analyzing imaging data from Earth-based missions that monitor phenomena such as snowfall and soil moisture could similarly benefit.
Memex would also enhance the search for published scientific data, so that scientists can be better aware of what has been released and analyzed on their topics. The technology could be applied to large NASA data centers such as the Physical Oceanography Distributed Active Archive Center, which makes NASA’s ocean and climate data accessible and meaningful. Memex would make PDF documents more easily searchable and allow users to more easily arrive at the information they seek. Awareness of existing publications also helps program managers to assess the impact of spacecraft data.
All of the code written for Memex is open-source. JPL is one of 17 teams working on it as part of the DARPA initiative.
Read more: ‘Deep Web Search’ May Help Scientists
The Latest on: Deep Web
via Google News
The Latest on: Deep Web
- Cobwebs Technologies Lauded by Frost & Sullivan for Its Ground-breaking Web Intelligence Solutionson February 26, 2021 at 5:33 am
Based on its recent analysis of the global artificial intelligence (AI)-powered Web intelligence market, Frost & Sullivan recognizes Cobwebs Technologies (Cobwebs) with the 2020 Global Technology ...
- Tales of the Mighty Whitey: Deep Diving in the Dark Web Dumpsteron February 25, 2021 at 11:54 pm
She hung out with them in the dungeon-minded Deep Web. Her journo mission: “It was a means to elevate the grim, dirty business of racist violence.” It’s not funny, but she brings her wryest Jewish ...
- Four ways journalists can protect sources using the “deep web”on February 25, 2021 at 8:47 am
According to Alan Pearce, author of Deep Web for Journalists, the “deep web" is the "greatest tool" we can use to safeguard vulnerable sources. Here are four deep web tools you can use to protect your ...
- Web Scraper Software Market is Booming Worldwide | Diggernaut, Phantom Buster, Sequentumon February 18, 2021 at 9:48 pm
Latest released the research study on Global Web Scraper Software Market offers a detailed overview of the factors influencing the global business scope Web Scraper Software Market research report ...
- The Do’s and Don’ts of Exploring the Dark Web with Tor Browseron February 18, 2021 at 1:54 am
This article is about The Do’s and Don’ts of Exploring the Dark Web with Tor Browser. So read this free guide, The Do’s and Don’ts of Exploring the Dark ...
- Brazil Tech Round-Up: Government Responds To Massive Data Leak, Totvs Results, Healthtech Growthon February 12, 2021 at 4:01 pm
PSafe contacted a cybercriminal from outside Brazil, who is selling the leaked information on the deep web and claimed the information referred to customers from two major mobile operators ...
- The 'Deep Web' installation is a ballet of high-precision laserson February 11, 2021 at 4:00 pm
is a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content for its ...
- Deep Web (2020)on January 31, 2021 at 4:00 pm
A gamer meets a girl on an online forum who introduces him to the deep web an underground network where anything is possible. The pair quickly finds themselves falling dangerously into the depths ...
- What is the Deep Web and how to access iton January 20, 2021 at 5:11 am
What is the Deep Web? Did you know that the internet you are used to, the Internet, only makes up a tiny percentage of the actual web out there? There is something that is bigger than this web by ...
- The Deep Web Tour Blog - Part 1on December 28, 2020 at 2:47 am
RAP GENIUS NOTE: We suggest you first read this blog on blog.thedeepwebtour.com for the full authentic experience. This page is a tool for further exploration ...
via Bing News