‘Deep Web Search’ May Help Scientists

What you see when you do a basic Web search is only the tip of the iceberg. Most of the information is buried in the "Deep Web." JPL is collaborating on a DARPA initiative called Memex, which explores the connections between bits of information hidden in this vast ocean of content. Image credit: NASA/JPL-Caltech
What you see when you do a basic Web search is only the tip of the iceberg. Most of the information is buried in the “Deep Web.” JPL is collaborating on a DARPA initiative called Memex, which explores the connections between bits of information hidden in this vast ocean of content. Image credit: NASA/JPL-Caltech

When you do a simple Web search on a topic, the results that pop up aren’t the whole story. The Internet contains a vast trove of information — sometimes called the “Deep Web” — that isn’t indexed by search engines: information that would be useful for tracking criminals, terrorist activities, sex trafficking and the spread of diseases. Scientists could also use it to search for images and data from spacecraft.

The Defense Advanced Research Projects Agency (DARPA) has been developing tools as part of its Memex program that access and catalog this mysterious online world. Researchers at NASA’s Jet Propulsion Laboratory in Pasadena, California, have joined the Memex effort to harness the benefits of deep Web searching for science. Memex could, for example, help catalog the vast amounts of data NASA spacecraft deliver on a daily basis.

“We’re developing next-generation search technologies that understand people, places, things and the connections between them,” said Chris Mattmann, principal investigator for JPL’s work on Memex.

Memex checks not just standard text-based content online but also images, videos, pop-up ads, forms, scripts and other ways information is stored to look at how they are interrelated.

“We’re augmenting Web crawlers to behave like browsers — in other words, executing scripts and reading ads in ways that you would when you usually go online. This information is normally not catalogued by search engines,” Mattmann said.

Additionally, a standard Web search doesn’t get much information from images and videos, but Memex can recognize what’s in this content and pair it with searches on the same subjects. The search tool could identify the same object across many frames of a video or even different videos.

The video and image search capabilities of Memex could one day benefit space missions that take photos, videos and other kinds of imaging data with instruments such as spectrometers. Searching visual information about a particular planetary body could greatly facilitate the work of scientists in analyzing geological features. Scientists analyzing imaging data from Earth-based missions that monitor phenomena such as snowfall and soil moisture could similarly benefit.

Memex would also enhance the search for published scientific data, so that scientists can be better aware of what has been released and analyzed on their topics. The technology could be applied to large NASA data centers such as the Physical Oceanography Distributed Active Archive Center, which makes NASA’s ocean and climate data accessible and meaningful. Memex would make PDF documents more easily searchable and allow users to more easily arrive at the information they seek. Awareness of existing publications also helps program managers to assess the impact of spacecraft data.

All of the code written for Memex is open-source. JPL is one of 17 teams working on it as part of the DARPA initiative.

Read more: ‘Deep Web Search’ May Help Scientists


The Latest on: Deep Web

[google_news title=”” keyword=”Deep Web” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]

via Google News


The Latest on: Deep Web
  • Shedding Light on the Dark Web: Dangers, Myths, and Realities
    on May 24, 2024 at 1:52 am

    A detailed overview of the hidden internet. Learn if it is safe, its dangers, and the common misconceptions about using it.

  • The web is disappearing: Is it IT’s fault?
    on May 23, 2024 at 11:26 am

    Nothing lives forever, and researchers have confirmed that web pages are no exception. They pop into existence at one moment in time and have a habit of disappearing with an abrupt “404 not found” at ...

  • Fake Pegasus spyware source code floods dark web
    on May 22, 2024 at 5:00 pm

    “Over the years, CloudSEK researchers have been triaging and investigating incidents occurring in dark and deep web sources, providing visibility into the global threat landscape,” CloudSEK said in a ...

  • 10 Shocking Dark Web Facts We Bet You Didn’t Know
    on May 15, 2024 at 6:10 am

    Police, intelligence agencies, and CISOs are all afraid of the deep dark web, which keeps attracting legitimate users. Is there more to it than meets the eye?

  • Dark Web Vs Deep Web Explained: What's The Difference?
    on May 11, 2024 at 9:30 am

    The deep web and the dark web are different than the internet you probably use on a daily basis. Here's what they are, and the differences between them.

  • ‘Nothing is untouched’: DDT found in deep-sea fish raises troubling concerns for food web
    on May 6, 2024 at 8:00 am

    Scientists have found DDT in zooplankton and deep-sea fish off the coast of L.A., indicating the toxic chemical might be infiltrating the base of the food web.

  • The Deep Web: Murdershow
    on October 8, 2023 at 3:57 am

    Dan Zachary A podcaster's search for clues into his sisters death lands him on the deep web where uncovers THE MURDERSHOW, a site where the highest crypto bidder selects how the victim will be killed.

  • Deep Web XXX
    on January 16, 2023 at 4:04 pm

    Robbie Hampstead Domiziano Cristopharo, Jason Impey, Elisa Carrera Fumagalli, Martyna Madej A collection of disturbing, sick, morbid and unusual clips from the world wide web. Advertisement ...

  • Advantages, Disadvantages and Risks of Deep Web Search Engines
    on July 21, 2018 at 9:21 pm

    The Right Tools for the Job While Deep Web search engines like Infomine, CompletePlanet, Deep Dyve or TechXtra can locate hidden material, other tools may be needed to view it. Many Deep Web ...

via  Bing News


What's Your Reaction?
Don't Like it!
I Like it!
Scroll To Top