Princeton University has developed a method that offers a solution to data overload
Advances in computer storage have created collections of data so huge that researchers often have trouble uncovering critical patterns in connections among individual items, making it difficult for them to realize fully the power of computing as a research tool.
Now, computer scientists at Princeton University have developed a method that offers a solution to this data overload. Using a mathematical method that calculates the likelihood of a pattern repeating throughout a subset of data, the researchers have been able to cut dramatically the time needed to find patterns in large collections of information such as social networks. The tool allows researchers to identify quickly the connections between seemingly disparate groups such as theoretical physicists who study intermolecular forces and astrophysicists researching black holes.
“The data we are interested in are graphs of networks like friends on Facebook or lists of academic citations,” said David Blei, an associate professor of computer science and co-author on the research, which was published Sept. 3 in the Proceedings of the National Academy of Science. “These are vast data sets and we want to apply sophisticated statistical models to them in order to understand various patterns.”
Finding patterns in the connections among points of data can be critical for many applications. For example, checking citations to scientific papers can provide insights to the development of new fields of study or show overlap between different academic disciplines. Links between patents can map out groups that indicate new technological developments. And analysis of social networks can provide information about communities and allow predictions of future interests.
The Latest on: Pattern Recognition
- Jim Simons, the legendary hedge-fund manager who cracked the market, dead at 86on May 10, 2024 at 10:25 am
Jim Simons, the legendary hedge-fund manager who founded the prolific Renaissance Technologies, has died at age 86.
- Benzinga's 'Stock Whisper' Index: 5 Stocks Investors Secretly Monitor But Don't Talk About Yeton May 10, 2024 at 8:11 am
Benzinga’s Stock Whisper Index uses a combination of proprietary data and pattern recognition to showcase five stocks just under the surface and warrant attention. Investors are constantly on the hunt ...
- In ‘Power,’ Policing and Politics Are Inextricableon May 10, 2024 at 7:25 am
Though Yance Ford’s new Netflix documentary takes on a much-explored topic, its mix of personal and polemic makes for a strong argument.
- First-Ever MAGNA-TILES Studio Now Open at the Museum of Discovery and Scienceon May 9, 2024 at 12:50 pm
Explore the world of creativity and meaningful play at the first-ever MAGNA-TILES studio at the Museum of Discovery and Science. Experience the award-winning magnetic building sets for endless fun.
- AI to Transform Financial Reporting and Auditing, Report Claimson May 9, 2024 at 5:02 am
Three-quarters of Australian companies are using or piloting Artificial Intelligence (AI) in financial reporting, according to KPMG International survey.
- Who is Allan Lichtman and how does he predict the presidential race with such accuracy?on May 8, 2024 at 1:58 pm
Known as the presidential prognosticator, this American University professor has a strong record of predicting who might win the White House.
- Meet Allan Lichtman, the professor who predicted the president (and the last 9)on May 8, 2024 at 12:00 pm
So how does he do it? With a crystal ball? Tarot readings? Ayahuasca retreats in the desert? No, he does it with science.
- What is pattern recognition?on December 28, 2023 at 9:40 am
Pattern recognition is one of the four cornerstones of Computer Science. It involves finding the similarities or patterns among small, decomposed problems that can help us solve more complex ...
- ELEC_ENG 433: Statistical Pattern Recognitionon September 19, 2015 at 2:45 pm
CATALOG DESCRIPTION: Fundamental and advanced topics in statistical pattern recognition including Bayesian decision theory, Maximum-likelihood and Bayesian estimation, Nonparametric density estimation ...
- pattern recognitionon August 23, 2014 at 5:00 pm
[Bharath] recently uploaded the source code for an OpenCV based pattern recognition platform that can be used for Augmented Reality, or even robots. It was built with C++ and utilized the OpenCV ...
via Bing News
The Latest on: Data overload
- How to Clear Cache and Browsing Data on Microsoft Edgeon May 11, 2024 at 5:30 am
Tick the appropriate checkboxes to clear your Browsing history and Cached images and files. Scroll down and tap on Storage > Clear cache. To clear more browsing data, tap on Manage storage > CLEAR ALL ...
- Enterprises outsource data storage as complexity riseson May 10, 2024 at 1:30 pm
An overload of operations data, ongoing business growth and expanding web analytics are pushing data estates to their limit, according to a Forrester report.
- Citi forecasts a datacenter-associated power load surging in the U.S.on May 10, 2024 at 5:00 am
Citi analysts believe the U.S. data center-related power load will jump from ~21.4 GW in 2023 to ~52.0 GW in 2030. AI-driven power demand has captured the spotlight recently, and the bank feels the ...
- Proposed 500-kV transmission line aimed at powering data centers would cross Frederick Countyon May 9, 2024 at 9:45 pm
A proposed 500-kilovolt transmission line that would cross northern Frederick County along an existing utility line corridor — as well as a new substation proposed in Clear Brook — are ...
- Cribl and Deloitte Announce Strategic Alliance to Help Clients Transform Security Data Managementon May 8, 2024 at 11:47 am
Cribl, the Data Engine for IT and Security, today announced a strategic alliance with Deloitte, including the integration of its data processing engine into Deloitte’s security information and event ...
- Duke Energy seeks take-or-pay power contracts for data centerson May 7, 2024 at 9:44 am
Duke Energy is pursuing electricity supply contract terms with data centers that include take-or-pay and up-front infrastructure build out payments to guard against volatility in the energy-intensive ...
- Investors should load up on defensive sectors like consumer staples as macro data sends mixed signals about the economy, Morgan Stanley sayson May 6, 2024 at 12:14 pm
Analysts led by Mike Wilson said consumer staples are among the defensive sectors as consumers focus on value amid economic uncertainty.
- Load Centers Market to Hit Valuation of USD 2,608.8 Million By 2032: Astute Analyticaon May 6, 2024 at 9:30 am
Global load center market is experiencing significant growth, driven by increasing electricity consumption, data center expansion, urbanization, electrification, and renewable energy adoption. Asia ...
- Eskom’s load-shedding respite spurs doubts over diesel use ahead of electionson April 30, 2024 at 1:35 am
Eskom's recent streak of no load-shedding has sparked suspicion among South Africans regarding the utility's diesel consumption.
- The Gigawatt Data Center Campus is Comingon April 29, 2024 at 8:02 am
Hyperscale tech companies are seeking campuses that can support 1 gigawatt of electric power capacity. Developers say new approaches to MegaCampuses can enable new ...
via Bing News