A new algorithm designed at the University of Toronto has the power to profoundly change the way we find photos among the billions on social media sites such as Facebook and Flickr.
This month, the United States Patent and Trademark Office will issue a patent on this technology.
Developed by Parham Aarabi, a professor in The Edward S. Rogers Sr. Department of Electrical & Computer Engineering, and his former Master’s student Ron Appel, the search tool uses tag locations to quantify relationships between individuals, even those not tagged in any given photo.
Imagine you and your mother are pictured together, building a sandcastle at the beach. You’re both tagged in the photo quite close together. In the next photo, you and your father are eating watermelon. You’re both tagged. Because of your close ‘tagging’ relationship with both your mother in the first picture and your father in the second, the algorithm can determine that a relationship exists between those two and quantify how strong it may be.
In a third photo, you fly a kite with both parents, but only your mother is tagged. Given the strength of your ‘tagging’ relationship with your parents, when you search for photos of your father the algorithm can return the untagged photo because of the very high likelihood he’s pictured.
“Two things are happening: we understand relationships, and we can search images better,” says Professor Aarabi.
The nimble algorithm, called relational social image search, achieves high reliability without using computationally intensive object- or facial-recognition software.
“If you want to search a trillion photos, normally that takes at least a trillion operations. It’s based on the number of photos you have,” says Aarabi. “Facebook has almost half a trillion photos, but a billion users—it’s almost a 500 order of magnitude difference. Our algorithm is simply based on the number of tags, not on the number of photos, which makes it more efficient to search than standard approaches.”
Work on this project began in 2005 in Professor Aarabi’s Mobile Applications Lab, Canada’s first lab space for mobile application development.
Currently the algorithm’s interface is primarily for research, but Aarabi aims to see it incorporated on the back-end of large image databases or social networks. “I envision the interface would be exactly like you use Facebook search—for users, nothing would change. They would just get better results,” says Aara
The Latest on: Relational social image search
- BenFred: New Mizzou AD Veatch is familiar face in what he says is 'forever home.' Now time will tell.on April 27, 2024 at 5:29 am
Laird Veatch, the University of Missouri’s new director of athletics, leaves an event welcoming him to the position on Friday, April 26, 2024, at the Stephens Indoor Facility at the University of ...
- Meet the Gen Zers struggling to stay in work or school — and the parents who are at a loss for how to helpon April 27, 2024 at 2:22 am
A rising number of America's young people are disconnected from work, school, and a sense of purpose.
- Internet Shocked at Sibling's 'Revenge' on Brother for Ruining Weddingon April 24, 2024 at 3:09 pm
The Redditor had announced that they're expecting their first child to steal the spotlight on their brother's big day.
- AI-generated images draw in social media userson April 24, 2024 at 6:40 am
AI-generated images are increasingly prevalent -- and popular -- on social media platforms. Even as many of them border on the surreal, they're often used to bait engagement from ordinary users.
- Why vector databases are having a moment as the AI hype cycle peakson April 20, 2024 at 8:00 am
Vector databases are all the rage, judging by the number of startups entering the space and the investors ponying up for a piece of the pie. The proliferation of large language models (LLMs) and the ...
- Why vector databases are having a moment as the AI hype cycle peakson April 20, 2024 at 8:00 am
While traditional relational databases such as Postgres ... doesn’t work so well for unstructured data such as images, videos, emails, social media posts, and any data that doesn’t adhere ...
- Watching This Video May Make You Less Scared of Snakeson April 17, 2024 at 11:00 am
A study found that people's attitudes changed towards snakes after watching videos that focused on enhancing empathy towards them.
- How to a reverse image search on Googleon January 23, 2024 at 10:41 pm
Reverse image search helps you find the origin of a photo and similar photos. While plenty of services offer reverse image search, you don't need to go further than Google Search to find the ...
- The Relational Subjecton November 24, 2023 at 8:10 pm
Many social theorists now call themselves 'relational sociologists', but mean entirely different things by it. The majority endorse a 'flat ontology', dealing exclusively with dyadic relations.
- Reverse Image Searchon September 30, 2023 at 1:22 am
Upload an image from your Photo Library, iCloud, Dropbox, Google Drive or take a new picture with your phone's camera and reverse search. Google’s search by image feature is currently available for ...
via Bing News
The Latest on: Social image search
- When Are May 2024 Social Security Payments Coming?on April 26, 2024 at 4:07 pm
The date a claimant is paid is determined by several factors, including the type of benefit, date of birth, and where they live. If you're not sure when you are due to be paid, Newsweek has broken ...
- A Social Media Post Attributed to Rep. Lauren Boebert Is Parodyon April 26, 2024 at 11:04 am
The image originated from a March 31, 2023, post on X by user Faith Back Rub, who claims in their account description that most of the images posted by the account are satirical. The original image ...
- Sudan crisis: Don't fall for these misleading images and claims on social mediaon April 25, 2024 at 9:24 pm
As deadly clashes erupt in Sudan and the scramble to evacuate civilians continues, unrelated or misleading images have been circulating on social media creating panic ... a quick reverse image search ...
- AI-generated images draw in social media userson April 24, 2024 at 6:40 am
AI-generated images are increasingly prevalent -- and popular -- on social media platforms. Even as many of them border on the surreal, they're often used to bait engagement from ordinary users.
- 6 Social Media Campaigns That Will Inspire Any Businesson April 22, 2024 at 12:26 pm
Your guide to the best in personal financial products such as credit cards, mortgages, bank accounts, and brokerages.
- Social Commerce Strategies to Expand Your Businesson April 22, 2024 at 12:25 pm
Your guide to the best in personal financial products such as credit cards, mortgages, bank accounts, and brokerages.
- Use These Google Tools to Tell If a Photo Is Fakeon April 21, 2024 at 5:00 pm
If the picture shows up on unknown blogs or social media posts with hyped claims, that's usually a red flag. Classic fact-checking methods are still practical. An image search like the above with ...
- Social Savvy: The rise of social SEO – Nov 2023on April 21, 2024 at 5:16 am
However, a paradigm shift is underway, with the younger internet users increasingly turning to social media platforms like Instagram, TikTok, YouTube and others as their go-to search engines rather ...
- Viral image of puppy snuggling baby elephant created with artificial intelligenceon April 18, 2024 at 2:32 pm
This image of a puppy hugging a baby elephant is proof that some things you see online really are too cute to be true.
- Best free people search finder service of 2024on April 18, 2024 at 12:49 am
ThatsThem primarily uses public records, social media profiles ... The 15-year-old service is a reverse image search engine that is a terrific resource when you want to confirm someone's identity ...
via Bing News