
The location of tags in a images tells us a story. From them, we can extract a tag relativity graph. The graph enables social search by understanding tag relationships. (Credit: University of Toronto)
A new algorithm designed at the University of Toronto has the power to profoundly change the way we find photos among the billions on social media sites such as Facebook and Flickr.
This month, the United States Patent and Trademark Office will issue a patent on this technology.
Developed by Parham Aarabi, a professor in The Edward S. Rogers Sr. Department of Electrical & Computer Engineering, and his former Master’s student Ron Appel, the search tool uses tag locations to quantify relationships between individuals, even those not tagged in any given photo.
Imagine you and your mother are pictured together, building a sandcastle at the beach. You’re both tagged in the photo quite close together. In the next photo, you and your father are eating watermelon. You’re both tagged. Because of your close ‘tagging’ relationship with both your mother in the first picture and your father in the second, the algorithm can determine that a relationship exists between those two and quantify how strong it may be.
In a third photo, you fly a kite with both parents, but only your mother is tagged. Given the strength of your ‘tagging’ relationship with your parents, when you search for photos of your father the algorithm can return the untagged photo because of the very high likelihood he’s pictured.
“Two things are happening: we understand relationships, and we can search images better,” says Professor Aarabi.
The nimble algorithm, called relational social image search, achieves high reliability without using computationally intensive object- or facial-recognition software.
“If you want to search a trillion photos, normally that takes at least a trillion operations. It’s based on the number of photos you have,” says Aarabi. “Facebook has almost half a trillion photos, but a billion users—it’s almost a 500 order of magnitude difference. Our algorithm is simply based on the number of tags, not on the number of photos, which makes it more efficient to search than standard approaches.”
Work on this project began in 2005 in Professor Aarabi’s Mobile Applications Lab, Canada’s first lab space for mobile application development.
Currently the algorithm’s interface is primarily for research, but Aarabi aims to see it incorporated on the back-end of large image databases or social networks. “I envision the interface would be exactly like you use Facebook search—for users, nothing would change. They would just get better results,” says Aara
The Latest on: Relational social image search
- Social media has some significant upsides for teenage girls, survey findson March 30, 2023 at 5:03 am
“It definitely wasn’t healthy.” But also on social media, she found a hotline for eating disorders that helped her develop healthier eating habits. And she found countless messages about positive body ...
- Selena Gomez's 'throuple' with Beckhams: Gwyneth Paltrow and Dolly Parton embrace atypical Hollywood marriageson March 30, 2023 at 4:00 am
Selena Gomez, Nicola Peltz and Brooklyn Beckham have joked that they are a "throuple." Other celebrities including Helena Bonham Carter and Tim Burton have had unorthodox relationships.
- 'Plasticky, hyper-realistic': If you fell for the viral, AI-generated image of Pope Francis in a white puffer, here are the tell-tale signson March 27, 2023 at 8:34 am
An curved arrow pointing right. An AI-generated image of Pope Francis wearing a stylish white puffer jacket shared on social media over the weekend has tricked thousands of users into thinking it ...
- Sprout Social Reviewon March 26, 2023 at 5:00 pm
Rating image ... search operators and the set-up process includes a handy preview tool, so you can see whether the results match expectations before finalizing your reports. Sprout Social's ...
- How to Google reverse image search on Android, iOS, and Windows deviceson March 12, 2023 at 5:00 pm
Wondering how to do a Google reverse image search? It’s actually effortless to do on Chrome for PC. The process isn’t as straightforward when using an Android device, though. You will need to ...
- The Relational Subjecton March 10, 2023 at 8:14 am
Many social theorists now call themselves 'relational sociologists', but mean entirely different things by it. The majority endorse a 'flat ontology', dealing exclusively with dyadic relations.
- How Social Relationships Matter for Healthon March 4, 2023 at 11:02 am
Chapter 2 describes four types of relational features: social support, social integration, social capital, and social norms, collectively referred to as the “four socials.” The ways in which each of ...
- Here’s how reverse image search works on Google Search and Chromeon January 25, 2023 at 1:05 am
Google reverse image search allows you to search with images rather than written keywords. You can do a Google reverse image search on your smartphone with Chrome's mobile app or any computer.
- Image searchon February 23, 2022 at 3:10 pm
SEO This is powered by the DALL∙E model and is rolling out to Bing Chat. SEO Learn how search engines process images and key image SEO tactics to implement from this comprehensive overview.
- Reverse Image Searchon December 18, 2021 at 8:51 pm
Upload an image from your Photo Library, iCloud, Dropbox, Google Drive or take a new picture with your phone's camera and reverse search. Google’s search by image feature is currently available for ...
via Bing News
The Latest on: Social image search
- Social media has some significant upsides for teenage girls, survey findson March 30, 2023 at 5:03 am
“It definitely wasn’t healthy.” But also on social media, she found a hotline for eating disorders that helped her develop healthier eating habits. And she found countless messages about positive body ...
- Opinion: I’m a teen who sees how social media makes many obsess over appearances. This must stop.on March 28, 2023 at 11:27 pm
This lack of intellectual development can have long-term consequences, not only for our own personal growth but for society.
- Twitter users fooled by AI images of Pope in street fashionon March 28, 2023 at 7:00 am
An image of Pope Francis wearing a large white puffer jacket took Twitter by storm, with social media users praising his new style. But the image is not authentic, displaying classic signs of AI ...
- 'Plasticky, hyper-realistic': If you fell for the viral, AI-generated image of Pope Francis in a white puffer, here are the tell-tale signson March 27, 2023 at 8:34 am
An curved arrow pointing right. An AI-generated image of Pope Francis wearing a stylish white puffer jacket shared on social media over the weekend has tricked thousands of users into thinking it ...
- AI-generated images can fool people. Here are tips to identify themon March 27, 2023 at 5:31 am
Donald Trump behind bars? Russian leader Vladimir Putin kneeling before his Chinese counterpart Xi Jinping? You might have seen what seem to be realistic images like these circulating online, the ...
- Sprout Social Reviewon March 26, 2023 at 5:00 pm
Rating image, 4.10 out of 5 stars ... around clear topics and opens with a search bar to help users navigate straight to what they need. The Sprout Social Twitter account is accessible and ...
- Poor Body Image Might Be Social Media's Fault — Here's How To Change Your Settings and See Uplifting Content Insteadon March 24, 2023 at 11:29 am
But it's easier said than done, especially when your social media feeds are bombarded with extreme weight loss tips and images of ultra-thin women ... In the menu that appears, tap the search bar and ...
- Social media and the self-perpetuating cycle of risk for body image and eating disorderson March 23, 2023 at 8:30 am
A scoping review to investigate the association between social media, body image and eating disorders amongst young people," published in the journal PLOS Global Public Health, suggests that ...
- Social media is part of a ‘self-perpetuating cycle of risk’ for eating disorders and negative body image, per studyon March 22, 2023 at 12:39 pm
Social media use is linked with body image concerns and eating disorders among young people, according to a new review of the scientific literature. But rather than social media being a direct ...
- The Search Party: SEJ’s Weekly News Recap For Search, Social, And AIon March 17, 2023 at 6:05 am
Don't miss the latest news in search, social and AI including the release of GPT-4, Microsoft Copilot, AI in Google Workspace, and more!
via Bing News