
The location of tags in a images tells us a story. From them, we can extract a tag relativity graph. The graph enables social search by understanding tag relationships. (Credit: University of Toronto)
A new algorithm designed at the University of Toronto has the power to profoundly change the way we find photos among the billions on social media sites such as Facebook and Flickr.
This month, the United States Patent and Trademark Office will issue a patent on this technology.
Developed by Parham Aarabi, a professor in The Edward S. Rogers Sr. Department of Electrical & Computer Engineering, and his former Master’s student Ron Appel, the search tool uses tag locations to quantify relationships between individuals, even those not tagged in any given photo.
Imagine you and your mother are pictured together, building a sandcastle at the beach. You’re both tagged in the photo quite close together. In the next photo, you and your father are eating watermelon. You’re both tagged. Because of your close ‘tagging’ relationship with both your mother in the first picture and your father in the second, the algorithm can determine that a relationship exists between those two and quantify how strong it may be.
In a third photo, you fly a kite with both parents, but only your mother is tagged. Given the strength of your ‘tagging’ relationship with your parents, when you search for photos of your father the algorithm can return the untagged photo because of the very high likelihood he’s pictured.
“Two things are happening: we understand relationships, and we can search images better,” says Professor Aarabi.
The nimble algorithm, called relational social image search, achieves high reliability without using computationally intensive object- or facial-recognition software.
“If you want to search a trillion photos, normally that takes at least a trillion operations. It’s based on the number of photos you have,” says Aarabi. “Facebook has almost half a trillion photos, but a billion users—it’s almost a 500 order of magnitude difference. Our algorithm is simply based on the number of tags, not on the number of photos, which makes it more efficient to search than standard approaches.”
Work on this project began in 2005 in Professor Aarabi’s Mobile Applications Lab, Canada’s first lab space for mobile application development.
Currently the algorithm’s interface is primarily for research, but Aarabi aims to see it incorporated on the back-end of large image databases or social networks. “I envision the interface would be exactly like you use Facebook search—for users, nothing would change. They would just get better results,” says Aara
The Latest on: Relational social image search
- PostgreSQL: The World's Most Advanced Open Source Relational Databaseon November 29, 2023 at 8:58 am
PostgreSQL is a powerful, open source object-relational database system with over 35 years of active development that has earned it a strong reputation for reliability, feature robustness, and ...
- People Are Sharing Social Norms That Are Actually Pretty Awful, And I Definitely Agree With A Few Of Theseon November 28, 2023 at 4:15 am
1."Unsafe driving has been totally normalized in the US. It’s probably the most dangerous activity that 90% of the population participates in daily, and it’s no longer treated with respect or care.
- Bing Image Search inspires to learn more and do moreon November 26, 2023 at 4:01 pm
Bing has plans to offer several things through image search. They believe, that image search should not be the end of search, but it should be the beginning of the search. Inspired by this thought ...
- How to Reverse Image Search Using Googleon November 6, 2023 at 4:01 pm
All of us are familiar with using text to search for what we need. For example, type "black boots" into Google, and millions of results pop up. But sometimes an image does a much better job at ...
- What Is Social Listening And How To Get Startedon November 2, 2023 at 5:00 pm
Learn what social listening is, why it matters, and our top tips for getting started with your social listening strategy in this article. Most marketers now understand the value of social media as ...
- Reverse Image Searchon August 25, 2023 at 5:49 pm
Upload an image from your Photo Library, iCloud, Dropbox, Google Drive or take a new picture with your phone's camera and reverse search. Google’s search by image feature is currently available for ...
- Relational Healthon March 4, 2023 at 11:02 am
Yet a clear understanding of how to promote behavior change has remained elusive. Laura Richman’s Relational Health will shift attention away from failed dependence on will power to evidence-based ...
- Alibaba Image Searchon July 15, 2021 at 5:25 pm
Based on machine learning and deep learning, Alibaba Cloud Image Search helps users find similar or identical images while using e-commerce websites or stock photography and photo-sharing sites.
- Online Image Search stock illustrationson June 18, 2021 at 9:57 am
social media advertising concept. small people working decorated laptop technology. flat cartoon design for banner mobile and web online image search stock illustrations content strategy marketing ...
- Reverse Image Searchon December 12, 2018 at 9:28 pm
Here is a free reverse image search tool that allows you to search the web based on the image input. Enter image URL or upload the image file and search similar images from Google, Bing and Yandex ...
via Bing News
The Latest on: Social image search
- Why Your Max Social Security Benefit Will Increase in 2024on November 30, 2023 at 8:10 am
(Photo illustration by Kevin Dietsch/Getty Images ... no longer drains value from Social Security benefits," the SSA has said. Newsweek is committed to challenging conventional wisdom and finding ...
- Is real-life violence on social media desensitising your child?on November 30, 2023 at 7:02 am
“It is said that by the age of seven, a child can differentiate between fantasy and reality. So, for children in the age group of 13 to 17, seeing scenarios of real-life violence could have more of an ...
- Old Image Falsely Shared as a Worker Trapped in Uttarakhand Tunnelon November 30, 2023 at 3:10 am
This image has been on the internet since 2019 and is unrelated to 41 workers trapped in Silkyara tunnel in Uttarakhand's Uttarkashi.
- Lauren Boebert 'Torched' During Clash With Social Security Officialon November 30, 2023 at 2:07 am
The Colorado Republican took aim at the agency's teleworking policies during a House Oversight Committee hearing.
- Doctors warn against using 'first aid measure' for fainting circulating on social mediaon November 29, 2023 at 11:21 pm
First aid measures for unconsciousness should include calling for emergency services and CPR, instead of pressing on the area under the nose as claimed in social media posts circulating in Indonesia, ...
- Image of child trapped under rubble predates Gaza war and shows signs of AIon November 28, 2023 at 11:33 pm
Israel's bombardment of the Gaza Strip has killed thousands of children, according to Gaza's Hamas government. An image that social media posts say shows a Palestinian child trapped under rubble, ...
- Social media sites failing to stop the spread of suicide content, charity sayson November 28, 2023 at 4:01 pm
New report from the Molly Rose Foundation says social media firms are failing to stop the promotion of self-harm and suicide content.
- People Are Sharing Social Norms That Are Actually Pretty Awful, And I Definitely Agree With A Few Of Theseon November 28, 2023 at 4:15 am
1."Unsafe driving has been totally normalized in the US. It’s probably the most dangerous activity that 90% of the population participates in daily, and it’s no longer treated with respect or care.
- Google's new tools help discussion forums and social media platforms rank higher in search resultson November 27, 2023 at 1:09 pm
Google today introduced new tools for website owners, including those running social media sites and discussion forums, who want to better elevate their content in Google's search results. The feature ...
- Social Pictures: Power Dressing Remasteredon November 23, 2023 at 4:01 pm
The exclusive IMAGE x Christian Louboutin ‘Power Dressing Remastered’ event took place in Browns Brasserie in Brown Thomas on Wednesday night. Centred on fashion, confidence and career progression, it ...
via Bing News