via University of Michigan
An algorithm-based system that identifies telltale linguistic cues in fake news stories could provide news aggregator and social media sites like Google News with a new weapon in the fight against misinformation.
The University of Michigan researchers who developed the system have demonstrated that it’s comparable to and sometimes better than humans at correctly identifying fake news stories.
In a recent study, it successfully found fakes up to 76 percent of the time, compared to a human success rate of 70 percent. In addition, their linguistic analysis approach could be used to identify fake news articles that are too new to be debunked by cross-referencing their facts with other stories.
Rada Mihalcea, the U-M computer science and engineering professor behind the project, said an automated solution could be an important tool for sites that are struggling to deal with an onslaught of fake news stories, often created to generate clicks or to manipulate public opinion.
Catching fake stories before they have real consequences can be difficult, as aggregator and social media sites today rely heavily on human editors who often can’t keep up with the influx of news. In addition, current debunking techniques often depend on external verification of facts, which can be difficult with the newest stories. Often, by the time a story is proven a fake, the damage has already been done.
Linguistic analysis takes a different approach, analyzing quantifiable attributes like grammatical structure, word choice, punctuation and complexity. It works faster than humans and it can be used with a variety of different news types.
“You can imagine any number of applications for this on the front or back end of a news or social media site,” Mihalcea said. “It could provide users with an estimate of the trustworthiness of individual stories or a whole news site. Or it could be a first line of defense on the back end of a news site, flagging suspicious stories for further review. A 76 percent success rate leaves a fairly large margin of error, but it can still provide valuable insight when it’s used alongside humans.”
Linguistic algorithms that analyze written speech are fairly common today, Mihalcea said. The challenge to building a fake news detector lies not in building the algorithm itself, but in finding the right data with which to train that algorithm.
Fake news appears and disappears quickly, which makes it difficult to collect. It also comes in many genres, further complicating the collection process. Satirical news, for example, is easy to collect, but its use of irony and absurdity make it less useful for training an algorithm to detect fake news that’s meant to mislead.
Ultimately, Mihalcea’s team created its own data, crowdsourcing an online team that reverse-engineered verified genuine news stories into fakes. This is how most actual fake news is created, Mihalcea said, by individuals who quickly write them in return for a monetary reward.
Study participants, recruited with the help of Amazon Mechanical Turk, were paid to turn short, actual news stories into similar but fake news items, mimicking the journalistic style of the articles. At the end of the process, the research team had a dataset of 500 real and fake news stories.
They then fed these labeled pairs of stories to an algorithm that performed a linguistic analysis, teaching itself distinguish between real and fake news. Finally, the team turned the algorithms to a dataset of real and fake news pulled directly from the web, netting the 76 percent success rate.
The details of the new system and the dataset that the team used to build it are freely available, and Mihalcea says they could be used by news sites or other entities to build their own fake news detection systems. She says that future systems could be further honed by incorporating metadata such as the links and comments associated with a given online news item.
Learn more: Fake news detector algorithm works better than a human
The Latest on: Fake news
via Google News
The Latest on: Fake news
- Mike Durant mocks apparently fake Lincoln Project postcard: ‘You’re struggling,’ Rick Wilson replieson May 12, 2022 at 4:53 pm
"So (Mike Durant), because of your play, I’m officially giving you My Complete and Total Endorsement," the co-founder of the anti-Trump group added.
- The Seahawks pranked their players with a ridiculously unfair fake scheduleon May 12, 2022 at 4:46 pm
The Seattle Seahawks already knew they'd have a tough schedule with the most miles traveled of any NFL team this season. And when some Seahawks got word of additional details of their 2022 slate, they ...
- Fake Sydney nurse who injected patients with vaccines convicted and finedon May 12, 2022 at 4:29 pm
In Australia, a fake nurse who injected patients with vaccines, took blood samples and measured heart health has been convicted and fined AU$3000 (NZ$3298). Belinda Elwell, also known as Belinda ...
- The Seahawks pulled a hilarious prank on their players with a fake schedule revealon May 12, 2022 at 3:24 pm
With the 2022 NFL schedule being revealed on Thursday, these creative groups often show their team’s regular-season slate in funny ways. At this point, it might as well be a time-honored tradition ...
- Fake address lands man in troubleon May 12, 2022 at 3:05 pm
A MAN from Harare challenging the legitimacy of President Mnangagwa’s appointment as Zanu PF leader in the High Court, Sybeth Musengezi, yesterday appeared in court on allegations of using a fake ...
- The Miami Grand Prix, Fake Marina and All, Was a True Super Bowl-Like Eventon May 12, 2022 at 3:00 pm
The Miami Grand Prix felt like something between a live taping of Drive to Survive and an overgrown Instagram prop. It makes sense as an F1 race anyway.
- Woman sold fake negative COVID tests for $200 to travelers at Utah airport, feds sayon May 12, 2022 at 2:20 pm
A woman is accused of selling fake negative COVID-19 tests at a Utah airport, prosecutors said. Linda Tufui Toli pleaded guilty to one count of wire fraud on Wednesday, May 11, according to plea ...
- MAFS viewers accuse Decison Day results of being ‘fake’ Dr. Viviana respondson May 12, 2022 at 2:12 pm
Critics found the D-Day outcome to appear fake and even speculated that the couples and experts were paid bonuses based on saying yes. Dr. Viviana caught wind of the accusations and shared her ...
- Seahawks prank players with fake 2022 schedule releaseon May 12, 2022 at 1:23 pm
With the NFL set to release the full 2022 regular season schedule later today, a lot of “leaked” games have been floating around online – many of them from fake accounts committed to chaos and ...
- Emmy Rossum’s ‘heavy’ fake ‘Angelyne’ breasts gave her blisterson May 12, 2022 at 10:23 am
Emmy Rossum didn’t have the breast time filming “Angelyne.” The actress fully transformed into the iconic singer/model for the upcoming Peacock series — including rocking a very large, fake chest.
via Bing News