New UMBC research is helping dismantle gender and publication biases in science.
A team of researchers working across disciplines has developed a new statistical technique to understand similarity, rather than difference, in the natural world. With this new technique, they’ve determined that among Eastern Bluebirds the structure of songs female birds sing is statistically indistinguishable from songs males sing.
Awareness of female birdsong is growing worldwide, thanks in part to a breakthrough paper by Karan Odom, Ph.D. ’16, biological sciences, but it’s still understood as a trait found primarily in tropical birds. Evangeline Rose, a current Ph.D. student in the same lab and first author on a new paper in Animal Behavior, wanted to look at song in a temperate species.
During Rose’s fieldwork, “I was finding that the females were singing, to me, what sounded just like male songs,” she says. “So we started thinking about equality, and equivalence, and how to test for it.” On the advice of her advisor, Kevin Omland, professor of biological sciences, she reached out to Thomas Mathew, professor of statistics, who has expertise in statistical equivalence.
Challenging a paradigm
Working together, the team modified a statistical method used in generic drug testing to meet their needs for ecology and animal behavior studies. The existing test helps determine whether generic and brand name drugs are “statistically equivalent,” meaning they are similar enough to be prescribed safely for the same purpose. The new modification will allow scientists in other fields to test for equivalence. Before, researchers could only report they did not find a significant difference—a very different statement than saying two things are conclusively equivalent.
“We’re really hoping this new method is going to address some issues with what kinds of data get published,” Rose says. “The most important thing about being a good scientist is to be unbiased. And the whole tradition of testing for difference really leads to incredible biases in scientists,” Omland says. He adds, “There’s a whole realm of things in nature that we find interesting and important because of their similarity.”
For example, in addition to similarities in songs between the sexes in birds, researchers could use the new test to ask if two species use the same type of habitat, respond the same way to predators, or consume the same food sources. Answers to those questions could fill long-standing knowledge gaps, or even inform conservation efforts.
“This test is really broadly applicable,” says Rose, “and we’re hoping to introduce it more to the ecology and evolution field.”
A new approach
One advantage of the new method is it accounts for unequal sample sizes. In a medical study, researchers can carefully control the size of treatment and control groups. In other fields, from ecology, to engineering, to agriculture, that’s often not possible. The new test also allows researchers to determine the equivalence of several traits simultaneously, Mathew explains. For example, in this study, the authors found that the male and female birds’ songs were statistically equivalent across five different characteristics, such as duration of each song and the range of pitches the birds produced.
Rather than testing whether two things are exactly equal, the team was looking for a way to determine if two things were “close enough,” given a defined allowable margin of difference. Because of that added layer, “There are additional challenges here,” Mathew says.
“Even though this methodology is out there, it hasn’t been applied—even in statistics—with this kind of data. That’s why I was very excited when they brought this project to me,” Mathew says. Rose adds, “It ended up being a really great partnership to look at these questions that hadn’t been asked before for female song, and we also ended up modifying this test in a really cool, new way.”
As research on similarities grows, there is also a growing drive to remove the bias against publishing studies that do not find a significant difference, often termed a “negative result.” This paper “is part of an amazing drumbeat that’s building up in the scientific community,” Omland says. “There’s a broader problem with the scientific method that’s being increasingly acknowledged, and the test we’ve developed can at least play a small role, and I hope a big role, in addressing it.”
Rose, who plans to next investigate the function of female bluebird songs, says she will carry these new techniques with her as she moves through her research career. “I think in the future, I’ll be thinking about how equivalence can change the questions we’re asking, and I’ll always keep in mind that we have extra tools in the toolkit.”
The Latest on: Biases in science
via Google News
The Latest on: Biases in science
- Responsible Artificial Intelligence for Anti-Money Laundering: How to Address Biason September 1, 2021 at 10:19 am
The eager and rapid adoption of artificial intelligence (A.I.) by financial institutions (F.I.s) may surprise those outside this otherwise cautious industry. However, the industry consensus is clear ...
- Middlebury Professor's New Book Examines the Epidemic of Science Denialon September 1, 2021 at 7:33 am
When Barbara Hofer and Gale Sinatra submitted the first draft of their book Science Denial: Why It Happens and What to Do About It ...
- 5 Unconventional Career Tips From Top Women In Data Scienceon August 31, 2021 at 4:35 pm
So much of our world today depends a great deal on good data, from funding decisions to public health to climate policy. So, we need it to be as unbiased as possible, and that means we need more women ...
- New scientific approach reduces bias in training data for improved machine learningon August 31, 2021 at 5:00 am
Gautam Thakur leads a team of ORNL researchers who have developed a new scientific method for identifying bias in human data annotators to ensure high-quality data inputs for machine learning ...
- The Social Science Monoculture Doubles Downon August 30, 2021 at 2:42 pm
Over the past 18 months, a number of significant events have occurred that were interpreted through two entirely different worldviews: COVID–19 lockdowns; rise of the BLM movement; the riots and ...
- Convicted by Memory, Exonerated by Scienceon August 30, 2021 at 1:35 pm
Research exploring factors that contribute to wrongful convictions reveals a path for addressing the serious consequences of wrongful incarceration.
- Afghanistan Shows Real Media Bias at Workon August 26, 2021 at 4:30 am
Let’s talk about media bias and Afghanistan. Because this is a really good case study of how real media bias works. I’ll start with an excellent column from my Bloomberg Opinion colleague Ramesh ...
- How to Eliminate Bias in Artificial Intelligenceon August 25, 2021 at 5:04 pm
Angela Benton, founder and CEO of data-science company Streamlytics, talks about using ethically sourced data to train AI.
- Institutional imperatives for the advancement of women in medicine and science through the COVID-19 pandemicon August 24, 2021 at 6:02 pm
The multiple roles women have in societies, including in medicine and science, mean that many women have faced unique challenges personally and professionally since the start of the COVID-19 pandemic.
via Bing News