Half of mouse studies fail to report the sex and age of the models involved
A project at The University of Manchester to analyse 15,000 mouse studies – the largest of its kind ever undertaken – has revealed that about half of these studies failed to report the sex and age of the mice involved, despite these being recognised as key variables that can affect the outcome of scientific studies.
The project utilised text mining software developed at the University, which can analyse large collections of documents to unearth information which would otherwise have been virtually impossible to discover. The software relies on a number of rules, which automatically scan the method section of papers to identify mentions of gender and age.
The results of the project, published this week in eLife, highlight the issue of reproducibility of scientific research – around £20 billion is spent every year on research which is not reproducible, and over 80% of potential therapeutics fail in humans after being tested in mice.
Previously published studies have suggested that research done on female animals may not be applicable for men, and in many of the studies analysed in this project, the animals used were overwhelmingly female. This may be due to female mice being less aggressive, which makes them easier to use in the studies. This is important, because the sexes can have markedly different responses to the same investigations – for example, in infection research.
This may significantly reduce the reliability of studies, and lead to drugs that won’t work for half of the population.
The reproducibility of studies often focuses on the interpretation of statistics, but this project has highlighted that the methods used may not be reported rigorously enough to assess whether they were done correctly. By looking at the methods used, it is possible to infer whether or not the statistics produced are sound, and reproducible in the future. Without knowing these methods, this cannot be inferred at all, which hampers cross-disciplinary research and longevity of data.
The project has produced a vital tool to measure the reproducibility of scientific studies, but there is a long way to go – failure to consider gender in research is still very much the norm, and according to one analysis of scientific studies published in 2009, only 45% of animal studies involving depression or anxiety and only 38 percent involving strokes used females, even though these conditions are more common in women.
“The opportunity to use text mining to cover such a broad portfolio of research was brilliant, and vital to see the bigger picture,” said Sheena Cruickshank, Senior Lecturer in Immunology at The University of Manchester. “We are an interdisciplinary team, and it was this which enabled us to spot this issue and then explore it. The paper builds on several pieces of work we have done together, and highlights the importance of the scientific community to come together and define what is important in the current reproducibility crisis.”
“This study has demonstrated how state-of-the-art computer science technology is instrumental for a large-scale and systematic analysis of literature,” said Dr Goran Nenadic from The University of Manchester’s School of Computer Science. “It avoids small sample bias, and allows us to explore the research landscape on a large scale to identify key issues in reporting details of scientific methodologies, which are necessary for reproducibility, transparency and fidelity of research.”
Learn more: Groundbreaking text mining project highlights ‘gender gap’ in scientific research
The Latest on: Reproducibility of scientific research
via Google News
The Latest on: Reproducibility of scientific research
- A novel highly quantitative and reproducible assay for the detection of anti-SARS-CoV-2 IgG and IgM antibodieson March 4, 2021 at 3:11 pm
The quantitative range and reproducibility of current serological tests for severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) are not optimized. Herein, we developed a diagnostic test that ...
- Conserved and reproducible bacterial communities associate with extraradical hyphae of arbuscular mycorrhizal fungion March 1, 2021 at 3:15 pm
Extraradical hyphae (ERH) of arbuscular mycorrhizal fungi (AMF) extend from plant roots into the soil environment and interact with soil microbial communities. Evidence of positive and negative ...
- ‘An army of open science evangelists’: Professors launch Center for Open and REproducible Scienceon March 1, 2021 at 2:03 pm
Scientists from across Stanford came together to launch an initiative dedicated towards openness, transparency and reproducibility of science.
- Data meets science: Open access, code, datasets, and knowledge graphs for machine learning research and beyondon February 17, 2021 at 5:10 am
Science and data are interwoven in many ... seems to be in the roadmap. As far as reproducible research goes, we should also mention open-source technology by eLife that lets authors publish ...
- Scientific fraud or false claim? China confronts a research crisison February 11, 2021 at 4:10 pm
Some researchers and science policy experts saythe Rao vs Pei case reflects the “reproducibility crisis” in the country. China has led the world in research output in recent years, thanks to ...
- Reproducible Quantification of Cancer-Associated Proteins in Body Fluids Using Targeted Proteomicson February 6, 2021 at 4:00 pm
7 Faculty of Science, University of Zurich ... cohorts is a major limitation in translational research. This is particularly the case for the validation of protein biomarkers; the lack of accurate, ...
- Ensuring Reproducible Data in Life Science Laboratorieson February 5, 2021 at 1:34 pm
Cell culture and immunoassays are fundamental techniques for life science research in academic and pharmaceutical laboratories. Whether laboratories are in the race to publish, or be first-to-market ...
- Launch of German Reproducibility Network: Foster trustworthiness and transparency in scientific researchon February 1, 2021 at 5:30 am
Eight key Open Science actors in Germany founded the German Reproducibility Network. This cross-disciplinary consortium is dedicated to promote reproducible and robust research on a national level.
- Reproducible Research Support Service (R2S2)on January 13, 2021 at 1:39 am
much easier if you consider reproducibility from the start of a research project. If there are no experts on computational reproducibility or open science at your lab/institute/working group, we are ...
- Colin Grudzien: Reproducible scientific software development for predictabilityon August 28, 2020 at 4:29 pm
Prior to joining the faculty at the University of Nevada, Reno, Grudzien was a research ... Because climate science and meteorology rely heavily on numerical models, it is critical to develop this ...
via Bing News