Experiment reproducibility of research results reproducibility of results. Medical search. Frequent questions

In recent decades, there has been a rising concern that many published scientific results fail the test of reproducibility, evoking a reproducibility or replication crisis. (wikipedia.org)
This is known as the reproducibility crisis . (hubbardresearch.com)
Is there a reproducibility "crisis" in biomedical research? (scienceblogs.com)
This phenomenon has been described as 'reproducibility crisis' and affects various fields from medici. (researchgate.net)
and innovative approaches, welcoming manuscripts proposing novel methods and technologies to enhance responsible research practices and address the reproducibility crisis in animal science. (biomedcentral.com)
These challenges underscore the importance of our collective effort to address the reproducibility crisis and elevate the overall quality of scientific research. (biomedcentral.com)
The Life Science industry has been in the grips of a reproducibility crisis for a number of years. (abcam.com)
The replication crisis means that many scientific experiments fail to replicate . (rationalwiki.org)
Despite a widespread agreement on the importance of transparency in science, a growing body of evidence suggests that both the natural and the social sciences are facing a reproducibility crisis. (scielo.br)
In the recent few years this has been observed as an issue across the sciences and the term "reproducibility crisis" has evolved. (lu.se)

Reproducibility, closely related to replicability and repeatability, is a major principle underpinning the scientific method. (wikipedia.org)
Replicability and repeatability are related terms broadly or loosely synonymous with reproducibility (for example, among the general public), but they are often usefully differentiated in more precise senses, as follows. (wikipedia.org)
Two major steps are naturally distinguished in connection with reproducibility of experimental or observational studies: When new data is obtained in the attempt to achieve it, the term replicability is often used, and the new study is a replication or replicate of the original one. (wikipedia.org)
Across the life sciences, there are genuine concerns about the reproducibility, replicability and reliability of published research studies. (bna.org.uk)
Replicability means that, when the experiment is repeated in a different context by a second person, the same (or consistent) results are obtained. (bna.org.uk)
abstract = 'Replicability and reproducibility of experimental results are primary concerns in all the areas of science and IR is not an exception. (ku.dk)
We discuss simple recommendations that make replicability, reproducibility and reusability easier to achieve. (lu.se)
In this chapter, we will use "reproducibility" and "replicability" interchangeably, indicating that a similar result is obtained when collecting new data under conditions similar to those in the original study. (bvsalud.org)
It enables interdisciplinary research, enhances transparency and replicability and ultimately strengthens the foundations of research integrity. (lu.se)

Human and animal cell culture techniques - growing human or animal cells under controlled conditions outside their natural environment - represent one of key technologies used in modern biomedical research. (ed.ac.uk)
Reproducibility is one of the corner stones of effective, open and transparent biomedical published research. (mmpc.org)
a problem it is in fields other than those where it is being actively examined, such as biomedical research and social psychology. (nationalacademies.org)
Can we predict the reproducibility of biomedical studies? (bmj.com)
The Brazilian Reproducibility Initiative , which aims to replicate between 60 and a 100 experiments from Brazilian biomedical science using common laboratory methods, provides a unique opportunity to study this question. (bmj.com)
Another point often related to the lack of reproducibility in biomedical research is the biased use of statistical models. (bvsalud.org)

While more and more data is generated by an increasing number of researchers and increasing research expenditure worldwide, this data is hardly manageable by our scholarly practice of communicating scientific results. (uni-stuttgart.de)
The EnzymeML toolbox makes best use of rapidly growing enzymatic data and is a useful tool that allows researchers to surf the research data wave. (uni-stuttgart.de)
The mass of growing and constantly changing data resulting from multiple disciplines represents one of the biggest challenges researchers and public health officials must confront while trying to manage the ongoing COVID-19 pandemic. (buffalo.edu)
The UB ontology team also regularly collaborates with information disease informatics researchers from other universities - including the Center for Vaccine Ontology Research at the University of Michigan at Ann Arbor. (buffalo.edu)
The researchers performed analysis of experimental parameters in 3,058 published spheroid-related experiments. (ed.ac.uk)
CRediT (Contributor Role Taxonomy) is a taxonomy tool by CASRAI (Consortia Advancing Standards in Research Administration) and it was developed to increase transparency in contributions by researchers to scholarly publications. (rsc.org)
The discovery of the current problems of reproducibility only occurred because, periodically, some diligent researchers decided to investigate it. (hubbardresearch.com)
In addition, if research is non-replicable, scientific progress is stalled, research cannot be translated into clinical applications, time and money are wasted and capable and talented early career researchers can become disillusioned and leave the field. (bna.org.uk)
As scientists and researchers, we take the reproducibility of our work very seriously. (cam.ac.uk)
She also leads the MERIDIAN initiative which seeks to improve the reporting of all research involving animals and the SYREAF website (Systematic Reviews of Animals and Food), which provides unique information for researchers seeking to conduct systematic reviews. (biomedcentral.com)
The path to responsible research is one of continual improvement, but it's a journey that all researchers must take. (biomedcentral.com)
One such advancement is the introduction of Biocash solutions, which have revolutionized the way researchers conduct experiments and analyze data. (raisinrats.com)
These costs are mainly considered from a U.S. perspective, even though it is important to remember that research misconduct and DRPs are global phenomena and that their costs are borne by researchers, institutions, funding agencies, and journals around the world. (nationalacademies.org)
The question of whether researchers can estimate the reproducibility of published findings has been studied in replication initiatives in psychology (see also this ), economics and social sciences , and the answer is that they are reasonably good at it. (bmj.com)
With this in mind, we are recruiting experimental researchers to predict the probability that the results will be replicated - as well as to explain the reasons for their predictions! (bmj.com)
Our prediction project started last November, with 44 researchers performing a total of 880 predictions on 60 experiments (with 1259 trades in the prediction markets). (bmj.com)
Participation involves around 2 hours of work, distributed over a 4-week period, in which researchers will make predictions on experiments using one of the methods included in the Initiative (MTT assay, RT-PCR or elevated plus maze). (bmj.com)
If there are too many research grants chasing too few research areas, together with a socio-psychological environment in which researchers are incentivized to streamline their research, you get a cocktail where fashions and hype may damage scientific truth and explanation. (lse.ac.uk)
Researchers that continued to work on the topic have claimed that over the years many successful replications have been made, but still have problems getting reliable replications.Reproducibility is one of the main principles of the scientific method, and its lack led most physicists to believe that the few positive reports could be attributed to experimental error. (documentaryheaven.com)
Some cold fusion researchers who claim that they can consistently measure an excess heat effect have argued that the apparent lack of reproducibility might be attributable to a lack of quality control in the electrode metal or the amount of hydrogen or deuterium loaded in the system. (documentaryheaven.com)
Ultra-dilute homeopathic medicines have been shown to exert various effects on various living cells and organisms in vitro , but the problem researchers are currently facing is that when an experiment is repeated multiple times (especially by teams in different laboratories across the world) the results are not always consistent. (hri-research.org)
KRAWCZYK and REUBEN, 2012 KRAWCZYK, Michal and REUBEN, Ernesto (2012), (Un) Available upon request: field experiment on researchers' willingness to share supplementary materials. (scielo.br)
In some cases, even the replication of ones own results is difficult for researchers. (lu.se)
The ultimate goal of easy reuse of software developed for a research project by a completely different group in a potentially very different computational environment is likely to far fetched, since in the end researchers are typically not software engineers. (lu.se)
Furthermore, we provide basic guidelines for the handover of research software projects that increase their lifetime, make their development more sustainable and enable researchers to find answers to their scientific challenges rather than reinventing the wheel writing yet another basic code for their communities favorite academic toy problem. (lu.se)
The main cause attributed to the observations described above is a publication and incentive system that rewards the impact and novelty of scientific findings, but does not systematically assess their reproducibility, which is rarely considered in the evaluation of researchers (14,15). (bvsalud.org)

We present the Lifelong Database of Experiments (LDE) that automatically extracts and stores linked metadata from experiment artifacts and provides features to reproduce these artifacts and perform meta-learning across them. (ibm.com)
Then, we perform two experiments on this metadata: 1) examining the reproducibility and variability of the performance metrics and 2) implementing a number of meta-learning algorithms on top of the data and examining how variability in experimental results impacts recommendation performance. (ibm.com)
In order to 'debug' experiments, scientists must correlate data and metadata from various sources, such as cold storage parameters, process parameters, etc. (massbio.org)
The lack of standards, incomplete metadata, and missing original data make it nearly impossible to reproduce published results. (uni-stuttgart.de)
Management activities to annotate (produce metadata), scrub data and maintain research data (including software code, where it is necessary for interpreting the data itself) for initial use and later reuse. (rsc.org)

Reproducibility is a cornerstone of science, and the development of new drugs and medical treatments relies on the results of preclinical research being reproducible. (elifesciences.org)
This hampers the translation of preclinical research findings to humans and wastes animals. (parliament.uk)

In a recent paper published in the journal Nature Methods, MISpheroID investigators, including Prof Neil Carragher and Dr John Dawson from Cancer Research UK Edinburgh Centre, describe development of MISpheroID: a knowledgebase and transparency tool for minimum information in spheroid identity . (ed.ac.uk)
Transparency and Open Science: We welcome submissions that promote or demonstrate open science practices, including data sharing, preregistration of studies, and submission of a study protocol, to ensure the reproducibility of research. (biomedcentral.com)
The scholarly interest in transparency, reproducibility and replication has been rising recently, with compelling evidence that many scientific studies have failed to be replicated (GOODMAN, FANELLI and IOANNIDIS, 2016). (scielo.br)

However, too often, resources (e.g. model organisms, antibodies, and tools) are not reported with adequate detail to ensure others can replicate or expand upon the published results. (mmpc.org)
[7] Another drug company, Amgen, could only replicate 6 out of 53 "landmark" studies in cancer research. (rationalwiki.org)
Between 2011 and 2012, pharmaceutical companies Bayer and Amgen released data from internal attempts to replicate experiments from the academic literature. (bvsalud.org)

However, good scientific practice requires research results to be reproducible, experiments to be repeatable and methods to be reusable. (copernicus.org)
For this to occur efficiently, each piece of acquired knowledge must be robust and reliable, which in turn involves performing reproducible experiments, observations, and analyses. (bvsalud.org)

We are able to aggregate data from various sources and correlate experimental results to relevant inputs such as material storage, environmental parameters, time-dependencies, etc. (massbio.org)
EnzymeML documents are structured and standardized, therefore the experimental results encoded in an EnzymeML document are interoperable and reusable by other groups. (uni-stuttgart.de)
Credits can later be redeemed as Amazon gift cards according to prediction success once experimental results are in. (bmj.com)

There is a lost opportunity to document these experiments and learn from them at scale, but the complexity of tracking and reproducing these experiments is often prohibitive to data scientists. (ibm.com)
This allowed research teams to run experiments and ask questions of these simulations similar to social scientists studying real-world systems, and enabled robust evaluation of their causal inference, prediction, and prescription capabilities. (sandia.gov)
Fed by too-trite tales of simple linear progressions from observation to theory to observation to better theory taught in school, as well as media portrayals of scientists as finding answers fast, most people seem to think that science is able to generate results virtually on demand. (scienceblogs.com)
This seamless integration between financial transactions and biological research not only accelerates the pace of experimentation but also facilitates knowledge sharing among scientists globally. (raisinrats.com)
Through secure digital payment systems integrated with research platforms and scientific journals, scientists can conveniently share their findings with colleagues across different institutions without geographical limitations or administrative hurdles. (raisinrats.com)

For the findings of a study to be reproducible means that results obtained by an experiment or an observational study or in a statistical analysis of a data set should be achieved again with a high degree of reliability when the study is replicated. (wikipedia.org)
A related problem is the lack of objective statistical validation in reporting modeling results, a very important topic that has been highlighted recently . (fieldofscience.com)
Even when protocols are supposedly accurately described, the absence of error bars or statistical variation means that one can get a different result even if the original recipe is meticulously followed. (fieldofscience.com)
Technically, a "statistically significant" result only means that if there were no real phenomena being observed (the "null" hypothesis) then the statistical test result - or something more extreme - would be unlikely. (hubbardresearch.com)
Improving Methodological Rigor: We are looking for research papers or study protocols that address the enhancement of experimental design, statistical analysis, and adherence to ethical guidelines, with a focus on minimizing biases and improving the robustness of findings. (biomedcentral.com)
These include indicators of methodological rigor such as randomisation and blinding, which are widely thought to reduce risk of bias , as well as effect sizes and statistical results - which have been shown to correlate with reproducibility in psychology studies . (bmj.com)
Psychology results evaporate upon further review: Surprising reports, findings with marginal statistical significance least likely to be reproduced, study concludes by Bruce Bower (2:00pm, August 27, 2015) Science News . (rationalwiki.org)
W he re training on experimental design and statistical analysis is available to research ers , the training is often not tailored to tackle issues that are s pecific to animal experiments. (parliament.uk)
As a result, researcher s often have a poor understanding of the importance of rig orous experimental design and the implications of the statistical tests used to analyse the results. (parliament.uk)

By using the published descriptions to reconstruct how the outputs were manipulated, I expected to reproduce and corroborate the results. (intarch.ac.uk)
So why are results from scientific experiments so difficult to reproduce? (massbio.org)
Yet across numerous fields like psychology, computer systems, and water resources there are great problems to reproduce research results. (copernicus.org)
Concerns have recently increased that the integrity of some scientific research is questionable due to the inability to reproduce the claimed results of some experiments and thereby confirm that the original researcher's conclusions were justified. (researchgate.net)
Of course, reproducibility alone is not enough when even random numbers can reproduce prior results. (rationalwiki.org)
This is important to the NC3Rs mission as it ensures that studies use the minimum number of animals consistent with the scientific aims, and that findings are robust and truly add to the knowledge base thus avoiding animals being used unnecessarily, including in subsequent experiments that build on , or aim to reproduce , the original findings. (parliament.uk)
In 1989, after Fleischmann and Pons had made their claims, many research groups tried to reproduce the Fleischmann-Pons experiment, without success. (documentaryheaven.com)

Another explanation is that scientific research findings are not reproducible. (massbio.org)
If the research is meant to inform corporate or public decisions (it is certainly often used that way) then it should be able to tell us the probability that the findings are true. (hubbardresearch.com)
Our findings reflect the importance of clonal isolation in identifying constituents of mixed infections containing new or emerging strains and of viable clones for research to more fully understand the dynamics of in vivo strain-mixing, evolution, and disease pathogenesis. (cdc.gov)
By doing so, we not only bolster the credibility of our findings but also uphold the ethical responsibility we bear toward the subjects of our research, be they animals or humans. (biomedcentral.com)
In recent years, data on the reproducibility of published findings in some areas of research has become available. (bvsalud.org)
In experimental psychology, several warning signs about the low reproducibility of published findings emerged in the early 2010s (7,8). (bvsalud.org)
Still, the available figures suggest that research findings, even if peer-reviewed and published in reputable journals, should not be necessarily assumed to be reproducible. (bvsalud.org)
Thus, the acceptance of an article, particularly in journals that are very selective for high-impact findings, ends up depending not only on the research's methods but also on its results. (bvsalud.org)

Boyle, a pioneer of the experimental method, maintained that the foundations of knowledge should be constituted by experimentally produced facts, which can be made believable to a scientific community by their reproducibility. (wikipedia.org)
Universities and research laboratories have geared their research strategies towards attracting money from investment-seeking foundations and research councils. (lse.ac.uk)

Without a stronger emphasis on reproducibility, the published datasets may not be sufficient to confirm published results and the scientific process of self-correction is at risk. (intarch.ac.uk)

In 2005, epidemiologist John Ioannidis analyzed published replications of highly cited articles in clinical research that presented either a higher level of methodological rigor or a higher sample size than the original articles. (bvsalud.org)

Design your experiment with sufficient controls (rigor) and replicates (reproducibility). (unc.edu)
Such assertions express a common dogma in modern science that reproducibility is a necessary condition (although not necessarily sufficient) for establishing a scientific fact, and in practice for establishing scientific authority in any field of knowledge. (wikipedia.org)
Areas of concern that emerged during the peer review process included the limited budget for in vivo experiments and, in some cases, the possibility that the scope of the proposed experiments might not be sufficient to adequately explore the reproducibility of the original studies. (elifesciences.org)
Nonetheless, sufficient documentation of how computational results have been obtained in experiments described in research publications is often not available. (lu.se)

1,500 3D spheroid experiments and provides a recommended minimum information for spheroid culture. (ed.ac.uk)

The solution lies in embracing open science principles and adhering to reporting standards like ARRIVE (Animal Research: Reporting of In Vivo Experiments). (biomedcentral.com)

The original plan was to conduct 50 replications but some had to be dropped for budget reasons, and a small number of Registered Reports did not make it through peer review as reviewers decided that it would not be possible to draw meaningful conclusions from the proposed experiments. (elifesciences.org)
CONCLUSIONS: Exploration of the natural experiments such that occurred in Anchorage, Granville County, New York City, and Philadelphia is the beginning of our understanding of the drivers and contextual factors that may affect childhood obesity. (cdc.gov)

In catalytic sciences, as in all scientific fields, we face a rapidly increasing volume and complexity of research data, which are a challenge for analysis and reuse. (uni-stuttgart.de)

The existence of such data did not alter the efforts of the Reproducibility Project to independently assess the reproducibility of the original studies. (elifesciences.org)
Whether reproducibility can be accurately estimated from published information has major implications not only for choosing what to believe or what is worth replicating, but also for how we assess and fund science. (bmj.com)
This method is already an established technique in agricultual/horticultural research e.g. being used to assess the effects of fertilisers. (hri-research.org)

Document all steps , reagents, equipment and data analysis methods used in the experiment. (unc.edu)
With a narrower scope, reproducibility has been introduced in computational sciences: Any results should be documented by making all data and code available in such a way that the computations can be executed again with identical results. (wikipedia.org)
Obtaining the same results when analyzing the data set of the original study again with the same procedures, many authors use the term reproducibility in a narrow, technical sense coming from its use in computational research. (wikipedia.org)
While these experiments highlight some successes, they also point to significant problems in reproducing an analysis at various stages, from reading the data to plotting the results. (intarch.ac.uk)
Consequently, this article proposes some guidance on how to increase the reproducibility of data in order to assist aspirations of refining results or methodology. (intarch.ac.uk)
EnzyemML serves as a format to comprehensively report the results of an enzymatic experiment and stores the data in a structured way and makes it traceable and reusable. (uni-stuttgart.de)
Even managing your own data manually is time-consuming and error-prone, but accessing and re-analyzing data from other research groups is almost impossible. (uni-stuttgart.de)
What also complicates matters in this area is the fact that data describing enzymatic experiments is particularly complex, because an enzymatic reaction depends on many factors, such as the protein sequence of the enzyme, the recombinant host organism, the reaction conditions, and non-enzymatic secondary reactions. (uni-stuttgart.de)
The new, standardized data exchange format "EnzymeML", presented by 23 authors from 14 different research institutions in the scientific journal "Nature Methods" gives hope in this respect. (uni-stuttgart.de)
EnzymeML can completely record the results of an enzymatic experiment, from the reaction conditions to the measured data, as well as the kinetic model used to analyze experimental data and the estimated kinetic parameters. (uni-stuttgart.de)
Because an EnzymeML document is machine-readable, it can be used in an automated workflow to store, visualize, and analyze data, as well as reanalyze previously published data, with no restrictions of the size of each data set, or the number of experiments. (uni-stuttgart.de)
Furthermore, digitalization improves the reproducibility of experiments and data analyses, thus promoting trust in scientific results. (uni-stuttgart.de)
EnzymeML is also used in research projects within the Collaborative Research Center "Molecular Heterogeneous Catalysts in Confined Geometries" ( SBF 1333 ) and the Cluster of Excellence "Data-Integrated Simulation Science" (SimTech) at the University of Stuttgart, and is also incorporated into the German National Research Data Infrastructures NFDI4Cat and NFDI4Chem . (uni-stuttgart.de)
Reproducibility, a cornerstone of research, requires defined data formats, which include the setup and output of experiments. (nih.gov)
The real-time PCR data markup language (RDML) is a recommended standard of the minimum information for publication of quantitative real-time PCR experiments guidelines. (nih.gov)
But several centers across the country, including the University at Buffalo's National Center for Ontological Research (NCOR), are working to develop ontologies to assist in the efforts to control the current outbreak, accelerate data discovery in future pandemics, and promote reproducible infectious disease research, according to Smith, director of NCOR. (buffalo.edu)
We tested three hypotheses about research effectiveness using data from the ground truth program, specifically looking at the influence of complexity, causal understanding, and data collection on performance. (sandia.gov)
We found some evidence that system complexity and causal understanding influenced research performance, but no evidence that data availability contributed. (sandia.gov)
Primary components of GDSA Framework include PFLOTRAN to simulate the major features, events, and processes (FEPs) over time, Dakota to propagate uncertainty and analyze sensitivities, meshing codes to define the domain, and various other software for rendering properties, processing data, and visualizing results. (sandia.gov)
Conducting a research and investigation process, specifically performing the experiments, or data/evidence collection. (rsc.org)
In other words, we have to have to be able to determine a probability the hypothesis is true before the research (experiment, survey, etc.) and then update it based on the data. (hubbardresearch.com)
It is possible for invalid or incomplete results to be presented on the MMPC web site due to software bugs, data problems, or artifacts of human error. (mmpc.org)
Bushell, who, along with NCSA Director William Gropp, serves on the Alliance's Executive Committee, said NCSA not only collaborates directly with Mayo Clinic colleagues but also supports research efforts between UIUC faculty and Mayo Clinic by providing computation and data science expertise when needed. (illinois.edu)
Gordon is a consultant in emergency medicine and a National Institute of Health Research fellow in health data science. (sheffield.ac.uk)
He has subsequently been awarded NIHR Doctoral Research Fellowship, NIHR Clinical Trials Fellowship, and NIHR clinical lecturer posts at the University of Sheffield, prior to his current academic role as a NIHR health data science fellow. (sheffield.ac.uk)
Research in neuroscience, graphene, artificial intelligence or big data, to mention a few, have attracted massive investments as well as tremendous expectations. (lse.ac.uk)
Enabling reproducibility and sharing of experiments across data science team members is another area that will be advantageous to those trying to get their projects to production-grade. (cio.com)
Because the instrument collects data on all ions, the approach offers better reproducibility across samples than DDA approaches. (genomeweb.com)
However, some sources propose different uses of the two terms to distinguish the reproducibility of analyses based on the same data from those based on new experiments or observations (3). (bvsalud.org)
These tests, however, are usually applied flexibly after data collection and examination, and end up being reported selectively according to the results found (18,19). (bvsalud.org)
Compared with GYTS data edits, the do-nothing and gatekeeper approaches produced similar estimates, whereas the global approach resulted in lower estimates and the preponderance approach, higher estimates. (cdc.gov)
Posters may address examples of any of the various ways of engaging in open science, such as open access publishing, sharing methods and analytical tools for making (meta)data, data products, and research outputs more Open and FAIR, projects that involve the public, citizen science, open science skills and education, or other facets of open science. (lu.se)

the scientific effect found in the original experiment may be real and the failed replication may be due to chance, or due to differences in methodology. (rationalwiki.org)
Obtaining the same or similar results using different methodology does, however, increase confidence in the results. (rationalwiki.org)
This is due to the lack of software development education outside computer science, and would require a whole new infrastructure with positions for research software engineers, having enough knowledge about the field to understand the methodology, but also being educated in modern software development strategies. (lu.se)
RESULTS/DISCUSSION: The primary result of the COBD project is an in-depth examination of the question, 'What happened and how did it happen in communities where the prevalence of obesity declined' The primary aim of this article is to describe the project's methodology and present its limitations and strengths. (cdc.gov)

Nowadays, almost all of Gore Japan's engineers use JMP to plan and implement efficient design of experiments (DOE). (jmp.com)

There are plenty of natural language processing experiments. (zdnet.com)

Additionally, because precursors are selected stochastically, the same proteins may not be measured in different experiments, which negatively impacts reproducibility. (genomeweb.com)

We believe that this kind of openness is the way that all good, scholarly scientific research should be conducted. (cam.ac.uk)

The first to stress the importance of reproducibility in science was the Irish chemist Robert Boyle, in England in the 17th century. (wikipedia.org)
A recent issue of Science has an article discussing an issue that has been a constant headache for anyone involved with any kind of modeling in drug discovery - the lack of reproducibility in computational science. (fieldofscience.com)
The ground truth program used simulations as test beds for social science research methods. (sandia.gov)
The ground truth program may be the first robust coupling of simulation test beds with an experimental framework capable of teasing out factors that determine the success of social science research. (sandia.gov)
The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Spent Fuel & Waste Disposition (SFWD) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). (sandia.gov)
A central tenant of modern science is that experiments must be reproducible. (hubbardresearch.com)
It aims to foster a debate on open science, lower the bar for engaging in open science and showcase examples, including software and other instruments for assisting open research. (copernicus.org)
Science and engineering rest on the concept of reproducibility. (copernicus.org)
In this presentation, I identify reasons for low reproducibility in science. (copernicus.org)
Finally, I advance a vision for what our future reproducible science should look like and I ask each attendee to identify and commit to take at least one step to make their research results more reproducible. (copernicus.org)
The goal of Project InnerEye is to democratize AI for medical image analysis and empower developers at research institutes, hospitals, life science organizations, and healthcare providers to build their own medical imaging AI models using Microsoft Azure. (microsoft.com)
The aim of the Reproducibility Project: Cancer Biology, which is a collaboration between the Center for Open Science and Science Exchange, is two-fold: to provide evidence about reproducibility in preclinical cancer research, and to identify the factors that influence reproducibility more generally. (elifesciences.org)
BMC Veterinary Research invites submissions to our Collection on Responsible research in animal science. (biomedcentral.com)
Dr O'Connor has been a leader in veterinary science to translate research into practice by reducing research wastage and maximizing the value of research. (biomedcentral.com)
Dr O'Connor has been instrumental in developing and applying research synthesis methods, including network-meta-analysis in veterinary science. (biomedcentral.com)
This special collection encompasses a multifaceted approach to ensure the highest standards in animal science research. (biomedcentral.com)
We welcome contributions that discuss novel strategies and innovations in applying the 3Rs to animal science research, including alternatives to animal models, reduced animal use, and refined research methodologies. (biomedcentral.com)
Some NSF awards in its Science and Society grants program go toward efforts related to research integrity. (nationalacademies.org)
Awareness of reproducibility issues in various areas of science has been on the rise in recent years, with systematic replication efforts in areas such as psychology , economics , cancer biology and social sciences arising in recent years. (bmj.com)
Overhyped and concentrated investments in research funding are leading to unsustainable science bubbles. (lse.ac.uk)
No one with even a passing interest in science and technology has failed to notice the past decade's massive investments in a select handful of new research fields. (lse.ac.uk)
The generous provision of funding for a select group of research areas creates the first condition for a science bubble to propagate. (lse.ac.uk)
Experiment replication attempts are part of the philosophy of good science. (rationalwiki.org)
Estimating the reproducibility of psychological science by B. A. Nosek et al. (rationalwiki.org)
Response to Comment on "Estimating the reproducibility of psychological science" , Anderson et al. (rationalwiki.org)
She joined the Department of Computer Science at Karlstad University, Sweden, in 1996, where she is currently a Full Professor and Research Manager for the Distributed Systems and Communications Research Group. (kau.se)
In response, a group of powerful physicists, heavily reliant upon government funding for their hot fusion research, leveled an unprecedented smear campaign against Pons, Fleishman and the entire field of Cold Fusion science. (documentaryheaven.com)
The Behavioral Science Committee (BSC) of the Children's Oncology Group (COG), comprised of psychologists, neuropsychologists, social workers, nurses, physicians, and clinical research associates, aims to improve the lives of children with cancer and their families through research and dissemination of empirically supported knowledge. (bvsalud.org)
The process of verification and correction of published science, however, occurs in a non systematic way, which means that reproducibility is not guaranteed by scientific publication in its current format. (bvsalud.org)
Have you engaged in open science practices in your research project? (lu.se)
Open Science is ascribed increased importance by multiple actors in the research communities for facilitating dialogue between academia and society. (lu.se)
The event is organised by the European Science Cluster of Environmental Research Infrastructures (the ENVRIs) and will highlight the main achievements of the ENVRI community and their significance for the society. (lu.se)

The use of 3-dimensional (3D) in vitro models to more faithfully recapitulate in vivo tumour biology within the laboratory is accelerating rapidly as a result of advances in 3D bioprinting, tissue organoids, microfluidic and automated high content confocal screening technologies. (ed.ac.uk)
Increasingly, isolates representing single clones are needed for in vitro and in vivo research, including genomic, murine, and translational studies, to advance our understanding of chlamydial pathogenesis. (cdc.gov)
Indeed, we have recently started a new initiative to develop reporting principles for in vitro research (working title RIVER - Reporting In Vitro Experiments Responsibly). (parliament.uk)

Manufacturing processes must also be 'debugged' to achieve reproducibility and optimize yield. (massbio.org)

Uta Frith, keynote speaker at our BNA2019 Festival of Neuroscience explains, 'Reproducibility relies on information being available for anyone to repeat an experiment. (bna.org.uk)
Earlier this year, we were delighted to announce that the Gatsby Charitable Foundation has awarded the BNA £450,000 funding to help us develop a significant programme of activities, promoting and supporting credibility in neuroscience research over the next ten years. (bna.org.uk)
This year's Festival of Neuroscience included a special workshop on safeguarding credibility and reproducibility in neuroscience. (bna.org.uk)
Taking as an example the overwhelming investments in neuroscience, such high expectations may actually drain the research system from resources and new ideas. (lse.ac.uk)

The Research Resource Identification Initiative (#RII) seeks to change these limitations in reporting by the use of unique Research Resource Identifiers (RRIDs). (mmpc.org)
This initiative is designed to encourage authors to provide identification of the types of resources used in their research by adding a globally unique accession number to the resources described in the their manuscripts. (mmpc.org)
Olavo Amaral is an associate professor at the Institute of Medical Biochemistry Leopoldo de Meis, at the Federal University of Rio de Janeiro and project coordinator of the Brazilian Reproducibility Initiative. (bmj.com)

The experiments in the Reproducibility Project are typically powered to have an 80% probability of reproducing something that is true: this means that if we attempt to repeat three experiments from a paper, there is only a ~50% chance that all three experiments will yield significant p values, even if the original study was reproducible. (elifesciences.org)
With it, engineers can easily run experiments that yield critical insight into the optimal combination of factors affecting product quality. (jmp.com)

formulation or evolution of overarching research goals and aims. (rsc.org)

Consult with a statistician if you need help developing a Power Analysis to assure that your results will be adequately powered. (unc.edu)

The lack of assay standards and consistency in 3D tumour spheroid protocols has hampered inter-laboratory reproducibility and interpretation of results from the published literature. (ed.ac.uk)
The results of the experiments are then published as a Replication Study, irrespective of the outcome, but subject to peer review to check that the designs and protocols contained in the Registered Report were followed. (elifesciences.org)

Only after one or several such successful replications should a result be recognized as scientific knowledge. (wikipedia.org)
The air pump, which in the 17th century was a complicated and expensive apparatus to build, also led to one of the first documented disputes over the reproducibility of a particular scientific phenomenon. (wikipedia.org)
05" refers to the "significance test", ubiquitous in scientific research. (hubbardresearch.com)
The article I authored with Alicia Carriquiry (Distinguished Professor of Statistics at Iowa State University) is titled Quality Control for Scientific Research: Addressing Reproducibility, Responsiveness, and Relevance . (hubbardresearch.com)
Many who have been using scientific research to make major decisions would be surprised to learn that the "Null Hypothesis Significance Test" (NHST) does not actually tell us that. (hubbardresearch.com)
To have lasting impact on the scientific community and broader society, hydrologic research must be open, accessible, reusable, and reproducible. (copernicus.org)
At the BMC Series , our primary focus, however, is not on the potential impact or interest of a study, but rather on ensuring that the research submitted and published in our journals is reliable, valid, and contributes to the broader scientific understanding of its field. (biomedcentral.com)
As we continue to witness technological advancements in this domain, it is evident that Biocash solutions will continue to revolutionize biological research and drive scientific discoveries forward. (raisinrats.com)
It is key that the public, who directly and indirectly provide the money to fund our research efforts and who are our most important ambassadors in advocating for the importance of scientific investigation, are confident of the processes we have in place. (nationalacademies.org)
Neuroimaging, for example, is one among several research areas that is driven by a strong economics of scientific promise. (lse.ac.uk)
Whether or not the expectations will be realized, research funding is framed with expectations that new scientific projects will lead to greater explanatory power and eventually translate into jobs and growth. (lse.ac.uk)
Reproducibility is a key part of the scientific method and refers to the possibility of reproducing an experimental result by a third party following the same procedures as the original experimenter. (rationalwiki.org)
Having the experiment repeated by an independent investigator reduces the impact of a single study's experimental error and increases the chances of the hypothesis being accepted by the scientific community. (rationalwiki.org)
Scientific experiments can also lack reproducibility, [2] but this just indicates either that the original experiment was flawed, that a better understanding of the problem is needed, or it is something that for its nature happens very often. (rationalwiki.org)
Dr Stephan Baumgartner, HRI Scientific Advisory Committee member, has published the results of his international collaboration, working on a possible solution to the problem of reproducibility when testing homeopathic medicines. (hri-research.org)
It should be noted that the reproducibility of a scientific finding can be defined in many ways, and that there is no consensus on the use of the terms "reproducible" and "replicable" (1,2). (bvsalud.org)
This leads to a literature that is full of positive and impacting results, but usually at the expense of selective or biased analyses and inflated effects, which distort our perception of the scientific problems under study (16). (bvsalud.org)

Chapter 10 discusses education in the responsible conduct of research (RCR), including topics such as human subjects protection. (nationalacademies.org)
This creates a problematic conflict of interest for the authors, as career advancement depends on obtaining particular results, biasing the conduct and the analysis of studies (17). (bvsalud.org)

However, currently there are no established 3D assay standards or best practice, as a result different laboratories are using different methods and reagents to perform 3D experiments, including thousands of drug screening studies in tumour spheroid assays. (ed.ac.uk)
Today, the method is used only note that the establishment of the standard in commercial systems using unit-dose was not based on results of an international reagents. (who.int)

It was even demonstrated that laypeople without a PhD in psychology show some accuracy in predicting reproducibility in these studies. (bmj.com)
[4] A large-scale replication project was published in 2015 of the results of replication attempts of original published psychology experiments from 2008. (rationalwiki.org)
among cognitive psychology experiments, only 21/41 (50%) replicated. (rationalwiki.org)
In 2015, the results of a large systematic replication of studies in cognitive and social psychology were released, which indicated success rates between 36% and 47% (9). (bvsalud.org)

A better interpretation would be "plausible" or perhaps "worth further research. (hubbardresearch.com)

In addition, through hypothesis-driven research and multidisciplinary collaborations, the BSC will also begin to prioritize initiatives to expand the systematic collection of predictive factors (e.g., social determinants of health) and psychosocial outcomes, with overarching goals of addressing health inequities in cancer care and outcomes, and promoting evidence-based interventions to improve outcomes for all children, adolescents, and young adults with cancer. (bvsalud.org)
We present a systematic comparison of the results from our non-equilibrium Green's function formalism with a large number of AlGaAs-GaAs terahertz quantum cascade lasers previously published in the literature. (lu.se)

This commitment to research integrity is driven by our recognition of the challenges authors encounter in their pursuit of excellence, which can sometimes inadvertently lead to questionable research practices, such as HARKING (Hypothesizing After the Results are Known) or p-hacking, as well as the pursuit of statistically significant but potentially fragile results. (biomedcentral.com)

Moreover, we lack any reproducibility-oriented dataset, which would allow us to develop such methods. (ku.dk)
One of the signs of pseudoscience is a lack of reproducibility in their experiments. (rationalwiki.org)
Various issues contribute to the lack of reproducibility of animal research. (parliament.uk)
Internal inconsistencies and lack of predictability and reproducibility remain serious concerns. (documentaryheaven.com)

It turns out that a surprisingly large proportion of published results in certain fields of research - especially in the social and health sciences - do not satisfy that requirement. (hubbardresearch.com)
In addition to advancing research and discovery in pure and applied mathematics, computation is pervasive across the sciences and now computational research results are more crucial than ever for public policy, risk management, and national security. (brown.edu)

Verification, whether as a part of the activity or separate, of the overall replication/reproducibility of results/experiments and other research outputs. (rsc.org)

Preparation, creation and/or presentation of the published work by those from the original research group, specifically critical review, commentary or revision - including pre- or post-publication stages. (rsc.org)
Since the publication of the original studies, published and unpublished results from other labs have suggested that a number of the studies are reproducible, but there is concern that some of them may not be reproducible. (elifesciences.org)
It is important to note that only selected experiments (or figures) from the original paper would be repeated, and in some cases these did not include key experiments in the original studies. (elifesciences.org)
If a replication reproduces some of the key experiments in the original study, and sees effects that are similar to those seen in the original in other experiments, we need to conclude that it has substantially reproduced the original study. (elifesciences.org)
The low reproducibility rates in some of these areas raise the question of whether irreproducible results can be predicted from particular features in the original publications. (bmj.com)

Scopus features tools to track, analyze and visualize research. (lu.se)

The purpose of this article is to delve into the contributions made by Biocash solutions in transforming biological research methodologies. (raisinrats.com)
In conclusion, Biocash solutions have significantly transformed biological research methodologies by integrating biotechnology with digital payment systems. (raisinrats.com)

As a result, they were able to make groundbreaking discoveries about the relationship between the microbiome and certain diseases. (raisinrats.com)

economics ( CHANG and LI, 2015 CHANG, Andrew C. and LI, Phillip (2015), Is economics research replicable? (scielo.br)

This chapter reviews the benefits and costs of improved approaches to addressing research misconduct and detrimental research practices and explores several new approaches considered by the committee. (nationalacademies.org)
We did a lot of tricks like staggering the isolation windows" to improve the performance of DIA approaches on Orbitrap instruments, MacCoss said, noting that he and his colleagues were able with such techniques to get results comparable to those achieved on other platforms. (genomeweb.com)

Any statistically significant result should be treated as a tentative finding awaiting further confirmation. (hubbardresearch.com)
If you would have run an experiment 100 times you would, by chance alone, get a statistically significant result in about 5 experiments at a significance level of .05. (hubbardresearch.com)
This might sound like a tested hypothesis with a statistically significant result has a 95% chance of being of being true. (hubbardresearch.com)

For over a decade, the Project InnerEye (opens in new tab) team at Microsoft Research Cambridge (opens in new tab) has been developing state-of-the-art machine learning methods for the automatic, quantitative analysis of three-dimensional medical images. (microsoft.com)
METHODS AND RESULTS: State-level policies were searched within the CDC's online Chronic Disease State Policy Tracking System. (cdc.gov)

During a NIHR Academic Clinical Fellowship he then worked with the Trauma Audit and Research Network and completed a MPH (awarded with distinction) specialising in Global Health. (sheffield.ac.uk)
Among them, the nonsteroidal anti-inflammatory drugs (NSAIDs) are probably the most studied medications, showing effective outcomes in controllingperiodontal breakdown in pre-clinical experiments when systemically administered 3-5 . (bvsalud.org)

One of the first lessons graduate students learn as they embark on their doctoral research is that early reports in the peer-reviewed literature are by their very nature tentative and have a high probability of ultimately being found to be incorrect-or, more often, only partially correct. (scienceblogs.com)

The 3Rs in Animal Research: Respect for the principles of Replacement, Reduction, and Refinement (the 3Rs) is fundamental in minimizing animal suffering in research. (biomedcentral.com)

Project InnerEye has been working closely with the University of Cambridge and Cambridge University Hospitals NHS Foundation Trust to make progress on this problem through a deep research collaboration. (microsoft.com)
Interpreting the first results from the Reproducibility Project: Cancer Biology requires a highly nuanced approach. (elifesciences.org)
The project is employing a Registered Report/Replication Study approach to publish its work and results. (elifesciences.org)
As a result of that first project, NCSA's Visual Analytics group began working with Mayo Clinic's Department of Laboratory Medicine and Pathology to develop a visual method of presenting a comprehensive diagnostic panel of 17 hereditary colon cancer genes. (illinois.edu)
Registrations to participate in the project are open until January 24th to anyone over 18 with experience in experimental research in an academic environment. (bmj.com)

Our response is not intended to imply that animal research suffers from reproducibility problems to a greater extent than other areas of research. (parliament.uk)
These surveys, however, are uncommon and restricted to specific research areas and sets of articles. (bvsalud.org)

Because the reliability and reproducibility of results obtained according to advance planning varies, it is necessary to draw up designs for experiments taking a variety of factors into consideration… after specifying what it is you want to know. (jmp.com)

The focus of this blog addresses the reproducibility problem. (massbio.org)

Anatomy9

Organisms1

Diseases3

Chemicals and Drugs9

Analytical, Diagnostic and Therapeutic Techniques and Equipment131

Psychiatry and Psychology14

Phenomena and Processes11

Disciplines and Occupations30

Anthropology, Education, Sociology and Social Phenomena16

Technology, Industry, Agriculture5

Humanities6

Information Science37

Named Groups3

Health Care63

Geographicals4

Crisis10

Replicability9

Biomedical6

Researchers26

Metadata5

Preclinical research2

Transparency3

Replicate3

Reproducible Experiments2

Experimental results3

Scientists5

Statistical9

Reproduce7

Findings8

Foundations2

Datasets1

Methodological Rigor1

Sufficient4

1,5001

Vivo experiments1

Conclusions2

Reuse1

Assess3

Data32

Methodology4

Design of Experime1

Natural language pr1

Impacts1

Scholarly1

Science32

Vitro3

Optimize1

Neuroscience4

Initiative3

Yield2

Aims1

Adequately1

Protocols2

Scientific17

Conduct2

Reagents2

Psychology4

Interpretation1

Systematic2

Questionable1

Lack4

Sciences2

Outputs1

Original5

Analyze1

Methodologies2

Discoveries1

Replicable1

APPROACHES2

Statistically3

Methods2

Clinical2

Probability1

Principles1

Project5

Areas2

Reliability1

Problem1