lack of reproducibility
- The new "Reproducibility of Research Results" module discusses factors that contribute to the lack of reproducibility and the resulting problems that can emerge. (citiprogram.org)
- The IAT is the subject of much controversy regarding precisely what it measures, and the lack of reproducibility of many of its results. (wikipedia.org)
reliability
- Reproducibility, reliability, and reuse of research results are becoming essential topics in the field of neuroscience. (frontiersin.org)
- ATCC biological standards are vital to assuring reliability of research results, reproducibility of experimentation, and consistency in the scientific method. (atcc.org)
- Accuracy Accuracy and precision Monitoring (medicine) Reliability (statistics) Reproducibility Types of Reliability The Research Methods Knowledge Base. (wikipedia.org)
Replicability
- To address this need, Language Resources and Evaluation (LRE) , the premier journal for publication of papers concerning resources that support HLT research as well as evaluation of both resources and results, is acting to encourage the discussion and advancement of what is commonly referred to as replicability and reproducibility in the field of Human Language Technology. (springer.com)
- It should be noted that despite efforts to distinguish reproducibility and replicability (e.g., by definig "levels" of reproducability Dalle ( 2012 )), the line between the two is not always clear. (springer.com)
- By establishing a special section on Replicability and Reproducibility, LRE is encouraging submissions of articles providing positive or negative quantitative assessment of previously published results in the field. (springer.com)
- A related concept is replicability, meaning the ability to independently achieve non identical conclusions that are at least similar, when differences in sampling, research procedures and data analysis methods may exist. (wikipedia.org)
reuse of research
- SHARE is a collaborative initiative of ARL, the Association of American Universities (AAU), and the Association of Public and Land-grant Universities (APLU) to ensure the preservation of, access to, and reuse of research findings and reports. (digital-scholarship.org)
empirical
- That is the main message of the Academy advisory report Replication studies - Improving reproducibility in the empirical sciences . (knaw.nl)
- However, recent problems with the reproducibility of empirical results in large-scale systems and in biomedical research have cast doubts on its universal and rigid applicability beyond the so-called basic sciences. (royalsocietypublishing.org)
replication
- For example, it has been shown that for some published results with major impact, replication of published results is difficult or impossible (e.g. (springer.com)
- In fact, several recent articles have reported on reproducibility and/or replication problems in the HLT field (e.g. (springer.com)
- 2015 ), and two recent workshops 1 have addressed the need for replication and reproduction of HLT results. (springer.com)
- Related to replication is reproducibility, which is the calculation of quantitative scientific results by independent scientist using the original datasets and methods. (springer.com)
- What is clear is that whether for the purposes of replication or reproduction of prior results, access to the resources, procedures, parameters, and test data used in an original work is critical to the exercise. (springer.com)
- The replication crisis, publication bias, p-hacking, harking, bad incentives, undesirable pressures and probably other factors all contribute to diminish the trustworthiness of published research, with obvious implications for research synthesis. (researchblogging.org)
- The Academy recommends that researchers, research institutions, funding agencies and scientific journals make a joint effort to facilitate replication studies, for example by requiring the proper storage of study data. (knaw.nl)
- The immediate motivation for this increased interest is to be found in a number of factors, including the realization that for some published results, their replication is not being obtained (e.g. (ul.pt)
- We are thus inviting submissions of articles that present pioneering cases, either with positive or negative results, of actual replication exercises of previous published results in our area. (ul.pt)
- We are interested also in articles discussing the challenges, the risk factors, the procedures, etc. specific to our area or that should be adopted, or adapted from other neighboring areas, possibly including of course the new risks raised by the replication articles themselves and their own integrity, in view of the preservation of the reputation of colleagues and works whose results are reported has having been replicated, etc. (ul.pt)
- I highly recommend anyone interested in results replication and research reproducibility read this. (epistasisblog.org)
stakeholders
- The module also describes the stakeholders affected by reproducibility problems, a collection of reproducibility initiatives, and strategies that can mitigate or prevent irreproducibility. (citiprogram.org)
- SHARE's first project, the Notification Service, will inform stakeholders when research results-including articles and data-are released. (digital-scholarship.org)
- Through these activities, BBEBP seeks to advance biomedical research, foster public knowledge, and engage key stakeholders in policy development. (wikipedia.org)
neuroscience
- Computational neuroscience is a rapidly developing field, where reproducibility and comparability of research results have gained increasing interest over the past years. (frontiersin.org)
- That is the message of a new analysis in Nature Neuroscience that shows that more than half of 314 articles on neuroscience in elite journals during an 18-month period failed to take adequate measures to ensure that statistically significant study results were not, in fact, erroneous. (scientificamerican.com)
- Consequently, at least some of the results from papers in journals like Nature, Science, Nature Neuroscience and Cell were likely to be false positives, even after going through the arduous peer-review gauntlet. (scientificamerican.com)
experimentation
- He was Director of the Central Institute for Experimental Animals (CIEA), Japan His most important achievement to date is the establishment of comprehensive animal experimentation systems using strictly defined laboratory animals to assure reproducibility of experimental results in medical research. (wikipedia.org)
- He has completely changed this out-dated paradigm in medical research by establishing comprehensive animal experimentation systems. (wikipedia.org)
- CIEA has developed animal experimentation systems based on the concept "scientific animal experiments with reproducible results can not be achieved unless the experiments are performed ethically with the animals maintained in a normal state. (wikipedia.org)
experiment
- In particular, reproducibility is an inevitable requirement for experiments in the natural sciences: each experiment must be repeatable at any time and at any place by any informed experimentalist in such a way that the experiment takes the same course under the same initial and boundary conditions. (royalsocietypublishing.org)
- The reproducibility of an experiment in the natural sciences includes the reproducibility of experimental setups and measuring instruments. (royalsocietypublishing.org)
- the extent to which an experiment, test, or measuring procedure yields the same result during independent, repeated trials. (thefreedictionary.com)
- One of the factors that affects the reproducibility of the results of animal experiments is the proximate environment in which the experiment is performed including the temperature and humidity of the animal room, the size of cages and caretakers. (wikipedia.org)
- However, for important results, other groups will try to repeat the experiment. (wikipedia.org)
cornerstone
- The concept of reproducibility is widely considered a cornerstone of scientific methodology. (royalsocietypublishing.org)
- The Declaration of Helsinki is widely regarded as the cornerstone document on human research ethics. (wikipedia.org)
experimental results
- Tatsuji Nomura (野村 達次, Nomura Tatsuji) M.D., Ph.D. (May 15, 1922 - January 11, 2013) was a pioneer in the development of laboratory animals with the aim of assuring reproducibility of experimental results in medical research. (wikipedia.org)
- This approach helped establish Artifact Evaluation at several ACM-sponsored conferences to encourage sharing of artifacts and validation of experimental results from accepted papers. (wikipedia.org)
different observers
- Statistics The extent to which the same test or procedure will yield the same result either over time or with different observers. (thefreedictionary.com)
- However the need for reproducibility requires that observations by different observers can be comparable. (wikipedia.org)
behavioral research
- The Belmont Report was created by the National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research to describe the ethical behaviors that involve researching human subjects. (wikipedia.org)
- By looking primarily at biomedical and behavioral research that involve human subjects, the report was generated to promise that ethical standards are followed during research of human subjects.There are three standards that serve as the baseline for the report and how human subjects are to be researched. (wikipedia.org)
- The CHRP Division is responsible for biomedical and behavioral research policy development in two program areas - clinical research policy and healthcare research policy. (wikipedia.org)
- Such prospective biomedical or behavioral research studies on human participants are designed to answer specific questions about biomedical or behavioral interventions, including new treatments (such as novel vaccines, drugs, dietary choices, dietary supplements, and medical devices) and known interventions that warrant further study and comparison. (wikipedia.org)
widely
- While focused on supporting and collaborating with the global research and scientific community, ATCC activities range widely, from repository-related operations to providing standard and specialized services, conducting in-house R&D, and intellectual property management. (atcc.org)
- Based on such systems, he has established international research collaborations to develop three animal models: Transgenic Polio Mice - Widely used in polio vaccine neurovirulence testing as a replacement for monkeys. (wikipedia.org)
- The IAT is now widely used in social psychology research and, to some extent, in clinical, cognitive, and developmental psychology research. (wikipedia.org)
findings
- The inability to reproduce findings from prior research, whether it is one's own study or a study conducted by other researchers, is a growing issue of concern for research communities. (citiprogram.org)
- Justice is important because it causes the researchers to be fair in their research findings and share what they have found, whether the information is good or bad. (wikipedia.org)
reproduce
- In addition, we were able to reproduce the original results of only one of the models completely based on the information given in the original publications and in the errata. (frontiersin.org)
- Ideally, research results are only worthy of attention, publication and citation if independent researchers can reproduce them. (royalsocietypublishing.org)
validity
- Clinical study design aims to ensure the scientific validity and reproducibility of the results. (wikipedia.org)
biomedical
- After some more general remarks in §2, we first document problems with reproducibility in basically three areas (§3): inanimate matter (physics, chemistry), living organisms (biomedical sciences) and mental processes (psychology, cognitive science, consciousness studies). (royalsocietypublishing.org)
- Established by the World Medical Association, the declaration recommended guidelines for medical doctors conducting biomedical research that involves human subjects. (wikipedia.org)
- NIH Office of Science Policy is the primary advisor to the Director of the NIH on matters of biomedical research policy issues that are of significance to the agency, the research community, and the public. (wikipedia.org)
Researchers
- The researchers note that some of the studies surveyed probably report false-positive results, although they couldn't extract enough information to quantify precisely how many. (scientificamerican.com)
- Reproducibility is the ability to get the same research results or inferences, based on the raw data and computer programs provided by researchers. (wikipedia.org)
Responsible Conduct of Research
- The module, written by Dr. Teri A. Hamill from Nova Southeastern University, is designed to complement the topical offerings in the Responsible Conduct of Research (RCR) Basic Course . (citiprogram.org)
- Introduces concepts and principles relating to what has come to be known as the Responsible Conduct of Research (RCR), and provides an overview of the subject matter covered in this course. (citiprogram.org)
computational
- As the number of computational models of brain functions is increasing, we chose to address reproducibility using four previously published computational models of astrocyte excitability as an example. (frontiersin.org)
experiments
- Russell and Burch proposed the term "dramatype" in 1959 from the standpoint of animal welfare (Reduction), but Dr. Nomura developed this concept to promote the importance of control of the environment to assure reproducibility of the results of animal experiments. (wikipedia.org)
- If the animals are not maintained in a normal state, reproducibility of results of experiments on animals as "living measuring instruments" cannot be assured. (wikipedia.org)
- Clinical trials are experiments or observations done in clinical research. (wikipedia.org)
describes
- The infrastructure school is tied closely with the notion of "cyberscience", which describes the trend of applying information and communication technologies to scientific research, which has led to an amicable development of the infrastructure school. (wikipedia.org)
Framework
- JASP also promotes open science by integration with the Open Science Framework and reproducibility by integrating the analysis settings into the results. (wikipedia.org)
discusses
- Discusses the ethical issues relating to collaborative research partnerships. (citiprogram.org)
data
- Recent headlines decry the alarming amount of irreproducible data in published research papers. (mbfbioscience.com)
- Our program included five symposia: "Getting to the Best Reaction: Tools for Finding a Needle in a Haystack," "Defining Value in Scholarly Communications," "Research Results: Reproducibility, Reporting, Sharing and Plagiarism," "Molecular and Structural 2D and 3D Chemical Fingerprinting," and "Development and Use of Data Format Standards for Cheminformatics. (acscinf.org)
- By the same token, this workshop is interested also on articles addressing methodologies for monitoring, maintaining or improving citation of language resources and tools and to assess the importance of data citation for research integrity and for the advancement of natural language science and technology. (ul.pt)
- Open science is the movement to make scientific research, data and dissemination accessible to all levels of an inquiring society, amateur or professional. (wikipedia.org)
- These include financial paywalls of for-profit research publishers, restrictions on usage applied by publishers of data, poor formatting of data or use of proprietary software that makes it difficult to re-purpose, and cultural reluctance to publish data for fears of losing control of how the information is used. (wikipedia.org)
- The current NIH Associate Director for Science Policy is Carrie D. Wolinetz, Ph.D. The NIH Office of Science Policy works on a wide range of issues including biosafety, biosecurity, genetic testing, genomic data sharing, human subjects protections, the organization and management of the NIH, and the outputs and value of NIH-funded research. (wikipedia.org)
- and, 2) the sharing and management of scientific data to promote reproducibility and translation of research results to advance science, medicine, and public health. (wikipedia.org)
- appendix D Practical explanation of repeatability and reproducibility in terms of how data can be different between samples. (wikipedia.org)
reproducible
- Such non-reproducible results impede scientific progress and are a waste of research funding. (knaw.nl)
- Before his concepts were applied, it was generally considered to be very difficult or even impossible to obtain reproducible results in medical research using laboratory animals, mainly due the traditional consensus that the animals are living organisms with individual differences. (wikipedia.org)
- The Collective Optimization Database is an important part of the Collective Tuning Initiative which is developing open-source R&D tools for collaborative and reproducible computing systems' research. (wikipedia.org)
phenomenon
- The air pump, which in the 17th century was a complicated and expensive apparatus to build, also led to one of the first documented disputes over the reproducibility of a particular scientific phenomenon. (wikipedia.org)
precisely
- Specifically, all necessary mathematical equations, as well as parameter values, initial values of variables, and stimuli used should be given precisely for successful reproduction of scientific results. (frontiersin.org)
Conduct
- Specific activities include optimizing the conduct and oversight of gene transfer research, updating and interpreting biosafety policies under the NIH Guidelines for Research Involving Recombinant and Synthetic Nucleic Acids, collaborating with Federal partners to develop and implement U.S. government policies regarding dual use research, and managing the NIH Stem Cell Registry. (wikipedia.org)
disciplines
- The scientific community across all disciplines faces the same challenges of ensuring accessibility, reproducibility, and efficient comparability of scientific results. (frontiersin.org)
- Reporting directly to the Provost, the Director secures the support and resources necessary for providing outstanding innovative and creative collections and services across a broad range of research disciplines to a world-class scholarly community. (digital-scholarship.org)
consistent
- It yields a formally sound and empirically applicable procedure to translate between descriptive levels and thus construct level-specific criteria for reproducibility in an overall consistent fashion. (royalsocietypublishing.org)
- If repeated use of the same measurement tool on the same sample produces the same consistent results, the measurement is considered reliable. (thefreedictionary.com)
Science
- ATCC conducts independent research in support of its mission and utilizes the latest technology, such as Droplet Digital™ PCR, CRISPR, and Next Generation Sequencing to authenticate and develop quality products that drive innovation and standards in science. (atcc.org)
- Reproducibility in Language Science and Technology: Ready for the Integrity Debate? (ul.pt)
- The reproducibility of research results is one of the key cornerstones of scientific methodology-a gold standard for science as it were. (royalsocietypublishing.org)
- It encompasses practices such as publishing open research, campaigning for open access, encouraging scientists to practice open notebook science, and generally making it easier to publish and communicate scientific knowledge. (wikipedia.org)
- The European-funded project Facilitate Open Science Training for European Research (FOSTER) has developed an open science taxonomy as an attempt to map the open science field. (wikipedia.org)
- To show the term's multitudinous perceptions, they differentiate between five Open Science schools of thought: The infrastructure school is founded on the assumption that "efficient" research depends on the availability of tools and applications. (wikipedia.org)
- However, in science, a very well reproduced result is one that can be confirmed using as many different experimental setups as possible and as many lines of evidence as possible (consilience). (wikipedia.org)
- The first to stress the importance of reproducibility in science was the Irish chemist Robert Boyle, in England in the 17th century. (wikipedia.org)
- Such assertions express a common dogma in modern science that reproducibility is a necessary condition (although not necessarily sufficient) for establishing a scientific fact, and in practice for establishing scientific authority in any field of knowledge. (wikipedia.org)
- Human subject research can be either medical (clinical) research or non-medical (e.g., social science) research. (wikipedia.org)
- The continued success of tissue engineering, and the eventual development of true human replacement parts, will grow from the convergence of engineering and basic research advances in tissue, matrix, growth factor, stem cell, and developmental biology, as well as materials science and bio informatics. (wikipedia.org)
- In some specific fields of science the results of observation differ depending on factors which are not important in everyday observation. (wikipedia.org)
- His doctoral research included a paper titled, "A Mechanisms and Kinetics Study of Polymeric Thin-film Deposition in Glow Discharge" that was published later in the Journal of Macromolecular Science - Chemistry (1976). (wikipedia.org)
systematic
- Play media Human subject research is systematic, scientific investigation that can be either interventional (a "trial") or observational (no "test article") and involves human beings as research subjects. (wikipedia.org)
- citation needed] Next to unintentional but possibly systematic error, there is always the possibility of deliberate misrepresentation of scientific results, whether for gain, fame, or ideological motives. (wikipedia.org)
study
- The Nature journals have instituted a checklist to help authors on reporting on the methods used in their research, a list that inquires about whether the statistical objectives for a particular study were met. (scientificamerican.com)
- In addition, better research methods and more transparent study reporting will improve the reproducibility of research results. (knaw.nl)
principle
- Reproducibility of research results is a founding principle of scientific methodology. (frontiersin.org)
- To this end, the 3R (Replacement, Refinement, and Reduction of Animals in Research) principle proposed by Russell and Burch in 1959 was adopted. (wikipedia.org)
clinical research
- BMJ (Clinical research ed.). 298 (6689): 1659-1660. (wikipedia.org)
However
- However, there is no established venue for publications on the topic, and perhaps more problematically, research that investigates existing methods rather than introducing new ones is often implicitly discouraged in the process of peer review. (springer.com)
- However, as discussed in Howison and Herbsleb ( 2013 ), even though its importance is increasingly recognized, often not enough (academic) credit is given for making the code and resources used to produce a set of results available. (springer.com)
- In recent years, however, many existing results in medicine, the life sciences, psychology and other fields could not be reproduced. (knaw.nl)
improve
- The committee indicates that much can still be done to improve the quality and therefore the reproducibility of research. (knaw.nl)
- Dr. Nomura is currently Director of the Central Institute for Experimental Animals, Japan, that he founded in 1952, to improve the level of medical research. (wikipedia.org)
- Using common research-and-development tools should help to improve the quality and reproducibility of research into code, architecture design and optimization, encouraging innovation in this area. (wikipedia.org)
- The Collective Optimization Database is also intended to improve the quality and reproducibility of the research on code and architecture design, characterization and optimization. (wikipedia.org)
extent
- in research) the extent to which a test measurement or device produces the same results with different investigators, observers, or administration of the test over time. (thefreedictionary.com)
- The extent to which multiple measurements of the same thing, made on separate occasions, yield approximately the same results. (thefreedictionary.com)
problems
- Problems arise from not understanding the limits of objectivity in scientific research, especially when results are generalized. (wikipedia.org)
medicine
- and 2) the development and implementation of health care research, outcomes research, and evidence-based medicine. (wikipedia.org)
- Qigong practices were brought to the public beginning in the 1950s, when the Communist Party institutionalized and began research into traditional Chinese medicine. (wikipedia.org)
institutions
- Robust research: Institutions must do their part for reproducibility. (ox.ac.uk)
known
- It produces statistics that evaluate the ability of the appraisers to agree with themselves (repeatability), with each other (reproducibility), and with a known master or correct value (overall accuracy) for each characteristic - over and over again. (wikipedia.org)
methods
- Weak research methods, poor reporting and disincentives regularly lead to the same studies producing different results. (knaw.nl)
practice
- This course covers the core norms, principles, regulations, and rules governing the practice of research. (citiprogram.org)
- Gong (or kung) is often translated as cultivation or work, and definitions include practice, skill, mastery, merit, achievement, service, result, or accomplishment, and is often used to mean gongfu (kung fu) in the traditional sense of achievement through great effort. (wikipedia.org)
aims
- SHARE aims to make research assets more discoverable and more accessible, and to enable the research community to build upon these assets in creative ways. (digital-scholarship.org)
citation
- That is the topic of the reproducibility of research results and the citation of resources, and its impact on research integrity. (ul.pt)
- citation needed] It is thus intimately related to the aim of testability and reproducibility. (wikipedia.org)
- citation needed] Various scientific processes, such as peer reviews, the discussions at scientific conferences, and other meetings where scientific results are presented, are part of a social process whose purpose is to strengthen the objective aspect of the scientific method. (wikipedia.org)
collaborative
- This course provides an in-depth review of the core RCR topics including authorship, collaborative research, conflicts of interest, human subjects, and research misconduct. (citiprogram.org)
- The Director is expected to leverage an increasingly networked and collaborative information environment as an important partner with MIT's academic and administrative units to advance the Institute's research, teaching, and global agendas in alignment with its mission and values. (digital-scholarship.org)
- The Collective Tuning Initiative is a community-driven initiative started by Grigori Fursin to develop free collaborative open-source research tools with unified API for code and architecture characterization, optimization and co-design. (wikipedia.org)
social sciences
- On the other hand, human subject research in the social sciences often involves surveys which consist of questions to a particular group of people. (wikipedia.org)
produces
- JASP generally produces APA style results tables and plots to ease publication. (wikipedia.org)
- The mutagen produces mutations in the DNA, and deleterious mutation can result in aberrant, impaired or loss of function for a particular gene, and accumulation of mutations may lead to cancer. (wikipedia.org)
studies
- I have always believed that it is unrealistic to expect research results to replicate across studies when the underlying biology is complex. (epistasisblog.org)
- Medical human subject research often involves analysis of biological specimens, epidemiological and behavioral studies and medical chart review studies. (wikipedia.org)
issue
- The issue of reproducibility of research results has preoccupied the editors of many top journals in recent years. (scientificamerican.com)
- Reproducibility is a particularly difficult issue in interdisciplinary work where the results to be reproduced typically refer to different levels of description of the system considered. (royalsocietypublishing.org)
comparable
- Additionally, we studied how well the selected models can be reused and whether they are comparable in other stimulation conditions and research settings. (frontiersin.org)
process
- reproducibility means that the process of establishing a fact, or the conditions under which the same fact can be observed, is repeatable. (royalsocietypublishing.org)
- Measurement reduces an observation to a number which can be recorded, and two observations which result in the same number are equal within the resolution of the process. (wikipedia.org)
- One problem encountered throughout scientific fields is that the observation may affect the process being observed, resulting in a different outcome than if the process was unobserved. (wikipedia.org)
- So any interaction between an isolated wave function and the external world that results in this wave function collapse is called an observation or measurement, whether or not it is part of a deliberate observation process. (wikipedia.org)
- Moreover, well-intentioned operators without authority often changed process settings that affected etch results. (wikipedia.org)
- Given that the object selection and measurement process are typically subjective, when results of that subjective process are generalized to the larger system from which the object was selected, the stated conclusions are necessarily biased. (wikipedia.org)
FOSTER
- This workshop seeks to foster the discussion and the advancement on a topic that has been so far given insufficient attention in the research area of language processing tools and resources (Branco, 2013, Fokkens et al. (ul.pt)
regulate
- The Declaration of Helsinki was established in 1964 to regulate international research involving human subjects. (wikipedia.org)
- Artificial pancreas: research involves using islet cells to produce and regulate insulin, particularly in cases of diabetes. (wikipedia.org)
made
- 2015), to the point that it has recently crossed the borders of the research world and made its appearance in important mass media and was brought to the attention of the general public (e.g. (ul.pt)
- Boyle, a pioneer of the experimental method, maintained that the foundations of knowledge should be constituted by experimentally produced facts, which can be made believable to a scientific community by their reproducibility. (wikipedia.org)
problem
- But for much of the current scientific literature reproducibility has become a serious problem. (royalsocietypublishing.org)
- The present essay addresses one specific question concerning the problem of reproducibility-the question of which properties of a system in a given context are actually relevant for its description and should thus be taken as the target to be reproduced. (royalsocietypublishing.org)
- Open research computation also addresses the problem of reproducibility of scientific results. (wikipedia.org)
academic
- As a result, there is an increasingly urgent call for validation and verification of published research results, both within the academic community and the public at large (e.g. (springer.com)
- As research has become formalized, the academic community has developed formal definitions of "human subject research", largely in response to abuses of human subjects. (wikipedia.org)
field
- In 2003, the NSF published a report entitled "The Emergence of Tissue Engineering as a Research Field", which gives a thorough description of the history of this field. (wikipedia.org)