Analysis and news g
scientific advances has shone a light on the pace at which peer review moves. So, how can we make sharing research results faster and more efficient? Artificial intelligence is now supporting authors and publications by speeding up the publication process while helping preserve quality with fewer human resources, and the tools can give journals competitive advantages for attracting authors. AI-based tools can be used in editorial
processes and decision making in ways that support the often-overburdened humans who are responsible for them, and there is a growing number of working examples already supporting various stages of scholarly publishing to share. There are now tools to help journal
editors find the right peer reviewers, an increasingly difficult task that is critical in obtaining timely reviews. Two primary reasons that reviewers decline review invitations are that the article is outside their area of expertise and that they are too busy with their own research. AI can help by enabling editors to identify reviewers in specific research disciplines. Some publishers use AI for optimal human oversight, while leveraging some of the latest advancements in natural language processing and language models. Now editors can receive an unbiased ranked and ordered list of the most suitable reviewers based on the content of the
20 Research Information December 2021/January 2022
“If AI can screen manuscripts, copy edit and find peer reviewers, could it write a paper?”
paper in just a few seconds, a task that typically takes an editor 90 minutes. Another time-consuming process that journals must carry out are manuscript checks generally carried out on all submissions. Automated checks allow editors and reviewers to focus on the content of the paper rather than routine checks. Ripeta also uses natural language processing technology to target several critical elements of a scientific manuscript, including purpose, data and code availability statements; funding statements, and more to gauge the level of responsible reporting in authors’ scientific papers and suggest improvements. The service can be integrated into the journal submission process to provide data for editors and reviewers that support the peer review and decision-making process. Scholarcy is an AI-powered article summariser that pulls out key concepts to automatically summarise papers. One
use case for publishers is extracting information on data availability, study participants and analyses used, study limitations, and ethical compliance information, as part of the manuscript screening process. AJE and its parent, Research Square Company, were built on helping to level the playing field for underrepresented researchers. The goal of our services is to ensure researchers’ works are judged on the quality of their contribution and not on their English language abilities. We began investing in AI in 2017, developing language assessment and editing tools using deep learning natural language processing technology. The technology is trained on our corpus of 900,000 edited manuscripts amassed over 15 years and is effectively supplementing the work of our own editors, improving efficiency and reducing costs. Among other things, these tools optimise our workflow by first scoring the language quality of manuscripts and then providing an automated edit, which makes an average of 1,000 changes in a 5,000-word manuscript prior to being assigned to our in-house editors. If AI can screen manuscripts, copy edit and find peer reviewers, could it write a paper? Generative Pre-trained Transformer 3 (GPT-3) is a neural network machine learning model that produces realistic human text. In a study, professors were asked to create a writing exercise and grade submissions from both students and from GPT-3. The average time between assignment and completion for GPT-3 was three to 20 minutes compared to three days for the humans. These same professors then graded the papers, not knowing whether they came from students or the GPT-3 model. At the end of the reviews, the GTP-3 model scored an average grade of ‘C’, receiving similar feedback as the students, although professor feedback noted that it wrote shallow, less descriptive papers compared to its human counterparts. There is no doubt that AI will become
more commonly used in academic publishing. As the technology improves, not only can it help to increase efficiency and reduce costs in the existing research communications system; it may also have the potential to completely transform it. The importance of human judgement in the creation and evaluation of research papers is clear, but AI tools can be applied to augment tasks that humans have traditionally carried out, and they can enable greater scale and speed. As the technology improves over time, we’ll be asking how far we should push the limits of AI.
@researchinfo |
www.researchinformation.info
Owlaheartstudio/
Shutterstock.com
Page 1 |
Page 2 |
Page 3 |
Page 4 |
Page 5 |
Page 6 |
Page 7 |
Page 8 |
Page 9 |
Page 10 |
Page 11 |
Page 12 |
Page 13 |
Page 14 |
Page 15 |
Page 16 |
Page 17 |
Page 18 |
Page 19 |
Page 20 |
Page 21 |
Page 22 |
Page 23 |
Page 24 |
Page 25 |
Page 26 |
Page 27 |
Page 28 |
Page 29 |
Page 30 |
Page 31 |
Page 32
