Methods for using Bing's AI-Powered Search Engine for data extraction for a systematic review

Hill, James Edward orcid iconORCID: 0000-0003-1430-6927, Harris, Catherine orcid iconORCID: 0000-0001-7763-830X and Clegg, Andrew orcid iconORCID: 0000-0001-8938-7819 (2023) Methods for using Bing's AI-Powered Search Engine for data extraction for a systematic review. Research Synthesis Methods . ISSN 1759-2879

[thumbnail of VOR]
Preview
PDF (VOR) - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

886kB

Official URL: https://doi.org/10.1002/jrsm.1689

Abstract

Data extraction is a time-consuming and resource-intensive task in the systematic review process. Natural language processing (NLP) artificial intelligence (AI) techniques have the potential to automate data extraction saving time and resources, accelerating the review process, and enhancing the quality and reliability of extracted data. In this paper, we propose a method for using Bing AI and Microsoft Edge as a second reviewer to verify and enhance data items first extracted by a single human reviewer. We describe a worked example of the steps involved in instructing the Bing AI Chat tool to extract study characteristics as data items from a PDF document into a table so that they can be compared with data extracted manually. We show that this technique may provide an additional verification process for data extraction where there are limited resources available or for novice reviewers. However, it should not be seen as a replacement to already established and validated double independent data extraction methods without further evaluation and verification. Use of AI techniques for data extraction in systematic reviews should be transparently and accurately described in reports. Future research should focus on the accuracy, efficiency, completeness, and user experience of using Bing AI for data extraction compared with traditional methods using two or more reviewers independently.


Repository Staff Only: item control page