ICASR 2025

July 9, 2025

Artur Nowak represented Evidence Prime at the 10th meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR), held on 9 July 2025 at the Potsdam Institute for Climate Impact Research in Germany. Hosted by the DESTInY Consortium, the meeting examined how digital tools can support trustworthy screening, data extraction and living evidence.

Bringing practical questions from the Laser AI team

In his reflections after the workshop, Artur described the discussions he joined and the perspectives he brought from the Laser AI team. Four topics stood out:

  • Evaluation and human baselines: how to assess models rigorously and define the human performance against which their results are compared.
  • Agentic workflows: how to design AI-assisted processes for evidence synthesis, beyond evaluating a model in isolation.
  • Scholarly PDFs and copyright: the practical challenges associated with processing research publications.
  • Gaps in scholarly metadata: missing abstracts in OpenAlex, including those removed by publishers, and the implications for tools that depend on these records.

These questions connect the methodology of evidence synthesis with the conditions in which automation actually operates. A workflow depends on the evidence it can access, the information available about that evidence, and the criteria used to judge its outputs. For us, discussing those dependencies alongside model evaluation was a useful part of the meeting.

Living evidence across disciplines

The official programme brought together responsible AI guidance, methods for automated data extraction, shared evaluation datasets and evidence-synthesis infrastructure. Jan Minx presented DESTInY's work on living evidence for climate and health. Artur also highlighted Kinlabel Miyaka's work on assessing how evidence relates to local contexts, a question relevant to adopting or adapting recommendations.

ICASR offered an opportunity to compare these perspectives with existing collaborators and researchers from other disciplines. The host's event page provides further context on the meeting and its relationship with the subsequent evidence-synthesis hackathon.

Blank white image with no visible content or details