How to Conduct a Systematic Literature Review (SLR) Using an AI Tool | Step-by-Step Tutorial
This YouTube insight note was created with LilysAI. Sign up free and get 10× faster, deeper insights from videos.
Q: How does an AI tool like AnswerThis aid Systematic Literature Review (SLR)?
How can AI simplify a Systematic Literature Review (SLR)? An AI tool can automate tedious manual tasks like search string generation, screening, data extraction, and quality assessment, streamlining the entire SLR process.
1. Understanding Systematic Literature Reviews (SLRs) and Their Steps
1.1. What is an SLR?
- Performing an SLR manually can be overwhelming and time-consuming, especially when dealing with hundreds of papers for screening and data extraction.
- A normal literature review involves steps like searching Google Scholar, shortlisting relevant studies, reading them, organizing findings, and explaining the research.
- However, this approach can lead to questions about the selection process, such as "why did you choose these 30 papers?" or "are you sure you did not miss any important studies?".
- An SLR defines a systematic and transparent process for finding, selecting, evaluating, and synthesizing research evidence.
- This ensures that any researcher reviewing the SLR can understand exactly how the final studies were chosen.
- This transparency is the fundamental difference between a normal literature review and an SLR.
1.2. Six Steps to Conduct an SLR
- Define your research question.
- This step clarifies what the SLR aims to answer.
- A broad topic, such as "treatment of anemia," needs to be narrowed down to a focused research question.
- Frameworks like PICO (Population, Intervention, Comparison, Outcome) can help refine a broad topic into a specific research question.
- P stands for Population: what is being studied (e.g., "adults with eczema").
- I stands for Intervention: the treatment or technique given to the population (e.g., "biological therapies").
- C stands for Comparison: what the intervention is compared against (e.g., "standard care").
- O stands for Outcome: what is being measured (e.g., "symptom control").
- An example of a focused research question using PICO is: "In adults with eczema, do biological therapies improve symptom control compared with standard care?"
- Define the review protocol.
- A protocol is a complete plan for conducting the SLR.
- It includes decisions on:
- Which databases to search (e.g., PubMed, Scopus, Semantic Scholar).
- What keywords and search strings to use.
- Inclusion and exclusion criteria for studies.
- How papers will be screened.
- How data will be extracted.
- How the quality or risk of bias of studies will be assessed.
- How findings will be combined or synthesized (e.g., narrative review, meta-analysis).
- These decisions are crucial for the systematic review process and become part of the protocol.
- Register the protocol.
- Registering the protocol on a public registry, such as PROSPERO (for health and social care) or OSF Registries (broader platforms), "seals" the finalized plan.
- This prevents changes to the protocol later based on the results obtained during the review.
1.3. Using AnswerThis AI Tool for SLR Steps
- The AnswerThis AI tool can assist with the first two steps: defining the research question and developing the review protocol.
- Developing a search strategy and finding studies is where AnswerThis becomes even more relevant.
- Users log in, go to "Systematic Reviews," enter their research question, and start the review.
- The tool displays eligibility criteria based on the PICO framework, which users fill in with labels, descriptions, and inclusion/exclusion criteria.
- Users can also add custom criteria, choose the number of screening reviewers (AI or human), and select databases (e.g., PubMed, Semantic Scholar, ClinicalTrials.gov).
- Forming search strings is the next part on AnswerThis.
- Researchers need to define search terms and their synonyms because different researchers might use different terminology (e.g., "biologic therapies," "biologic treatment," "biologic agents").
- Synonyms and alternative terms are combined with Boolean operators:
- "Or" is used between similar terms (e.g., "biologic therapy or biologic treatment or biologic agent or biologic drug").
- "And" is used between different concepts (e.g., "amna or bronchila AND biologic therapy or biologic treatment or biologic agent AND amna control or symptom control or symptom improvement").
- Traditionally, identifying and refining these search strings is a manual process involving extensive literature review.
- AnswerThis automatically generates search strings based on the research question and criteria, which users can review and modify.
- Fetching the papers is done by AnswerThis based on the research question, search strings, and selected databases.
- Multiple databases are used because no single database contains all papers.
- Using multiple databases can result in duplicate papers.
- Duplication removal and mechanical filtering is the next step.
- AnswerThis removes duplicates by DOI and title.
- Papers are also filtered based on publication date, citation count, and missing abstracts.
- This process significantly reduces the number of papers; for example, from 1,876 to 532 papers.
1.4. Screening, Data Extraction, and Quality Assessment
- Title and abstract screening is the next step to remove irrelevant studies.
- For example, a paper titled "Safety of Biologics for the Treatment of ADHD in Children and Adolescents" would be excluded if the research question focuses on adults.
- If a paper seems relevant after title and abstract screening, it moves to full-text screening rather than being immediately included.
- AnswerThis can reduce the number of studies significantly at this stage (e.g., from 532 to 25 studies).
- The tool clearly shows which studies are included or excluded and provides reasons for exclusion (e.g., "Ama Condition," "Adults," "Biologic Therapies").
- Full-text screening is the subsequent step.
- Users need to upload the full text of papers, especially those behind a paywall, as AnswerThis might not have access to all of them.
- While AnswerThis can perform full-text screening, it is highly recommended that researchers also review the papers themselves to ensure they meet eligibility criteria and to clearly document reasons for exclusion.
- The entire process, from initial records to final included papers, is illustrated through a PRISMA flow diagram, which AnswerThis also provides.
- Data extraction and quality assessment are performed after full-text screening, once a final set of studies (e.g., 12 studies) is identified.
- Data extraction involves deciding what information is needed from the papers and extracting it into structured columns, rather than making random notes.
- On AnswerThis, users can define their own variables or choose from recommended extraction variables based on selected papers.
- The tool then extracts this information neatly into structured columns.
- Quality assessment (or risk of bias assessment) determines if all studies are equally reliable.
- For example, a well-designed randomized controlled trial with 500 participants (Study A) is more reliable than a study with 20 participants, unclear patient assignment, and missing data (Study B).
- AnswerThis recommends assessment frameworks, such as Cochrane RoB 2.0, based on the research question.
- The tool adds columns indicating which studies meet the assessment criteria.
- Data extraction involves deciding what information is needed from the papers and extracting it into structured columns, rather than making random notes.
2. Evidence Synthesis and AI Tool Capabilities
Evidence synthesis is the final step in an SLR, where findings from selected studies are combined to answer the research question, and AI tools like AnswerThis can assist throughout the entire process.
2.1. Evidence Synthesis and Reporting
- Evidence synthesis is the final step to answer the research question (e.g., "in adults with rheumatoid arthritis, do biologic therapies improve symptom control compared with standard care?").
- There are two main ways to synthesize evidence:
- Narrative synthesis: This involves looking at all studies together to find common patterns, similarities, and differences, rather than listing findings one by one.
- Meta-analysis: This is a statistical technique that quantitatively combines the results of multiple studies to obtain an overall or pooled effect, if the studies allow for it.
- After synthesis, conclusions are drawn based on the quality, consistency, and limitations of the reviewed studies.
- AnswerThis provides additional features for synthesis:
- Evidence grading: Outcomes are presented in a comparison table called the "Summary of Findings," which combines the main information extracted from the papers.
- Meta-analysis: The tool indicates which studies are not pooled and the outcomes found across all studies, considering factors like outcome, comparison, and time point.
- Users can export files from AnswerThis at any stage, including screening, extraction, risk of bias assessment, meta-analysis, and forest plots.
- AnswerThis can also help write the systematic literature review report.
- While generating AI content for writing is generally not recommended, users can generate a report for reference and then write their own.
2.2. Benefits of Using AI Tools for SLR
- The SLR process involves significant manual work, including:
- Building complex search strings.
- Searching across multiple databases.
- Screening hundreds or thousands of papers.
- Documenting reasons for excluding each study.
- Extracting information from each paper.
- Assessing the risk of bias.
- Synthesizing all findings.
- Platforms like AnswerThis are helpful because they consolidate all these tasks into a single platform.
- This eliminates the need for multiple tools.
- The majority of the manual tasks are handled by the tool, simplifying the SLR process step by step.
- The video concludes by offering courses on research writing and mastering AI tools for research, including a discount coupon for AnswerThis.
Understand massive materials like a genius — with LilysAI
Over 1,000,000 knowledge seekers use Lilys AI.
