AI-Assisted Literature Discovery
Core summary
AI-powered tools like Semantic Scholar, Elicit, Consensus, and Research Rabbit can help you discover relevant literature using natural-language queries and semantic matching. However, they have critical limitations that mean they cannot replace traditional database searching.
Detailed explanation
Detailed explanation
AI literature discovery tools work differently from traditional database searching. Instead of matching exact keywords, they use semantic understanding to find papers related to your question conceptually. Tools to know: Semantic Scholar: A free academic search engine that uses AI to analyze paper content, identify key findings, and surface related work. It covers over 200 million papers. Its 'TLDR' feature provides one-sentence summaries. Elicit: Designed specifically for researchers. Enter a research question in natural language, and it finds relevant papers, extracts key findings, and organizes them in a table. Useful for rapid evidence mapping. Consensus: Searches the scientific literature and synthesizes findings using AI. Presents a 'consensus meter' showing the balance of evidence for or against a claim. Useful for quick evidence checks. Research Rabbit: A citation-based discovery tool. Add seed papers and it recommends related papers based on citation networks and content similarity. Useful for exploring a topic you are new to. What these tools do well: Find conceptually related papers regardless of keyword overlap. Provide quick summaries of findings. Help you discover papers in adjacent fields. Reduce the initial overwhelm of a new topic. Critical limitations: 1. Incomplete coverage: No AI tool indexes all journals. Many index only open-access papers or papers from specific publishers. You cannot know what they missed. 2. Non-reproducible: AI search results may differ between users and over time. You cannot document a reproducible search strategy. 3. AI hallucination: Large language models (like ChatGPT, Claude, and others) can fabricate citations — inventing realistic-looking paper titles, authors, and DOIs that do not exist. NEVER cite a paper based solely on an AI-generated reference without verifying it exists in PubMed or another database. 4. Not accepted for systematic reviews: PRISMA requires transparent, reproducible search strategies. AI-assisted tools currently do not meet this standard. Best practice: Use AI tools for initial exploration, brainstorming search terms, and discovering papers you might have missed. Then verify every reference in a real database. Always build your formal search in PubMed, Embase, or Cochrane using the methods from previous lessons.
Clinical example
A medical student asks ChatGPT: 'Give me 5 references on the efficacy of ivermectin in COVID-19.' ChatGPT provides 5 citations with titles, authors, and journal names. When the student checks PubMed, only 3 of the 5 actually exist — 2 were hallucinated with fabricated authors and realistic-sounding journal names. The student would have submitted fake references without verification.
Research example
Walters et al. tested ChatGPT-4 on generating academic references and found that approximately 30% of generated citations were fabricated, containing non-existent papers with plausible-looking titles and author names.
Knowledge check
Q1. What is the biggest risk of using AI chatbots (like ChatGPT) to find research references?
Q2. Why can't AI-powered search tools replace traditional database searching for systematic reviews?
Q3. What is the recommended role for AI tools in a literature search workflow?