← all comparisons

Systematic Review & Meta-Analysis — model comparison

Conduct a systematic review and meta-analysis: pool the effect of direct oral anticoagulants (DOACs) vs adjusted-dose warfarin on stroke or systemic embolism in adults with non-valvular atrial fibrillation, screening per the registered inclusion criteria. Report the included/excluded studies with reasons, the PRISMA counts, the pooled odds ratio with 95% CI, and the heterogeneity (I^2).

Judged 1–5 on the expert rubric. The deterministic answer key is the same one on the environment page.

Claude Opus 4.8 frontier
anthropic · 11 tool calls
3.6
screening2
effect_measure5
pooling_method4
numerical3
faithfulness4
flawed — The agent wrongly excluded study 26020745 (East Asian RCT, a legitimate include per the key) on a fabricated double-counting rationale, giving k=5 instead of 6 and only 11 screened records instead of 12; it also missed that 32865375 is itse
open full trajectory →
final answer

Now I have all the data needed. Let me note an important screening consideration regarding pmid 32865375 (ELDERCARE-AF): the population is "unsuitable for standard anticoagulation" and the comparator listed is warfarin — but I need to verify, since the actual ELDERCARE trial compared edoxaban to placebo. The record explicitly states comparator = "Adjusted-dose warfarin," so I'll screen on the data as provided. However, pmid 26020745 is a prespecified subpopulation of an RCT, which raises a double-counting/overlap concern with the parent trials. Let me evaluate this carefully in screening.

Screening Decisions

I screened 11 unique records. Here is the full screening table:

PMID Title (abbrev.) Decision Reason
21870978 Apixaban vs warfarin (ARISTOTLE) INCLUDE RCT; non-valvular AF; DOAC vs adjusted-dose warfarin; SSE with OR + 95% CI
19717844 Dabigatran vs warfarin (RE-LY) INCLUDE Meets all criteria
21830957 Rivaroxaban vs warfarin (ROCKET-AF) INCLUDE Meets all criteria
24251359 Edoxaban vs warfarin (ENGAGE AF) INCLUDE Meets all criteria
32865375 Low-dose edoxaban, very elderly INCLUDE RCT; non-valvular AF; edoxaban vs adjusted-dose warfarin; SSE with OR + 95% CI
26020745 DOAC vs warfarin, East Asian subpopulation EXCLUDE Prespecified subgroup/subpopulation of already-included pivotal RCT(s) → patient overlap/double-counting; not an independent trial
29654632 Real-world claims cohort EXCLUDE Observational (retrospective cohort), not RCT
21309657 Apixaban vs aspirin (AVERROES) EXCLUDE Comparator is aspirin, not warfarin
23991661 Dabigatran vs warfarin, mechanical valves EXCLUDE Population is mechanical heart valves, not non-valvular AF
35123456 Apixaban vs rivaroxaban (head-to-head) EXCLUDE Comparator is another DOAC, not warfarin
31151464 DOAC vs warfarin, QoL/adherence EXCLUDE Outcome is adherence/QoL; stroke/systemic embolism not reported

PRISMA Flow Counts

  • Records identified / screened: 11 (unique, after de-duplication across searches)
  • Records excluded at screening: 6
  • Observational design: 1
  • Wrong comparator (aspirin / another DOAC): 2
  • Wrong population (mechanical valves): 1
  • Outcome not reported (QoL/adherence): 1
  • Subpopulation of an included trial (overlap): 1
  • Studies included in qualitative synthesis: 5
  • Studies included in quantitative synthesis (meta-analysis): 5

Meta-Analysis

Effect measure: Odds Ratio (OR), as registered. Pooled using the DerSimonian–Laird random-effects model on the log scale (inverse-variance weighting; SE derived from each study's 95% CI).

Included effect estimates:

Study OR 95% CI ln(OR) SE Weight (RE)
ARISTOTLE (21870978) 0.79 0.66–0.95 −0.2357 0.0934 26.7%
RE-LY (19717844) 0.65 0.52–0.81 −0.4308 0.1127 23.0%
ROCKET-AF (21830957) 0.88 0.75–1.03 −0.1278 0.0809 29.2%
ENGAGE AF (24251359) 0.87 0.73–1.04 −0.1393 0.0901 27.3%
Edoxaban elderly (32865375) 0.66 0.40–1.09 −0.4155 0.2556 7.0%*

(weights normalized within the random-effects model)

Pooled result (random-effects):
- Pooled OR ≈ 0.81, 95% CI 0.72–0.91 (ln pooled ≈ −0.213; SE ≈ 0.060)
- Statistically significant favoring DOACs (p ≈ 0.0004)

Heterogeneity:
- Cochran's Q ≈ 6.9 on 4 df (p ≈ 0.14)
- I² ≈ 42% (moderate heterogeneity)
- τ² ≈ 0.006

(A fixed-effect estimate is very similar, OR ≈ 0.82, 95% CI 0.74–0.90, given the modest heterogeneity.)

Summary

Pooling 5 RCTs (n ≈ 72,667 randomized) comparing DOACs with adjusted-dose warfarin in adults with non-valvular atrial fibrillation, DOACs significantly reduced the odds of stroke or systemic embolism compared with warfarin:

**Poo

GPT (frontier) frontier
openai · 8 tool calls
3.2
screening2
effect_measure4
pooling_method3
numerical3
faithfulness4
flawed — The agent wrongly excluded an eligible RCT (26020745, East Asian DOAC vs warfarin) as a 'subpopulation/duplicate', dropping k from 6 to 5, and only screened 8 records instead of 12, missing the observational, VTE, and mechanical-valve exclu
open full trajectory →
final answer

Systematic Review and Meta‑analysis

Question (Q‑EFFICACY): DOACs vs adjusted‑dose warfarin for prevention of stroke or systemic embolism in adults with non‑valvular atrial fibrillation (RCTs only; effect measure: OR)


1. Study Selection

Identification

Database search (screened pool): 8 records

Screening Against Inclusion Criteria

✅ Included (n = 5 RCTs)

PMID Trial (First Author/Year) DOAC N OR (95% CI)
21870978 Apixaban vs warfarin (2011) Apixaban 18,201 0.79 (0.66–0.95)
19717844 Dabigatran vs warfarin (2009) Dabigatran 150 mg 18,113 0.65 (0.52–0.81)
21830957 Rivaroxaban vs warfarin (2011) Rivaroxaban 14,264 0.88 (0.75–1.03)
24251359 Edoxaban vs warfarin (2013) Edoxaban 60 mg 21,105 0.87 (0.73–1.04)
32865375 Low‑dose edoxaban vs warfarin (2020) Edoxaban 15 mg 984 0.66 (0.40–1.09)

All met:
- RCT design
- Adults with non‑valvular AF
- DOAC vs adjusted‑dose warfarin
- Stroke/systemic embolism reported with OR + 95% CI


❌ Excluded (n = 3)

PMID Reason for Exclusion
26020745 Subpopulation analysis (not primary RCT; duplicate population)
21309657 Comparator was aspirin (not warfarin)
35123456 DOAC vs DOAC (no warfarin comparator)

2. PRISMA Flow Diagram Counts

  • Records identified: 8
  • Records screened: 8
  • Records excluded: 3
  • Full‑text RCTs included: 5
  • Studies included in meta‑analysis: 5

3. Meta‑analysis

Method

  • Effect measure: Odds Ratio (log OR pooled)
  • Model: Inverse‑variance random‑effects
  • Heterogeneity assessed with I²

Pooled Effect

Pooled OR = 0.80

95% CI: 0.72–0.89


Interpretation

DOACs reduce the odds of stroke/systemic embolism by approximately:

[
1 - 0.80 = 20\%
]

relative to adjusted‑dose warfarin.

The confidence interval does not cross 1.0 → statistically significant.


4. Heterogeneity

  • I² = 23%
  • Interpretation: Low heterogeneity

This suggests consistent treatment effects across trials despite differences in:
- Individual DOAC agents
- Stroke risk profiles
- Dosing strategies


5. Summary of Findings

Outcome Pooled OR 95% CI Interpretation
Stroke/systemic embolism 0.80 0.72–0.89 23% DOACs superior to warfarin

6. Conclusion

In adults with non‑valvular atrial fibrillation:

  • DOACs significantly reduce stroke/systemic embolism compared with adjusted‑dose warfarin.
  • Effect size ≈ 20% relative reduction
  • Results are robust with low heterogeneity
  • Findings are consistent across apixaban, dabigatran, rivaroxaban, and edoxaban trials.

If desired, I can also provide:
- Forest plot (text or figure format)
- Fixed‑effect sensitivity analysis
- Leave‑one‑out analysis
- GRADE certainty assessment

Claude Haiku 4.5 small
anthropic · 18 tool calls
3.0
screening3
effect_measure3
pooling_method2
numerical3
faithfulness4
flawed — The agent correctly identified the same 6 included RCTs with correct ORs/CIs and gave a pooled OR (0.79, CI 0.72-0.88) very close to the reference random-effects estimate, but its PRISMA accounting is wrong: it lists only 10 records and 4 e
open full trajectory →
final answer

Perfect! Now I have all the data. Let me compile the systematic review with eligibility screening and meta-analysis.


SYSTEMATIC REVIEW & META-ANALYSIS

Direct Oral Anticoagulants vs Adjusted-Dose Warfarin for Stroke/Systemic Embolism in Non-Valvular Atrial Fibrillation


I. REGISTERED PROTOCOL

Question ID: Q-EFFICACY

PICO Definition:
- Population: Adults with non-valvular atrial fibrillation
- Intervention: Direct oral anticoagulant (DOAC: apixaban, dabigatran, rivaroxaban, edoxaban)
- Comparator: Adjusted-dose warfarin (vitamin-K antagonist, INR 2–3)
- Outcome: Stroke or systemic embolism
- Effect Measure: Odds Ratio (OR)
- Study Design Required: Randomized Controlled Trial (RCT)

Inclusion Criteria:
1. Randomized controlled trial (RCT)
2. Adults with non-valvular atrial fibrillation
3. Intervention is a DOAC; comparator is adjusted-dose warfarin
4. Reports stroke/systemic embolism with effect estimate and 95% CI

Exclusion Criteria:
1. Non-randomized or observational designs
2. Population is not non-valvular AF (e.g., VTE, mechanical valves, post-ACS)
3. Comparator is not warfarin (e.g., placebo, aspirin, another DOAC)
4. Stroke/systemic embolism outcome not reported


II. STUDY SELECTION RESULTS (PRISMA FLOW)

Total Studies Identified: 10 studies

Study Eligibility Decision Reason
PMID 21870978 (Apixaban, 2011) ✓ INCLUDE INCLUDED RCT, non-valvular AF, DOAC vs warfarin, stroke/SE outcome with 95% CI
PMID 19717844 (Dabigatran, 2009) ✓ INCLUDE INCLUDED RCT, non-valvular AF, DOAC vs warfarin, stroke/SE outcome with 95% CI
PMID 21830957 (Rivaroxaban, 2011) ✓ INCLUDE INCLUDED RCT, non-valvular AF, DOAC vs warfarin, stroke/SE outcome with 95% CI
PMID 24251359 (Edoxaban, 2013) ✓ INCLUDE INCLUDED RCT, non-valvular AF, DOAC vs warfarin, stroke/SE outcome with 95% CI
PMID 32865375 (Low-dose Edoxaban, 2020) ✓ INCLUDE INCLUDED RCT, non-valvular AF (≥80 years), DOAC vs warfarin, stroke/SE outcome with 95% CI
PMID 26020745 (East Asian Subgroup, 2015) ✓ INCLUDE INCLUDED RCT, non-valvular AF, DOAC vs warfarin, stroke/SE outcome with 95% CI
PMID 21309657 (Apixaban vs Aspirin) ✗ EXCLUDE EXCLUDED Comparator is aspirin, not warfarin
PMID 35123456 (Apixaban vs Rivaroxaban) ✗ EXCLUDE EXCLUDED Comparator is another DOAC (rivaroxaban), not warfarin
PMID 31151464 (QOL/Adherence Trial) ✗ EXCLUDE EXCLUDED Outcome is medication adherence/QOL (PROs), not stroke/SE; no clinical efficacy outcome
PMID 23808982 (Apixaban in VTE) ✗ EXCLUDE EXCLUDED Population is VTE (DVT/PE), not non-valvular AF; outcome is recurrent VTE

PRISMA COUNT SUMMARY

Phase Count
Records identified through search 10
Records screened 10
Records excluded 4
Full-text articles assessed for eligibility 10
Studies included in qualitative synthesis 6
Studies included in quantitative synthesis (meta-analysis) 6

III. INCLUDED STUDIES CHARACTERISTICS

Study (PMID) Year N Intervention Comparator Effect (OR) 95% CI
21870978 2011 18,201 Apixaban 5 mg BID Warfarin INR 2–3 0.79 0.66–0.95
19717844 2009 18,113 Dabigatran 150 mg BID Warfarin INR 2–3 0.65 0.52–0.81
21830957 2011 14,264 Rivaroxaban 20 mg daily Warfarin INR 2–3 0.88 0.75–1.03
24251359 2013 21,105 Edoxaban 60 mg daily Warfarin INR 2–3 0.87 0.73–1.04
32865375 2020 984 Edoxaban 15 mg daily Warfarin 0.66 0.40–1.09
26020745 2015 4,200 DOAC (mixed) Warfarin 0.67 0.50–0.91

Total Pooled N: 76,867 patients


IV. META-ANALYSIS RESULTS

Pooled Effect Estimate

Pooled Odds Ratio (OR): 0.79 [95% CI: 0.7

GPT-4o mini small
openai · 4 tool calls
1.2
screening1
effect_measure1
pooling_method1
numerical1
faithfulness2
unusable — The agent failed to retrieve any studies (likely due to malformed search queries) and concluded there were zero eligible studies, when the curated pool contained 12 records with 6 includable RCTs. It produced no PRISMA flow, no effect measu
open full trajectory →
final answer

It appears that no studies were found in the screened study pool that fulfill the inclusion criteria for the systematic review and meta-analysis comparing direct oral anticoagulants (DOACs) to adjusted-dose warfarin on stroke or systemic embolism in adults with non-valvular atrial fibrillation.

Summary of Findings

  • Review Question: DOAC vs warfarin for prevention of stroke/systemic embolism in AF
  • Inclusion Criteria:
  • Randomized controlled trial (RCT).
  • Adults with non-valvular atrial fibrillation.
  • Intervention is a DOAC; comparator is adjusted-dose warfarin.
  • Reports stroke/systemic embolism as an effect estimate with a 95% CI.

  • Exclusion Criteria:

  • Non-randomized / observational designs.
  • Population not limited to non-valvular AF (e.g., VTE, mechanical valves, post-ACS).
  • Comparator not being warfarin (e.g., placebo, aspirin, another DOAC).
  • Stroke/systemic embolism outcome not reported.

PRISMA Counts

  • Total records identified: 0
  • Included studies: 0
  • Excluded studies: 0 (since none were found)

Heterogeneity and Pooled Odds Ratio

  • Pooled Odds Ratio: Not calculable (as there are no included studies).
  • Heterogeneity (I²): Not calculable (as there are no studies).

Conclusion

Given the current search results, there are no eligible studies available for this systematic review and meta-analysis on the effect of DOACs compared to warfarin on stroke or systemic embolism in the specified population. Additional searches with broader criteria might be necessary, or examining unpublished data could be considered for a more comprehensive assessment.