BioGrade · expert reasoning data for biopharma agentsEnvironmentsBenchmarkCompare modelsData flywheelThesis
← Epidemiology-Based Market Sizing comparison · model: GPT-4o mini
LLM-judge score: 2.4 / 5 · flawed
funnel_construction: 2 eligibility_gating: 2 numerical_consistency: 3 assumptions_revenue: 2 faithfulness: 3
The agent skipped the diagnosis (95%) and treatment (85%) gates entirely, applying subtype fractions directly to raw incidence, which inflates the addressable population (10,803 vs reference 8,720). More critically, it never applied any peak-share assumption — it multiplied the full addressable population by effective price, producing a ~$1.31B 'addressable revenue' that conflates total opportunity with peak revenue (reference ~$317M at 30% share). The tool numbers cited are faithful, but the funnel construction and revenue reasoning are materially wrong.
Commercial / Forecasting · Commercial forecasting analyst

Epidemiology-Based Market Sizing — agent trajectory for expert review

gpt-4o-mini · 2026-06-06T10:21:09.639345+00:00 · 3 tool calls · 12.8s · 1881 tokens
run id: market_sizing_20260606_031816_market-sizing__gpt-4o-mini

Query

Size the US addressable patient population and rough peak revenue for a DLL3 T-cell engager (tarlatamab-like) in second-line extensive-stage small cell lung cancer.

Trajectory

Agent · turn 1
⚙ calls get_epidemiology(indication=ES-SCLC, geography=US)
⚙ calls get_subtype_prevalence(indication=ES-SCLC)
⚙ calls get_pricing(indication=ES-SCLC)
↳ get_epidemiology result
show data
{
  "disclaimer": "Teaching snapshot: curated, rounded epidemiology for funnel-building practice. Not a live data pull; do not cite as ground truth.",
  "indication": "ES-SCLC",
  "label": "Extensive-stage small cell lung cancer",
  "funnel_basis": "incidence",
  "diagnosis_rate": 0.95,
  "treatment_rate": 0.85,
  "epidemiology": {
    "US": {
      "incidence_per_year": 33000,
      "prevalence": 38000
    }
  },
  "note": "funnel_basis tells you whether to start the funnel from incidence (new patients/year) or prevalence (point count of living patients)."
}
↳ get_subtype_prevalence result
show data
{
  "disclaimer": "Teaching snapshot: curated, rounded epidemiology for funnel-building practice. Not a live data pull; do not cite as ground truth.",
  "indication": "ES-SCLC",
  "subtypes": {
    "extensive_stage_fraction": 0.7,
    "DLL3_expression_fraction": 0.85,
    "fit_for_2L_fraction": 0.55
  },
  "line_splits": {
    "1L": 0.95,
    "2L": 0.5,
    "3L+": 0.2
  },
  "notes": "SCLC is ~13% of lung cancer; counts here are SCLC totals. ~70% present extensive-stage. DLL3 is expressed in ~85% of SCLC. A DLL3 T-cell engager (e.g. tarlatamab) is used 2L+; gate ES-SCLC on DLL3 expression AND being fit for second-line therapy. Short treated duration reflects rapid progression and high mortality."
}
↳ get_pricing result
show data
{
  "disclaimer": "Teaching snapshot: curated, rounded epidemiology for funnel-building practice. Not a live data pull; do not cite as ground truth.",
  "indication": "ES-SCLC",
  "annual_price": 220000,
  "treated_months": 8,
  "persistence": 0.55,
  "note": "annual_price is the list price for a full year. persistence is the fraction of a year actually paid for (discontinuation/mortality). Effective revenue per addressable patient/year = annual_price x persistence."
}
Agent · turn 2

To size the US addressable patient population and estimate the rough peak revenue for a DLL3 T-cell engager (similar to tarlatamab) in second-line treatment of extensive-stage small cell lung cancer (ES-SCLC), we'll use the following key data:

Epidemiology Information:

Subtype Prevalence:

Pricing Information:

Calculating Addressable Patient Population:

  1. Total Incidence of SCLC:
    [
    \text{Total Incidence} = 33,000 \text{ patients/year}
    ]

  2. Patients with Extensive-stage SCLC:
    [
    \text{Extensive-stage incidence} = 33,000 \times 0.70 = 23,100 \text{ patients/year}
    ]

  3. Patients expressing DLL3:
    [
    \text{DLL3-positive patients} = 23,100 \times 0.85 \approx 19,635 \text{ patients/year}
    ]

  4. Patients fit for second-line therapy:
    [
    \text{Fit for 2L therapy} = 19,635 \times 0.55 \approx 10,803 \text{ patients/year}
    ]

Rough Peak Revenue Calculation:

  1. Effective Revenue per Patient per Year:
    [
    \text{Effective Price} = 220,000 \times 0.55 \approx 121,000 \text{ USD/patient/year}
    ]

  2. Total Addressable Revenue:
    [
    \text{Total Revenue} = 10,803 \times 121,000 \approx 1,308,763,000 \text{ USD}
    ]

Summary:

This estimate provides a useful insight into the potential market opportunity for DLL3 T-cell engagers in the specified patient population.

Final output

To size the US addressable patient population and estimate the rough peak revenue for a DLL3 T-cell engager (similar to tarlatamab) in second-line treatment of extensive-stage small cell lung cancer (ES-SCLC), we'll use the following key data:

Epidemiology Information:

Subtype Prevalence:

Pricing Information:

Calculating Addressable Patient Population:

  1. Total Incidence of SCLC:
    [
    \text{Total Incidence} = 33,000 \text{ patients/year}
    ]

  2. Patients with Extensive-stage SCLC:
    [
    \text{Extensive-stage incidence} = 33,000 \times 0.70 = 23,100 \text{ patients/year}
    ]

  3. Patients expressing DLL3:
    [
    \text{DLL3-positive patients} = 23,100 \times 0.85 \approx 19,635 \text{ patients/year}
    ]

  4. Patients fit for second-line therapy:
    [
    \text{Fit for 2L therapy} = 19,635 \times 0.55 \approx 10,803 \text{ patients/year}
    ]

Rough Peak Revenue Calculation:

  1. Effective Revenue per Patient per Year:
    [
    \text{Effective Price} = 220,000 \times 0.55 \approx 121,000 \text{ USD/patient/year}
    ]

  2. Total Addressable Revenue:
    [
    \text{Total Revenue} = 10,803 \times 121,000 \approx 1,308,763,000 \text{ USD}
    ]

Summary:

This estimate provides a useful insight into the potential market opportunity for DLL3 T-cell engagers in the specified patient population.

Reference answer key (deterministic) — open after grading

Deterministic funnel for ES-SCLC in US built from the curated tool data (basis = incidence). Eligibility gating is the product of the subtype fractions that apply to this drug, then the line-of-therapy gate. The peak-revenue sketch uses an illustrative 30% peak share; a strong agent may choose a different, well-justified share. Teaching snapshot: curated, rounded epidemiology for funnel-building practice. Not a live data pull; do not cite as ground truth.

Funnel stepPatients / valueCalculation
1. Incidence (new/yr)33,000US ES-SCLC; basis = incidence
2. Diagnosed31,350x 95% diagnosis rate
3. Drug-treated26,648x 85% treatment rate
4. Extensive-stage18,653x 70%
5. DLL3-expressing15,855x 85%
6. Fit for 2L therapy8,720x 55%
7. Line gate: 2L+8,720x 100% (=1.0 if already encoded above)
= Addressable patients8,720eligibility = 33% of treated, x line
Peak capture @ 30% share2,616illustrative peak share assumption
Eff. revenue / patient-yr$121,000$220,000 list x 55% persistence
~ Peak revenue (USD/yr)$316,550,316= captured patients x eff. revenue/pt

Expert grading

Epidemiology sourcing & funnel construction 1 (poor) 5 (excellent)
5: Pulls the right epidemiology via the tools, correctly chooses incidence vs prevalence as the funnel basis for the disease (incidence for acute/short-survival oncology, prevalence for chronic disease), and lays out a clean population -> diagnosed -> treated -> eligible -> addressable chain for the queried geography.
1: Builds the funnel from the wrong base (e.g. prevalence for an incidence-driven cancer, or vice versa), skips diagnosis/treatment steps, ignores the requested geography, or reasons from memory instead of the tool data.
Eligibility / biomarker gating correctness 1 (poor) 5 (excellent)
5: Applies the correct biomarker / subtype / stage gates for THIS drug and only those — e.g. advanced-stage AND activating EGFR mutation for a 1L EGFR TKI, DLL3-expressing AND fit-for-2L for a DLL3 engager, HER2+ AND metastatic for a 2L ADC — and applies the line-of-therapy gate without double-counting.
1: Omits a required gate (e.g. forgets the EGFR-mutant or DLL3 filter), applies an irrelevant or wrong-direction gate, double-counts a line split already implied by another gate, or multiplies fractions that should not stack.
Numerical correctness & internal consistency 1 (poor) 5 (excellent)
5: Every multiplication checks out against the returned tool numbers; intermediate counts are consistent and monotonically shrinking down the funnel; the final addressable number is reproducible from the stated inputs.
1: Arithmetic errors, mismatched units, numbers that don't follow from the cited fractions, or a funnel step larger than the one above it.
Assumptions & peak-share / revenue reasoning 1 (poor) 5 (excellent)
5: States and justifies the peak-share and pricing assumptions, applies persistence / treated duration sensibly, and produces a revenue sketch (addressable x share x effective price) whose magnitude is defensible; flags the key sensitivities.
1: Pulls a peak share or price out of thin air with no rationale, ignores persistence/duration, garbles the revenue formula, or presents a point estimate with no acknowledgement of uncertainty.
Evidence faithfulness 1 (poor) 5 (excellent)
5: Every number traces to a specific tool output (epidemiology counts, subtype fractions, price); no fabricated rates or invented epidemiology; the curated/teaching nature of the data is respected and not overstated as live truth.
1: Invents incidence/prevalence or subtype fractions not returned by the tools, contradicts the tool data, or presents the snapshot numbers as authoritative real-world figures.
Overall verdict
Your name / ID