Issues

• Eligibility question: agent using a prebuilt consolidated data layer for DAB

  ucbepic/DataAgentBench#112 · Filter by author tjworks opened on Sep 23, 2026

• Clarification: eligibility of offline metadata profiling and knowledge reuse

  ucbepic/DataAgentBench#110 · Filter by author ldzhouquan opened on Sep 22, 2026

• Rubric 2.2 vs "tuned prompt": may a prompt state the intended reading of a query that #17 listed as ambiguous?

  ucbepic/DataAgentBench#109 · Filter by author marc-shade opened on Sep 20, 2026
  1

• pancancer query 1: golden uses ICD-O-3 codes, question says "histology types"

  ucbepic/DataAgentBench#107 · Filter by author jackn11 opened on Sep 13, 2026

• crmarenapro query 13's policy sentence cannot be applied and the golden ignores it

  ucbepic/DataAgentBench#105 · Filter by author jackn11 opened on Sep 13, 2026

• agnews queries 2–4 are unpassable without the stripped labels

  ucbepic/DataAgentBench#101 · Filter by author jackn11 opened on Sep 13, 2026

• query_crmarenapro/query8 golden answer omits eligible agents with zero transfers

  ucbepic/DataAgentBench#98 · Filter by author jackn11 opened on Sep 9, 2026

• Clarify review weighting in Yelp average-rating questions

  ucbepic/DataAgentBench#97 · Filter by author jackn11 opened on Sep 9, 2026

• More validators share the #78 substring-without-word-boundary defect (agnews/query4, bookreview/query1, crmarenapro/query1)

  ucbepic/DataAgentBench#93 · Filter by author marc-shade opened on Aug 30, 2026

• Git LFS budget exceeded — 10 dataset files unfetchable, blocking 10 of 17 datasets

  ucbepic/DataAgentBench#60 · Filter by author Jarus77 opened on Jun 18, 2026
  2

• Peer review request: AANA verifier-gated data-agent architecture

  ucbepic/DataAgentBench#48 · Filter by author mindbomber opened on May 7, 2026

• PATENTS queries: EMA initialization and CPC hierarchy-level definitions are under-specified

  ucbepic/DataAgentBench#45 · Filter by author sahrizvi opened on May 4, 2026