Warn when Copilot API-proxy mode disables native web tools by Copilot · Pull Request #9420 · github/gh-aw-firewall

Copilot · 2026-10-03T16:54:45Z

Copilot API-proxy routing sets COPILOT_OFFLINE=true, which disables native web_fetch and web_search even when explicitly permitted. Allowlisted domains therefore remain unused without an explanation.

Startup diagnostic: Warn when Copilot sidecar routing is active and the domain allowlist is non-empty; preserve offline mode and credential isolation.
Workaround: Document shell curl with Copilot URL permissions. Squid continues enforcing the domain allowlist.
Coverage and compiler follow-up: Add warning/suppression regression tests and link upstream tracking for compiler diagnostics or an MCP fallback.

Example gh-aw configuration:

engine:
  id: copilot
  args: ["--allow-url", "osv.dev"]
network:
  allowed: ["osv.dev"]
tools:
  bash: ["curl"]

This enables fetching known URLs through curl; it does not restore native web tools.

Fixes [awf] copilot engine: web-fetch/web-search tools unavailable in COPILOT_OFFLINE api-proxy mode #9402

Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>

Copilot

Copilot review overview

🟡 Changes recommended

The sidecar documentation omits base-URL-only configurations that also set COPILOT_OFFLINE=true.

Review effort: Balanced
Findings: 1

Open (1)

Include COPILOT_PROVIDER_BASE_URL in the condition · New

What changed in this PR

Adds diagnostics and guidance for Copilot web tools disabled by API-proxy offline mode.

Changes:

Warns when offline Copilot routing conflicts with allowlisted domains.
Adds regression tests and documents the curl workaround.
Documents the web-tool limitation in sidecar configuration.

File	Description
`src/services/credentials/copilot-credential-env.ts`	Emits the startup warning.
`src/services/credentials/copilot-credential-env.test.ts`	Tests warning and suppression behavior.
`docs/troubleshooting.md`	Documents symptoms, cause, and workaround.
`docs/api-proxy-sidecar.md`	Notes offline-mode web-tool limitations.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

lpcox · 2026-10-03T17:36:19Z

@copilot merge main and address review feedback

…ix-web-tools Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>

Copilot · 2026-10-03T17:40:49Z

@copilot merge main and address review feedback

Merged main and updated the COPILOT_OFFLINE condition to include COPILOT_PROVIDER_BASE_URL. The fix is in d6c118d.

github-actions · 2026-10-03T18:02:00Z

Documentation Preview

Documentation has been built for this PR.

Download preview artifact

To view locally:

Download the docs-preview-pr-9420 artifact from the workflow run
Unzip and open index.html in your browser

Built from commit b47aac7

github-actions · 2026-10-03T18:02:00Z

📡 Smoke OTel Tracing completed. All tracing scenarios validated. ✅

📡 OTel tracing validated by Smoke OTel Tracing

github-actions · 2026-10-03T18:02:01Z

🔌 Smoke Services — All services reachable! ✅

🔌 Service connectivity validated by Smoke Services

github-actions · 2026-10-03T18:02:01Z

❌ Smoke Copilot BYOK AOAI (Entra) reports failed. AOAI BYOK (Entra) mode investigation needed...

🪪 BYOK (AOAI Entra) report filed by Smoke Copilot BYOK AOAI (Entra)

github-actions · 2026-10-03T18:02:03Z

✅ Smoke Copilot BYOK completed. Copilot BYOK mode operational. 🔓

🔑 BYOK report filed by Smoke Copilot BYOK

github-actions · 2026-10-03T18:02:03Z

❌ Smoke Gemini reports failed. Facets need polishing...

💎 Faceted by Smoke Gemini

github-actions · 2026-10-03T18:02:04Z

✅ Smoke Claude passed

Generated by Smoke Claude for #9420

github-actions · 2026-10-03T18:02:04Z

🛡️ Smoke Copilot Network Isolation confirmed the egress allowlist is enforced. ✅

🛡️ Egress verdict from Smoke Copilot Network Isolation

github-actions · 2026-10-03T18:02:05Z

📰 VERDICT: Smoke Copilot has concluded. All systems operational. This is a developing story. 🎤

📰 BREAKING: Report filed by Smoke Copilot

github-actions · 2026-10-03T18:02:05Z

🚀 Security Guard has started processing this pull request

github-actions · 2026-10-03T18:02:07Z

❌ Smoke Copilot BYOK AOAI (api-key) reports failed. AOAI BYOK (api-key) mode investigation needed...

🔑 BYOK (AOAI api-key) report filed by Smoke Copilot BYOK AOAI (api-key)

github-actions · 2026-10-03T18:02:13Z

Chroot tests passed! Smoke Chroot - All security and functionality tests succeeded.

Tested by Smoke Chroot

github-actions · 2026-10-03T18:02:21Z

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

🔮 The oracle has spoken through Smoke Codex

github-actions · 2026-10-03T18:02:41Z

✅ Build Test Suite completed successfully!

Generated by Build Test Suite for #9420

github-actions · 2026-10-03T18:03:05Z

Smoke Cloud Hypervisor completed. Cloud Hypervisor + Copilot passed.

Cloud Hypervisor + Copilot smoke test by Smoke Cloud Hypervisor

github-actions · 2026-10-03T18:04:41Z

Smoke Test: Claude Engine Validation

API status: ✅ PASS
GH check: ✅ PASS
File status: ✅ PASS

Overall result: PASS

Generated by Smoke Claude for #9420 · claude · haiku45 · 24.3 AIC · ⊞ 6.2K · ◷
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:04:52Z

EGRESS_RESULT allow=pass deny=pass

✅ Allowed: api.github.com returned HTTP 403 (a response, curl exit 0)
✅ Blocked: example.com failed (self-signed cert error), reported as blocked
Overall: PASS. cc @lpcox

🛡️ Egress verdict from Smoke Copilot Network Isolation
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:05:19Z

OTEL smoke test

✅ S1 Module loading: otel.js loads; exports startRequestSpan, setTokenAttributes, setBudgetAttributes, endSpan, endSpanError, shutdown, isEnabled
✅ S2 Tests: 3 suites, 68/68 passed
✅ S3 Env forwarding: trace/parent IDs in env-passthrough.ts; OTEL vars in api-proxy-env-config.ts
✅ S4 Token tracker: onUsage callback present in token-tracker-http.js
✅ S5 Diagnostics: otel.jsonl present (1 line)

📡 OTel tracing validated by Smoke OTel Tracing
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:05:32Z

Services smoke test:

Redis PING: ✅ PONG
pg_isready: ✅ accepting connections
psql SELECT 1: ✅ 1

Overall: PASS

🔌 Service connectivity validated by Smoke Services
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:05:35Z

Smoke Test: Copilot BYOK (Direct Mode)

Status: ✅ PASS

✅ GitHub MCP connectivity verified
✅ HTTP code: 200 (github.com reachable)
✅ File write/read test passed
✅ BYOK inference working (running in direct mode)

Mode: Direct BYOK (COPILOT_PROVIDER_API_KEY) via api-proxy → api.githubcopilot.com

🔑 BYOK report filed by Smoke Copilot BYOK
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:05:36Z

Smoke Copilot — PR: "Warn when Copilot API-proxy mode disables native web tools"

✅ GitHub MCP (last merged: "Fix Squid crashes with assertion failure in Claude inference")
✅ github.com HTTP 200
✅ File write/read
PASS — @Copilot @lpcox

📰 BREAKING: Report filed by Smoke Copilot
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:06:07Z

✅ Coverage Check Passed

Overall Coverage

Metric	Base	PR	Delta
Lines	92.91%	92.91%	➡️ +0.00%
Statements	91.38%	91.38%	➡️ +0.00%
Functions	89.55%	89.55%	➡️ +0.00%
Branches	85.04%	85.04%	➡️ +0.00%

📁 Per-file Coverage Changes (2 files)

File	Lines (Before → After)	Statements (Before → After)
`src/nvx/one-shot-adapter.ts`	83.5% → 82.9% (-0.60%)	80.3% → 79.8% (-0.56%)
`src/log-directory-setup.ts`	96.8% → 100.0% (+3.18%)	96.9% → 100.0% (+3.13%)

Coverage comparison generated by scripts/ci/compare-coverage.ts

github-actions · 2026-10-03T18:06:57Z

Chroot version comparison

Runtime	Host Version	Chroot Version	Match?
Python	Python 3.12.14	Python 3.12.14	✅
Node.js	v24.21.0	v22.23.2	❌
Go	go1.22.12	go1.22.12	✅

Node.js differs between host and chroot, so not all tests passed. The smoke-chroot label was not added.

Tested by Smoke Chroot
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:07:04Z

Smoke Test: Cloud Hypervisor + Copilot

list_pull_requests MCP call: PASS (returned PR Route Copilot auto requests to Codex-compatible Responses models #9422)
curl https://github.com: FAIL — bash tool denied all curl network calls ("Permission denied and could not request permission from user"), even to localhost; not an AWF firewall block, a sandbox tool restriction
Write/read /tmp/gh-aw/agent/smoke-cloud-hypervisor-37142669328.txt: PASS
curl (example.com/redacted) (expect blocked): FAIL — same curl permission restriction as Secret proxying #2, could not execute to confirm block

Overall: 2/4 checks verified; curl-based network checks (#2, #4) could not run due to sandbox denying all curl invocations, unrelated to firewall allow/deny logic.

Cloud Hypervisor + Copilot smoke test by Smoke Cloud Hypervisor
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:07:47Z

Smoke Test

Merged PR review: ❌
PR detail lookup: ❌
Playwright title check: ❌
Temp file write/read: ✅
AWF build: ❌
Overall status: FAIL

🔮 The oracle has spoken through Smoke Codex
_{Add label ready-for-aw to run again}

github-actions · 2026-10-03T18:08:01Z

🏗️ Build Test Suite Results

Ecosystem	Project	Build/Install	Tests	Status
Bun	elysia	✅	1/1 passed	✅ PASS
Bun	hono	✅	1/1 passed	✅ PASS
C++	fmt	✅	N/A	✅ PASS
C++	json	✅	N/A	✅ PASS
Deno	oak	N/A	1/1 passed	✅ PASS
Deno	std	N/A	1/1 passed	✅ PASS
.NET	hello-world	✅	N/A	✅ PASS
.NET	json-parse	✅	N/A	✅ PASS
Go	color	✅	ok	✅ PASS
Go	env	✅	ok	✅ PASS
Go	uuid	✅	ok	✅ PASS
Java	gson	✅	1/1 passed	✅ PASS
Java	caffeine	✅	1/1 passed	✅ PASS
Node.js	clsx	✅	all passed	✅ PASS
Node.js	execa	✅	all passed	✅ PASS
Node.js	p-limit	✅	all passed	✅ PASS
Rust	fd	✅	1/1 passed	✅ PASS
Rust	zoxide	✅	1/1 passed	✅ PASS

Overall: 8/8 ecosystems passed — PASS

Note: Java's first Maven run failed because ~/.m2 was root-owned, so Maven could not create ~/.m2/repository. I re-ran both Java projects with -Dmaven.repo.local=/tmp/gh-aw/agent/m2, and they passed. The runner's ~/.m2 ownership may be worth fixing.

Generated by Build Test Suite for #9420 · copilot · auto · 19.2 AIC · ⊞ 11.8K · ◷
_{Add label ready-for-aw to run again}

Initial plan

7a03a02

Copilot AI assigned Copilot and lpcox Oct 3, 2026

Copilot started work on behalf of lpcox October 3, 2026 16:54 View session

Copilot AI linked an issue Oct 3, 2026 that may be closed by this pull request

[awf] copilot engine: web-fetch/web-search tools unavailable in COPILOT_OFFLINE api-proxy mode #9402

Closed

fix: warn when Copilot offline mode disables native web tools

43db74c

Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>

Copilot AI changed the title ~~[WIP] Fix web-fetch and web-search tool availability in offline mode~~ Warn when Copilot API-proxy mode disables native web tools Oct 3, 2026

Copilot finished work on behalf of lpcox October 3, 2026 17:06

Copilot AI requested a review from lpcox October 3, 2026 17:06

lpcox marked this pull request as ready for review October 3, 2026 17:15

Copilot AI balanced review requested due to automatic review settings October 3, 2026 17:15

Copilot started reviewing on behalf of lpcox October 3, 2026 17:15 View session

Copilot AI reviewed Oct 3, 2026

View reviewed changes

Comment thread docs/api-proxy-sidecar.md Outdated

Copilot started work on behalf of lpcox October 3, 2026 17:36 View session

Copilot AI added 2 commits October 3, 2026 17:37

Merge remote-tracking branch 'origin/main' into copilot/awf-copilot-f…

c3bedf7

…ix-web-tools Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>

docs: clarify Copilot offline mode trigger

d6c118d

Copilot finished work on behalf of lpcox October 3, 2026 17:41

lpcox added the ready-for-aw label Oct 3, 2026

lpcox had a problem deploying to aoai-model October 3, 2026 18:02 — with GitHub Actions Failure

lpcox enabled auto-merge (squash) October 3, 2026 18:02

github-actions Bot added smoke-claude smoke-copilot-network-isolation Copilot network-isolation egress smoke test labels Oct 3, 2026

lpcox deployed to aoai-model October 3, 2026 18:05 — with GitHub Actions Active

github-actions Bot added the smoke-services label Oct 3, 2026

github-actions Bot added smoke-copilot-byok smoke-copilot labels Oct 3, 2026

lpcox deployed to aoai-model October 3, 2026 18:05 — with GitHub Actions Active

github-actions Bot added the build-test label Oct 3, 2026

lpcox merged commit c5042c7 into main Oct 3, 2026
132 of 137 checks passed

lpcox deleted the copilot/awf-copilot-fix-web-tools branch October 3, 2026 18:14

Conversation

Copilot AI commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Copilot review overview

🟡 Changes recommended

Uh oh!

Uh oh!

lpcox commented Oct 3, 2026

Uh oh!

Copilot AI commented Oct 3, 2026

Uh oh!

github-actions Bot commented Oct 3, 2026

Documentation Preview

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 3, 2026

Smoke Test: Claude Engine Validation

Uh oh!

github-actions Bot commented Oct 3, 2026

Uh oh!

github-actions Bot commented Oct 3, 2026

Uh oh!

github-actions Bot commented Oct 3, 2026

Uh oh!

github-actions Bot commented Oct 3, 2026

Smoke Test: Copilot BYOK (Direct Mode)

Uh oh!

github-actions Bot commented Oct 3, 2026

Uh oh!

github-actions Bot commented Oct 3, 2026

✅ Coverage Check Passed

Overall Coverage

Uh oh!

github-actions Bot commented Oct 3, 2026

Chroot version comparison

Uh oh!

github-actions Bot commented Oct 3, 2026

Copilot AI commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading

github-actions Bot commented Oct 3, 2026 •

edited

Loading