For builders operationalizing agentic work.
Two harness settings tripled a vendor ARC-AGI-3 score on the same model — so re-run your agent evals before you blame the weights
Week 31 of 2026 · August 1, 2026
Big read
OpenAI reported taking its ARC-AGI-3 public-set score from 13.3% to 38.3% by changing two Responses API harness settings on the same model: retain private reasoning between tool calls, and replace rolling truncation at 175k characters with context compaction. It also reported roughly 6× fewer output tokens. That is the week's central technique result — and it is vendor-measured on one benchmark by the company selling the API, with no independent replication yet. Discount it accordingly. The practical instruction does not need the replication to hold: before you attribute a performance gap to model quality, re-run the evaluation with identical weights and a different memory policy.
The transferable pattern is Retained-Reasoning Compaction. Truncation forces the model to re-derive plans every turn once the window rolls; discarding private chain-of-thought between tool calls throws away hypotheses the next action needed. Compaction keeps learned environment state inside the window as a summary rather than a hard cut. Measure both task success and output tokens. If your harness still hard-truncates long trajectories, you are measuring the truncation policy as much as the model.
The rest of the week made the same point from the connector and routing side. MCP specification 2026-07-28 went final as a normative, stateless request/response core — no initialize handshake, no session ID, method and name in headers, MRTR for mid-call elicitation, cacheable list results, and a twelve-month deprecation floor as Dynamic Client Registration yields to client metadata documents. Anthropic shipped a 950+ connector directory with IdP-provisioned enterprise connectors and research-preview MCP tunnels for private-network servers without inbound exposure. GitHub took Agent skills plus read-only MCP to general availability in Copilot code review on Jul 29. Snowflake positioned Cortex AI Gateway as a data-plane control plane for MCP and third-party agents, with many gateway features still private preview.
Put together: fix the memory policy, then fix the connector contract, then encode task-class routing as harness policy. Microsoft's MDASH with MAI-Cyber-1-Flash handling roughly 90% of tasks before escalating to frontier models is the same pattern as Luna-default / Terra-mid / Sol-exception economics on GPT-5.6 fleets — specialist first, expensive generalist last. Independent audited workflow ROI with baseline and method still did not clear the bar this week. Treat CyberGym, ARC-AGI, and GPU-cost claims as vendor instrumentation until someone else reproduces them.
Technique of the week
Automate
Retained-Reasoning Compaction
OpenAI's vendor-reported ARC-AGI-3 jump (13.3% → 38.3%, ~6× fewer output tokens) came from harness memory settings on unchanged weights. That does not prove every workload will triple, but it does prove memory policy is a first-class evaluation variable. Operators who only swap models are confounding scaffold effects with intelligence. Fix the retention and compaction contract, instrument success and tokens, then decide whether a weight change is even warranted.
- Trigger
- A multi-step tool loop approaches the context ceiling, or successive tool calls discard private reasoning between turns. The failure mode is repeated re-planning and rising output tokens without commensurate task progress.
- Retain reasoning
- Keep private reasoning items across tool calls rather than stripping them at each hop. The next action should inherit hypotheses, constraints, and partial plans already formed — not reconstruct them from truncated transcripts.
- Compact, do not truncate
- When the window fills, replace rolling hard truncation (OpenAI's prior official harness cut at 175k characters) with a summary compaction of older turns that preserves environment state, decisions taken, and open questions.
- Tools
- Use an API surface that can thread prior response state and compaction (OpenAI documents this via the Responses API with retained reasoning). Homegrown harnesses should store reasoning items and emit an explicit compaction artifact the model can read.
- Verifier
- Score the same task suite under both memory policies with identical weights. Track task success, output tokens, retries, and verifier pass rate. A score move without a token move, or the reverse, is a scaffold signal — not a model ranking.
- Escalation
- If compaction summaries lose critical state, split the trajectory into checkpointed stages with human review rather than silently truncating. Do not escalate to a larger model until the memory-policy A/B has been run.
- An ARC-style or long research agent on GPT-5.6 Sol keeps reasoning between tool calls and compacts context via the Responses API instead of truncating at a character ceiling — OpenAI's vendor-reported public-set path from 13.3% to 38.3%.
- A coding agent whose repo exploration exceeds the window stores a compaction summary of files already inspected and open hypotheses, then continues tool use without re-listing the tree from scratch each turn.
- An evaluation harness pins model ID and temperature, then runs two arms — truncate vs compact+retain — before any bake-off concludes that Model A beats Model B.
New agent capabilities
2026-07-29 · OpenAI · Automate
Responses API / GPT-5.6 Sol harness
Re-run agent evaluations with identical weights and a different memory policy before attributing a gap to the model. Treat the triple as a vendor-measured scaffold effect until independent parties reproduce it.
Sources OpenAI
2026-07-27 · Microsoft · Automate
MDASH with MAI-Cyber-1-Flash
Encode task-class routing — cheap specialist to expensive generalist — as harness policy with route logs, not as chat defaults. Demand evidence of when Flash versus frontier models actually ran.
Sources Microsoft AI
2026-07-29 · GitHub · Build
Copilot code review (Agent skills + MCP)
Ship org coding standards as versioned skills and wire issue/docs MCP with read-only as the adoption gate. Prefer the same skill pack across cloud agent, CLI, and review rather than one-off prompts.
Sources GitHub Changelog
2026-07-28 · GitHub / xAI · Build
Grok 4.5 in GitHub Copilot
Add Grok as an optional coding route only after admin policy and data-retention review. Long context is not a substitute for compaction discipline on multi-hour agent jobs.
Sources GitHub Changelog
2026-07-30 · Google DeepMind · Automate
Gemini Robotics ER 2
Treat physical agents as the same pattern as software agents — planner plus actuator plus safety stop — and demand ASIMOV-Agentic and human-proximity evidence before production pilots.
Sources Google DeepMind
2026-07-30 · Alibaba / Qwen · Cowork
Qwen Code v0.21.x
Session memory is becoming a first-class UX primitive. Prefer inject-summary over resume/fork when you need context without hijacking the current thread, and version learned skills like code.
Sources Qwen Code Docs
2026-07-30 · OpenAI · Automate
GPT-5.6 Luna / Terra / Sol fleet
Redesign agent graphs around Luna default, Terra mid, Sol exception. Pair the economic ladder with task-class routing so the expensive node is an escalation, not the idle default.
Sources OpenAI
New skills and connectors
2026-07-28 · Model Context Protocol · Connector
MCP specification 2026-07-28
Inventory every MCP server for hidden session assumptions, plan gateway routing on headers, prefer EMA for enterprise SSO, and treat Dynamic Client Registration as transitional debt under RFC 9207 issuer hardening.
Sources MCP Blog
2026-07-28 · Anthropic · Connector
Claude connectors directory + MCP tunnels
Prefer IdP-provisioned connectors over user-owned OAuth sprawl. Use tunnels for private tools only in preview with explicit network policy; production still needs a gateway audit trail.
Sources Anthropic / Claude
2026-07-28 · Snowflake · Harness
Cortex AI Gateway
Put MCP behind a data-plane gateway before enabling IDE agents against warehouse tools. Treat preview controls as non-contractual until GA dates are in writing.
Sources Snowflake
2026-07-29 · GitHub · Skill
Portable SKILL.md + read-only MCP for PR review
One versioned skill pack can serve cloud agent, CLI, and review. Read-only MCP is the right default for any automated reviewer that can see production systems of record.
Sources GitHub Changelog
Proof of value
Evidence · Benchmark
OpenAI · ARC-AGI-3 public task set via agent harness
This is the week's strongest technique evidence and still grade-discounted: same company, same API surface, one benchmark, no independent reproduction. Use it as a mandate to A/B memory policy under pinned weights — not as proof that every agent will triple overnight.
Sources OpenAI
Evidence · Vendor Claim
Microsoft · MDASH vulnerability find / validate / remediate (CyberGym)
Useful as a routing-pattern illustration, not as audited ROI. Require route logs and an external or red-team corpus before treating CyberGym percentages as procurement truth.
Sources Microsoft AI
Evidence · Vendor Claim
Microsoft · PowerPoint image generation GPU cost
Production switch claims are directionally useful for completed-task cost reviews, but they are vendor instrumentation without published methodology detail. Rebid high-volume image paths on measured GPU/token cost in your own tenant.
Sources Microsoft AI
Enterprise readiness
Permissioning
MCP 2026-07-28 plus Claude IdP-provisioned connectors push enterprise SSO and EMA as the preferred path. Ban agent-inherits-full-user-token patterns; prefer task-scoped short-lived credentials as Snowflake's agent-identity model describes.
Data Access
GitHub's read-only MCP default for code review is the right posture for automated reviewers. Research-preview MCP tunnels that reach private networks without inbound exposure still need explicit allowlists and gateway logging before production.
Auditability
Stateless MCP moves routing onto Mcp-Method and Mcp-Name headers — good for gateways, useless without capturing those headers, effective model, memory policy (retain/compact), and skill-manifest version in the run log.
Verification
Retained reasoning and compaction change what the model 'knows' mid-run. Re-verify after compaction events the same way W30 required re-verification after model failover; summary loss is a silent failure mode.
Cost
Pair Luna/Terra/Sol (or Flash/specialist/frontier) ladders with measured output tokens under compaction. A cheaper model with truncate-and-retry can outspend a mid tier that retains and compacts cleanly.
Human Approval
GitHub's default model enablement for Business/Enterprise (effective Aug 26) turns new GA models on unless the org opts out. Set policy to disabled before that date if manual model approval is required; use enterprise-teams targeting (preview) for frontier experimentation without org-wide exposure.
Scorecard
As of 2026-08-01
| Mode | Leading pattern | Representative tools | Control gap |
|---|---|---|---|
| Chat | Long-context options expand (e.g. Grok 4.5 up to 500k) while memory policy remains invisible to the end user | GitHub Copilot + Grok 4.5, Claude connectors, ChatGPT / Responses API | Consumer and IDE chat rarely expose whether reasoning was retained, when compaction ran, or which connector identity was used. |
| Cowork | Session summaries via @ mention and resident background agents (Qwen Code) plus portable skills across review and CLI | Qwen Code v0.21, GitHub Copilot review skills, Claude IdP connectors | Injected session summaries and learned skills need retention, redaction, and provenance rules before they become silent context in regulated threads. |
| Build | SKILL.md packs, read-only MCP, and header-routable MCP 2026-07-28 become the packaging layer for agent tools | MCP 2026-07-28 SDKs, GitHub .github/skills, Snowflake Cortex AI Gateway | Servers still assuming initialize/session IDs will break behind gateways; DCR-based OAuth remains transitional debt under the CIMD migration. |
| Automate | Retained-reasoning compaction plus specialist-to-generalist task-class routing as declared harness policy | OpenAI Responses API compaction, MDASH + MAI-Cyber-1-Flash, Gemini Robotics ER 2 | No independent replication of this week's vendor PoVs; production automation still needs local A/B harnesses and route-level audit envelopes. |
Try this
A/B your harness memory policy on one pinned model
Expected outcome: You leave with a side-by-side score and token delta under identical weights, plus a written rule: no model comparison ships without a declared memory policy. Expect at least one workflow where truncation was silently taxing performance.
- Pick one non-production multi-step agent eval (10–30 tasks) and pin model ID, temperature, tools, and verifier. Do not change weights between arms.
- Run arm A with your current truncation or drop-reasoning behavior. Run arm B with retained reasoning between tool calls and context compaction (Responses API settings if you are on OpenAI; equivalent summary memory if not).
- Compare task success, median output tokens, retries, and verifier failures. Any material move belongs to the scaffold — document the memory policy as a required eval dimension before the next model bake-off.
Watchlist
Next 30 days
Independent ARC-AGI / compaction replications
The week’s headline number stays vendor-grade until a third party reproduces retained-reasoning plus compaction under published harness settings.
By Aug 26
GitHub Copilot default model enablement
New GA models turn on for Business/Enterprise unless policy is set to disabled — operators who require manual approval must act before the effective date.
Aug 2026
MCP server migration off sessions and DCR
Stateless 2026-07-28 plus the CIMD deprecation floor will expose which production connectors still assume initialize, session IDs, or Dynamic Client Registration.
Next 14 days
Snowflake Cortex AI Gateway GA dates
Many cost, routing, and partner-identity controls remain private preview; contractual GA timing decides whether the gateway is a production control plane or a pilot.
Changelog
- W31 spotlights Retained-Reasoning Compaction in automate mode: identical weights, different memory policy, measured on OpenAI's vendor-reported ARC-AGI-3 harness result (13.3% → 38.3%, ~6× fewer output tokens).
- Skills/connectors center on MCP specification 2026-07-28 (normative), Claude's connector directory and tunnels, Snowflake Cortex AI Gateway, and GitHub Copilot review skills with read-only MCP GA.
- Proof-of-value entries are explicitly vendor-instrumented; no audited independent workflow ROI cleared the bar in-window.