Skip to content

Operating layer

Agent Techniques Weekly

For builders operationalizing agentic work.

Two harness settings tripled a vendor ARC-AGI-3 score on the same model — so re-run your agent evals before you blame the weights

Big read

OpenAI reported taking its ARC-AGI-3 public-set score from 13.3% to 38.3% by changing two Responses API harness settings on the same model: retain private reasoning between tool calls, and replace rolling truncation at 175k characters with context compaction. It also reported roughly 6× fewer output tokens. That is the week's central technique result — and it is vendor-measured on one benchmark by the company selling the API, with no independent replication yet. Discount it accordingly. The practical instruction does not need the replication to hold: before you attribute a performance gap to model quality, re-run the evaluation with identical weights and a different memory policy.

The transferable pattern is Retained-Reasoning Compaction. Truncation forces the model to re-derive plans every turn once the window rolls; discarding private chain-of-thought between tool calls throws away hypotheses the next action needed. Compaction keeps learned environment state inside the window as a summary rather than a hard cut. Measure both task success and output tokens. If your harness still hard-truncates long trajectories, you are measuring the truncation policy as much as the model.

The rest of the week made the same point from the connector and routing side. MCP specification 2026-07-28 went final as a normative, stateless request/response core — no initialize handshake, no session ID, method and name in headers, MRTR for mid-call elicitation, cacheable list results, and a twelve-month deprecation floor as Dynamic Client Registration yields to client metadata documents. Anthropic shipped a 950+ connector directory with IdP-provisioned enterprise connectors and research-preview MCP tunnels for private-network servers without inbound exposure. GitHub took Agent skills plus read-only MCP to general availability in Copilot code review on Jul 29. Snowflake positioned Cortex AI Gateway as a data-plane control plane for MCP and third-party agents, with many gateway features still private preview.

Put together: fix the memory policy, then fix the connector contract, then encode task-class routing as harness policy. Microsoft's MDASH with MAI-Cyber-1-Flash handling roughly 90% of tasks before escalating to frontier models is the same pattern as Luna-default / Terra-mid / Sol-exception economics on GPT-5.6 fleets — specialist first, expensive generalist last. Independent audited workflow ROI with baseline and method still did not clear the bar this week. Treat CyberGym, ARC-AGI, and GPU-cost claims as vendor instrumentation until someone else reproduces them.

Technique of the week

Automate

Retained-Reasoning Compaction

OpenAI's vendor-reported ARC-AGI-3 jump (13.3% → 38.3%, ~6× fewer output tokens) came from harness memory settings on unchanged weights. That does not prove every workload will triple, but it does prove memory policy is a first-class evaluation variable. Operators who only swap models are confounding scaffold effects with intelligence. Fix the retention and compaction contract, instrument success and tokens, then decide whether a weight change is even warranted.

Trigger
A multi-step tool loop approaches the context ceiling, or successive tool calls discard private reasoning between turns. The failure mode is repeated re-planning and rising output tokens without commensurate task progress.
Retain reasoning
Keep private reasoning items across tool calls rather than stripping them at each hop. The next action should inherit hypotheses, constraints, and partial plans already formed — not reconstruct them from truncated transcripts.
Compact, do not truncate
When the window fills, replace rolling hard truncation (OpenAI's prior official harness cut at 175k characters) with a summary compaction of older turns that preserves environment state, decisions taken, and open questions.
Tools
Use an API surface that can thread prior response state and compaction (OpenAI documents this via the Responses API with retained reasoning). Homegrown harnesses should store reasoning items and emit an explicit compaction artifact the model can read.
Verifier
Score the same task suite under both memory policies with identical weights. Track task success, output tokens, retries, and verifier pass rate. A score move without a token move, or the reverse, is a scaffold signal — not a model ranking.
Escalation
If compaction summaries lose critical state, split the trajectory into checkpointed stages with human review rather than silently truncating. Do not escalate to a larger model until the memory-policy A/B has been run.
  • An ARC-style or long research agent on GPT-5.6 Sol keeps reasoning between tool calls and compacts context via the Responses API instead of truncating at a character ceiling — OpenAI's vendor-reported public-set path from 13.3% to 38.3%.
  • A coding agent whose repo exploration exceeds the window stores a compaction summary of files already inspected and open hypotheses, then continues tool use without re-listing the tree from scratch each turn.
  • An evaluation harness pins model ID and temperature, then runs two arms — truncate vs compact+retain — before any bake-off concludes that Model A beats Model B.

Sources OpenAI (ARC-AGI-3 harness settings post)

New agent capabilities

2026-07-29 · OpenAI · Automate

Responses API / GPT-5.6 Sol harness

Re-run agent evaluations with identical weights and a different memory policy before attributing a gap to the model. Treat the triple as a vendor-measured scaffold effect until independent parties reproduce it.

Sources OpenAI

2026-07-27 · Microsoft · Automate

MDASH with MAI-Cyber-1-Flash

Encode task-class routing — cheap specialist to expensive generalist — as harness policy with route logs, not as chat defaults. Demand evidence of when Flash versus frontier models actually ran.

Sources Microsoft AI

2026-07-29 · GitHub · Build

Copilot code review (Agent skills + MCP)

Ship org coding standards as versioned skills and wire issue/docs MCP with read-only as the adoption gate. Prefer the same skill pack across cloud agent, CLI, and review rather than one-off prompts.

Sources GitHub Changelog

2026-07-28 · GitHub / xAI · Build

Grok 4.5 in GitHub Copilot

Add Grok as an optional coding route only after admin policy and data-retention review. Long context is not a substitute for compaction discipline on multi-hour agent jobs.

Sources GitHub Changelog

2026-07-30 · Google DeepMind · Automate

Gemini Robotics ER 2

Treat physical agents as the same pattern as software agents — planner plus actuator plus safety stop — and demand ASIMOV-Agentic and human-proximity evidence before production pilots.

Sources Google DeepMind

2026-07-30 · Alibaba / Qwen · Cowork

Qwen Code v0.21.x

Session memory is becoming a first-class UX primitive. Prefer inject-summary over resume/fork when you need context without hijacking the current thread, and version learned skills like code.

Sources Qwen Code Docs

2026-07-30 · OpenAI · Automate

GPT-5.6 Luna / Terra / Sol fleet

Redesign agent graphs around Luna default, Terra mid, Sol exception. Pair the economic ladder with task-class routing so the expensive node is an escalation, not the idle default.

Sources OpenAI

New skills and connectors

2026-07-28 · Model Context Protocol · Connector

MCP specification 2026-07-28

Inventory every MCP server for hidden session assumptions, plan gateway routing on headers, prefer EMA for enterprise SSO, and treat Dynamic Client Registration as transitional debt under RFC 9207 issuer hardening.

Sources MCP Blog

2026-07-28 · Anthropic · Connector

Claude connectors directory + MCP tunnels

Prefer IdP-provisioned connectors over user-owned OAuth sprawl. Use tunnels for private tools only in preview with explicit network policy; production still needs a gateway audit trail.

Sources Anthropic / Claude

2026-07-28 · Snowflake · Harness

Cortex AI Gateway

Put MCP behind a data-plane gateway before enabling IDE agents against warehouse tools. Treat preview controls as non-contractual until GA dates are in writing.

Sources Snowflake

2026-07-29 · GitHub · Skill

Portable SKILL.md + read-only MCP for PR review

One versioned skill pack can serve cloud agent, CLI, and review. Read-only MCP is the right default for any automated reviewer that can see production systems of record.

Sources GitHub Changelog

Proof of value

Evidence · Benchmark

OpenAI · ARC-AGI-3 public task set via agent harness

This is the week's strongest technique evidence and still grade-discounted: same company, same API surface, one benchmark, no independent reproduction. Use it as a mandate to A/B memory policy under pinned weights — not as proof that every agent will triple overnight.

Sources OpenAI

Evidence · Vendor Claim

Microsoft · MDASH vulnerability find / validate / remediate (CyberGym)

Useful as a routing-pattern illustration, not as audited ROI. Require route logs and an external or red-team corpus before treating CyberGym percentages as procurement truth.

Sources Microsoft AI

Evidence · Vendor Claim

Microsoft · PowerPoint image generation GPU cost

Production switch claims are directionally useful for completed-task cost reviews, but they are vendor instrumentation without published methodology detail. Rebid high-volume image paths on measured GPU/token cost in your own tenant.

Sources Microsoft AI

Enterprise readiness

Permissioning

MCP 2026-07-28 plus Claude IdP-provisioned connectors push enterprise SSO and EMA as the preferred path. Ban agent-inherits-full-user-token patterns; prefer task-scoped short-lived credentials as Snowflake's agent-identity model describes.

Data Access

GitHub's read-only MCP default for code review is the right posture for automated reviewers. Research-preview MCP tunnels that reach private networks without inbound exposure still need explicit allowlists and gateway logging before production.

Auditability

Stateless MCP moves routing onto Mcp-Method and Mcp-Name headers — good for gateways, useless without capturing those headers, effective model, memory policy (retain/compact), and skill-manifest version in the run log.

Verification

Retained reasoning and compaction change what the model 'knows' mid-run. Re-verify after compaction events the same way W30 required re-verification after model failover; summary loss is a silent failure mode.

Cost

Pair Luna/Terra/Sol (or Flash/specialist/frontier) ladders with measured output tokens under compaction. A cheaper model with truncate-and-retry can outspend a mid tier that retains and compacts cleanly.

Human Approval

GitHub's default model enablement for Business/Enterprise (effective Aug 26) turns new GA models on unless the org opts out. Set policy to disabled before that date if manual model approval is required; use enterprise-teams targeting (preview) for frontier experimentation without org-wide exposure.

Scorecard

As of 2026-08-01

ModeLeading patternRepresentative toolsControl gap
ChatLong-context options expand (e.g. Grok 4.5 up to 500k) while memory policy remains invisible to the end userGitHub Copilot + Grok 4.5, Claude connectors, ChatGPT / Responses APIConsumer and IDE chat rarely expose whether reasoning was retained, when compaction ran, or which connector identity was used.
CoworkSession summaries via @ mention and resident background agents (Qwen Code) plus portable skills across review and CLIQwen Code v0.21, GitHub Copilot review skills, Claude IdP connectorsInjected session summaries and learned skills need retention, redaction, and provenance rules before they become silent context in regulated threads.
BuildSKILL.md packs, read-only MCP, and header-routable MCP 2026-07-28 become the packaging layer for agent toolsMCP 2026-07-28 SDKs, GitHub .github/skills, Snowflake Cortex AI GatewayServers still assuming initialize/session IDs will break behind gateways; DCR-based OAuth remains transitional debt under the CIMD migration.
AutomateRetained-reasoning compaction plus specialist-to-generalist task-class routing as declared harness policyOpenAI Responses API compaction, MDASH + MAI-Cyber-1-Flash, Gemini Robotics ER 2No independent replication of this week's vendor PoVs; production automation still needs local A/B harnesses and route-level audit envelopes.

Try this

A/B your harness memory policy on one pinned model

Expected outcome: You leave with a side-by-side score and token delta under identical weights, plus a written rule: no model comparison ships without a declared memory policy. Expect at least one workflow where truncation was silently taxing performance.

  • Pick one non-production multi-step agent eval (10–30 tasks) and pin model ID, temperature, tools, and verifier. Do not change weights between arms.
  • Run arm A with your current truncation or drop-reasoning behavior. Run arm B with retained reasoning between tool calls and context compaction (Responses API settings if you are on OpenAI; equivalent summary memory if not).
  • Compare task success, median output tokens, retries, and verifier failures. Any material move belongs to the scaffold — document the memory policy as a required eval dimension before the next model bake-off.

Watchlist

Next 30 days

Independent ARC-AGI / compaction replications

The week’s headline number stays vendor-grade until a third party reproduces retained-reasoning plus compaction under published harness settings.

By Aug 26

GitHub Copilot default model enablement

New GA models turn on for Business/Enterprise unless policy is set to disabled — operators who require manual approval must act before the effective date.

Aug 2026

MCP server migration off sessions and DCR

Stateless 2026-07-28 plus the CIMD deprecation floor will expose which production connectors still assume initialize, session IDs, or Dynamic Client Registration.

Next 14 days

Snowflake Cortex AI Gateway GA dates

Many cost, routing, and partner-identity controls remain private preview; contractual GA timing decides whether the gateway is a production control plane or a pilot.

Changelog

  • W31 spotlights Retained-Reasoning Compaction in automate mode: identical weights, different memory policy, measured on OpenAI's vendor-reported ARC-AGI-3 harness result (13.3% → 38.3%, ~6× fewer output tokens).
  • Skills/connectors center on MCP specification 2026-07-28 (normative), Claude's connector directory and tunnels, Snowflake Cortex AI Gateway, and GitHub Copilot review skills with read-only MCP GA.
  • Proof-of-value entries are explicitly vendor-instrumented; no audited independent workflow ROI cleared the bar in-window.