Skip to the content.

Research Pass 2 — Open Questions Closed

As of: 2026-06-04. Closes the seven items left open after pass 1 (A1, A2, A3, D1, D2, D4, D6). Each finding is anchored to primary or near-primary sources; treat the conclusions as directional and re-verify before locking architectural decisions.

Companion to PENDING.md and RESEARCH-PICKS.md.


A1 — Closed-tool architecture clues (Decagon / Sierra / Moveworks / Cresta / Aisera)

Decagon — Agent Operating Procedures (AOPs): structured procedures in plain English that compile to API calls + knowledge-base lookups + escalation criteria. A built-in Routing module decides AI-vs-human per inquiry. Compliance posture: SOC 2, ISO 27001, GDPR, HIPAA. Watchtower does real-time QA + guardrails. Strengths: knowledge-base-heavy SaaS support with an audit-trail-friendly behavior contract.

Sierra — Constellation architecture routes across multiple LLM providers with model-level guardrails to reduce hallucination. Voice-first deployment is the headline. Ghostwriter (Mar 2026) builds production agents from SOPs, call transcripts, whiteboard sketches, or plain-English descriptions.

Sources:

Decision implication for TENET:


A2 — Vector-store cost-perf at 100M+ vectors

Synthesized from a 12-DB benchmark on 100M × 768-dim vectors (identical hardware):

DB 100M-vector cost / mo Notable
Turbopuffer $800 Object-storage-native; cold-query 300-800ms; lacks hybrid search
Qdrant Cloud $5,000 Lowest latency — p50 4ms, p99 25ms among purpose-built
Weaviate $3,500 Hybrid search built in
Pinecone $7,000 Mature; high cost at scale
pgvector n/a Buckles above 50M on a single node — index builds > 2 hours, p95 > 200ms without careful tuning

Sources:

Decision implication for TENET:


A3 — MCP enterprise adoption signal

Production adoption is real and material:

Sources:

Decision implication for TENET:


D1 — Claude Agent SDK + Opus 4.8 + Haiku 4.5 current surface

Opus 4.8 (released 2026-05-28) — confirmed picks in BENCHMARKS.md remain accurate. Key SDK-relevant updates:

Sources:

Decision implication for TENET:


D2 — MCP spec changelog since 2026-06-03

Release candidate (2026-06-04 status): the 2026-07-28 spec release is the largest revision since launch. The RC is live now.

Key changes:

Sources:

Decision implication for TENET:


D4 — OSS framework refresh (Letta / Mastra / Pydantic-AI / Inkeep / OpenAI Agents SDK)

Framework 2026 positioning Notable
Mastra De facto TypeScript choice 19k+ stars; 300k+ weekly downloads; workflows + HITL primitives + Next.js integration
Pydantic AI Best Python-first for structured outputs / validation / DI Clean app architecture
OpenAI Agents SDK (TS) Next-best TS choice after Mastra  
Letta Niche — persistent-memory assistants  
Inkeep SDK TS extension to no-code platform; MCP + A2A protocols; deep customization  
LangGraph Still strongest mindshare; complex flows We design out the ecosystem’s CVE-class mistake categories by construction (see SECURITY.md); no advisory attributed here to any named project
CrewAI Multi-agent role-based; simpler than LangGraph  
Google ADK Multi-language flagship (Python + TS + Java + Go)  

Sources:

Decision implication for TENET:


D6 — Reranker head-to-head (Cohere / Voyage / BGE / Jina)

Public leaderboard snapshot (ELO + nDCG@10):

Reranker Top metric License
Zerank 2 1638 ELO (top) hosted
Cohere Rerank v4.0 Pro 1629 ELO hosted
Voyage Rerank 2.5 Fastest (~595ms p50) + quality hosted
Cohere Rerank 3.5 ~603ms p50; less favored by LLM judge hosted
Jina Reranker v3 61.94 nDCG@10 BEIR; 131k ctx; listwise (64 docs/pass) Apache-2.0
BGE-Reranker-v2-M3 Lightweight, multilingual, fast Apache-2.0
Qwen3-Reranker-4B 69.76 MTEB-R / 75.94 CMTEB-R Apache-2.0

Sources:

Decision implication for TENET:

Revised default ordering (replaces tentative pick in RESEARCH-PICKS.md):

  1. Voyage Rerank 2.5 — primary hosted: fastest + competitive quality.
  2. Cohere Rerank v4.0 Pro — secondary hosted: 1629 ELO, broader provider footprint.
  3. Qwen3-Reranker-4B — primary self-host: strongest open-weights as of 2026-06-04, Apache-2.0.
  4. Jina Reranker v3 — secondary self-host: listwise + huge context (specialty long-doc workloads).
  5. BGE-Reranker-v2-M3 — practical baseline: small, multilingual, easy ops.

Our Reranker interface in @tenet/retrieval is unchanged — each is a 4-line adapter. Update RESEARCH-PICKS.md reranker section when this ships.


Net deltas vs prior research-picks

  1. Reranker primary changed: Cohere 3.5 → Voyage Rerank 2.5 (faster + better quality at MTEB).
  2. Self-host reranker primary changed: BGE-Reranker-v2-M3 → Qwen3-Reranker-4B (stronger benchmarks, same Apache-2.0).
  3. Vector-store phase-2 default: Qdrant confirmed (lowest latency at 100M).
  4. Vector-store budget-tier: Turbopuffer added as a phase-3 archive-tier adapter target.
  5. MCP: launch-grade differentiator confirmed, not deferred. Pin 2026-07-28 spec.
  6. Direct competitor: Mastra. Worth explicit README mention.
  7. Opus 4.8 cache threshold: 1024 tokens — update cost model.