DC

The Unbearable Lightness of Agent Optimization — Alberto Romero, Jointly

Nov 24, 2025 · 17:58

Alberto Romero, co-founder and CTO of Jointly, introduces Meta-ACE, a meta-optimization framework that orchestrates multiple adaptation strategies to overcome the limitations of single-dimensional context engineering like ACE. The framework uses a meta-controller to profile task complexity, uncertainty, verifiability, and resource constraints, then allocates strategies across context, compute, verification, memory, and parameter dimensions. Initial results show 8-11% improvement on agent benchmarks, 30-40% reduction in compute costs, and 6-8% gains on domain-specific tasks. Meta-ACE addresses ACE's weak reflector problem with quality gates and multi-signal reflection, feedback brittleness via a hierarchical verification cascade (self-verification, multimodal consensus, execution checks), and task complexity mismatch by dynamically adjusting strategy allocation to save up to 90% compute on simple tasks. Future work includes scaling to multimodal and compound AI systems, with challenges in meta-controller training stability, computational overhead, and verification cascade brittleness.

Vision AI in 2025 — Peter Robicheaux, Roboflow

Aug 3, 2025 · 17:24

Peter Robicheaux, ML lead at Roboflow, argues vision models are not smart because they fail at basic visual tasks like telling time on a watch or identifying a school bus direction. He attributes this to saturated evals like ImageNet and COCO, and to vision models not leveraging large pre-training like language models. Roboflow introduces RFDetter, a real-time detector using a Dynav2 backbone, achieving second SOTA on COCO and large gains on their new RF100VL dataset of 100 diverse domains. The benchmark shows specialist models fine-tuned on 10-shot examples outperform large VLMs like Qwen2.5 VL 72B, indicating VLMs are strong linguistically but weak visually. Roboflow's platform is free for researchers contributing data back; dataset at rf100vl.org.