Post-training environments
Build RL environments and preference-signal datasets for post-training and evaluation, with an emphasis on calibrated reward signals and pass@k targets.
Producto de entornos RL de Labelbox para posentrenamiento y evaluación de tareas de IA de largo alcance.
Horizon is Labelbox’s RL environment product for post-training and evaluation. It focuses on generating software-based environments, preference signals, and rubrics for long-horizon AI tasks where reward signal quality matters.
The product is positioned for reasoning, tool use, and computer use across economically important knowledge-work domains. The site describes use cases such as autonomous AI research, scientific knowledge work, agent coding, multimodal work, voice with agentic tool use, computer use, and cybersecurity.
Build RL environments and preference-signal datasets for post-training and evaluation, with an emphasis on calibrated reward signals and pass@k targets.
Model tasks around reasoning, tool use, and computer use, including long-horizon workflows where verification and intermediate rewards matter.
Use WorldSim-style simulations to recreate enterprise environments such as GitLab, Jira, CRM, email, and chat with realistic business data.
Design configurable scenarios that generate diverse tasks at scale, including outages, workflow changes, and other long-tail situations.
Capture preference labels across agent trajectories to turn human judgment into structured comparisons for reward modeling.
Apply the same environment and evaluation approach across knowledge work domains such as autonomous research, software engineering, multimodal work, voice agents, computer use, and cybersecurity.
Create simulations for enterprise knowledge work so agents can practice tasks in systems that resemble GitLab, Jira, CRM, email, and chat.
Generate reward signals and rubrics for long-horizon tasks where models need intermediate verification rather than only final-answer scoring.
Build training and eval sets for software agents that debug, author PRs, and work through multi-step software engineering workflows.
Construct scenarios for cybersecurity work, including attack and defense tasks with programmatic verification and adversarial edge cases.
Tune environments for knowledge work that spans text, images, charts, documents, and structured data within a single workflow.
Labelbox positions Horizon as RL environments and preference-signal infrastructure for post-training and evaluation. It is built for reasoning, tool use, computer use, autonomous research, scientific knowledge work, agent coding, and cybersecurity.
The source describes Horizon as software-generated RL environments at scale, with calibrated reward signals and preference labels. It emphasizes scenarios, verification, difficulty progression, and credit assignment for long-horizon tasks.
Horizon is presented for frontier AI labs and teams working on long-horizon, economically important knowledge-work domains. The examples shown include scientific knowledge work, agent coding, computer use, and cybersecurity.
The source does not list public pricing or packaging details for Horizon. It provides a contact path and a start-for-free call to action on the main site.
Los datos de tráfico son solo como referencia.
oqoqo.ai
Plataforma de evaluación para ejecutar experimentos repetibles con agentes en entornos realistas y aislados. Permite crear benchmarks privados, comparar agentes y modelos e investigar por qué los flujos de trabajo tienen éxito o fallan.
artificialanalysis.ai
Plataforma independiente de evaluación y análisis de IA para comparar modelos, proveedores de inferencia y hardware, con planes Pro y Enterprise y una API gratuita con datos de benchmarks y límites de uso.
superannotate.com
Plataforma de datos de IA para crear flujos de anotación y evaluación de imágenes, vídeo, texto y audio.
opentrain.ai
Marketplace y servicio gestionado para contratar formadores de IA, etiquetadores de datos y expertos de dominio previamente evaluados, para RLHF, evaluación, red teaming, anotación y flujos de trabajo con agentes en tus herramientas actuales.
computearena.ai
Directorio comunitario de benchmarks para medir el rendimiento de modelos de IA locales en distintos chips, cuantizaciones y entornos de ejecución.