idler is a San Francisco-based frontier data research lab and AI evaluation platform that develops comprehensive benchmarking suites and reinforcement learning environments for frontier AI models. It specializes in long-horizon software engineering, cybersecurity, and safety testing beds and provides evaluation datasets and benchmarks such as ShelfLife to stress-test autonomous agents.