ASI-Bench: At the Dawn of Artificial Superintelligence

Summary

ASI-Bench is the first benchmark to jointly evaluate AI systems' capabilities in innovative exploration and autonomous scientific execution across general research domains, and the first to progressively withdraw human methodological guidance within the same project to test how far AI can proceed independently. Built by over 40 experts with 31,000+ human hours, it includes 60 project-level tasks across 11 scientific domains. Across 18 state-of-the-art agent-model configurations, average scores drop from 50.91 with full guidance to 29.10 with only method specified, and 26.62 when agents must determine methods themselves, showing current systems heavily depend on human guidance and are far from autonomous end-to-end research. The benchmark is open for global contributions.