PhAIL: A Real-Robot VLA Benchmark and Distributional Methodology
Launches a real-robot VLA benchmark on Franka FR3 with distributional metrics beyond binary success rates.
Evidence notes
- Includes analysis code, paper sources, annotation pipeline, dataset metadata, and public dataset download instructions.
- Reports throughput-style comparisons across public VLA systems using time-to-success curves, bootstrap confidence intervals, and KS tests.