Can frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course.
attemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commandsAccepted set_motion and stop_now calls during the attempt.tokens · costTotal tokens and cost at list prices for the attempt, including the reflection after it.
attemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commandsAccepted set_motion and stop_now calls during the attempt.tokens · costTotal tokens and cost at list prices for the attempt, including the reflection after it.
attemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commandsAccepted set_motion and stop_now calls during the attempt.tokens · costTotal tokens and cost at list prices for the attempt, including the reflection after it.
attemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commandsAccepted set_motion and stop_now calls during the attempt.tokens · costTotal tokens and cost at list prices for the attempt, including the reflection after it.