DrivingBench: Can frontier LLM models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course.

beep@piefed.world · 22 hours ago

DrivingBench: Can frontier LLM models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course.

Armand1@lemmy.world · 12 hours ago

Why the hell would you give a language model the wheel of a car?

They don’t even understand the concept of time and space. Some of them can parse an image, but typically only enough to pull text from it, and extremely slowly.

It’s like asking an overweight English teacher to play pro football.

We built visual recognition machine learning systems for this purpose.

latetolemmy@lemmy.world · 7 hours ago

They’re better drivers than low IQ humans

DrivingBench: Can frontier LLM models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course.

DrivingBench: Can frontier LLM models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course.

Report · DrivingBench