HyperDrone claims 20x faster GPU quadrotor simulation and sim-to-real transfer
Original title: HyperDrone: Simulation-to-Reality Transfer at Millions of Frames per Second
Authors say HyperLux still hits millions of frames per second on consumer GPUs at highest fidelity.
Researchers present HyperDrone, a batch quadrotor simulator they say is more than 20 times faster than existing state-of-the-art batch simulators. It runs multirotor dynamics and a new ray tracer, HyperLux, entirely on the GPU, with Nvidia OptiX, Vulkan, Apple Metal, and WebGPU backends. HyperLux can emit RGB, depth, segmentation, normals, and optical flow, including reflections, lighting, motion blur, and physically based rendering. They trained a vision-based yaw-control policy in simulation and transferred it to a camera-equipped Crazyflie running fully onboard.
Unconfirmed: Speed and fidelity figures are the authors' measurements, not independently verified.
- HyperLux supports OptiX, Vulkan, Metal, and WebGPU.
- Outputs include RGB, depth, segmentation, normals, and optical flow.
- The real platform is a small Crazyflie with an onboard camera.
- Policy transfer is demonstrated for yaw control only.
From the original article
1 min read at huggingface.co
We present HyperDrone, an extremely fast quadrotor simulator focused on high-performance batch rendering that is more than 20x faster than existing state-of-the-art batch quadrotor simulators.
By Jonas Eschmann, Giuseppe Loianno · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.