Announcing Rockchip RK3588 ISP Support
After three months of rapid development, we are excited to announce that we now have a working camera pipeline running on the RK3588 using the integrated image signal processor (ISP), with fully functional auto exposure and auto white balance.
Over the past few years there has been a lot of ongoing work in the Linux kernel community to upstream the Rockchip RK3588 SoC. Naturally, Ideas on Board joined the effort to implement camera support.
Leveraging our expertise in cameras, Ideas on Board has completed in record time the enablement for the key components of the image processing pipeline in the RK3588 ISP. This involves support for image statistics and ISP parameters in the kernel, as well as the image capture pipeline in libcamera including the auto exposure and auto white balance control algorithms.
Development was done on an Orange Pi CM5 Base with a Rasbperry Pi Camera v2 (IMX219).
Getting the full image capture pipeline on the RK3588 was a combined effort, with Collabora providing support for the video capture (CSI-2 receiver and VICAP) blocks of the RK3588, and Rockchip providing a skeleton driver with memory-to-memory input to the ISP. This allowed us to focus our efforts on the ISP and its control algorithms.
Following our upstream-first philosophy at Ideas on Board, all of this work targets mainline. An initial version of patches will be posted in the near future, at which point you can try out and review the code. Support for the Orange Pi CM5 Base itself has already been upstreamed in v7.0 as a side product of this effort. In the meantime, here is a preview of what you can expect:
What’s next in development? We have a few more essential image processing blocks in the works, and of course tuning needs to be done as well. Support for operating the ISP in inline mode will also be tackled as a joint effort with Collabora. Other than that, you can decide what feature of the ISP should be implemented next by contacting us.
We will be demoing this work at the Embedded Recipes conference in Nice on May the 27th and 28th. Come meet us there to talk about your camera needs, and extend your stay with the libcamera developers day on the 29th!