RZ/V2H and RZ/V2N RAW
Handling RAW Color Formats
Non-Image Processing
V4L2 API standard supports both packed( RAW 6,7,9,10,14,20) and unpacked ( RAW8 and16) RAW Bayer formats, but most modern drivers use packed formats for efficiency (especially for >8-bit data). The exact behavior depends on the sensor and driver implementation. The Renesas MIPI and CRU assumes the camera sensor RAW data is packed ( see table below).
If the RZ/V2H CRU is setup to output RAW ( not RGB ) the image from the MIPI interface is output as 256bit block ( 4 x 64bit blocks). The table below shows the memory format.
Padding differs depending on which RAW is used.This layout is not the same as the standard V4L2 layout. It is designed to be compatible with the Renesas ISU ( Image Scaling Unit ) and ISP. The ISU features include scaling and format conversion.
The ISU can be used with the gstreamer by using the Renesas Gstreamer plugin vspmfilter.
Image Processing
RAW is passed through De-mosaic and output RGB888.
Bypass
MIPI Camera dtata bypasses the CRU
MIPI-CSI Format is maintained
Not supported on Standard RZ/V2H and RZ/V2N AI SDK. ( Contact FAE for support )
Terminology
Bayer Format
Most digital cameras use a Bayer filter—a color filter array (CFA) over the sensor that captures only one color per pixel (Red, Green, or Blue). The missing colors are interpolated later (demosaicing) to produce a full-color image.
8-bit Bayer Formats (Uncompressed)
RGGB(8-bit): Red-Green top, Green-Blue bottom.BA81(8-bit): Alias forBGGR(Blue-Green top, Green-Red bottom).GRBG(8-bit): Green-Red top, Blue-Green bottom.GBRG(8-bit): Green-Blue top, Red-Green bottom.
10-bit Bayer Formats (Uncompressed)
RG10,BG10,BA10,GB10: Same patterns as above but with 10 bits per pixel.
12-bit Bayer Formats (Uncompressed)
RG12,BG12,BA12,GB12: Higher precision (12 bits per pixel).
14-bit Packed Bayer Formats
pREE,pBEE,pgEE,pGEE: 14-bit Bayer data packed into bytes (space-efficient storage).pREE= Packed Red-Green (RGGB) 14-bit.pBEE= Packed Blue-Green (BGGR) 14-bit.pgEE= Packed Green-Red (GRBG) 14-bit.pGEE= Packed Green-Blue (GBRG) 14-bit.
16-bit Bayer Formats (Uncompressed)
RG16,BYR2,GR16,GB16: Full 16-bit depth per pixel.BYR2is an alias forBGGR(16-bit).