RZ/V2H and RZ/V2N RAW

RZ/V2H and RZ/V2N RAW


Handling RAW Color Formats

Non-Image Processing

  • V4L2 API standard supports both packed( RAW 6,7,9,10,14,20) and unpacked ( RAW8 and16) RAW Bayer formats, but most modern drivers use packed formats for efficiency (especially for >8-bit data). The exact behavior depends on the sensor and driver implementation. The Renesas MIPI and CRU assumes the camera sensor RAW data is packed ( see table below). 

    If the RZ/V2H CRU is setup to output RAW ( not RGB ) the image from the MIPI interface is output as 256bit block ( 4 x 64bit blocks). The table below shows the memory format.
    Padding differs depending on which RAW is used. 

  • Screenshot from 2025-04-04 13-08-49-20250404-200849.png

     

    This layout is not the same as the standard V4L2 layout. It is designed to be compatible with the Renesas ISU ( Image Scaling Unit ) and ISP. The ISU features include scaling and format conversion. 
    The ISU can be used with the gstreamer by using the Renesas Gstreamer plugin vspmfilter.  

Image Processing

  • RAW is passed through De-mosaic and output RGB888.

Bypass

  • MIPI Camera dtata bypasses the CRU 

  • MIPI-CSI Format is maintained

  • Not supported on Standard RZ/V2H and RZ/V2N AI SDK. ( Contact FAE for support )

Terminology

  • Bayer Format

    •  Most digital cameras use a Bayer filter—a color filter array (CFA) over the sensor that captures only one color per pixel (Red, Green, or Blue). The missing colors are interpolated later (demosaicing) to produce a full-color image.

    • 8-bit Bayer Formats (Uncompressed)

      • RGGB (8-bit): Red-Green top, Green-Blue bottom.

      • BA81 (8-bit): Alias for BGGR (Blue-Green top, Green-Red bottom).

      • GRBG (8-bit): Green-Red top, Blue-Green bottom.

      • GBRG (8-bit): Green-Blue top, Red-Green bottom.

    • 10-bit Bayer Formats (Uncompressed)

      • RG10BG10BA10GB10: Same patterns as above but with 10 bits per pixel.

    • 12-bit Bayer Formats (Uncompressed)

      • RG12BG12BA12GB12: Higher precision (12 bits per pixel).

    • 14-bit Packed Bayer Formats

      • pREEpBEEpgEEpGEE: 14-bit Bayer data packed into bytes (space-efficient storage).

      • pREE = Packed Red-Green (RGGB) 14-bit.

      • pBEE = Packed Blue-Green (BGGR) 14-bit.

      • pgEE = Packed Green-Red (GRBG) 14-bit.

      • pGEE = Packed Green-Blue (GBRG) 14-bit.

    • 16-bit Bayer Formats (Uncompressed)

      • RG16BYR2GR16GB16: Full 16-bit depth per pixel.

      • BYR2 is an alias for BGGR (16-bit).