Introducing Quadra Video Processing Units
Encoder
Quadra has 4 encoder cores, all cores support H.264/H.265/AV1 and JPEG.
Decoder
Quadra has 4 decoder cores that support H.264/H.265/VP9 and JPEG.
Connection
A PCIe Gen4 x4 interface provides highspeed connectivity to the host PC, with up to 6 GB/s of bidirectional data. The allows the host to transfer up to 10 bit YUV 8k@60fps. Low speed connectivity is provided via 2x I2C, SPI, UART, GPIO, and JTAG interfaces.
2D Engine
Quadra also includes a 2D Engine that contains 4 GPUs. The GPUs are capable of multiple types of operation on raw video input. Some supported GPU operations are:
- Scaling
- Cropping
- Video overlay
- Video format conversion
- Draw box
- Rotation
AI
Quadra also has 2 Deep Neural Network processing blocks each containing an AI engine. The AI engine is capable of 18 Trillion Operations Per Second (TOPs) for typical DNN operations, such as:
- Object detection
- Classification
- Segmentation
One application of the AI engine is to send Region of Interest (ROI) information to the encoder. The ROI is a dynamic, AI selected area of a frame, this can then be used by the encoder to improve image quality. Another AI use case for Quadra is background replacement. The background of a video can be replaced with a different, static background.