Jetson Xavier SDK for Image and Video Processing on GPU

NVIDIA Jetson AGX Xavier is the latest mobile processor with high-performance Volta GPU architecture, which includes 8-core 64-bit ARM and CUDA Tensor cores, 8K video encoding and decoding. Jetson Xavier brings high CPU and GPU performance to mobile heterogeneous computing. Imaging applications that require high performance in real time, low energy consumption and large amount of memory, can now be created with Jetson Xavier. Fastvideo has ported its high performance Image & Video Processing SDK to Jetson to offer fast solutions on NVIDIA Jetson AGX Xavier for realtime imaging and video applications.

That high performance SDK for image and video processing on GPU is a set of separate components which correspond to standard image processing pipeline for camera applications. Jetson SDK covers all image processing stages starting from camera raw image acquisition to JPEG and JPEG2000 compression with storage to RAM or HDD. All image processing is fully done on GPU and this leads to exceptionally high performance. That SDK is also compatible with Jetson Nano, TX1 and TX2.

Jetson SDK Features

• Image acquisition from a camera, CPU RAM or GPU memory
• Dark frame subtraction (FPN)
• Flat-Field Correction (Shading Correction)
• White Balance
• Exposure correction
• Raw Bayer Curves and Levels (master and RGB)
• Raw Denoiser (wavelets and/or median filter)
• Debayer HQLI, DFPD, MG algorithms
• Denoiser for luma and chroma (wavelets, bilateral, NLM)
• Color Correction with matrix profile
• Color Transforms: RGB->YCbCr, YCbCr->RGB, RGB->HSV, HSV->RGB, etc.
• Tone mapping at RGB or HSV with 1D LUTs
• 3D LUTs for RGB and HSV
• RGB Histogram and Parade (waveform monitor)
• Crop
• Rotation to 90/180/270 degrees and flip/flop
• Resize (downscale or upscale)
• Remap (rotation to arbitrary angle, affine transform, perspective transform, projection, arbitrary mapping)
• Gamma (composite or per-color component)
• Sharpening (USM)
• Realtime output via OpenGL
• JPEG codec (8/12 bits per channel)
• Raw Bayer codec for lossy encoding and decoding (8/12 bits per channel)
• JPEG2000 codec (8-16 bits per channel)
• Trace
• Multiplexor
• Stream-per-thread support for better performance

Benchmarks for Fastvideo SDK on Jetson Nano, TK1, TX1, TX2, AGX Xavier

• Jetson Nano benchmarks
• Jetson TK1 benchmarks
• Jetson TX1 benchmarks
• Jetson TX2 benchmarks
• Jetson AGX Xavier benchmarks