Real-time Image Processing for 400 fps 2.7 MPix camera with 10-GigE

Image processing for camera applications has one very essential feature: it should not allow frame drops, all image processing should be done at real time. This is exactly what we can offer for high-speed and high data rate cameras which generate huge streams. With GPU-based ISP we can even perform long-term recording with maximun performance.

Camera Features

• IMX421 image sensor: 1936 * 1472 pixels, 4.5μm * 4.5μm
• Global Shutter CMOS
• Bit depth: 8/10/12-bit
• Frame rate up to 409 fps (8-bit)
• Exposure time 7μs-10s
• Analog Gain 0-24dB
• Digital Gain 0.004-8.000x
• Data Rate 1165 MB/s (8-bit)
• 10-GigE interface
• Dynamic Range ≥72 dB
• Optical Size: 10.94mm
• Lens interface: C-mount
• Temperature monitor
• Power Supply DC12-24V(±10%) 2.5A
• Power Consumption: 16.0 W
• Dimensions 70.0mm(W) x 70.0mm(H) x 73.2mm(D)(Without adapter)
• Camera manufacturer: Hefei I-TEK Optoelectronics Co., LTD.

Image processing pipeline on GPU

• Image acquisition
• Frame unpacking for 10-bit and 12-bit modes
• Image linearization
• Dark frame subtraction (FPN)
• Flat-Field Correction (shading correction)
• Bad pixel removal
• Adaptive Exposure and Gain control
• Exposure correction (brightness control)
• Denoiser: Bilateral, NLM
• Rotation to 90/180/270 degrees and flip/flop
• Crop
• Resize (downscale and upscale)
• Rotation to an arbitrary angle
• Undistortion via LCP or via calibrated maps
• Sharpening (local contrast)
• Gamma transform
• JPEG compression and storage on SSD

Available software outputs

• Video output to monitor via OpenGL in real time
• Camera statistics
• Realtime processing and JPEG compression with image storage on SSD

Vision System Components

• 10-GigE monochrome camera 2.7 MPix at 400 fps
• External PCIe Gen3 x4 frame grabber with 4 x SFP+, compatible with optical/electrical ports
• Lens with C-mount
• Cable to connect camera and grabber
• PC with installed NVIDIA GPU, Windows/Linux
• Tripod