Real-time Image Processing for 400 fps 2.7 MPix camera with 10-GigE
Updated:
Image processing for camera applications has one very essential feature: it should not allow frame drops, all image processing should be done at real time. This is exactly what we can offer for high-speed and high data rate cameras which generate huge streams. With GPU-based ISP we can even perform long-term recording with maximun performance.
Detailed benchmark data. Measured results are published on our benchmark pages: all benchmarks.
How do you process a 400 fps camera stream in real time?
Image acquisition
Frame unpacking for 10-bit and 12-bit modes
Image linearization
Dark frame subtraction (FPN)
Flat-Field Correction (shading correction)
Bad pixel removal
Adaptive Exposure and Gain control
Exposure correction (brightness control)
Denoiser: Bilateral, NLM
Rotation to 90/180/270 degrees and flip/flop
Crop
Resize (downscale and upscale)
Rotation to an arbitrary angle
Undistortion via LCP or via calibrated maps
Sharpening
Gamma transform
JPEG compression and storage on SSD
Available software outputs
Video output to monitor via OpenGL in real time
Camera statistics
Real-time processing and JPEG compression with image storage on SSD
Vision System Components
10-GigE monochrome camera 2.7 MPix at 380 fps
External PCIe Gen3 x4 frame grabber with 4 x SFP+, compatible with optical/electrical ports
Lens with C-mount
Cable to connect camera and grabber
PC with installed NVIDIA GPU, Windows/Linux
Tripod
About the author
Fyodor Serzhenko, PhD, is the founder and CEO of Fastvideo. He earned his PhD at the Moscow Institute of Physics and Technology (MIPT) in 1993. Since 2009 he has led the development of Fastvideo’s GPU-accelerated image codecs and ISP modules, including the Fastvideo SDK. Connect on LinkedIn.
Why you can trust these results
Fastvideo has built GPU-accelerated image processing software since 2009. Our codecs comply with the standards they implement — JPEG (ITU-T T.81 / ISO IEC 10918) and JPEG2000 (ITU-T T.800 / ISO IEC 15444) — and our tools are open source on GitHub. Every performance figure we publish is reproducible: see our benchmark methodology, download the Fastvideo SDK benchmark report (PDF), and measure it on your own GPU.