3D Light Field Vision and Plenoptic Camera
Resolution
up to 65 MegaRays
Lateral Resolution in X and Y
Max. 25% of original image sensor resolution
Extended Depth-of-Field
up to factor x6
Frame Rate
max 600 FPS with R21 at full resolution
3D depth resolution
Approx. up to several 1.000 discrete depth layers
Lens mount
C-Mount, Canon EF, Nikon/F-mount, M42, M58, M72
WHY WOULD I WANT TO USE LIGHT-FIELDS?
The 3D light field cameras work particularly well for small objects. You can use a standard lens, a telecentric lens or a microscope to select desired field-of-view and depth resolution. The patented micro lens array offers an optimal combination of high effective resolution and extended depth-of-field. Since you only need a single camera and a single shot you can
- estimate the 3D position of objects situated deeply inside a cylindrical enclosure
- take images of moving objects at high frame rates using a flash or strobe
- obtain 3D data through a standard microscope in a single shot.
The effective lateral resolution is at most a quarter of the sensor resolution and the depth resolution is about 1% of the total depth-of-field. The absolute values depend on the main lens used. Typical application areas are:
- Automated optical 3D inspection in industry.
- Measurement of 3D flow with a single access point in fluid mechanics research.
- 3D Plant analysis for breeding, picking or weeding.
- 3D Microscopy for industrial parts.
HOW DOES IT WORK?
To obtain 2D and 3D data from a single shot, we need mainly two things: a micro lens array (MLA) and software algorithms.
The MLA is placed in front of the image sensor inside the camera, which turns the image sensor into a micro-camera array, where each micro-camera sees part of the intermediate image from a slightly different perspective. That is, instead of using a large camera array that looks at the object directly, we can choose a main lens to select the desired field-of-view and create the intermediate image in front of the micro camera array. The images generated by the camera in this setup are processed on a PC with appropriate software algorithms to calculate the scene depth and to reconstruct a 2D image.
All of the processing is done on a GPU, which allows to typically process 60 26 megaray raw images per second, resulting in thirty 6 megapixel 2D & 3D images per second (30 FPS).
INTEGRAL PHOTOGRAPHY: INSECT’S COMPOUND EYE
Raytrix light field cameras enable you to simultaneously record the 2D image and metrically calibrated 3D depth information of a scene with just a single camera and a single main lens in a single shot.
This typically works with standard lighting and even a flash. For difficult surfaces a pattern projector can also be used. The exposure time is only limited by the camera electronics and the available amount of light. The cameras perform no processing internally, they simply deliver a raw image to a PC, which is then processed on a GPU to obtain the 2D and 3D data.
In principle, any camera can be turned into a light field camera. Cameras are available with USB3, 10GigE or CoaxPress connection types, with different frame rates, resolutions and sensor sizes. Most cameras are available in color and mono version and some are available as NIR version.
WHAT ELSE?
You can obtain 2D & 3D data in a single shot but you pay with effective lateral resolution. Raytrix cameras have a maximal effective lateral resolution of about one quarter of the sensor resolution. This effective lateral resolution also varies over the whole depth-of-field. The camera is setup by focusing the main lens to the furthest plane you are interested in. From this plane towards the camera the depth can be calculated and a 2D image reconstructed. Everything that lies behind this plane can not be reconstructed at all. The effective lateral resolution is highest at the focus plane and drops as you get closer to camera.
The depth resolution is typically 1% of the total depth-of-field, which in turn depends on the focal length of the main lens and the focus setting. It is possible select different main lenses for the same light field camera to adjust the depth-of-field to your needs. However, the larger the field-of-view, the larger the depth-of-field and the closer you need to be to the main lens to obtain a good depth resolution. In particular, this means that a light field camera in combination with a wide-angle lens can only see depth differences close to the main lens.
On the other hand, light field cameras work well within the macro realm, with microscopes and also with telescopes.
4D Plenoptic Image Sensor | up to 65 Megarays for 60 FPS video, 12 Megarays for 340 FPS high speed, and 151 Megarays for 6 FPS. Sensor for RGB, Mono and NIR spectrum available. |
Lateral Resolution in X and Y | Max. 25% of original image sensor resolution Rx, e.g. R26 delivers max. 26 x 0.25 = 6,5 MP resolution |
Data Format | RGB-Z, RGB-Depth, PCD Point-Clouds, Bitmap, SDK for direct Matrix and Array Data Access, Raytrix RAY-files, and many more… |
Extended Depth-of-Field | thanks to the patented multi-focus Microlens-Array (MLA) technology we, the DoF is being extended up to factor x6 |
Frame Rate | max 340 FPS with R12 at full resolution (and CoaxPress computer interface). Binning and ROI is also possible optional. |
3D depth resolution | Approx up to several 1.000 discrete depth layers, strongly depending on object being captured in 3D |
Microlens Array (MLA) | Polymer on Glass F/2.4, F/2.8, F/4, F/5.6, F/7, F/8, F/26, F/30 (we offer full customized micro lens array optics meeting your needs) Multi-Focus Microlens-Array Worldwide Patent |
Computer Interfaces | Camera-Link, CoaxPress, USB3, GigE, Dual-GigE, 10GigE, PCIe |
Lens mount | C-Mount, Nikon/F-mount, M42, M58, M72 |
Software support | MVTec Halcon plugin interface, SDK/API programming interface for Microsoft Windows, supports HMD such as the Oculus Rift, NVIDIA 3D |
Hardware requirements | >8GB VRAM, NVIDIA RTX 2080 Ti, Titan V, RTX Titan, RTX Quadro, SLI and Multi-GPU support |
Software requirements | Microsoft Windows 10 Pro (64bit), CUDA, latest nvidia Studio Driver |
Applications | Video, VR/AR/MR, Immersive Sports, Fluid flow (3D Particle tracking, PIV), Light Field R&D, machine vision, plant research, animal research, visual quality inspection, scientific imaging, surface inspection, life science, … |
Operation Environments | Indoor/Outdoor, 24/5 Industrial Production Lines, Aerospace, Underwater, Robotics Endeffectors, Mobile, Nuclear Plants, Parabolic Flight |
1- 3D LIGHT-FIELD MACHINE VISION AND OPTICAL INSPECTION
by 4D Plenoptic Technology
With a single Raytrix light field 3D camera you can capture both: 3D object surface and the 2D object image. The patented micro lens array design used in Raytrix cameras extends the depth-of-field compared to standard cameras and offers a high effective resolution, which makes them the highest resolving light field cameras on the market.
- 2D & 3D DATA FROM A SINGLE CAMERA, A standard 2D image and the 3D surface profile can be calculated from a single exposure with a single Raytrix camera.
- FAST IMAGE CAPTURE, Since only a single image is needed, images can be taken at high frame rates also with flash light.
- GOES WHERE OTHER 3D SYSTEMS CAN’T GO, Ideally suited for small objects or deep-seated structures.
Test pin height and body with 3D connector inspection. Capture 2D & 3D data with a single camera in a single exposure.Metric calibration of the light field camera allows you to measure in all three dimensions: pin heights and pin 2D positions. Independent of Pin Material.
Microscopic dimensions 3D bonding wire inspection. Inspect microscopic parts in 3D – with a single shot, a standard microscope and no special lighting. The patented multi-focus light field technology increases the depth-of-field dramatically. The software RxLive makes it easy to metrically calibrate the microscope light field system, enabling you to measure directly in the recorded images.
Surface Analysis 3D key inspection. Capture 2D & 3D data with a single camera in a single exposure. Metric calibration of the light field camera allows you to measure in all three dimensions to create an exact copy in all three dimensions. The 3D surface model can be generated with standard light if the object surface offers sufficient structure.
2-PIV / PTV 3D PARTICLE FLUID DYNAMICS
by Monocular 4D Plenoptic Technology
- SINGLE CAMERA VOLUMETRIC PTV 3D particle positions and 3D velocities with a single camera
- EASY METRIC CALIBRATION Cameras can be easily metrically calibrated with the Raytrix software RxLive.
- VERSATILE APPLICATION Many different cameras types available including double shot, high speed capture and micro PTV.
Simultaneous flow and surface measurement using a R29 PTV. The same camera is used to capture the particle flow and the variations of the surface due to the flow.Only one camera is needed, which largely simplifies the experimental setup. Particles are tracked within a volume of 100 x 100 x 60 mm (WxHxD).
RXFLOW Software. RxFlow analyses flow from a single or a sequence of double shots, as well as from continuous image captures. The 3D flow is calculated directly from the raw light field images assuming particle images. RxFlow visualizes the data in 3D and can also store it in ParaView file format or for interactive visualization in PowerPoint. Watch the video here
3- 3D VOLUME EXAMPLES
EXAMPLE APPLICATION | CAMERA MODEL | FIELD-OF-VIEW WIDTH (X) IN MM | FIELD-OF-VIEW HEIGHT (Y) IN MM | DEPTH-OF-FIELD (Z) IN MM | MINIMAL WORKING DISTANCE IN MM | MAXIMAL WORKING DISTANCE IN MM | LATERAL RESOLUTION (X,Y) IN MICRONS | DEPTH RESOLUTION (Z) IN MICRONS | MAX. FRAME RATE IN FPS |
---|---|---|---|---|---|---|---|---|---|
Face Recognition and Detection | R26 | 500 | 500 | 500 | 670 | 3200 | 250 | 1000 | 80 |
Flat Panel and Mobile Device Display | R50 | 90 | 68 | 16 | 135 | 660 | 23 | 50 | 30 |
Gesture Recognition | R26 | 300 | 300 | 300 | 420 | 2000 | 140 | 600 | 80 |
Microscopy Cell Characterization | R12micro | 0,22 | 0,15 | 0,01 | 0,19 | 0,25 | 0,25 | 60 | |
Phenotyping and Plant Growth Research | R50 | 300 | 300 | 300 | 420 | 2000 | 140 | 600 | 30 |
Pick & Place Robotics | R50 | 500 | 380 | 300 | 450 | 2100 | 160 | 800 | 30 |
Pin & Connector Inspection | R42 | 20 | 14 | 9 | 170 | 350 | 5 | 12 | 7 |
Pin & Connector Inspection | R8 | 20 | 14 | 9 | 170 | 350 | 10 | 20 | 30 |
Pin & Connector Inspection | R50 | 75 | 57 | 15 | 130 | 610 | 19 | 35 | 30 |
PIV/PTV Headlamp Flow Model | R12 | 300 | 225 | 300 | 430 | 2000 | 150 | 1000 | 330 |
PIV/PTV: Stent / Aneurysm Particel / Fluid Flow Mechanics | R12macro | 60 | 45 | 45 | 140 | 1000 | 30 | 150 | 330 |
Semiconductor Bonding Wires, PCBs, SMDs, MLCCs | R26macro | 7,8 | 7,8 | 1,1 | 48 | 3 | 2,5 | 80 | |
Semiconductor MEMS Scanner | R12micro | 0,65 | 0,44 | 0,06 | 20 | 0,7 | 0,4 | 60 | |
Semiconductor Solder Paste | R50macro | 12,1 | 9,2 | 1,1 | 48 | 3,1 | 1,5 | 30 | |
Small Parts and Hard-to-Access Areas | R12macro | 22 | 17 | 15 | 250 | 400 | 11 | 20 | 330 |
Small Parts Pick&Place and Bin Picking | R12 | 45 | 34 | 15 | 450 | 22 | 40 | 330 |
- Heinze, Christian, et al. “Automated robust metric calibration algorithm for multifocus plenoptic cameras.” IEEE Transactions on Instrumentation and Measurement 65.5 (2016): 1197-1205.
- Perwass, Christian, and Lennart Wietzke. “Single lens 3D-camera with extended depth-of-field.” Human Vision and Electronic Imaging XVII. Vol. 8291. International Society for Optics and Photonics, 2012.
Description
WHY WOULD I WANT TO USE LIGHT-FIELDS?
The 3D light field cameras work particularly well for small objects. You can use a standard lens, a telecentric lens or a microscope to select desired field-of-view and depth resolution. The patented micro lens array offers an optimal combination of high effective resolution and extended depth-of-field. Since you only need a single camera and a single shot you can
- estimate the 3D position of objects situated deeply inside a cylindrical enclosure
- take images of moving objects at high frame rates using a flash or strobe
- obtain 3D data through a standard microscope in a single shot.
The effective lateral resolution is at most a quarter of the sensor resolution and the depth resolution is about 1% of the total depth-of-field. The absolute values depend on the main lens used. Typical application areas are:
- Automated optical 3D inspection in industry.
- Measurement of 3D flow with a single access point in fluid mechanics research.
- 3D Plant analysis for breeding, picking or weeding.
- 3D Microscopy for industrial parts.
HOW DOES IT WORK?
To obtain 2D and 3D data from a single shot, we need mainly two things: a micro lens array (MLA) and software algorithms.
The MLA is placed in front of the image sensor inside the camera, which turns the image sensor into a micro-camera array, where each micro-camera sees part of the intermediate image from a slightly different perspective. That is, instead of using a large camera array that looks at the object directly, we can choose a main lens to select the desired field-of-view and create the intermediate image in front of the micro camera array. The images generated by the camera in this setup are processed on a PC with appropriate software algorithms to calculate the scene depth and to reconstruct a 2D image.
All of the processing is done on a GPU, which allows to typically process 60 26 megaray raw images per second, resulting in thirty 6 megapixel 2D & 3D images per second (30 FPS).
INTEGRAL PHOTOGRAPHY: INSECT’S COMPOUND EYE
Raytrix light field cameras enable you to simultaneously record the 2D image and metrically calibrated 3D depth information of a scene with just a single camera and a single main lens in a single shot.
This typically works with standard lighting and even a flash. For difficult surfaces a pattern projector can also be used. The exposure time is only limited by the camera electronics and the available amount of light. The cameras perform no processing internally, they simply deliver a raw image to a PC, which is then processed on a GPU to obtain the 2D and 3D data.
In principle, any camera can be turned into a light field camera. Cameras are available with USB3, 10GigE or CoaxPress connection types, with different frame rates, resolutions and sensor sizes. Most cameras are available in color and mono version and some are available as NIR version.
WHAT ELSE?
You can obtain 2D & 3D data in a single shot but you pay with effective lateral resolution. Raytrix cameras have a maximal effective lateral resolution of about one quarter of the sensor resolution. This effective lateral resolution also varies over the whole depth-of-field. The camera is setup by focusing the main lens to the furthest plane you are interested in. From this plane towards the camera the depth can be calculated and a 2D image reconstructed. Everything that lies behind this plane can not be reconstructed at all. The effective lateral resolution is highest at the focus plane and drops as you get closer to camera.
The depth resolution is typically 1% of the total depth-of-field, which in turn depends on the focal length of the main lens and the focus setting. It is possible select different main lenses for the same light field camera to adjust the depth-of-field to your needs. However, the larger the field-of-view, the larger the depth-of-field and the closer you need to be to the main lens to obtain a good depth resolution. In particular, this means that a light field camera in combination with a wide-angle lens can only see depth differences close to the main lens.
On the other hand, light field cameras work well within the macro realm, with microscopes and also with telescopes.
Related Products
-
HiCAM Fluo High Speed Intensified Camera
Rated 0 out of 5HiCAM FLUO is a high-speed camera for fluorescence applications. It records high resolution images at a frame rate of 1,000
-
Cyclone High-Speed CoaXPress 2.0 cameras
Rated 0 out of 5CamPerform-Cyclone series cameras are high-speed CMOS cameras for machine vision applications. The cameras use the fast CoaXPress 2.0 interface to
-
CamRecord Sprinter-FHD High-speed Camera
Rated 0 out of 5The Sprinter-FHD high-speed camera is equipped with a large-format, light-sensitive image sensor that records the fastest movements. With a high
-
CamPerform CP, High-Speed CoaXPress cameras
Rated 0 out of 5CUTTING-EDGE CAMERA TECHOLOGY FOR YOUR AUTOMATION SOLUTION Here are our convincing arguments for a compelling image-processing machine vision solution: CoaXPress
-
MAGIC HDR
Rated 0 out of 5MAGIC camera is a 1.3 M pixels (1280 x 1024 active pixels) Wide Dynamic Range CMOS image sensor which benefits from
-
HICATT High Speed Intensifier
Rated 0 out of 5The HiCATT is an intensified camera attachment specifically designed for use in combination with high-speed cameras. It can be used
-
CamRecord Sprinter-HD High-speed Camera
Rated 0 out of 5The Sprinter-HD high-speed camera of the CamRecord-Sprinter series is equipped with a large-format, highly light-sensitive image sensor that records the