10.08.2022
Dennis Pawlowski is research assistant at the IIB and has been working on the topic of the use of camera-based methods on construction sites since his master's thesis. As part of the EU project BIM2TWIN, which involves the creation of digital twins of construction sites, Dennis is working on equipment optimization - currently with a very special camera. What makes it so special and what it can be used for, he tells in the interview.
What kind of camera is this and what can it do?
Dennis: This is a stereovision camera (type ZED 2i) from the company Stereolabs, which has two cameras. It can be used to track objects in 3D, thanks to depth perception up to 35 meters. Furthermore, it has a special polarization filter that prevents or reduces glare and lens reflections. In addition, the camera has all sorts of sensors so that tilt, temperature and acceleration can be recorded. It also has a barometer for measuring the altitude and a magnetometer, which is a compass. All these sensors support orientation and classification of situations on site. Another advantage is the camera's ease of use. Since the construction site and the construction site environment change frequently, the camera must be easy to install. This works according to the plug & play principle. In doing so, the system calibrates itself and automatically reacquires the parameters. In addition, the camera is IP66 certified, i.e. waterproof and dustproof - ideal for outdoor use.
What will the camera be used for?
Dennis: In short, the camera is supposed to automatically detect construction materials or machinery. When a dump truck or cement mixer passes by and falls within the camera's field of view, it is supposed to recognize and track it. This information could be, for example, the position where concreting work or loading and unloading is taking place. Questions that arise are: When did the object you are looking for arrive, where is it located, or did it arrive at all? In this way, the information could be compared with the existing schedule and adjusted accordingly. The purpose is to have an accurate overview of the materials, which is crucial for large construction sites. On the one hand, the system can save time and improve and simplify the coordination of the construction site.
How does the system work?
Dennis: We have trained an AI to recognize different objects such as construction machines or vehicles in real time. Currently, the AI can distinguish between three different types of machines. These are: Cement mixers, excavators and dump trucks. However, it should later be able to distinguish a total of up to 12 different objects. We have trained the AI with different data sets so that it can recognize the vehicles under different conditions (weather, lighting conditions, etc.). Soon we want to test our current status in practice on a construction site. We are very excited to see what the results will be.
Dennis Pawlowski is research assistant at the IIB and has been working on the topic of the use of camera-based methods on construction sites since his master's thesis. As part of the EU project BIM2TWIN, which involves the creation of digital twins of construction sites, Dennis is working on equipment optimization - currently with a very special camera. What makes it so special and what it can be used for, he tells in the interview.
What kind of camera is this and what can it do?
Dennis: This is a stereovision camera (type ZED 2i) from the company Stereolabs, which has two cameras. It can be used to track objects in 3D, thanks to depth perception up to 35 meters. Furthermore, it has a special polarization filter that prevents or reduces glare and lens reflections. In addition, the camera has all sorts of sensors so that tilt, temperature and acceleration can be recorded. It also has a barometer for measuring the altitude and a magnetometer, which is a compass. All these sensors support orientation and classification of situations on site. Another advantage is the camera's ease of use. Since the construction site and the construction site environment change frequently, the camera must be easy to install. This works according to the plug & play principle. In doing so, the system calibrates itself and automatically reacquires the parameters. In addition, the camera is IP66 certified, i.e. waterproof and dustproof - ideal for outdoor use.
What will the camera be used for?
Dennis: In short, the camera is supposed to automatically detect construction materials or machinery. When a dump truck or cement mixer passes by and falls within the camera's field of view, it is supposed to recognize and track it. This information could be, for example, the position where concreting work or loading and unloading is taking place. Questions that arise are: When did the object you are looking for arrive, where is it located, or did it arrive at all? In this way, the information could be compared with the existing schedule and adjusted accordingly. The purpose is to have an accurate overview of the materials, which is crucial for large construction sites. On the one hand, the system can save time and improve and simplify the coordination of the construction site.
How does the system work?
Dennis: We have trained an AI to recognize different objects such as construction machines or vehicles in real time. Currently, the AI can distinguish between three different types of machines. These are: Cement mixers, excavators and dump trucks. However, it should later be able to distinguish a total of up to 12 different objects. We have trained the AI with different data sets so that it can recognize the vehicles under different conditions (weather, lighting conditions, etc.). Soon we want to test our current status in practice on a construction site. We are very excited to see what the results will be.
Copyright © 2022
Last update: Aug 10, 2022
