The company is implementing a Project co-financed by the European Union under the European Funds for a Smart Economy program. The goal is to develop a novel IT system for:
High-level analysis and interpretation of visual data in monitoring systems using LLM while preserving data privacy.
The project aims to create a groundbreaking space analysis and monitoring system. Our goal is to build an IT system utilizing a network of Arabox devices (created in an earlier R&D project) that can 'see' – i.e., detect objects, including people and movements in places like stores or open spaces where Digital Out Of Home (DOOH) advertising devices are installed, but in a way that protects individual privacy – without facial identification or other personal data. The central element of the Project is the creation of modern software using Large Language Models (LLM), enabling our system not only to observe but also to 'understand' and 'translate' what the cameras have recorded. This will allow users of our proposed system to ask questions about occurring events and receive explanations in a simple, understandable way. The system developed in the Project will enable not only continuous observation of space in a store or the area where a DOOH device is to have an impact but also intelligent interpretation of situations and interaction with the user, providing answers to questions about the scene without violating the privacy of observed individuals. The Project will develop unique methods for detecting so-called mid-level visual tokens, which will preserve the anonymity of observed individuals while providing a rich description of their states and activities. Additionally, a solution will be developed allowing for object re-identification over a wide area, far exceeding the capabilities of individual sensors. Modern techniques such as vision transformer architectures will enable behavior analysis in the context of larger gatherings.
The result of the Project will be an ambitious combination of visual monitoring and artificial intelligence with the potential to revolutionize customer analysis systems while maintaining ethical data protection standards.
#FunduszeEuropejskie
ARA collects and aggregates audience data in physical spaces OUT OF HOME
