Im Rahmen des Projektes „4C4FirstResponder“ wird die Entwicklung einer Kommunikationsund Informat... more Im Rahmen des Projektes „4C4FirstResponder“ wird die Entwicklung einer Kommunikationsund Informationslösung zur optimierten Einsatzführung von Interventionskräften angestrebt. Dazu werden multisensorale Daten (Text, Audio, Bilder, Video, etc.) generiert, zu einem Lagebild zusammengeführt sowie rollenbasiert verteilt (an mobile Teams, Einsatzleitung, etc.). Kern der Kommunikationslösung ist ein Kommunikationsmanager, der TETRA und andere Netzwerktechnologien integriert, die Vorteile aller Technologien nutzen kann und Daten entsprechend von QoS-Anforderungen über diese verschiedenen Technologien verschickt. Eine weitere wichtige Komponente der Lösung ist eine Szenarien-orientierte Darstellung der Daten und Bedienung auf (mobilen) Endgeräten. Das Projekt verfolgt einen agilen Entwicklungsansatz und startete mit einer Bedarfserhebung bei den Endbenutzern (Einsatzkräfte). Damit konnte eine erste Identifikation von Einsatzszenarien und Anwendungsfällen erfolgen und ein Architekturentwurf ...
2022 International Conference on Connected Vehicle and Expo (ICCVE)
Validation and certification enabling the operation of automated vehicles may perhaps be the bigg... more Validation and certification enabling the operation of automated vehicles may perhaps be the biggest challenge for the developers of such systems. While there is a consensus about the outstanding problem and the related questions, there is, unfortunately, no widely accepted and feasible solution to this problem. The classical automotive testing and validation approaches for certifying automated vehicles would require several millions of km of on-road testing time and are unfeasible. Simulation techniques can potentially be utilized for this purpose, but the fidelity and modelling accuracy requirements are unknown. This issue is addressed by the two recent sister projects, 'testEPS' and 'Central System', co-funded via the EUREKA network and the Austrian and Hungarian Ministry of Transportation. The current paper aims to introduce both projects together with their respective goals, implementation plans and expected outcomes. They originate from an exploratory phase with initial cross-project cooperation. Due to the joint genesis and unique structure cross-projects synergies effects are expected to be realised to support future verification and validation of ADAS/AD systems, including standardization.
In recent years, verification and validation processes of automated driving systems have been inc... more In recent years, verification and validation processes of automated driving systems have been increasingly moved to virtual simulation, as this allows for rapid prototyping and the use of a multitude of testing scenarios compared to on-road testing. However, in order to support future approval procedures for automated driving functions with virtual simulations, the models used for this purpose must be sufficiently accurate to be able to test the driving functions implemented in the complete vehicle model. In recent years, the modelling of environment sensor technology has gained particular interest, since it can be used to validate the object detection and fusion algorithms in Model-in-the-Loop testing. In this paper, a practical process is developed to enable a systematic evaluation for perception–sensor models on a low-level data basis. The validation framework includes, first, the execution of test drive runs on a closed highway; secondly, the re-simulation of these test drives i...
Quality reviewer KTH Project co-funded by the European Commission within the Sixth Framework Prog... more Quality reviewer KTH Project co-funded by the European Commission within the Sixth Framework Programme (2002–2006) Dissemination Level PU Public X PP Restricted to other programme participants (including the Commission Services) RE Restricted to a group specified by the consortium (including the Commission Services) CO Confidential, only for members of the consortium (including the Commission Services)
Mobile vision services are a type of mobile ITS applications that emerge with increased miniaturi... more Mobile vision services are a type of mobile ITS applications that emerge with increased miniaturization of sensor and computing devices, such as in camera equipped mobile phones, and appropriate adoption of advanced computer vision methodologies. The interpretation of mobile imagery with reference to geo-coded information from augmented city maps offers new applications. In this paper we describe a central component in mobile geo-service application, the Mobile Mapping Data Warehouse (MOMA) as developed by Tele Atlas, and associated prototypical mobile vision services that make use of MOMA features and cognitive vision technology, such as, (i) vision based geo-indexed object recognition, (ii) image based localization, and (iii) hyperlinking reality via camera phones. We demonstrate the applicability of the state-of-the-art mobile vision technology and outline a roadmap towards the realization of future mobile ITS applications.
Um die Akzeptanz von mobilen Informationsservices zu erhöhen sind innovative, zielgrup-penorienti... more Um die Akzeptanz von mobilen Informationsservices zu erhöhen sind innovative, zielgrup-penorientierte Präsentationstechnologien erforderlich. "Augmented Reality" Lösungen ermöglichen für mobile Applikationen eine wesentliche Unterstützung in der Mensch-Maschine-Interaktion und damit neue Möglichkeiten für eine intuitive Nutzerinteraktion. Basierend auf den rasanten Entwicklungen im Bereich der mobilen Technologien, und hier speziell im Bereich der mobilen verfügbaren Sensoren sowie der Prozessorleistung und Speicherverfügbarkeit, ist eine neue Qualität von mobilen, positionsbezogenen Services realisierbar. Ziel des Projektes MARFT ist es eine innovative Präsentation sowie einen optimierten Informationszugang zu geo-orientierter Information zu ermöglichen. Im Rahmen des Pro-jektes wurde eine Outdoor-Lösung entwickelt, die eine nutzerorientierte Präsentation von touristischer Information auf handelsüblichen Smartphones ermöglicht. Besucher können bei Wanderungen in alpinen R...
This paper focuses on the innovative concept of 'intelligent digital maps'. Event and con... more This paper focuses on the innovative concept of 'intelligent digital maps'. Event and context information are stored as part of the city maps in order to make the maps intelligent and to exploit further context information of objects. In the EU funded project MOBVIS advanced methodologies are developed to aid mobile vision and context awareness tasks using the enhanced Tele Atlas 2D and 3D City Maps. Augmenting the maps with visual features, semantic and context information enables support within a given context for specifically targeted geo-services in order to deliver appropriate geo-referenced map information on demand. Preliminary results of geo-indexing the map to retrieve map information in a mobile object recognition task are presented. For the covering abstract see ITRD E134653.
In the context of mapping and mobile vision services, the recognition of objects of the urban inf... more In the context of mapping and mobile vision services, the recognition of objects of the urban infrastructure plays an important role. E.g., the recognition of buildings can foster pointers to relevant information spaces, such as, annotation services, it can provide a semantic index for scene understanding, and can enable more efficient navigation by direct reference to landmark buildings. The presented work provides a generic technology for the recognition of urban objects, i.e., buildings, in terms of a reliable mobile vision service. The presented detection system grounds recognition on a Maximum A Posteriori based decision making on weak object hypotheses from local descriptor responses in the mobile imagery. We present an improvement over standard image descriptors by selecting only informative keys for descriptor matching. Selection is applied first to reduce the complexity of the object model and second to accelerate detection by selective attention. We trained a decision tree...
We describe a system with a multi-sensor object awareness and positioning solution for augmented ... more We describe a system with a multi-sensor object awareness and positioning solution for augmented tourist information systems in urban areas. The system offers technology of outdoors vision based object recognition that will extend state-of-the-art location and context aware services towards object based awareness in urban environments. In the proposed application scenario, tourist pedestrians are equipped with a GPRS or UMTS capable camera-phone. They are interested whether their field of view contains tourist sights that would point to more detailed information. Multimedia type data about related history might be explored by a mobile user who is intending to learn within the urban environment. Ambient learning is in this way achieved by pointing the device towards the urban sight, capturing an image, and consequently getting information about the object on site and within the focus of attention, i.e., the user's current field of view. The described mobile system offers multiple...
The tourism in rural areas and national parks can be regarded as a very sensitive economic factor... more The tourism in rural areas and national parks can be regarded as a very sensitive economic factor. On the one hand eco-tourism regions and especially national parks have to present their natural environment and fascinate landscape. On the other hand they have to guide tourist streams to avoid negative effects on their assets. This paper will briefly discuss the current situation of the digital presentation of national parks and includes also tourism aspects in the surrounding rural areas. It will discuss proposals for a novel interactive multimedia information system, while focusing on the various components of such a system.
We describe a mobile vision system that is capable of automated object identification using image... more We describe a mobile vision system that is capable of automated object identification using images captured from a PDA or a camera phone. We present a solution for the enabling technology of outdoors vision based object recognition that will extend state-of-the-art location and context aware services towards object based awareness in urban environments. In the proposed application scenario, tourist pedestrians are equipped with GPS, W-LAN and a camera attached to a PDA or a camera phone. They are interested whether their field of view contains tourist sights that would point to more detailed information. Multimedia type data about related history, the architecture, or other related cultural context of historic or artistic relevance might be explored by a mobile user who is intending to learn within the urban environment. Ambient learning is in this way achieved by pointing the device towards the urban sight, capturing an image, and consequently getting information about the object o...
Daily appropriate decision making on nutrition requires application of knowledge where it matters... more Daily appropriate decision making on nutrition requires application of knowledge where it matters, and being adjusted to the individual requirements. We present a highly personalized mobile application that assists the user in appropriate food choices during grocery shopping, while simultaneously incorporating a personalized dietary recommender system. The application can be used in video based augmented reality mode, where a computer vision algorithm recognizes presented food items and thus replaces tedious search within the food database. The recognition system employs a shallow Convolutional Neural Network (CNN) based classifier running at 10 fps. An innovative user study demonstrates the high usability and user experience of the application. The vision classifier is evaluated on a newly introduced reference image database containing 81 grocery foods (vegetables, fruits).
Im Rahmen des Projektes „4C4FirstResponder“ wird die Entwicklung einer Kommunikationsund Informat... more Im Rahmen des Projektes „4C4FirstResponder“ wird die Entwicklung einer Kommunikationsund Informationslösung zur optimierten Einsatzführung von Interventionskräften angestrebt. Dazu werden multisensorale Daten (Text, Audio, Bilder, Video, etc.) generiert, zu einem Lagebild zusammengeführt sowie rollenbasiert verteilt (an mobile Teams, Einsatzleitung, etc.). Kern der Kommunikationslösung ist ein Kommunikationsmanager, der TETRA und andere Netzwerktechnologien integriert, die Vorteile aller Technologien nutzen kann und Daten entsprechend von QoS-Anforderungen über diese verschiedenen Technologien verschickt. Eine weitere wichtige Komponente der Lösung ist eine Szenarien-orientierte Darstellung der Daten und Bedienung auf (mobilen) Endgeräten. Das Projekt verfolgt einen agilen Entwicklungsansatz und startete mit einer Bedarfserhebung bei den Endbenutzern (Einsatzkräfte). Damit konnte eine erste Identifikation von Einsatzszenarien und Anwendungsfällen erfolgen und ein Architekturentwurf ...
2022 International Conference on Connected Vehicle and Expo (ICCVE)
Validation and certification enabling the operation of automated vehicles may perhaps be the bigg... more Validation and certification enabling the operation of automated vehicles may perhaps be the biggest challenge for the developers of such systems. While there is a consensus about the outstanding problem and the related questions, there is, unfortunately, no widely accepted and feasible solution to this problem. The classical automotive testing and validation approaches for certifying automated vehicles would require several millions of km of on-road testing time and are unfeasible. Simulation techniques can potentially be utilized for this purpose, but the fidelity and modelling accuracy requirements are unknown. This issue is addressed by the two recent sister projects, 'testEPS' and 'Central System', co-funded via the EUREKA network and the Austrian and Hungarian Ministry of Transportation. The current paper aims to introduce both projects together with their respective goals, implementation plans and expected outcomes. They originate from an exploratory phase with initial cross-project cooperation. Due to the joint genesis and unique structure cross-projects synergies effects are expected to be realised to support future verification and validation of ADAS/AD systems, including standardization.
In recent years, verification and validation processes of automated driving systems have been inc... more In recent years, verification and validation processes of automated driving systems have been increasingly moved to virtual simulation, as this allows for rapid prototyping and the use of a multitude of testing scenarios compared to on-road testing. However, in order to support future approval procedures for automated driving functions with virtual simulations, the models used for this purpose must be sufficiently accurate to be able to test the driving functions implemented in the complete vehicle model. In recent years, the modelling of environment sensor technology has gained particular interest, since it can be used to validate the object detection and fusion algorithms in Model-in-the-Loop testing. In this paper, a practical process is developed to enable a systematic evaluation for perception–sensor models on a low-level data basis. The validation framework includes, first, the execution of test drive runs on a closed highway; secondly, the re-simulation of these test drives i...
Quality reviewer KTH Project co-funded by the European Commission within the Sixth Framework Prog... more Quality reviewer KTH Project co-funded by the European Commission within the Sixth Framework Programme (2002–2006) Dissemination Level PU Public X PP Restricted to other programme participants (including the Commission Services) RE Restricted to a group specified by the consortium (including the Commission Services) CO Confidential, only for members of the consortium (including the Commission Services)
Mobile vision services are a type of mobile ITS applications that emerge with increased miniaturi... more Mobile vision services are a type of mobile ITS applications that emerge with increased miniaturization of sensor and computing devices, such as in camera equipped mobile phones, and appropriate adoption of advanced computer vision methodologies. The interpretation of mobile imagery with reference to geo-coded information from augmented city maps offers new applications. In this paper we describe a central component in mobile geo-service application, the Mobile Mapping Data Warehouse (MOMA) as developed by Tele Atlas, and associated prototypical mobile vision services that make use of MOMA features and cognitive vision technology, such as, (i) vision based geo-indexed object recognition, (ii) image based localization, and (iii) hyperlinking reality via camera phones. We demonstrate the applicability of the state-of-the-art mobile vision technology and outline a roadmap towards the realization of future mobile ITS applications.
Um die Akzeptanz von mobilen Informationsservices zu erhöhen sind innovative, zielgrup-penorienti... more Um die Akzeptanz von mobilen Informationsservices zu erhöhen sind innovative, zielgrup-penorientierte Präsentationstechnologien erforderlich. "Augmented Reality" Lösungen ermöglichen für mobile Applikationen eine wesentliche Unterstützung in der Mensch-Maschine-Interaktion und damit neue Möglichkeiten für eine intuitive Nutzerinteraktion. Basierend auf den rasanten Entwicklungen im Bereich der mobilen Technologien, und hier speziell im Bereich der mobilen verfügbaren Sensoren sowie der Prozessorleistung und Speicherverfügbarkeit, ist eine neue Qualität von mobilen, positionsbezogenen Services realisierbar. Ziel des Projektes MARFT ist es eine innovative Präsentation sowie einen optimierten Informationszugang zu geo-orientierter Information zu ermöglichen. Im Rahmen des Pro-jektes wurde eine Outdoor-Lösung entwickelt, die eine nutzerorientierte Präsentation von touristischer Information auf handelsüblichen Smartphones ermöglicht. Besucher können bei Wanderungen in alpinen R...
This paper focuses on the innovative concept of 'intelligent digital maps'. Event and con... more This paper focuses on the innovative concept of 'intelligent digital maps'. Event and context information are stored as part of the city maps in order to make the maps intelligent and to exploit further context information of objects. In the EU funded project MOBVIS advanced methodologies are developed to aid mobile vision and context awareness tasks using the enhanced Tele Atlas 2D and 3D City Maps. Augmenting the maps with visual features, semantic and context information enables support within a given context for specifically targeted geo-services in order to deliver appropriate geo-referenced map information on demand. Preliminary results of geo-indexing the map to retrieve map information in a mobile object recognition task are presented. For the covering abstract see ITRD E134653.
In the context of mapping and mobile vision services, the recognition of objects of the urban inf... more In the context of mapping and mobile vision services, the recognition of objects of the urban infrastructure plays an important role. E.g., the recognition of buildings can foster pointers to relevant information spaces, such as, annotation services, it can provide a semantic index for scene understanding, and can enable more efficient navigation by direct reference to landmark buildings. The presented work provides a generic technology for the recognition of urban objects, i.e., buildings, in terms of a reliable mobile vision service. The presented detection system grounds recognition on a Maximum A Posteriori based decision making on weak object hypotheses from local descriptor responses in the mobile imagery. We present an improvement over standard image descriptors by selecting only informative keys for descriptor matching. Selection is applied first to reduce the complexity of the object model and second to accelerate detection by selective attention. We trained a decision tree...
We describe a system with a multi-sensor object awareness and positioning solution for augmented ... more We describe a system with a multi-sensor object awareness and positioning solution for augmented tourist information systems in urban areas. The system offers technology of outdoors vision based object recognition that will extend state-of-the-art location and context aware services towards object based awareness in urban environments. In the proposed application scenario, tourist pedestrians are equipped with a GPRS or UMTS capable camera-phone. They are interested whether their field of view contains tourist sights that would point to more detailed information. Multimedia type data about related history might be explored by a mobile user who is intending to learn within the urban environment. Ambient learning is in this way achieved by pointing the device towards the urban sight, capturing an image, and consequently getting information about the object on site and within the focus of attention, i.e., the user's current field of view. The described mobile system offers multiple...
The tourism in rural areas and national parks can be regarded as a very sensitive economic factor... more The tourism in rural areas and national parks can be regarded as a very sensitive economic factor. On the one hand eco-tourism regions and especially national parks have to present their natural environment and fascinate landscape. On the other hand they have to guide tourist streams to avoid negative effects on their assets. This paper will briefly discuss the current situation of the digital presentation of national parks and includes also tourism aspects in the surrounding rural areas. It will discuss proposals for a novel interactive multimedia information system, while focusing on the various components of such a system.
We describe a mobile vision system that is capable of automated object identification using image... more We describe a mobile vision system that is capable of automated object identification using images captured from a PDA or a camera phone. We present a solution for the enabling technology of outdoors vision based object recognition that will extend state-of-the-art location and context aware services towards object based awareness in urban environments. In the proposed application scenario, tourist pedestrians are equipped with GPS, W-LAN and a camera attached to a PDA or a camera phone. They are interested whether their field of view contains tourist sights that would point to more detailed information. Multimedia type data about related history, the architecture, or other related cultural context of historic or artistic relevance might be explored by a mobile user who is intending to learn within the urban environment. Ambient learning is in this way achieved by pointing the device towards the urban sight, capturing an image, and consequently getting information about the object o...
Daily appropriate decision making on nutrition requires application of knowledge where it matters... more Daily appropriate decision making on nutrition requires application of knowledge where it matters, and being adjusted to the individual requirements. We present a highly personalized mobile application that assists the user in appropriate food choices during grocery shopping, while simultaneously incorporating a personalized dietary recommender system. The application can be used in video based augmented reality mode, where a computer vision algorithm recognizes presented food items and thus replaces tedious search within the food database. The recognition system employs a shallow Convolutional Neural Network (CNN) based classifier running at 10 fps. An innovative user study demonstrates the high usability and user experience of the application. The vision classifier is evaluated on a newly introduced reference image database containing 81 grocery foods (vegetables, fruits).
Uploads
Papers by Patrick Luley