Critical Systems Engineering - Socio-technical Vehicle Systems (The Car that Cares)
Due to the increasing automation human-machine-interaction becomes more and more important. In this project, the socio-technical relationship between the individual driver and the technical systems of the vehicle is investigated regarding a future car “that cares”. Areas of research also include the surrounding traffic and road infrastructures. The scope of the CSE subproject The Car That Cares (CtC) is the development of socio - technical vehicle systems, which continuously adapt to internal (e.g. driver 's health, current tasks) and external conditions (e.g. weather, traffic) to offer a situation-related cooperative interaction with the driver of the car. The project addresses elderly drivers (aged 65 and over) who are increasing in numbers due to the demographic change. On the one hand, elderly drivers have a higher risk of accidents due to various restrictions accompanying the decline in age (such as perception or attention shift) that are crucial for driving. On the other hand, elderly drivers have a personal desire and a social need to stay mobile and independent as long as possible. High-resolution information about the drivers ‘cognitive status is essential to prevent overload situations and to enhance their performance.
Aim
We want to assess the cognitive, emotional, and health status of the driver within the car by a multi-sensor approach. Systems are developed to support the driver and provide recommendations to improve safety, comfort, and health through adaptive multimodal user interfaces. The focus of our research group is the development of robust procedures for the detection and context-specific modulation of the neurocognitive status of the elderly driver. We want to improve processing capabilities and reaction times to support appropriate and safe actions even in traffic situations with increasing complexity and under time pressure.
Approach
Therefore, our research group develops and refines systems for the detection and enhancement of cognitive performance and evaluates their suitability for application:
We develop a special mobile fNIRS system that makes it possible to measure cognitive load reliably in realistic environments. The mobile fNIRS will be more robust against environmental influences (movement of the subject, stray light) and achieve higher signal quality.
Transcranial alternating current (tACS) is investigated as a method for modulating the neurocognitive driver's status, also for the elderly. In tACS, electrodes glued to the head generate an alternating current field that influences intrinsic brain waves. tACS can modify certain brain waves and thus, among other things, increase cognitive capabilities (e.g. in learning tasks). We investigate the applicability of tACS to the driving context. Current scenarios are the enhancement of attention or reaction times during monotonous or tedious driving tasks.
In the Living Lab State Characterization and Identification (LL SCI) neurocognitive measurement methods for studies in the driving context are prepared. These methods are going to be used to evaluate previous results and to gain further insights into the neuronal activities in complex driving situations. In addition to systems like fNIRS and tACS, imaging techniques such as MEG and MRI are used and appropriate MRI and MEG suitable driving simulator hardware (steering wheels and pedals) are developed. These components will be integrated into a processing system together with a driving simulator and used in studies.
Grants and cooperations
The interdisciplinary research center for the design of safety-critical socio-technical systems investigates the role of humans in the control of complex transport systems on land and water. Cooperation partners are OFFIS e.V. in Oldenburg, DLR Institute for Traffic Systems Engineering in Braunschweig and the network SafeTRANS. Currently, the project is funded in the second phase by the state of Lower Saxony with EUR 2 million. The project runtime was extended by additional 18 months (2017-2018).
B. Löffler, H. I. Stecher, S. Fudickar, D. de Sordi, F. Otto-Sobotka, A. Hein, and C. Herrmann, "Counteracting the Slowdown of Reaction Times in a Vigilance Experiment with 40-Hz Transcranial Alternating Current Stimulation" IEEE - Transactions on Neural Systems & Rehabilitation Engineering.
@article{ALofflerBSStecherHIFudickarSdeSordiDOtto-SobotkaFHeinA2018, abstract = {Indicators for a decrement in vigilance are a slowdown in reaction times and an increase in alpha power in the electroencephalogram (EEG) in posterior regions of the brain. Transcranial alternating current stimulation (tACS) is a neuropsychological technique that has been found to interact with intrinsic brain oscillations and is able to enhance cognitive and behavioral performance. Recent studies showed that tACS in the gamma frequency range (30-80 Hz) is able to downregulate amplitudes in the alpha frequency range (8-12 Hz), in accordance to the effect referred to as cross-frequency coupling, where intrinsic alpha and gamma waves modulate each other. We applied 40 Hz gamma-tACS to the visual cortex during a vigilance experiment and investigated if stimulation improves reaction times and error rates with time-on-task. In our sham controlled experiment, participants completed two blocks of 30 minutes duration while performing the same visual two-choice task. The first block was used as BASELINE. A statistical analysis with a linear mixed model (LMM) revealed a significantly lower increase of modeled reaction times over time in the INTERVENTION-block of the tACS-group as compared to their BASELINE-block whereas there was no significant change between the BASELINE- and INTERVENTION-block for the SHAM-group. Error rates did not differ between groups. This study indicates that gamma-tACS can enhance performance in vigilance tasks as it significantly decreased the slowdown of reaction times in our study.},
author = {L\"{o}ffler, BS and Stecher, H I and Fudickar, S and de Sordi, D and Otto-Sobotka, F and Hein, A and Herrmann, CH},
journal = {IEEE - Transactions on Neural Systems {\&} Rehabilitation Engineering},
title = {{Counteracting the Slowdown of Reaction Times in a Vigilance Experiment with 40-Hz Transcranial Alternating Current Stimulation}},
year = {2018},
url = {https://ieeexplore.ieee.org/document/8458158}
}
N. Volkening, A. Unni, J. W. Rieger, S. Fudickar, and A. Hein, "Development of a Mobile Functional Near-Infrared Spectroscopy Prototype" in Proc. Internet of Vehicles. Technologies and Services Towards Smart City, Cham, 2018.
@inproceedings{Volkening2018b,
author="Volkening, Nils and Unni, Anirudh and Rieger, Jochem W. and Fudickar, Sebastian and Hein, Andreas", editor="Skulimowski, Andrzej M.J. and Sheng, Zhengguo and Khemiri-Kallel, Sond{\`e}s and C{\'e}rin, Christophe and Hsu, Ching-Hsien", title="Development of a Mobile Functional Near-Infrared Spectroscopy Prototype", booktitle="Internet of Vehicles. Technologies and Services Towards Smart City", year="2018", publisher="Springer International Publishing", address="Cham", pages="146--161", abstract="Driving is a complex and cognitively demanding task. It is important to assess the cognitive state of the driver in order to develop cognitive technical systems that can adapt to different cognitive states of the driver. For this purpose, we have developed a mobile functional near-infrared spectroscopy (mofNIRS) prototype. This paper describes the improvements of this mobile prototype with freely placeable optodes on a subject's head and the results of an evaluation study. We conducted a motor cortex experiment with four subjects, whereby the mobile prototype was mounted on the right hemisphere and a commercial, stationary fNIRS on the left hemisphere above the motor cortex area. One data set had to be discarded due to incorrect synchronization between both systems. The results of the remaining three subjects are presented and discussed in this paper. Here, we report the results from the time-series and Statistical Parametric Mapping (SPM) analyses, which shows t-values with high differentiability of the Results. Furthermore, both analysis methods show comparable results between the commercial system and the mobile prototype.", isbn="978-3-030-05081-8" }
N. Volkening, A. Unni, S. Becker, J. W. Rieger, S. Fudickar, and A. Hein, "Development of a Mobile Functional Near-infrared Spectroscopy Prototype and its Initial Evaluation: Lessons Learned" in Proc. Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference on - PETRA '18, 2018.
doi: 10.1145/3197768.3201534
@inproceedings{Volkening2018d, abstract = {This paper presents a new mobile near-infrared functional spectroscopy (fNIRS) device, with digital detectors that can be placed anywhere on the head and fit into standard caps to measure cortical brain activation. The device's functionality was evaluated in two steps, i.e. first, by means of simple pulse measurements and second, in a motor cortex study with nine subjects. In this study, the subjects had to alternate between right and left hands while using hand-held strength trainers. While the signals from the mobile prototype were not yet stable enough across all channels to perform analysis such as statistical parametric mapping, it was able to measure significant brain activation changes over the area of the motor cortex with the mobile prototype when the contralateral hand was activated in four subjects. In contrast, the device was yet unable to measure ipsilateral activities. The problems encountered and possible methods to improve signal acquisition are discussed at the end of the paper.},
author = {Volkening, Nils and Unni, Anirudh and Becker, Sabeth and Rieger, Jochem W and Fudickar, Sebastian and Hein, Andreas},
doi = {https://doi.org/10.1145/3197768.3201534},
keywords = {AMTCSE,AMTUNI,accepted,fnirs,full paper,functional near-infrared spectroscopy,is a non-invasive,method for the imaging,mobile fnirs,motor cortical activity,of the central nervous,prototype,system and is used},
title = {{Development of a Mobile Functional Near-infrared Spectroscopy Prototype and its Initial Evaluation: Lessons Learned}},
booktitle = {Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference on - PETRA '18},
isbn = {9781450363907},
pages = {214--221},
publisher = {ACM Press},
url = {http://dl.acm.org/citation.cfm?doid=3197768.3201534},
year = {2018}
}
S. Blum, S. Debener, R. Emkes, N. Volkening, S. Fudickar, and M. G. Bleichner, "EEG Recording and Online Signal Processing on Android: A Multiapp Framework for Brain-Computer Interfaces on Smartphone" BioMed Research International Hindawi, vol. 2017, p. 12.
doi: 10.1155/2017/3072870
@article{Blum2017, abstract = {Objective. Our aim was the development and validation of a modular signal processing and classification application enabling online electroencephalography (EEG) signal processing on off-the-shelf mobile Android devices. The software application SCALA (Signal ProCessing and CLassification on Android) supports a standardized communication interface to exchange information with external software and hardware. Approach. In order to implement a closed-loop brain-computer interface (BCI) on the smartphone, we used a multiapp framework, which integrates applications for stimulus presentation, data acquisition, data processing, classification, and delivery of feedback to the user. Main Results. We have implemented the open source signal processing application SCALA. We present timing test results supporting sufficient temporal precision of audio events. We also validate SCALA with a well-established auditory selective attention paradigm and report above chance level classification results for all participants. Regarding the 24-channel EEG signal quality, evaluation results confirm typical sound onset auditory evoked potentials as well as cognitive event-related potentials that differentiate between correct and incorrect task performance feedback. Significance. We present a fully smartphone-operated, modular closed-loop BCI system that can be combined with different EEG amplifiers and can easily implement other paradigms.},
author = {Blum, Sarah and Debener, Stefan and Emkes, Reiner and Volkening, Nils and Fudickar, Sebastian and Bleichner, Martin G},
doi = {10.1155/2017/3072870},
file = {:C$\backslash$:/Users/NilsV/AppData/Local/Mendeley Ltd./Mendeley Desktop/Downloaded/Blum et al. - Unknown - EEG Recording and Online Signal Processing on Android A Multiapp Framework for Brain-Computer Interfaces on Smar.pdf:pdf},
journal = {BioMed Research International Hindawi},
keywords = {AMTCSE,AMTUNI,accepted,full paper},
pages = {12},
title = {{EEG Recording and Online Signal Processing on Android: A Multiapp Framework for Brain-Computer Interfaces on Smartphone}},
volume = {2017},
year = {2017},
url={http://doi.org/10.1155/2017/3072870}
N. Volkening, A. Unni, B. S. Löffler, S. Fudickar, J. W. Rieger, and A. Hein, "Characterizing the Influence of Muscle Activity in fNIRS Brain Activation Measurements" in Proc. IFAC-PapersOnLine, 2016.
doi: 10.1016/j.ifacol.2016.08.013
@inproceedings{Volkening2016, abstract = {Driving is a complex and cognitively demanding task. It is essential to assess the cognitive state of the driver in order to design cognitive technical systems that can adapt to different driver cognitive states. Our research attempts to assess these states using functional Near Infrared Spectroscopy (fNIRS) by measuring brain activity in a virtual reality driving simulator. However, the fNIRS brain activation measurements could be influenced by muscle activity and we wanted to investigate this phenomenon. For this, we designed a paradigm with two conditions (listen, teeth clench) which show a significant contrast in the influence of muscle activity. We observed that the muscle hemodynamic response can show a higher magnitude of signal change compared to brain hemodynamic response. The muscle hemodynamic response showed an increase in deoxygenated hemoglobin (HbR) whereas the brain hemodynamic response showed a decrease in HbR. Moreover, the dynamics of the brain and muscle hemodynamic response differed. The brain response showed the same latency for oxygenated hemoglobin (HbO) and HbR while the muscle HbR response had a slower latency compared to HbO. We concluded that the fNIRS brain activation measurements could indeed be influenced by muscle activity. We were also able to determine some characteristics of the muscle hemodynamic response.},
author = {Volkening, Nils and Unni, Anirudh and L{\"{o}}ffler, Birte Sofie and Fudickar, Sebastian and Rieger, Jochen W. and Hein, Andreas},
booktitle = {IFAC-PapersOnLine},
doi = {10.1016/j.ifacol.2016.08.013},
file = {:C$\backslash$:/Users/NilsV/AppData/Local/Mendeley Ltd./Mendeley Desktop/Downloaded/Volkening et al. - 2016 - Characterizing the Influence of Muscle Activity in fNIRS Brain Activation Measurements.pdf:pdf},
issn = {24058963},
keywords = {OFFIS=G-AIT/AHT/CSE,UNIAMT,UNICSE,accepted,full paper},
mendeley-tags = {OFFIS=G-AIT/AHT/CSE,UNIAMT,UNICSE,accepted,full paper},
number = {11},
pages = {84--88},
title = {{Characterizing the Influence of Muscle Activity in fNIRS Brain Activation Measurements}},
volume = {49},
year = {2016}
}
B. S. Löffler, S. Fudickar, C. S. Herrmann, and A. Hein, "Ein Blick in das Gehirn: Messung und Verbesserung der Fahrleistung älterer Autofahrender mit Hilfe von Neuroimaging und Elektrostimulation" in Proc. Trends in Neuroergonomics, Berlin, 2015.
doi: 10.14279/depositonce-4887
@inproceedings{bwmms, abstract = {In diesem Beitrag wird ein Forschungsansatz vorgestellt, der es {\"{a}}lteren Autofahrern erm{\"{o}}glichen soll, bis in ein sehr hohes Alter ihre Fahrleistung zu erhalten. Motivation ist die, aufgrund des demografischen Wandels zu erwartende zuk{\"{u}}nftige hohe Zahl {\"{a}}lterer Autofahrer. Trotz des erh{\"{o}}hten Unfallrisikos ist in Deutschland keine regelm{\"{a}}{\ss}ige {\"{U}}berpr{\"{u}}fung der Fahreignung dieser Gruppe vorgesehen – bem{\"{a}}ngelt werden von der Zielgruppe und Fachleuten vor allem die fehlende Objektivit{\"{a}}t der Beurteilung und die assoziierten hohen Kosten. Neurotechnik wird auf Forschungsebene bereits im Auto und im Simulator eingesetzt und hat als Methode zur objektiven Fahrerzustandserkennung, auch von {\"{A}}lteren, Potential. Dieser Beitrag gibt einen {\"{U}}berblick {\"{u}}ber Assessment-Strategien der Fahreignung, und beschreibt ein angestrebtes Studiendesign, bei dem die Gehirnaktivit{\"{a}}ten mit Hilfe von EEG w{\"{a}}hrend der Fahrt aufgezeichnet und die M{\"{o}}glichkeit der Verbesserung der Fahrleistung durch Feedback und transkranielle Wechselstromstimulation im Auto erforscht werden soll. Der erste Ansatz und Pilotversuch zu letzterem Aspekt wird kurz vorgestellt.},
address = {Berlin},
author = {L{\"{o}}ffler, Birte Sofie and Fudickar, Sebastian and Herrmann, Christoph S. and Hein, Andreas},
booktitle = {Trends in Neuroergonomics},
doi = {10.14279/depositonce-4887},
editor = {{Carolin Wienrich, Thorsten Zander},
Klaus Gramann},
file = {:C$\backslash$:/Users/NilsV/AppData/Local/Mendeley Ltd./Mendeley Desktop/Downloaded/L{\"{o}}ffler B, Fudickar S, Herrmann CS - 2015 - Ein Blick in das Gehirn Messung und Verbesserung der Fahrleistung {\"{a}}lterer Autofahrender mit.pdf:pdf},
isbn = {9783798328037},
keywords = {UNIAMT,UNICSE,accepted},
mendeley-tags = {UNIAMT,UNICSE,accepted},
organization = {Technische Universit{\"{a}}t Berlin},
pages = {166--169},
publisher = {Universit{\"{a}}tsverlag der TU Berlin},
series = {11. Berliner Werkstatt Mensch-Maschine-Systeme},
title = {{Ein Blick in das Gehirn: Messung und Verbesserung der Fahrleistung {\"{a}}lterer Autofahrender mit Hilfe von Neuroimaging und Elektrostimulation}},
url = {https://depositonce.tu-berlin.de/handle/11303/5190{\%}5Cnhttp://dx.doi.org/10.14279/depositonce-4887},
year = {2015}
}