With the development of artificial intelligence and computer vision technologies, the driverless technology of trains has received great attention. How to perceive the driving environment in front of the train and discover potential safety risks are very important issues in unmanned train technology. Aiming at the unmanned driving trains, this paper proposes a near real-time situational awareness and anomaly detection mechanism. In order to realize situation awareness of complex railway environment, deep semantic segmentation is used to extract real-time track area. For anomaly detection, random track obstacles with irregular shapes and types are detected based on the continuity track line. Experimental results show that the trajectory extracted by this method has good continuity and low noise, and it can detect tiny obstacles on straight lines, elbows and turnouts. Our method is proven to be suitable for changing weather conditions and has high practical feasibility.

Elevator manufacturing companies make great effort to provide better user experience and to reduce elevator waiting time. Deep learning for visitor profiling offers more options for personalised service and enables the elevator to learn about its usage. In this paper, we present a solution that integrates conventional elevator with facial recognition, voice assistant and unsupervised learning and discuss some insights gained during the development. In the 3-month testing period, we experienced different social reactions that help us to examine people's readiness to accept new technologies in their daily life. The novelty of the solution lies in a combination of different cognitive technologies like facial recognition, unsupervised classification of persons, recognition of voice commands and statistics-based prediction of passenger destinations.

The introduction of small Unmanned Aircraft Systems (sUAS) in an increasingly wide range of civil applications implies several challenges for the integration of manned and unmanned traffic in the controlled and uncontrolled low-level airspace, both at a technological and procedural level. This paper discusses the design of an integrated platform for the management of contingency events and the improvement of situation awareness of the pilot. To this end, a head-up display, based on augmented reality (AR) technology, is designed to provide the pilot with visual cues that should improve his awareness of admissible flight volumes. A force feedback is also provided by a haptic joystick, which suggests manoeuvres to avoid collisions or violation of airspace constraints. Tests in an actual airport facility are expected to be conducted in 2021. In the meantime, a possible realistic scenario is analysed, illustrating the interactions among the various actors and components of the system.

Fake news is a global phenomenon with no language barriers. Online misinformation travels rapidly and in volumes across countries and languages, and tracking it poses a real challenge that can be solved with the use of AI-powered language technologies. Specific fake stories evolve with lifespans that go beyond a year, making it difficult to track the entire event from the beginning and across all its manifestations: when and where did the information originate, in what language? What websites & authors helped the spread of the information and how can a new story be verified against and previous stories on the same topic?

A theoretical approach to building a publicly available dataset for fake news stories that is continuously updated and contains semantically comparable multilingual data is described conceptually and from a functional perspective: data collection, processing, analysis, and reporting.

The potential use of commercially available Neural Machine Translation and Natural Language Processing (Semantic Comparison) for data processing and analysis purposes is also validated from a technical perspective.

Bettina Biron Faculty of Informatics University of Vienna

The phenomenon of fake news has been with us since the development of the earliest writing systems, or even since information and lie exist. The lecture aims to approach the question of fake news in history, which methods were used and what lessons can we learn from them nowadays in the times of digitalization and information overflow. The contribution focuses on migration, as an example on the case study of Sudeten Germans. Here we can see the transformation of a close relationship between ethnic as well as linguistic groups over centuries into national hatred. News, fake news and propaganda played an essential role in these developments. In the break of culture of National Socialism and the resulting post-war violence, this culminated in the expulsion of the Sudeten Germans from Czechoslovakia. These developments led to friend and foe schemes over generations until today - which are expressed offline as well as online.

Keywords - fake news, history, media, social media

With the proliferation of different forms of digital communication, the opportunities for spreading Fake News are increasing constantly. More often than not people inform themselves about news and current events in social networks or blogs. By doing so, they run the risk of falling for and also - often unconsciously - spreading false information from manipulative news sites. The distribution of fake news itself is not a new phenomenon, but thanks to the advances in digital communication their circulation accelerates, leading to major impacts for the whole society. This lecture will take a closer look at several aspects. (a) What exactly are fake news? Which legal and content-related criteria must be fulfilled in order to identify fake news as such? (b) Modus Operandi: What are the typical methods of committing a crime? Moreover, the typical motives for spreading fake news are going to be examined in more detail.

Fake news and misinformation is a widespread phenomenon these days, affecting social media, alternative and traditional media. In a climate of increasing polarization and perceived societal injustice, the topic of migration is one domain that is frequently the target of fake news, addressing both migrants and citizens in host countries. The problem is inherently a multi-lingual and multi-modal one in that it involves information in an array of languages, material in textual, visual and auditory form and often involves communication in a language which may be unfamiliar to recipients or which these recipients only may have basic knowledge of. We argue that semi-automatic approaches, empowering users to gain a clearer picture and base their decisions on sound information, are needed to counter the problem of misinformation. In order to deal with the scale of the problem, such approaches involve a variety of technologies from the field of Artificial Intelligence (AI). In this paper we identify a number of challenges related to implementing approaches for the detection of fake news in the context of migration. These include collecting multi-lingual and multi-modal datasets related to the migration domain, providing explanations of AI tools used in verification to both media professionals and consumers. Further efforts in truly collaborative AI will be needed.

The problems of organizing medical care in the context of a pandemic COVID-19 associated with the uncertainty and limited of various resources have led to the need for refining management systems for hospitalizing patients. With the use of situational management, decision making can be improved to better suit the considered situation. Since the conditions for the development of a pandemic are difficult to predict, situational management becomes important. Taking into account psychological and behavioral factors makes the situation model more accurate and realistic. The paper proposes the use of coalition games for situational management during the hospitalization of sick patients. The game players and coalition participants are hospitals, ambulance teams, patients, and computed tomography centers. The goal of the game is to form a coalition of participants that gives the maximum payoff, which is assessed on the basis of minimizing the time to make a decision. The general scheme of hospitalization, the main sources of information about the situation, the formulation and formalization of the problem are considered. The model was tested using the example of the COVID-19 pandemic. Due to the small amount of data and the lack of proven models for the development of the situation, heuristic models of the situation development were formed for conducting experiments, based on the analysis of information from open information sources. The experiment tested the formation of a coalition at the time of hospitalization.

This paper assesses the results of a STEM education pilot project bringing cyber-physical infrastructure for broadband connectivity, trusted devices, and secure cloud and privacy and rights-protecting edge cognitive computing and wireless services, to underserved New York City school children at Timothy Dwight PS 33X in the South Bronx, PS 91 Albany Avenue School and PS 316 Elijah Stroud Elementary School, both in Brooklyn, New York, USA. This pilot study, initiated in 2017, demonstrated how the innovative Internet Backpack could bring immediate connectivity and digital and physical (cyber-physical) resource-sharing including cognitive wireless networks to many school children simultaneously, much faster than previously thought possible, or affordable. Projecting from this successful pilot, in this paper we explain how we anticipate that the results will serve to focus further action by all stakeholders on the broadband underserved wherever they may be. We suggest utilizing the Internet Backpack to develop a gap-filling last few hundred feet road map of where broadband connectivity is otherwise lacking and hence hindering school children's education performance and opportunities to explore STEM learning topics. This model can guide future buildouts of broadband Internet and cyber-physical infrastructure to help address both the Covid-19 pandemic emergency and the ongoing, longstanding systemic societal emergencies exacerbated by limited Internet access in resource-constrained communities. Our initial pilot data shows improvement in both student scientific reasoning and science mastery when uninterrupted Internet connectivity is provided, allowing students to engage in both curricular and extracurricular science projects unimpeded by digital divides. Larger-scale studies, if replicating these results, could guide educators and policymakers towards utilizing cognitive systems such as the Internet Backpacks, and Science/IoT curricula, for efficient cloud to edge connectivity and innovative educational content, changing the equation for greater digital inclusion in urban and rural communities, quickly.

Shared mental models are critical to team success; however, in practice, team members may have misaligned models due to a variety of factors. In safety-critical domains (e.g., aviation, healthcare), lack of shared mental models can lead to preventable errors and harm. Towards the goal of mitigating such preventable errors, here, we present a Bayesian approach to infer misalignment in team members' mental models during complex healthcare task execution. As an exemplary application, we demonstrate our approach using two simulated team-based scenarios, derived from actual teamwork in cardiac surgery. In these simulated experiments, our approach inferred model misalignment with over 75% recall, thereby providing a building block for enabling computer-assisted interventions to augment human cognition in the operating room and improve teamwork.

Computation is often thought of as a branch of discrete mathematics, using the Turing model. That model works well for conventional applications such as word processing, database transactions, and other discrete data processing applications. But much of the world's computer power resides in embedded devices, sensing and controlling complex physical processes in the real world. Other computational models and paradigms might be better suited to such tasks. For example, a computer can be regarded as a form of open dynamical system. One particular approach taking this view is reservoir computing, which can be instantiated in a range of different material substrates. This approach can support smart processing 'at the edge', allow a close integration of sensing and computing in a single conceptual model and physical package, and provides a uniform approach to building hybrid architectures of heterogeneous devices.

In current paper we discuss about six core assumptions underpinning more integrated framework for psychology and situation management (SM). None of these assumptions have received special attention in situation management literature, but each of them is vital in psychological perspective. It worth considering whether and how it is appropriate it integrate discussed issues into future SM studies.

Industrial robots are widespread in today's production facilities. However, strict safety regulations are required for their operation. Therefore, the robots usually work spatially separated from humans. Only special designs - such as lightweight robots - can currently cooperate directly with humans and actively support them. The use of lightweight robots is nowadays limited to particular assistance tasks. In the case of heavy-duty robots, certain types of cooperation become necessary, where humans and robots can mutually exploit their advantages. Beside the Safety, the human fear is another obstacle in the interaction with heavy-duty robots. The robot is a fully dynamic machine that can move in all directions. Furthermore, by implementing intelligent and autonomous robots, humans could misinterpret the movements of the robot and act in wrong way. These unforeseen movements could endanger the human. This work performs an empirical study supported by a unique platform equipped with various sensors and flexible fusion-tool. The objectives of this study comprise 1. Measuring the mental states of the human objectively and subjectively during the interaction with heavy-duty robots. 2. Investigating the influence of robot parameters (speed, path, interaction level etc.) and various communication systems (e.g. visual and audio systems) on the human mental states in order to reduce the negative emotions during the interaction.

Work design theory research has a long and rich tradition in the industrial and organisational psychology. Work design identifies tasks, activities, relationships, and responsibilities in a specific job. It provides a comprehensive job description useful for examining and creating optimal working conditions, also by developing empowering workers or by restructuring their responsibilities. Human-robot interaction is among the domains with a high demand for work design. It is related to the widespread human fear of being replaced by machines at work, as well as the still small number of publications in this field, mostly devoted to human-robot interaction analysis conditions. Scholars have identified an elaborated set of tasks by a human during working with a robot. From work design perspective, besides expanding what tasks are considered, it is crucial to consider its meaning for creating critical psychological states, which are important for individual and organisational results. Thus, the paper preparation's impetus describes and analyses the tasks carried out by robot operators in a more precise manner, by using psychological work analysis from the work design perspective. The research group consists of 32 robot operators from a large international manufacturing company. The Work Design Questionnaire (WDQ) by Morgeson and Humphrey (2006) was used to describe 21 of work characteristics. Results show that Task Variety, Information Processing, Task Identity, Specialisation, Skill Variety, Problem-solving, Task Significance, Received Interdependence, Feedback From Others, and Feedback from Job are the highest work characteristics of robot operators. It suggests that robot operators distinguish non-routine, cognitive, and interpersonal tasks as more substantial than other tasks. Alike, according to the work design theory, the work characteristics indicated by respondents are recognised as important job-specific factors for workers' critical psychological states i.e., experiencing meaning, feeling responsible for outcomes, and understanding the results of their efforts, and helping shape the context of the work. It is imperative that further and more extensive research is conducted to bring more attention to how work design can support individuals' cognitive, social, and identity development in human-robot interaction.

Automatic Dependent Surveillance-Broadcast (ADS-B) is a communication protocol that is used in aviation for situational awareness by sending out own position and altitude data. ADS-B IN devices are able to receive ADS-B messages. The ADS-B protocol is known to be vulnerable to many cyber attacks. In our work, we simulated a ghost injection attack on drones that are equipped with ADS-B IN equipment to identify its effect on human behaviour. Our aim is to study how users and drone pilots will respond while under attack. To investigate this, we conducted an experiment with 50 participants in a drone simulator where they had to fly a time critical mission. During the mission, an attacker fakes a nearby aircraft by sending out spoofed ADS-B OUT messages to alter the drone's flight path. Participants were interviewed after the mission. Our research was focused on anthropological links between groups of participants: what are the conditions for operators to comply with legislation and land the drone after a proximity warning or ignore legislation and prioritising the mission and continuing the time critical flight? The results of this experiment show that the decision to land (or not) the drone is linked somehow to being Estonian or coming from abroad. About 40\% of the participants were Estonian and all of them complied with the message from the ghost injection attack and landed the drone, while the large majority of the non-Estonian participants continued the mission.

Human reliability is one of the key issues in driver-vehicle systems as human-related accidents accounts for the highest proportion of total accidents. Furthermore, the behaviors of drivers become increasingly essential for driving safety as the driving context is of increasing complexity. Cognitive reliability and error analysis method (CREAM) provides the evaluation method for human reliability in industrial fields, when it is applied to situated context, adaption is required. In this contribution, a modified fuzzy-based CREAM approach is introduced to evaluate human driver reliability in situated driving context using the data collected from driving simulator. Firstly, a new list of common performance conditions (CPCs) characterizing the situated driving context is generated due to the application limits of CPCs in CREAM. Secondly, to determine the levels in the new generated CPCs, fuzzy neighborhood density-based spatial clustering of application with noise (FN-DBSCAN) is applied to driving data defining the membership function parameters, which reduces reliance on expert knowledge and can better characterize human behaviors individually. Next, a new evaluation index, human performance reliability score (HPRS), is proposed for the quantitative and dynamic evaluation of human reliability. The results show that the new proposed method could quantify and evaluate human driver reliability in real time.

Complex Systems in which humans play a role, namely Human-Integrated Complex Systems (HICS), can be difficult to model or simulate due to the uncertainty introduced by the human component. Traditional modeling approaches such as physics-based modeling do not provide predictive insight towards situation awareness and management. War game designers, and game architects are familiar with HICS problem spaces, and use gamification of such complex contexts as a means of modeling human behavior to inform, predict, and manage an HICS style problem. The game play thereby becomes a means of providing situation awareness and management of the HICS by using human action during game play as a heuristic for pruning the intractable possibility space of the problem at large into a likely probability subspace based on the actions players actually take when playing an HICS game simulation. This paper explores the approach of gamification of real-world HICS problem spaces for situation awareness and management. A gamification methodology is introduced and investigated through the use case of military acquisitions.

The rally around the flag effect is a political science concept used to explain increased, yet short-lived, popular support of a country's government or political leader(s) during periods of crisis such as wars. The effect is teased out through solicited public opinion surveys which reach a limited sub-sample of willing participants and are expensive to conduct, leading to a slow response rate and after-the-fact results more suitable for historical studies than for situational awareness or crisis management. On the other hand, on social media platforms such as Twitter, millions of users provide their unsolicited opinion on almost any topic, including politics.

This paper aims to initiate the conversation around the question: Can social media be used to observe the rally around the flag effect in action as it happens and thus help increase situational awareness? This first study utilizes the Twitter social media platform as, at the time of this writing, Twitter is used for political discourse more frequently than other mainstream social media platforms are. Furthermore, Donald Trump, the 45th President of the United States of America was a staunch Twitter user who almost religiously used the platform for communicating to the public, more than and even some times in place of the regular established main stream media channels such as radio and television broadcasts and long standing processes such as white house press conferences and media releases. The study was conducted on tweets from the entire 4 years of Trump's presidency with a focus on the biggest crisis during his presidency: The COVID-19 global pandemic which did lead to the only, and exceptionally short-lived rally around the flag effect for his presidency.

The purpose of this short position paper is to stimulate a community wide discussion on how situation awareness (SA) technologies may best support the decisions made during pandemics. Currently much of SA is directed towards the critical information needed to make epidemiological and public health decisions; as important as this is, an epidemic also requires doctors and front line medical professional to make numerous decisions regarding individualized patient care. The question is how can SA contribute to both the rapid collection, analysis, and sharing of critical patient information among medical personnel, and then across all levels of decision-making from individual patients to public health policy?

As disaster scenarios unfold, flexibility is extremely important. Both tools and people need to rapidly adjust to changing situations. Simple, custom, and lightweight dependency solutions are the ideal position for such circumstances. Off-the-shelf solutions that are not easily modified or adapted can significantly impair making rapid changes and, ultimately, will not provide the response speed necessary to tackle the complexity and uncertainty characteristic of disasters. The result of this effort indicates that flexibility and performance are the two key metrics by which such tools should be gauged.

This talk encompasses the successes, challenges, and lessons learned from engaging in a yearlong COVID-19 emergency response effort in the United States and beyond. Fusing advanced computational analytics and applied public health knowledge, pandemic response may be best understood as a 'marathon of sprints.' There are few simple answers, but through sound science and resilient organization, it is possible to tackle the marathon one day and one task at a time.

The process of traditional convolutional neural network to deal with human expression features is often one-way, and it cannot make full use of the features of each layer in the convolutional network to retain valuable facial expression features. This paper proposes an improved convolutional neural network structure with a multi-feature fusion module to optimize facial expression recognition. Within this structure, three convolutional layers are divided into one area module. For each area module, the input of each convolutional layer is composed of the outputs of the previous two convolutional layers. At the same time, a dense connection structure is added between two different area modules to realize feature reuse, thereby relying on feature diversity to improve the accuracy of facial expression recognition. Our experimental results on the CK+ and FER2013 databases show that compared with existing convolutional neural networks, the method gives higher accuracy and lower structure complexity.

Decision making can be modeled in various ways for the design of decision-support systems. One strategy privileged for this purpose is policy capturing, i.e. using statistical techniques (and more recently machine learning) to model judgement policies. The Cognitive Shadow is a prototype tool suited for frugal learning that automatically learns a user's decision pattern in real time based on an ensemble of seven supervised learning algorithms. This tool can provide advisory warnings when the user decision is inconsistent with the predicted outcome. Evolutionary computation methods could reinforce the system's efficiency because of their ability to deal with computational complexity via evolution-inspired optimization mechanisms. The goal of this study was to assess the potential of evolutionary algorithms for frugal learning in an online policy capturing context. To do so, we tested three evolutionary algorithms on three different datasets (each split in three sizes), and compared both their prediction performance and training time with that of the other modeling techniques already implemented in the Cognitive Shadow system. Although all three evolutionary models were generally outperformed by non-evolutionary learning algorithms, one genetic programming method showed good prediction performance for the more complex use cases with the smaller datasets.

In this paper, an Emotion Regulation system with a multi-weighted Markov Decision Process (MDPER system) is created for human-robot interaction. The system is developed to maximize the transfer from negative emotion arousal to positive emotion while minimizing the service spendings in cost and time. To achieve this goal, the system is designed to take personality and emotion/intention degrees as the external input. The fuzzy analytic hierarchy process is used to regulate the weights of input factors. Actions taken by the robot are determined by the reward and punishment functions, which are affected by current personal emotional states, actions as well as the external input.

Personality is defined by the 'Big-five test', which has a significant influence on human beings' emotions and actions. For example, one type of big five personalities is Neuroticism (N), which is the personality trait of being emotional. High scorers tend to have high emotional reactions to stress. To regulate each type's emotions, several emotion regulation strategies are used in this paper, including relaxing music, images, and gifts.

A 3D grid world is proposed to validate and visualize the value function of the MDPER system. By using the input which simulates two types of people, one with high Neuroticism (N) score and one with a lower Neuroticism score, the 3D grid world simulation shows that the system successfully achieves the goal within three steps. The simulation of the high N scorer shows that in order to achieve the goal, the robot takes two actions determined by the MDPER system in three steps, one step of pictures and two steps of music. For the simulation of the low N scorer, the robot takes two actions determined by the MDPER system in two steps to achieve the goal. Then an experiment with 38 participants was implemented to test the MDPER system. Around 80 percent of participants are satisfied with the robot actions which are determined by the MDPER system. 93 percent of the participants experience a significant emotional improvement after interacting with the robot within three steps.

With the development of artificial intelligence and computer vision, the unmanned driving technology of trains has been greatly improved. How to determine the driving environment in front of the train for accurate sensing is a very important issue in the unmanned train technology. Aiming at the unmanned driving of trains, this paper proposes a track region extraction method based on semantic segmentation, and proposes track lines by using image processing algorithm. According to the continuity of track lines, random obstacles with irregular shapes and types are detected. Experimental results show that the track lines extracted by our method show good continuity and less noise. At the same time, it can extract track lines and detect obstacles on straights, bends and forks, and it is suitable for changing weather conditions, with high feasibility and innovation.

Assisted reproductive technology (ART) has been using increasingly over the years as infertility treatment globally among women of different ages since the first baby was born as a result of in vitro fertilization in the UK in 1978. Despite this diffusion, the success rate of assisted reproductive technology is relatively low. The main reasons are poor quality of embryos and eggs, age of the woman, small uterine cavity, immune system disorders and genetic factors such as chromosomal alterations. ART procedures are associated with risk for mothers and infants (e.g., miscarriage, premature delivery, low birth weight infants, and long-term disability among infants). Furthermore, since these treatments are highly expensive and time-consuming, their repetition is not affordable for most infertile couples. An adequate design of a decision support system and its capability to support ART outcome prediction can help infertile couples. In this work, we propose an approach to predict the outcome of ART procedures, based on the identification of the situation of the infertile couple (mainly in terms of physiological parameters), and to provide the doctor with a set of feedback aimed at supporting the doctor's decision to start or continue ART process. A prototypical system is proposed to preliminary verify the feasibility and utility of the approach.

This paper addresses the problem of situation modeling and machine learning-based decision making in open and non-predictive environments. Situational decision making incorporates the determination of an action based on the current situation, represented by the situation model and trained system behavior using deep neural networks. Commonly, the situation modeling is not considered an intermediate step for decision making in situational action selection. This contribution introduces a novel approach for decision making using situation modeling and deep neural networks. It uses an information structuring and representation technique for the generation of situation spectra used as input to deep learning-based decision making. Simulation-based experimental results show the proposed approach's effectiveness and importance.

This is an introductory discussion of links between collected situational awareness (e.g. data) and the cognitive processes required to create situation awareness that contributes to accomplish of missions. Basic cognitive processes (sensation, perception, attention, memory), higher cognitive processes (thinking, understanding and prediction) and operator competence are mentioned. The results will be merged under the name of comprehensive situation awareness model.

Decision-making in complex situations often requires significant human involvement and remains an activity that is performed jointly by humans and various computational (and AI) tools. This paper develops a concept of human-machine collective intelligence environment for decision support, leveraging self-organization of human-machine teams in decision-support scenarios. Specifically, the paper proposes a set of methods and mechanisms to stimulate self-organization in the human-machine collective intelligence environment: a) team-forming method, b) the method of ensuring the development of the participants, contributing to the fulfillment of the condition of self-organization in the long term. Although the proposed methods and mechanisms are designed, first of all, for the environment being developed, we believe that they can be adapted and therefore are useful for a wide range of applications, supporting collaborative work on complex problems.