A database for publications published by researchers and students at SimulaMet.
Status
Research area
Proceedings, refereed
Investigative Interviews using a Multimodal Virtual Avatar
In American Psychology-Law Society Conference 2022. Denver USA,: American Psychology-Law Society, 2022.Status: Accepted
Investigative Interviews using a Multimodal Virtual Avatar
To meet best-practice standards, we are developing an interactive virtual avatar aiming as a training tool to raise interviewing skills of child-welfare and law-enforcement professionals. Therefore, we present the “Ilma” avatar that recognizes interviewers’ behavior during open-ended, closed and leading questions, and which can automatically respond to the conversation. We conducted a user study in which master students (N=3) and child protective workers (N=8) interviewed “Ilma” and rated their perception of the interaction. The results show that the participants valued the interaction and found the avatar useful. Thus, it has great potential to be an effective training tool.
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Proceedings, refereed |
Year of Publication | 2022 |
Conference Name | American Psychology-Law Society Conference 2022 |
Publisher | American Psychology-Law Society |
Place Published | Denver USA, |
Joint Learning of Topology and Invertible Nonlinearities from Multiple Time Series
In IEEE International Conference on Machine Learning, Optimization, and Data Science (ISMODE), 2022.Status: Accepted
Joint Learning of Topology and Invertible Nonlinearities from Multiple Time Series
Afilliation | Machine Learning |
Project(s) | Signal and Information Processing for Intelligent Systems |
Publication Type | Proceedings, refereed |
Year of Publication | 2022 |
Conference Name | IEEE International Conference on Machine Learning, Optimization, and Data Science (ISMODE) |
Notes | This work is a joint collaboration between SimulaMet and University of Agder. This work was supported by the IKTPLUSS INDURB grant 270730/O70 and the SFI Offshore Mechatronics grant 237896/O30 from the Research Council of Norway. |
Talks, invited
Soccer Athlete Performance Prediction using Time Series Analysis
In NORA Annual Conference, 2022.Status: Accepted
Soccer Athlete Performance Prediction using Time Series Analysis
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Talks, invited |
Year of Publication | 2022 |
Location of Talk | NORA Annual Conference |
AI-Based Video Production for Soccer
In FOKUS Media Web Symposium, 2022.Status: Accepted
AI-Based Video Production for Soccer
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Talks, invited |
Year of Publication | 2022 |
Location of Talk | FOKUS Media Web Symposium |
URL | https://www.fokus.fraunhofer.de/go/mws |
7 Things They Don't Tell You About Streaming Analytics
In Demuxed, 2022.Status: Accepted
7 Things They Don't Tell You About Streaming Analytics
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Talks, invited |
Year of Publication | 2022 |
Location of Talk | Demuxed |
URL | https://2022.demuxed.com/#speakers |
Explainable Artificial Intelligence in Medicine
In Nordic AI Meet 2022, 2022.Status: Accepted
Explainable Artificial Intelligence in Medicine
Machine learning (ML) has shown outstanding abilities to solve a large variety of tasks such as image recognition and natural language processing, which has huge relevance for the medical field. Complex ML models, including convolutional neural networks (CNNs), are used to analyse high dimensional data such as images and videos from medical examinations. With increasing model complexity, the demand for techniques improving human understanding of the ML models also increases. If medical doctors do not understand how the models work, they might not know when the models are actually wrong or even refuse to use them. This can hamper the implementation of ML systems in the clinic and negatively affect patients. To promote successful integration of ML systems in the clinic, it is important to provide explanations that establish trust in the models among healthcare personnel. Explainable artificial intelligence (XAI) aims to provide explanations about ML models and their predictions. Several techniques have already been developed. Existing XAI methods often fail to meet the requirements of medical doctors, probably because they are not sufficiently involved in the development of the methods. We develop ML models solving tasks in various medical domains. The resulting models are explained using a selection of existing XAI methods, and the explanations are evaluated by medical experts. Their feedback is used to develop improved XAI methods. We have investigated established techniques for making ML systems more transparent in the fields of gastroenterology, assisted reproductive technology, organ transplantation and cardiology. Experiences from our projects will be used to develop new explanation techniques for clinical practice in close collaboration with medical experts.
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Talks, invited |
Year of Publication | 2022 |
Location of Talk | Nordic AI Meet 2022 |
Keywords | Explainable artificial intelligence, Machine learning, medicine |
Journal articles
DeepFake electrocardiograms: the key for open science for artificial intelligence in medicine
Scientific Reports (2021).Status: Accepted
DeepFake electrocardiograms: the key for open science for artificial intelligence in medicine
Recent global developments underscore the prominent role big data have in modern medical science. Privacy issues are a prevalent problem for collecting and sharing data between researchers. Synthetic data generated to represent real data carrying similar information and distribution may alleviate the privacy issue.In this study, we present generative adversarial networks (GANs) capable of generating realistic synthetic DeepFake 12-lead 10-sec electrocardiograms (ECGs). We have developed and compare two methods, WaveGAN* and Pulse2Pulse GAN. We trained the GANs with 7,233 real normal ECG to produce 121,977 DeepFake normal ECGs. By verifying the ECGs using a commercial ECG interpretation program (MUSE 12SL, GE Healthcare), we demonstrate that the Pulse2Pulse GAN was superior to the WaveGAN to produce realistic ECGs. ECG intervals and amplitudes were similar between the DeepFake and real ECGs. These synthetic ECGs are fully anonymous and cannot be referred to any individual, hence they may be used freely. The synthetic dataset will be available as open access for researchers at OSF.io and the DeepFake generator available at the Python Package Index (PyPI) for generating synthetic ECGs.In conclusion, we were able to generate realistic synthetic ECGs using adversarial neural networks on normal ECGs from two population studies, i.e., there by addressing the relevant privacy issues in medical datasets.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialN/AFunding StatementThis work is funded in part by Novo Nordisk Foundation project number NNF18CC0034900.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:We confirm that all experiments were performed in accordance with Helsinki guidelines and regulations of the Danish Regional Committees for Medical and Health Research Ethics. The data studies were approved by the ethical committee of Region Zealand (SJ-113, SJ-114, SJ-191), ethical committee of Copenhagen Amt (KA 98 155).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe Normal DeepFake ECGs are available at OSF (https://osf.io/6hved/) with corresponding MUSE 12SL ground truth values freely downloadable and usable for ECG algorithm development. The DeepFake generative model is available at https://pypi.org/project/deepfake-ecg/ to generate only synthetic ECGs. https://osf.io/6hved/ https://pypi.org/project/deepfake-ecg/
Afilliation | Scientific Computing, Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | Scientific Reports |
Publisher | Nature Publishing Group |
URL | https://www.medrxiv.org/content/early/2021/05/10/2021.04.27.21256189.1 |
DOI | 10.1101/2021.04.27.21256189 |
Posters
Assessment of sperm motility according to WHO classification using convolutional neural networks
ESHRE: ESHRE, 2021.Status: Accepted
Assessment of sperm motility according to WHO classification using convolutional neural networks
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Poster |
Year of Publication | 2021 |
Publisher | ESHRE |
Place Published | ESHRE |
Proceedings, refereed
DivergentNets: Medical Image Segmentation by Network Ensemble
In EndoCV, 2021.Status: Accepted
DivergentNets: Medical Image Segmentation by Network Ensemble
Detection of colon polyps has become a trending topic in the intersecting fields of machine learning and gastrointestinal endoscopy. The focus has mainly been on per-frame classification. More recently, polyp segmentation has gained attention in the medical community. Segmentation has the advantage of being more accurate than per-frame classification or object detection as it can show the affected area in greater detail. For our contribution to the EndoCV 2021 segmentation challenge, we propose two separate approaches. First, a segmentation model named TriUNet composed of three separate UNet models. Second, we combine TriUNet with an ensemble of well-known segmentation models, namely UNet++, FPN, DeepLabv3, and DeepLabv3+, into a model called DivergentNets to produce more generalizable medical image segmentation masks. In addition, we propose a modified Dice loss that calculates loss only for a single class when performing multi-class segmentation, forcing the model to focus on what is most important. Overall, the proposed methods achieved the best average scores for each respective round in the challenge, with TriUNet being the winning model in Round I and DvergentNets being the winning model in Round II of the segmentation generalization challenge at EndoCV 2021
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Proceedings, refereed |
Year of Publication | 2021 |
Conference Name | EndoCV |
Journal articles
Equivalence projective simulation as a framework for modeling formation of stimulus equivalence classes
Neural computation 32 (2020): 912-968.Status: Accepted
Equivalence projective simulation as a framework for modeling formation of stimulus equivalence classes
Stimulus equivalence (SE) and projective simulation (PS) study complex behavior, the former in human subjects and the latter in artificial agents. We apply the PS learning framework for modeling the formation of equivalence classes. For this purpose, we first modify the PS model to accommodate imitating the emergence of equivalence relations. Later, we formulate the SE formation through the matching-to-sample (MTS) procedure. The proposed version of PS model, called the equivalence projective simulation (EPS) model, is able to act within a varying action set and derive new relations without receiving feedback from the environment. To the best of our knowledge, it is the first time that the field of equivalence theory in behavior analysis has been linked to an artificial agent in a machine learning context. This model has many advantages over existing neural network models. Briefly, our EPS model is not a black box model, but rather a model with the capability of easy interpretation and flexibility for further modifications. To validate the model, some experimental results performed by prominent behavior analysts are simulated. The results confirm that the EPS model is able to reliably simulate and replicate the same behavior as real experiments in various settings, including formation of equivalence relations in typical participants, nonformation of equivalence relations in language-disabled children, and nodal effect in a linear series with nodal distance five. Moreover, through a hypothetical experiment, we discuss the possibility of applying EPS in further equivalence theory research.
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Journal Article |
Year of Publication | 2020 |
Journal | Neural computation |
Volume | 32 |
Number | 5 |
Pagination | 912–968 |
Publisher | {MIT Press |