A database for publications published by researchers and students at SimulaMet.
Status
Research area
Talks, invited
7 Things They Don't Tell You About Streaming Analytics
In Demuxed, 2022.Status: Accepted
7 Things They Don't Tell You About Streaming Analytics
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Talks, invited |
Year of Publication | 2022 |
Location of Talk | Demuxed |
URL | https://2022.demuxed.com/#speakers |
AI-Based Video Production for Soccer
In FOKUS Media Web Symposium, 2022.Status: Accepted
AI-Based Video Production for Soccer
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Talks, invited |
Year of Publication | 2022 |
Location of Talk | FOKUS Media Web Symposium |
URL | https://www.fokus.fraunhofer.de/go/mws |
Posters
Automatic Thumbnail Selection for Soccer using Machine Learning
NORA Annual Conference, Stavanger, Norway, 2022.Status: Accepted
Automatic Thumbnail Selection for Soccer using Machine Learning
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Poster |
Year of Publication | 2022 |
Place Published | NORA Annual Conference, Stavanger, Norway |
Journal articles
Cell exclusion during human embryo development result in altered morphokinetic patterns up to morula formation
Human Reproduction (2022).Status: Accepted
Cell exclusion during human embryo development result in altered morphokinetic patterns up to morula formation
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Journal Article |
Year of Publication | 2022 |
Journal | Human Reproduction |
Publisher | Human Reproduction |
Proceedings, refereed
A Time-aware Tensor Decomposition for Tracking Evolving Patterns
In MLSP'23: IEEE International Workshop on Machine Learning for Signal Processing. IEEE, 2023.Status: Accepted
A Time-aware Tensor Decomposition for Tracking Evolving Patterns
Afilliation | Machine Learning |
Project(s) | Department of Data Science and Knowledge Discovery , TrACEr: Time-Aware ConstrainEd Multimodal Data Fusion |
Publication Type | Proceedings, refereed |
Year of Publication | 2023 |
Conference Name | MLSP'23: IEEE International Workshop on Machine Learning for Signal Processing |
Publisher | IEEE |
Posters
Concept Explanations for Deep Learning-Based Diabetic Retinopathy Diagnosis
Nordic AI Meet 2023, 2023.Status: Accepted
Concept Explanations for Deep Learning-Based Diabetic Retinopathy Diagnosis
Diabetic retinopathy (DR) is a common complication of diabetes that damages the eye and potentially leads to blindness. The severity and treatment choice of DR depends on the presence of medical findings in fundus images. Much work has been done in developing complex machine learning (ML) models to automatically diagnose DR from fundus images. However, their high level of complexity increases the demand for techniques improving human understanding of the ML models. Explainable artificial intelligence (XAI) methods can detect weaknesses in ML models and increase trust among end users. In the medical field, it is crucial to explain ML models in order to apply them in the clinic. While a plethora of XAI methods exists, heatmaps are typically applied for explaining ML models for DR diagnosis. Heatmaps highlight image areas that are regarded as important for the model when making a prediction. Even though heatmaps are popular, they can be less appropriate in the medical field. Testing with Concept Activation Vectors (TCAV), providing explanations based on human-friendly concepts, can be a more suitable alternative for explaining models for DR diagnosis, but it has not been thoroughly investigated for DR models. We develop a deep neural network for diagnosing DR from fundus images and apply TCAV for explaining the resulting model. Concept generation with and without masking is compared. Based on diagnostic criteria for DR, we evaluate the model’s concept ranking for different severity levels of DR. TCAV can explain individual images to gain insight into a specific case, or an entire class to evaluate overall consistency with diagnostic standards. The most important concepts for the DR model agree with diagnostic criteria for DR. No large differences are detected between the two concept generation approaches. TCAV is a flexible explanation method where human-friendly concepts provide insights and trust in ML models for medical image analyses, and it shows promising results for DR grading.
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Poster |
Year of Publication | 2023 |
Place Published | Nordic AI Meet 2023 |
Keywords | concept-based explanations, diabetic retinopathy, Explainable artificial intelligence |
Posters
Assessment of sperm motility according to WHO classification using convolutional neural networks
ESHRE: ESHRE, 2021.Status: Accepted
Assessment of sperm motility according to WHO classification using convolutional neural networks
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Poster |
Year of Publication | 2021 |
Publisher | ESHRE |
Place Published | ESHRE |
Journal articles
DeepFake electrocardiograms: the key for open science for artificial intelligence in medicine
Scientific Reports (2021).Status: Accepted
DeepFake electrocardiograms: the key for open science for artificial intelligence in medicine
Recent global developments underscore the prominent role big data have in modern medical science. Privacy issues are a prevalent problem for collecting and sharing data between researchers. Synthetic data generated to represent real data carrying similar information and distribution may alleviate the privacy issue.In this study, we present generative adversarial networks (GANs) capable of generating realistic synthetic DeepFake 12-lead 10-sec electrocardiograms (ECGs). We have developed and compare two methods, WaveGAN* and Pulse2Pulse GAN. We trained the GANs with 7,233 real normal ECG to produce 121,977 DeepFake normal ECGs. By verifying the ECGs using a commercial ECG interpretation program (MUSE 12SL, GE Healthcare), we demonstrate that the Pulse2Pulse GAN was superior to the WaveGAN to produce realistic ECGs. ECG intervals and amplitudes were similar between the DeepFake and real ECGs. These synthetic ECGs are fully anonymous and cannot be referred to any individual, hence they may be used freely. The synthetic dataset will be available as open access for researchers at OSF.io and the DeepFake generator available at the Python Package Index (PyPI) for generating synthetic ECGs.In conclusion, we were able to generate realistic synthetic ECGs using adversarial neural networks on normal ECGs from two population studies, i.e., there by addressing the relevant privacy issues in medical datasets.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialN/AFunding StatementThis work is funded in part by Novo Nordisk Foundation project number NNF18CC0034900.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:We confirm that all experiments were performed in accordance with Helsinki guidelines and regulations of the Danish Regional Committees for Medical and Health Research Ethics. The data studies were approved by the ethical committee of Region Zealand (SJ-113, SJ-114, SJ-191), ethical committee of Copenhagen Amt (KA 98 155).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe Normal DeepFake ECGs are available at OSF (https://osf.io/6hved/) with corresponding MUSE 12SL ground truth values freely downloadable and usable for ECG algorithm development. The DeepFake generative model is available at https://pypi.org/project/deepfake-ecg/ to generate only synthetic ECGs. https://osf.io/6hved/ https://pypi.org/project/deepfake-ecg/
Afilliation | Scientific Computing, Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | Scientific Reports |
Publisher | Nature Publishing Group |
URL | https://www.medrxiv.org/content/early/2021/05/10/2021.04.27.21256189.1 |
DOI | 10.1101/2021.04.27.21256189 |
Proceedings, refereed
DivergentNets: Medical Image Segmentation by Network Ensemble
In EndoCV, 2021.Status: Accepted
DivergentNets: Medical Image Segmentation by Network Ensemble
Detection of colon polyps has become a trending topic in the intersecting fields of machine learning and gastrointestinal endoscopy. The focus has mainly been on per-frame classification. More recently, polyp segmentation has gained attention in the medical community. Segmentation has the advantage of being more accurate than per-frame classification or object detection as it can show the affected area in greater detail. For our contribution to the EndoCV 2021 segmentation challenge, we propose two separate approaches. First, a segmentation model named TriUNet composed of three separate UNet models. Second, we combine TriUNet with an ensemble of well-known segmentation models, namely UNet++, FPN, DeepLabv3, and DeepLabv3+, into a model called DivergentNets to produce more generalizable medical image segmentation masks. In addition, we propose a modified Dice loss that calculates loss only for a single class when performing multi-class segmentation, forcing the model to focus on what is most important. Overall, the proposed methods achieved the best average scores for each respective round in the challenge, with TriUNet being the winning model in Round I and DvergentNets being the winning model in Round II of the segmentation generalization challenge at EndoCV 2021
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Proceedings, refereed |
Year of Publication | 2021 |
Conference Name | EndoCV |
Journal articles
Equivalence projective simulation as a framework for modeling formation of stimulus equivalence classes
Neural computation 32 (2020): 912-968.Status: Accepted
Equivalence projective simulation as a framework for modeling formation of stimulus equivalence classes
Stimulus equivalence (SE) and projective simulation (PS) study complex behavior, the former in human subjects and the latter in artificial agents. We apply the PS learning framework for modeling the formation of equivalence classes. For this purpose, we first modify the PS model to accommodate imitating the emergence of equivalence relations. Later, we formulate the SE formation through the matching-to-sample (MTS) procedure. The proposed version of PS model, called the equivalence projective simulation (EPS) model, is able to act within a varying action set and derive new relations without receiving feedback from the environment. To the best of our knowledge, it is the first time that the field of equivalence theory in behavior analysis has been linked to an artificial agent in a machine learning context. This model has many advantages over existing neural network models. Briefly, our EPS model is not a black box model, but rather a model with the capability of easy interpretation and flexibility for further modifications. To validate the model, some experimental results performed by prominent behavior analysts are simulated. The results confirm that the EPS model is able to reliably simulate and replicate the same behavior as real experiments in various settings, including formation of equivalence relations in typical participants, nonformation of equivalence relations in language-disabled children, and nodal effect in a linear series with nodal distance five. Moreover, through a hypothetical experiment, we discuss the possibility of applying EPS in further equivalence theory research.
Afilliation | Machine Learning |
Project(s) | Department of Holistic Systems |
Publication Type | Journal Article |
Year of Publication | 2020 |
Journal | Neural computation |
Volume | 32 |
Number | 5 |
Pagination | 912–968 |
Publisher | {MIT Press |