A database for publications published by researchers and students at SimulaMet.
Status
Research area
Publication type
- All (88) Remove All <span class="counter">(88)</span> filter
- Journal articles (25)
- Books (2)
- Edited books (1)
- Proceedings, refereed (20)
- Book chapters (3)
- Talks, keynote (8)
- Proceedings, non-refereed (1)
- Posters (1)
- Technical reports (1)
- Manuals (1)
- Talks, invited (13)
- Public outreach (10)
- Miscellaneous (2)
Book chapters
Stakeholder Perceptions on Requirements for Accessible Technical Condition Information in Residential Real Estate Transactions
In Lecture Notes in Computer Science. 16th International Conference on Universal Access in Human-Computer Interaction (UAHCI) ed. Vol. 7. Springer International Publishing, 2022.Status: Accepted
Stakeholder Perceptions on Requirements for Accessible Technical Condition Information in Residential Real Estate Transactions
Buyers of residential real estate frequently experience dissatisfaction with the property they have purchased. Recent findings suggest that insufficient knowledge about the property is a key trigger to ensuing disappointment and claims for compensation. Further, a good technical condition report reduces the probability of dissatisfaction and insurance claims. For the purpose of designing services for improving technical condition information and its flow, we elicited stakeholder perceptions on the suitability of residential real estate technical condition reports. Specifically, we conducted multiple surveys which we content analyzed and used as the basis for a conceptual model of information products and dependencies needed to deliver better information to stakeholders in a real estate transaction process. The conceptual model, in turn, forms the basis for specific service design in future work.
Afilliation | Software Engineering |
Project(s) | EDOS: Effective Digitalization of Public Sector |
Publication Type | Book Chapter |
Year of Publication | 2022 |
Book Title | Lecture Notes in Computer Science |
Volume | 7 |
Edition | 16th International Conference on Universal Access in Human-Computer Interaction (UAHCI) |
Chapter | 16 |
Series Volume | 13308 |
Publisher | Springer International Publishing |
ISBN Number | 978-3-031-05027-5 |
Keywords | Conflict Reduction, Information Services, Residential Real Estate Transactions, Technical Condition Information |
Scenario Design for Healthcare Collaboration Training under Suboptimal Conditions
In Lecture Notes in Computer Science. 13th International Conference on Digital Human Modeling & Applications in Health, Safety, Ergonomics & Risk Management (DHM) ed. Vol. 19. Springer International Publishing, 2022.Status: Accepted
Scenario Design for Healthcare Collaboration Training under Suboptimal Conditions
Health care today
usually consists of various services covering various parts of the
total health care of a region or country. These services are
required to coordinate and collaborate, often using procedures and IT collaboration
tools that may not be designed for interoperating across the
evolving wider landscape of health care services. We posit that it
is necessary to train personnel in collaboration skills using
whatever infrastructure is in place. To this end, we present design
principles for simulation-based collaboration training scenarios that emphasizes the inclusion of suboptimal infrastructure elements. We
applied the principles in a co-creational workshop with healthcare stakeholders
from a hospital and surrounding municipalities in Norway where we
discussed cases where collaboration training is perceived as
critical. We elicited five training vignettes concerning the general case of
detecting, and following up on, clinical deterioration in a patient at home or in a nursing home. We found that the design principles spurred highly relevant discussions among participants and that novel ideas for collaboration training were brought forth on the basis of these principles. We conclude
that there is a potential in using these principles for eliciting training vignettes that address the actual situation more accurately.
Afilliation | Software Engineering |
Project(s) | EDOS: Effective Digitalization of Public Sector |
Publication Type | Book Chapter |
Year of Publication | 2022 |
Book Title | Lecture Notes in Computer Science |
Volume | 19 |
Edition | 13th International Conference on Digital Human Modeling & Applications in Health, Safety, Ergonomics & Risk Management (DHM) |
Series Volume | 13320 |
Publisher | Springer International Publishing |
Keywords | Healthcare Collaboration, IT Services, Procedures, Scenario Design, Simulation-based training, Stakeholder Journey Analysis |
Journal articles
When should we (not) use the mean magnitude of relative error (MMRE) as an error measure in software development effort estimation?
Information and Software Technology 143 (2022).Status: Accepted
When should we (not) use the mean magnitude of relative error (MMRE) as an error measure in software development effort estimation?
Context: The mean magnitude of relative error (MMRE) is an error measure frequently used to evaluate and compare the estimation performance of prediction models and software professionals.
Objective: This paper examines conditions for proper use of MMRE in effort estimation contexts.
Method: We apply research on scoring functions to identify the type of estimates that minimizes the expected value of the MMRE.
Results: We show that the MMRE is a proper error measure for estimates of the most likely (mode) effort, but not for estimates of the median or mean effort, provided that the effort usage is approximately log-normally distributed, which we argue is a reasonable assumption in many software development contexts. The relevance of the findings is demonstrated on real-world software development data.
Conclusion: MMRE is not a proper measure of the accuracy of estimates of the median or mean effort, but may be used for the accuracy evaluation of estimates of most likely effort.
Afilliation | Software Engineering |
Project(s) | Department of IT Management, EDOS: Effective Digitalization of Public Sector |
Publication Type | Journal Article |
Year of Publication | 2022 |
Journal | Information and Software Technology |
Volume | 143 |
Date Published | 03/2022 |
Publisher | Elsevier |
When 2 + 2 should be 5: The summation fallacy in time prediction
Journal of Behavioral Decision Making (2022).Status: Accepted
When 2 + 2 should be 5: The summation fallacy in time prediction
Predictions of time (e.g., work hours) are often based on the aggregation of estimates of elements (e.g., activities, subtasks). The only types of estimates that can be safely aggregated by summation are those reflecting predicted average outcomes (expected values). The sums of other types of estimates, such as bounds of confidence intervals or estimates of the mode, do not have the same interpretation as their components (e.g., the sum of the 90% upper bounds is not the appropriate 90% upper bound of the sum). This can be a potential source of bias in predictions of time, as shown in Studies 1 and 2, where professionals with experience in estimation provided total estimates of time that were inconsistent with their estimates of individual tasks. Study 3 shows that this inconsistency can be attributed to improper aggregation of time estimates and demonstrates how this can produce both over- and underestimation—and also time prediction intervals that are far too wide. Study 4 suggests that the results may reflect a more general fallacy in the aggregation of probabilistic quantities. Our observations are consistent with that inconsistencies and biases are driven by a tendency towards applying a naïve summation (2+2=4) of probabilistic (stochastic) values, in situations where this is not appropriate. This summation fallacy may be in particular consequential in a context where informal estimation methods (expert-judgment based estimation) are used.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2022 |
Journal | Journal of Behavioral Decision Making |
Publisher | Wiley |
Realizing benefits in public IT projects: A multiple case study
a journal (2022).Status: Submitted
Realizing benefits in public IT projects: A multiple case study
IT investments in the public sector are large, and it is essential that they lead to benefits for the organizations themselves and for the wider society. While there is evidence suggesting a positive connection between the existence of benefits management practices and benefits realization, less is known about how to implement such practices effectively. The paper aims to provide insights into when benefits are most likely to be realized, and how benefits management practices and roles should be implemented in order to have a positive effect on the projects’ success in terms of realizing benefits. The authors collected data relating to ten Norwegian public IT projects. For each project, they collected data on benefits management from project documents, by interviewing the project owners and benefits owners, and follow-up surveys. The benefits internal to the organization were those with the highest degree of realization, while the societal benefits were those with the lowest degree. Projects assessed to have more specific, measurable, accountable, and realistically planned benefits were more successful in realizing benefits. Benefits owners were most effective when they were able to attract attention towards the benefits to be realized, had a strong mandate, and had domain expertise.
Afilliation | Software Engineering |
Project(s) | EDOS: Effective Digitalization of Public Sector |
Publication Type | Journal Article |
Year of Publication | 2022 |
Journal | a journal |
Publisher | x |
Quantifying means-end reasoning skills in simulation-based training: a logic-based approach
SIMULATION (2022): 1-26.Status: Published
Quantifying means-end reasoning skills in simulation-based training: a logic-based approach
We develop a logic-based approach for designing simulation-based training scenarios. Our methodology embodies a concise definition of the scenario concept and integrates the notions of training goals, acceptable versus unacceptable actions and performance scoring. The approach applies classical artificial intelligence (AI) planning to extract coherent plays from a causal description of the training domain. The domain- and task-specific parts are defined in a high-level action description language AL. Generic causal and temporal logic is added when the causal theory is compiled into the underlying Answer Set Programming (ASP) language. The ASP representation is used to derive a scoring function that reflects the quality of a play or training session, based on a distinction of states and actions into green (acceptable) and red (unacceptable) ones. To that end, we add to the casual theory a set of norms that specify an initial assignment of colors. The ASP engine uses these norms as axioms and propagates colors by consulting the causal theory. We prove that any set of such norms constitutes a conservative extension of the underlying causal theory. With this work, we hope to lay the foundation for the development of design and analysis tools for exercise managers. We envision a software system that lets an exercise manager view all plays of a tentative scenario design, with expediency information and scores for each possible play. Our approach is applicable to any domain in which means-ends reasoning is pertinent. We illustrate the approach in the domain of crisis response and management.
Afilliation | Software Engineering |
Project(s) | EDOS: Effective Digitalization of Public Sector |
Publication Type | Journal Article |
Year of Publication | 2022 |
Journal | SIMULATION |
Pagination | 1--26 |
Date Published | 05/2022 |
Publisher | SAGE journals |
Keywords | Answer Set Programming, automated scoring, deontic logic, means-end reasoning, Simulation-based training |
URL | https://doi.org/10.1177/00375497221095070 |
DOI | 10.1177/00375497221095070 |
Proceedings, refereed
Measurement of software development effort estimation bias: Avoiding biased measures of estimation bias
In 11th International Conference on Software Engineering and Applications (SEA 2022), 2022.Status: Accepted
Measurement of software development effort estimation bias: Avoiding biased measures of estimation bias
In this paper, we propose improvements in how estimation bias, e.g., the tendency towards under-estimating the effort, is measured. The proposed approach emphasizes the need to know what the estimates are meant to represent, i.e., the type of estimate we evaluate and the need for a match between the type of estimate given and the bias measure used. We show that even perfect estimates of the mean effort will not lead to an expectation of zero estimation bias when applying the frequently used bias measure: (actual effort – estimated effort)/actual effort. This measure will instead reward under-estimates of the mean effort. We also provide examples of bias measures that match estimates of the mean and the median effort, and argue that there are, in general, no practical bias measures for estimates of the most likely effort. The paper concludes with implications for the evaluation of bias of software development effort estimates.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Proceedings, refereed |
Year of Publication | 2022 |
Conference Name | 11th International Conference on Software Engineering and Applications (SEA 2022) |
Perceived Challenges in Benefits Management - A Study of Public Sector Information Systems Engineering Projects
In 24th IEEE International Conference on Business Informatics. IEEE, 2022.Status: Accepted
Perceived Challenges in Benefits Management - A Study of Public Sector Information Systems Engineering Projects
The field of benefits management gives guidelines on how to plan and realize benefits throughout the life-cycle of a system. However, realizing benefits from information systems projects has proven to be challenging in practice. In this paper, we investigate specific benefits management challenges as perceived by practitioners involved in information systems engineering projects. We conducted 22 interviews with respondents representing nine public sector projects, where challenges in managing benefits were elicited and identified. We elicited six specific benefits management challenges: A - Identifying and describing benefits, B - Alignment of work with planned benefits, C - Reception and acceptance of the planned benefits, D - Organizational issues, E - Alternative or competing solutions, F - Measuring and evaluating benefits. Overlaying these challenges with current normative models on benefits management, we find that: 1. Normative models on benefits management lack sufficient guidance on operative work on how to create information systems fit for realizing benefits and how to introduce these solutions to ensure benefits realization, and 2. Normative models on benefits management do not explicitly leverage the rapid project learning promoted by modern engineering methods. We conclude that more specific benefits management models should be elaborated, which are integrated into modern information systems engineering practices. This will enable best practices on the continuous adjustments of cost and scope according to evolving knowledge in projects to also be adapted to the management of benefits.
Afilliation | Software Engineering |
Project(s) | EDOS: Effective Digitalization of Public Sector |
Publication Type | Proceedings, refereed |
Year of Publication | 2022 |
Conference Name | 24th IEEE International Conference on Business Informatics |
Publisher | IEEE |
Keywords | Benefits management challenges, Benefits management models, Information systems engineering, Public sector |
Research Incentives in Academia Leading to Unethical Behavior
In Research Challenges in Information Science. Vol. 44624156469341838. Cham: Springer International Publishing, 2022.Status: Published
Research Incentives in Academia Leading to Unethical Behavior
A current practice in academia is to reward researchers for achieving outstanding performance. Although intended to boost productivity, such a practice also promotes competitiveness and could lead to unethical behavior. This position paper exposes common misconducts that arise when researchers try to game the system. It calls the research community to take preventive actions to reduce misconduct and treat such a pervasive environment with proper acknowledgment of researchers’ efforts and rewards on quality rather than quantity.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Proceedings, refereed |
Year of Publication | 2022 |
Conference Name | Research Challenges in Information Science |
Volume | 44624156469341838 |
Pagination | 744 - 751 |
Date Published | 05/2022 |
Publisher | Springer International Publishing |
Place Published | Cham |
ISBN Number | 978-3-031-05759-5 |
ISSN Number | 1865-1348 |
Keywords | Incentives, Misconduct, Research ethics, Research quality, Researcher performance |
Notes | Part of the Lecture Notes in Business Information Processing book series (LNBIP,volume 446) |
URL | https://link.springer.com/chapter/10.1007/978-3-031-05760-1_51 |
DOI | 10.1007/978-3-031-05760-110.1007/978-3-031-05760-1_51 |
Books
Benefit/Cost-Driven Software Development - with Benefit Points and Size Points
Cambridge, UK: Springer, 2021.Status: Published
Benefit/Cost-Driven Software Development - with Benefit Points and Size Points
This open access book presents a set of basic techniques for estimating the benefit of IT development projects and portfolios. It also offers methods for monitoring how much of that estimated benefit is being achieved during projects.
Readers can then use these benefit estimates together with cost estimates to create a benefit/cost index to help them decide which functionalities to send into construction and in what order. This allows them to focus on constructing the functionality that offers the best value for money at an early stage.
Although benefits management involves a wide range of activities in addition to estimation and monitoring, the techniques in this book provides a clear guide to achieving what has always been the goal of project and portfolio stakeholders: developing systems that produce as much usefulness and value as possible for the money invested. The techniques can also help deal with vicarious motives and obstacles that prevent this happening. The book equips readers to recognize when a project budget should not be spent in full and resources be allocated elsewhere in a portfolio instead. It also provides development managers and upper management with common ground as a basis for making informed decisions.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Book |
Year of Publication | 2021 |
Publisher | Springer |
Place Published | Cambridge, UK |
ISBN Number | 978-3-030-74217-1 |
Keywords | benefit points, benefit/costs index, benefits management, earned business value management, periodization, uncertainty assessment |
URL | https://link.springer.com/book/10.1007/978-3-030-74218-8#toc |
DOI | 10.1007/978-3-030-74218-8 |