Department of IT Management

The department conducts research on software development methods, human judgment and decision making in software development contexts, benefits management, cost estimation, risk and uncertainty management, use of contracts and models for user involvements. The main research approach is empirical, including controlled experiments, observational studies, case studies and surveys.
The department’s main goal is to discover important relationships and connections related to the management of software development work, and use this to contribute to substantial improvement in software development processes and products. For this purpose, we work in close collaboration with industry partners in most of our research. We emphasize the transfer of new and useful knowledge to the industry by publishing and presenting not only in academic venues, but also at industry venues.
The IT Management Department also runs Hovedstadsområdets nettverk for IT-styring og ledelse (HIT-Nettverket), which is a network with the goal of increasing competance through sharing experiences in IT management. The network consist of research institutes, IT companies, consultant companies, public stakeholders and clients with an interest in IT management. The themes includes focuses both in the client and the supplier perspective, in addition to strategic, administrative and project related challenges. Read more about HIT here.
In addition, the department is in charge of the EDOS center (Effective Organization of Public Sector). This center is funded by the Ministry of Local Government and Modernization and was created in 2020. EDOS conducts surveys and analyzes information on digitalization in the public sector. The research aims to provide knowledge about what leads to successful digitalization in the public sector and to disseminate knowledge that leads to higher efficiency and more value creation. Read more about EDOS here.
People at Department of IT Management
Who we are?
Simula Metropolitan employees are researchers, postdoctoral fellows, PhD students, engineers and administrative people. We are from all over the world, ranging from newly educated to experienced researchers, all working on making research in digital engineering at the highest international level possible.
Publications at Department of IT Management
Talks, invited
Impacto Social y Laboral del Doctorado (Social and Labor Impact of the Doctorate)
In X Doctoral Conference of the University of Castilla-La Mancha (UCLM), Albacete, Spain, 2022.Status: Published
Impacto Social y Laboral del Doctorado (Social and Labor Impact of the Doctorate)
Afilliation | Software Engineering |
Project(s) | Department of IT Management, EDOS: Effective Digitalization of Public Sector |
Publication Type | Talks, invited |
Year of Publication | 2022 |
Location of Talk | X Doctoral Conference of the University of Castilla-La Mancha (UCLM), Albacete, Spain |
Type of Talk | Panel |
Book
Benefit/Cost-Driven Software Development - with Benefit Points and Size Points
Cambridge, UK: Springer, 2021.Status: Published
Benefit/Cost-Driven Software Development - with Benefit Points and Size Points
This open access book presents a set of basic techniques for estimating the benefit of IT development projects and portfolios. It also offers methods for monitoring how much of that estimated benefit is being achieved during projects.
Readers can then use these benefit estimates together with cost estimates to create a benefit/cost index to help them decide which functionalities to send into construction and in what order. This allows them to focus on constructing the functionality that offers the best value for money at an early stage.
Although benefits management involves a wide range of activities in addition to estimation and monitoring, the techniques in this book provides a clear guide to achieving what has always been the goal of project and portfolio stakeholders: developing systems that produce as much usefulness and value as possible for the money invested. The techniques can also help deal with vicarious motives and obstacles that prevent this happening. The book equips readers to recognize when a project budget should not be spent in full and resources be allocated elsewhere in a portfolio instead. It also provides development managers and upper management with common ground as a basis for making informed decisions.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Book |
Year of Publication | 2021 |
Publisher | Springer |
Place Published | Cambridge, UK |
ISBN Number | 978-3-030-74217-1 |
Keywords | benefit points, benefit/costs index, benefits management, earned business value management, periodization, uncertainty assessment |
URL | https://link.springer.com/book/10.1007/978-3-030-74218-8#toc |
DOI | 10.1007/978-3-030-74218-8 |
Journal Article
Benefits management in software development: A systematic review of empirical studies
IET Software 15, no. 1 (2021): 1-24.Status: Published
Benefits management in software development: A systematic review of empirical studies
Considerable resources are wasted on software projects delivering less than the planned benefits. Herein, the objective is to synthesize empirical evidence of the adoption and impact of benefits management (BM) in software development, and to suggest directions for future research. A systematic review of the literature is performed and identified 4836 scientific papers of which the authors found 47 to include relevant research. While most organizations identify and structure benefits at the outset of a project, fewer organizations report implementing BM as a continuous process throughout the project lifecycle. Empirical evidence gives support for positive impact on project outcome from the following BM practices: identifying and structuring benefits, planning benefits realization, BM during project execution, benefits evaluation and the practice of having people responsible for benefits realization. The authors suggest four research directions to understand (1) why BM practices sometimes not are adopted, (2) BM in relation to other management practices, (3) BM in agile software development and (4) BM in the context of organizations' value creation logics.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | IET Software |
Volume | 15 |
Issue | 1 |
Pagination | 1-24 |
Publisher | IET |
Leveraging Network-Centric Strategic Goals in Capabilities
Journal of Military Studies 10 (2021): 90-104.Status: Published
Leveraging Network-Centric Strategic Goals in Capabilities
The vision of network-centric operations is to increase operational capabilities through networked collaboration. NATO and its member nations state this vision in strategic documents at a very high level of abstraction. While suitable for giving an overall feel, current documentation renders the steps toward implementing those visions largely unsupported. We outline a method, based on agile requirements engineering, for converting high-level strategic visions into capabilities, whose form lend themselves to incremental implementation. We illustrate the use of this method in two cases that concern both operational capabilities and technical capabilities. We also show how the method enables one to prioritize which capabilities to develop first. We conclude that some form of explicit methodology to span the gap between strategic visions and implementing those visions is necessary.
Afilliation | Software Engineering |
Project(s) | EDOS: Effective Digitalization of Public Sector, Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | Journal of Military Studies |
Volume | 10 |
Number | 1 |
Pagination | 90-104 |
Publisher | De Gruyter |
Keywords | benefits management, capabilities, requirements engineering, strategic goals |
URL | https://www.sciendo.com/article/10.2478/jms-2021-0001 |
DOI | 10.2478/jms-2021-0001 |
Experiential Learning Approach for Software Engineering Courses at Higher Education Level
arXiv preprint arXiv:2012.14178 (2021).Status: Submitted
Experiential Learning Approach for Software Engineering Courses at Higher Education Level
Background: Software project management activities help to introducing software process models in Software Engineering courses. However, these activities should be adequately aligned with the learning outcomes and support student's progression.
Objective: Present and evaluate an approach to help students acquire theoretical and practical knowledge and experience real-world software projects' challenges. The approach combines a serious game and a design-implement task in which students develop a controlled-scale software system.
Methods: To evaluate our approach, we analyzed the students' perceptions collected through an online survey, their project plans, and their final reports using thematic analysis.
Results: Results suggest that the approach promotes knowledge acquisition, enables students' progression, reinforces theoretical concepts, and is properly aligned with the course's learning outcomes.
Conclusion: The approach seems to help introducing software process models in Software Engineering courses. Our experience can also be inspiring for educators willing to apply our approach in similar courses.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | arXiv preprint arXiv:2012.14178 |
Publisher | Springer |
Determining a Core View of Research Quality in Empirical Software Engineering
Empirical Software Engineering (2021).Status: Submitted
Determining a Core View of Research Quality in Empirical Software Engineering
Context: Research quality is intended to appraise the design and reporting of studies. It comprises a set of concepts such as methodological rigor, practical relevance, and conformance to ethical standards. Depending on the perspective, different views of importance are given to the conceptual dimensions of research quality.
Objective: We intend to assess the level of alignment between researchers with regard to a conceptual model of research quality. This includes aligning the definition of research quality and reasoning on the relative importance of quality characteristics.
Method: We conducted a mixed-methods approach with two distinct group perspectives: (i) a research group; and (ii) the empirical software engineering research community. Our data collection approach comprised a questionnaire survey and a complementary focus group. We carried out a hierarchical voting prioritization to collect relative values for importance.
Results: In the context of this research, ‘internally valid’, ‘relevant research idea’, and ‘applicable results’ are perceived as the core dimensions of quality. The alignment at the research group level was higher compared to that at the community level.
Conclusion: The interdisciplinary model of research quality was seen to express fairly the quality of research in the software engineering context. It presented limitations regarding its structure and components' description, which resulted in an updated model.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | Empirical Software Engineering |
Publisher | Springer |
Risks and risk mitigation in global software development: an update
Journal of Software: Evolution and Process 33, no. 11 (2021): e2370.Status: Published
Risks and risk mitigation in global software development: an update
Context: Interest in global software development (GSD) has led to the publication of numerous studies. Over time, these studies should be updated to verify if their findings and conclusions remain valid.
Objective: To update a tertiary study, published in 2014, focused on investigating risks and risk mitigation advice in the context of GSD.
Method: We conducted a systematic literature study based on forward snowballing, out of which we identified and selected 25 unique studies.
Results: We extracted: a) 122 risks (75 of which already identified in the original work), and b) 123 mitigation advice (44 of which were identified in the original work). The evidence supporting these risks and mitigation were extracted from 619 and 389 primary sources, respectively. Given the amount of evidence found, we have reported only those with higher empirical support. The raw data, including all the values obtained, are available online as complementary material.
Conclusions: Interest in GSD, its potential risks, and possible mitigation strategies, remains high. This update has allowed increasing the level of empirical support provided by the findings of the original work.
Afilliation | Software Engineering |
Project(s) | Department of IT Management, EDOS: Effective Digitalization of Public Sector |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | Journal of Software: Evolution and Process |
Volume | 33 |
Issue | 11 |
Pagination | e2370 |
Date Published | 09/2021 |
Publisher | John Wiley & Sons Ltd |
URL | https://onlinelibrary.wiley.com/doi/10.1002/smr.2370 |
DOI | 10.1002/smr.2370 |
Archetypes of delay: An analysis of online developer conversations on delayed work items in IBM Jazz
Information and Software Technology 129 (2021): 106435.Status: Published
Archetypes of delay: An analysis of online developer conversations on delayed work items in IBM Jazz
Project(s) | Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | Information and Software Technology |
Volume | 129 |
Pagination | 106435 |
Publisher | {Elsevier |
Evaluation of Probabilistic Project Cost Estimates
IEEE Transactions on Engineering Management (2021): 1-16.Status: Published
Evaluation of Probabilistic Project Cost Estimates
Evaluation of cost estimates should be fair and give incentives for accuracy. These goals, we argue, are challenged by a lack of precision in what is meant by a cost estimate and the use of evaluation measures that do not reward the most accurate cost estimates. To improve the situation, we suggest the use of probabilistic cost estimates and propose guidelines on how to evaluate such estimates. The guidelines emphasize the importance of a match between the type of cost estimate provided by the estimators and the chosen cost evaluation measure, and the need for an evaluation of both the calibration and the informativeness of probabilistic cost estimates. The feasibility of the guidelines is exemplified in an analysis of a set of 69 large Norwegian governmental projects. The evaluation indicated that the projects had quite accurate and unbiased P50 estimates and that the prediction intervals were reasonably well calibrated. It also showed that the cost prediction intervals were non-informative with respect to differences in cost uncertainty and, consequently, not useful to identify projects with higher cost uncertainty. The results demonstrate the usefulness of applying the proposed cost estimation evaluation guidelines.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | IEEE Transactions on Engineering Management |
Pagination | 1-16 |
Date Published | 08/2021 |
Publisher | IEEE |
A field experiment on trialsourcing and the effect of contract types on outsourced software development
Information and Software Technology 134 (2021): 106559.Status: Published
A field experiment on trialsourcing and the effect of contract types on outsourced software development
Context: To ensure the success of software projects, it is essential to select skilled developers and to use suitable work contracts. Objective: This study tests two hypotheses: (i) the use of work-sample testing (trialsourcing) improves the selection of skilled software developers; and (ii) the use of contracts based on hourly payment leads to better software project outcomes than fixed-price contracts. Method: Fifty-seven software freelancers with relevant experience and good evaluation scores from previous clients were invited to complete a two-hour long trialsourcing task to qualify for a software development project. Thirty-six developers completed the trialsourcing task with acceptable performance, and, based on a stratified allocation process, were asked to give a proposal based on an hourly payment or a fixed-price contract. Eight hourly payment-based and eight fixed-priced proposals were accepted. The process and product characteristics of the completion of these 16 projects were collected and analysed. Results and Conclusion: Only partial support for our hypotheses was observed. While the use of trialsourcing may have prevented the selection of developers with insufficient skills, the performance on the trialsourcing task of the selected developers did not predict performance on the project. The use of hourly payments led to lower costs than fixed-price contracts, but not to improved processes or products. We plan to follow up these, to us unexpected, results with research on how to design more skill-predictive trialsourcing tasks, and when and why different project contexts give different contract consequences.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Journal Article |
Year of Publication | 2021 |
Journal | Information and Software Technology |
Volume | 134 |
Pagination | 106559 |
Date Published | June 2021 |
Publisher | Elsevier |