A database for publications published by researchers and students at SimulaMet.
Research area
Publication type
- All (604)
- Journal articles (141)
- Books (5)
- Proceedings, refereed (193)
- Book chapters (4)
- Talks, keynote (16)
- PhD theses (1)
- Proceedings, non-refereed (16) Remove Proceedings, non-refereed <span class="counter">(16)</span> filter
- Posters (6)
- Technical reports (11)
- Talks, invited (150)
- Talks, contributed (11)
- Public outreach (41)
- Miscellaneous (9)
Proceedings, non-refereed
Predicting software development skill from effort predictions (Un)skilled and unware of it?
In International symposium on forecasting (ISF), 2019.Status: Published
Predicting software development skill from effort predictions (Un)skilled and unware of it?
If software developers’ estimates of how much effort they would need to complete tasks were strongly correlated with their actual use of efforts, we could safely select among the developers with the lowest effort estimates and predict that they will be among the most skilled ones. Unfortunately, this is not necessarily the case. As documented in studies in many domains, those with lower skill tend to know less about how little they know and, for this reason, give over-optimistic estimates of their own performance.
This effect is termed the Dunning-Kruger effect. Does this mean that effort estimates are useless as predictors of software development skill?
To find out more on this we requested 104 software developers to estimate four larger and five smaller software development tasks and measured their programming skills. We assessed the connection between lower estimates and higher skill through rank correlations and hit rates, where the hit rate measures the frequency of selecting the most skilled out of two developers when selecting the one with the lower effort estimate on the same task.
The results were as predicted by the Dunning-Kruger effect for the larger tasks. The developers in the lowest skill quartile had on average lower estimates than those in the highest skill quartile. To predict relative programming skill based on these estimates would be very inaccurate. The correlations between task estimates and skill were between -0.15 and 0.01 and the hit rates between 44% and 50%.
The developers’ effort estimates on the smaller tasks were, however, much better connected with their measured programming skills. The rank correlations were between 0.29 and 0.50 and the hit rates between 62% and 68%. Clustering the estimates of all the smaller tasks into the same factor gave a rank correlation of 0.45 between this factor and the measured skill and a hit rate of 70%. While not very strong, we show that the estimates on these tasks is better connected with measured skill than those in use in software development contexts, i.e., company-assesses skill category, length of experience, self-assessed skill and confidence in knowing how to solve the tasks. These indicators had rank correlations between 0.14 and 0.29, and hit rates between 57% and 65%.
A possible explanation of why lower skill was connected with higher effort estimates for the smaller, but not for the larger tasks, is that lower skill in solving a task can both lead to lower skill in identifying the complexity and the simplicity of a task. In the situation with the simpler tasks, we propose, those with better skill were also better in identifying how easily the tasks could be solved at the time of estimation. This explanation suggests that we may be able to design estimation tasks even better at separating those with high and low task completion skill than in our study, when focusing on hidden simplicity, i.e., simplicity that the more skilled are more likely to identify than the less skilled ones.
Afilliation | Software Engineering |
Project(s) | Department of IT Management |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2019 |
Conference Name | International symposium on forecasting (ISF) |
Proceedings, non-refereed
NorNet – The Internet Testbed for Multi-Homed Systems
In Proceedings of the Multi-Service Networks Conference (MSN, Coseners). Abingdon, Oxfordshire/United Kingdom, 2016.Status: Published
NorNet – The Internet Testbed for Multi-Homed Systems
Multi-homing denotes the simultaneous connection of endpoints (e.g. cloud servers, smartphones, etc.) to multiple Internet Service Providers (ISP). That is, the endpoints remain reachable even when some of the ISPs have problems (e.g. malfunction of hardware or break of cables). Besides the redundancy aspect, multi-homing can also make load sharing by multi-path transport possible, i.e. increasing the application throughput by utilising multiple paths simultaneously. Multi-path transport can e.g. be realised by Concurrent Multi-Path Transfer for SCTP (CMT-SCTP) and Multi-Path TCP (MPTCP), two protocols that are currently under standardisation in the IETF. The growing need for and deployment of multi-homed applications makes large-scale testing and evaluation in realistic Internet setups necessary. For instance, different paths can have very different characteristics with regard to bandwidth, packet loss rate, congestion, delay and jitter. Therefore, the NorNet project of the Simula Research Laboratory is building up an open platform for such experiments: the NorNet testbed. It provides programmable nodes with multiple ISP connections -- wired as well as wireless -- that are distributed all over Norway as well as some international locations. This talk will give an overview over NorNet.
Afilliation | , Communication Systems, Communication Systems |
Project(s) | NorNet, The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2016 |
Conference Name | Proceedings of the Multi-Service Networks Conference (MSN, Coseners) |
Date Published | 07/2016 |
Place Published | Abingdon, Oxfordshire/United Kingdom |
Keywords | Introduction, Multi-Homing, NorNet, NorNet Core, NorNet Edge, Overview, Testbed |
Proceedings, non-refereed
Reducing Transport Latency using Multi-path Protocols
In European Conference on Networks and Communications (EuCNC), 2015.Status: Published
Reducing Transport Latency using Multi-path Protocols
Afilliation | , Communication Systems, Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | European Conference on Networks and Communications (EuCNC) |
NorNet Edge Platform to Measure Mobile Broadband
In Proceedings of the 3rd International NorNet Users Workshop (NNUW-3). Fornebu, Akershus/Norway: Simula Research Laboratory, 2015.Status: Published
NorNet Edge Platform to Measure Mobile Broadband
This talk provides an introduction to the NorNet Edge testbed as well as a status overview on the development and deployment in August 2015.
Afilliation | Communication Systems, , Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | Proceedings of the 3rd International NorNet Users Workshop (NNUW-3) |
Date Published | 08/2015 |
Publisher | Simula Research Laboratory |
Place Published | Fornebu, Akershus/Norway |
Keywords | Introduction, Multi-Homing, Multi-Path Transport, NorNet, NorNet Edge, Testbed |
The NorNet Core Testbed: A Status Update for the NNUW-3
In Proceedings of the 3rd International NorNet Users Workshop (NNUW-3). Fornebu, Akershus/Norway: Simula Research Laboratory, 2015.Status: Published
The NorNet Core Testbed: A Status Update for the NNUW-3
This talk provides an update on the NorNet Core testbed development and research for the 3rd NorNet Users Workshop (NNUW-3) in August 2015.
Afilliation | Communication Systems, , Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | Proceedings of the 3rd International NorNet Users Workshop (NNUW-3) |
Date Published | 08/2015 |
Publisher | Simula Research Laboratory |
Place Published | Fornebu, Akershus/Norway |
Keywords | Multi-Homing, Multi-Path Transport, NorNet, NorNet Core, Status, Testbed |
Correlating Edge Measurements and Network Side Logs
In Proceedings of the 3rd International NorNet Users Workshop (NNUW-3). Fornebu, Akershus/Norway: Simula Research Laboratory, 2015.Status: Published
Correlating Edge Measurements and Network Side Logs
Afilliation | Communication Systems, , Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | Proceedings of the 3rd International NorNet Users Workshop (NNUW-3) |
Date Published | 08/2015 |
Publisher | Simula Research Laboratory |
Place Published | Fornebu, Akershus/Norway |
Keywords | Correlation, Measurements, Network-Side Logs, NorNet, NorNet Edge |
MONROE -- Measuring Mobile Broadband Networks in Europe
In Proceedings of the 3rd International NorNet Users Workshop (NNUW-3). Fornebu, Akershus/Norway: Simula Research Laboratory, 2015.Status: Published
MONROE -- Measuring Mobile Broadband Networks in Europe
Afilliation | Communication Systems, , Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | Proceedings of the 3rd International NorNet Users Workshop (NNUW-3) |
Date Published | 08/2015 |
Publisher | Simula Research Laboratory |
Place Published | Fornebu, Akershus/Norway |
Keywords | Measurements, Mobile Broadband, MONROE |
Using NorNet Edge to Measure Mobile Broadband Performance under Mobility
In Proceedings of the 3rd International NorNet Users Workshop (NNUW-3). Fornebu, Akershus/Norway: Simula Research Laboratory, 2015.Status: Published
Using NorNet Edge to Measure Mobile Broadband Performance under Mobility
Afilliation | Communication Systems, , Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | Proceedings of the 3rd International NorNet Users Workshop (NNUW-3) |
Date Published | 08/2015 |
Publisher | Simula Research Laboratory |
Place Published | Fornebu, Akershus/Norway |
Keywords | Measurements, Mobility, NorNet, NorNet Edge, NSB, Trains |
Cellular Network Measurements: A Study of Four Swedish HSDPA+ and LTE Networks
In Proceedings of the 3rd International NorNet Users Workshop (NNUW-3). Fornebu, Akershus/Norway: Simula Research Laboratory, 2015.Status: Published
Cellular Network Measurements: A Study of Four Swedish HSDPA+ and LTE Networks
Afilliation | Communication Systems, , Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | Proceedings of the 3rd International NorNet Users Workshop (NNUW-3) |
Date Published | 08/2015 |
Publisher | Simula Research Laboratory |
Place Published | Fornebu, Akershus/Norway |
Keywords | HSDPA+, LTE, Measurements, Mobile Broadband, Testbed |
Multipath Resilient Transport and Routing for the Future Internet
In Proceedings of the 3rd International NorNet Users Workshop (NNUW-3). Fornebu, Akershus/Norway: Simula Research Laboratory, 2015.Status: Published
Multipath Resilient Transport and Routing for the Future Internet
As the Internet becomes increasingly important to all aspects of society, the consequences of disruption are increasingly severe. Thus it is critical to increase the resilience and survivability of the future networks in general, and the Internet in particular. We define resilience as the ability of the network to provide desired service even when the network is challenged by attacks, large-scale disasters, and other failures. Resilience subsumes the disciplines of survivability, fault-tolerance, disruption-tolerance, traffic-tolerance, dependability, performability, and security. This presentation will provide a brief introduction to the disciplines and challenges to network resilience, and to our complex-systems analysis and heuristics to improve infrastructure resilience under cost constraints. Then, this presentation will describe ongoing work in the design and analysis of a new composable, cross-layered resilient transport (ResTP) and geodiverse multipath routing protocol (GeoDivRP). These protocols are designed to are being developed to provide resilience and survivability in the face of targeted attacks and large-scale disasters to the network infrastructure.
Afilliation | Communication Systems, , Communication Systems |
Project(s) | The Center for Resilient Networks and Applications |
Publication Type | Proceedings, non-refereed |
Year of Publication | 2015 |
Conference Name | Proceedings of the 3rd International NorNet Users Workshop (NNUW-3) |
Date Published | 08/2015 |
Publisher | Simula Research Laboratory |
Place Published | Fornebu, Akershus/Norway |
Keywords | Future Internet, GeoDivRP, Multipath, Resilience, ResTP, Routing, Transport |