arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Michael Halling

23 papers · 2000–2024

2000: 12001: 12002: 52003: 62004: 62005: 12006: 02007: 02008: 02009: 02010: 02011: 12012: 02013: 02014: 02015: 02016: 12017: 02018: 02019: 02020: 02021: 02022: 02023: 02024: 1
2000peak 6 in 20032024

Frequent co-authors

Papers

showing 1–23 of 23 RSS

Investigating the defect detection effectiveness and cost benefit of nominal inspection teams

Stefan Biffl, Michael Halling

Information Systems · IEEE Transactions on Software Engineering · · cited 92× · DOI ↗ · more like this ·

Inspection is an effective but also expensive quality assurance activity to find defects early during software development. The defect detection process, team size, and staff hours invested can have a considerable impact on the defect detection effectiveness and cost-benefit of an inspection. In this paper, we use empirical data and a probabilistic model to estimate this impact for nominal (noncommunicating) inspection teams in an experiment context. Further, the analysis investigates how cutting off the inspection after a certain time frame would influence inspection performance. Main findings of the investigation are: 1) Using combinations of different reading techniques in a team is considerably more effective than using the best single technique only (regardless of the observed level of effort). 2) For optimizing the inspection performance, determining the optimal process mix in a…

Integrating Collaborative Processes and Quality Assurance Techniques: Experiences from Requirements Negotiation

Paul Grünbacher, Michael Halling, Stefan Biffl +2 more

Information Systems · Journal of Management Information Systems · · cited 36× · DOI ↗ · more like this ·

Collaboration is essential in many mission-critical activities. Consequently, numerous methods and tools are available supporting collaborative processes such as strategic planning, risk management, requirements definition, and so on. These methods typically emphasize the collaborative, value-creating activities, but there is often less emphasis on quality aspects. Quality assurance (QA) techniques have been wellknown in engineering for a long time, and their effectiveness and efficiency has been empirically evaluated in many domains. In this paper, we propose to integrate repeatable QA techniques and collaborative processes. We evaluate our idea in the context of a collaborative process for requirements negotiation. We propose pre-process techniques to be used before the actual negotiation, in-process techniques for checking quality during a negotiation, as well as post-process…

Using reading techniques to focus inspection performance

Michael Halling, Stefan Biffl, Thomas Grechenig +1 more

Information Systems · · cited 35× · DOI ↗ · more like this ·

Software inspection is a quality assurance method to detect defects early during the software development process. For inspection planning there are defect detection techniques, so-called reading techniques, which let the inspection planner focus the effectiveness of individual inspectors on specific sets of defects. For realistic planning it is important to use empirically evaluated defect detection techniques. We report on the replication of a large-scale experiment in an academic environment. The experiment evaluated the effectiveness of defect detection for inspectors who use a checklist or focused scenarios on individual and team level. A main finding of the experiments is that the teams were effective to find defects: In both experiments the inspection teams found on average more than 70% of the defects in the product. The checklist consistently was overall somewhat more effective…

An empirical study on groupware support for software inspection meetings

Paul Grünbacher, Michael Halling, Stefan Biffl

Information Systems · · cited 25× · DOI ↗ · more like this ·

Software inspection is an effective way to assess product quality and to reduce the number of defects. In a software inspection, the inspection meeting is a key activity to agree on collated defects, to eliminate false positives, and to disseminate knowledge among the team members. However, inspection meetings often require high effort and may lose defects found in earlier inspection steps due to ineffective meeting techniques. Only few tools are available for this task. We have thus been developing a set of groupware tools to lower the effort of inspection meetings and to increase their efficiency. We conducted an experiment in an academic environment with 37 subjects to empirically investigate the effect of groupware tool support for inspection meetings. The main findings of the experiment are that tool support considerably lowered the meeting effort, supported inspectors in…

Systematically combining process simulation and empirical data in support of decision analysis in software development

Ioana Rus, Stefan Biffl, Michael Halling

Software · · cited 20× · DOI ↗ · more like this ·

Decision-making is a complex and important task in software engineering. The current state-of-the-practice is rather non-systematic as it typically relies upon personal experience without using explicit models. Empirical studies can help but are to some extent context dependent and costly to conduct. Typically it is not efficient or even possible to conduct empirical studies for a large number of context parameter variations. We propose to build on a set of systematic empirical studies to fill gaps in context variable space with simulation: (a) Simulation can use the empirical results from different contexts and apply them to a planning situation as appropriate. (b) The analysis of simulation results can point out situations and factors for which conducting empirical studies would be most worthwhile. This paper presents a general decision model, a simulation framework, and examples for…

Tailoring a COTS group support system for software requirements inspection

Michael Halling, Paul Grünbacher, Stefan Biffl

Information Systems · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · · cited 19× · DOI ↗ · more like this ·

The inspection of early life-cycle artifacts such as requirement documents promises great benefits. However, research demonstrates that the inspection process is complex and expensive and that tool support would be highly desirable. Existing inspection tools focus largely on the inspection of source code. We have therefore devised groupware support for inspecting requirements. Based on our experience with adopting a group support system (GSS) for requirements negotiation, we decided to tailor this commercial GSS to support inspection of requirements. The paper discusses our concept of a Groupware-supported Requirements Inspection Process (GRIP) and shows that tailoring a COTS GSS works well to automate this process.

Teaching the unified process to undergraduate students

Michael Halling, Wolfgang Zuser, M. Kohle +1 more

Information Systems · · cited 17× · DOI ↗ · more like this ·

A modern software development process framework, such as the unified process, is able to overcome problems of past frameworks, e.g., structural mismatches (notation, method used) between the products in different process steps. Moreover, it promotes an industry standard, which yields instantly tangible benefits from better communication in development teams and further secures investments in development methods based on such a standard. We describe the concept of a one-year undergraduate course in SE based on the unified process and elaborate why, where and how the unified process can be incorporated into the course. The students' response to the process was very positive. We argue that the unified process (UP) qualifies very well for being taught to SE students, as it integrates and extends essential SE practices. Another key argument for applying the UP was to integrate the different…

Repeatable quality assurance techniques for requirements negotiations

Paul Grünbacher, Michael Halling, Stefan Biffl +2 more

Information Systems · · cited 17× · DOI ↗ · more like this ·

Many software projects fail because early life-cycle defects such as ill-defined requirements are not identified and removed. Therefore, quality assurance (QA) techniques for defect detection and prevention play an important role. The effectiveness and efficiency of QA approaches has been empirically evaluated. In this paper we discuss QA techniques optimized for requirements negotiations. In particular, we focus on negotiations using the EasyWinWin approach. We present (1) repeatable techniques for checking quality throughout negotiations as well as (2) role-oriented inspection techniques helping a project team to reduce unnecessary complexity and to mitigate risks stemming from defects in requirements negotiation results. We present the results of a thorough feasibility study we conducted to test our approach.

SUPPORTING DECISION-MAKING IN SOFTWARE ENGINEERING WITH PROCESS SIMULATION AND EMPIRICAL STUDIES

Ioana Rus, Michael Halling, Stefan Biffl

Information Systems · International Journal of Software Engineering and Knowledge Engineering · · cited 16× · DOI ↗ · more like this ·

Decision-making is a complex and important task in software engineering. The current state-of-the-practice is rather non-systematic as it typically relies upon personal judgment and experience without using explicit models. Empirical studies can help but they are costly to conduct and, to some extent, context dependent. Typically it is not efficient or even possible to conduct empirical studies for a large number of context parameter variations. Process simulation offers decision support as well, but currently suffers from a lack of empirical knowledge on the determinants of underlying system dynamics. In this paper we present an assessment of empirical knowledge and simulation techniques for the area of quality assurance planning. There is a strong interdependency between process simulation and empirical models for decision-making in this area: (a) profound empirical knowledge enables…

Investigating the accuracy of defect estimation models for individuals and teams based on inspection data

Stefan Biffl, Michael Halling, Sabine Köszegi

Information Systems · · cited 15× · DOI ↗ · more like this ·

Defect content estimation approaches, based on data from inspection, estimate the total number of defects in a document to evaluate the quality of the product and the development process. Objective estimation approaches require a high-quality measurement process, potentially suffer from overfitting, and may underestimate the number of defects for inspections that yield few data points. Reading techniques for inspection, which focus the attention of the inspectors on particular parts of the inspected document, may influence their subjective estimates. In this paper we consider approaches to aggregate subjective estimates of individual inspectors in a team to alleviate individual bias. We evaluate these approaches with data from an experiment in a university environment where 177 inspectors in 30 teams inspected a software requirements document. Main findings of the experiment were that…

A groupware-supported inspection process for active inspection management

Michael Halling, Stefan Biffl, Paul Grünbacher

Information Systems · · cited 14× · DOI ↗ · more like this ·

Inspection is an important approach to reduce defects in software engineering artifacts. However, research and practice show that the performance of manual inspections fluctuates considerably. Based on experiences we gained in large-scale controlled inspection experiments we propose a concept for improved inspection management relying on (a) the transparent collection of detailed data on the actual inspection process and (b) groupware support for the flexible combination of inspection process modeling and data-driven process analysis. We expect an automated approach to be of versatile help both for researchers who use it for monitoring controlled experiments and for practitioners who may use it as part Of their infrastructure for inspection management and transparent data collection.

Investigating the effect of expert ranking of use cases for design inspection

Dietmar Winkler, Michael Halling, Stefan Biffl

Information Systems · Proceedings. 30th Euromicro Conference, 2004. · · cited 11× · DOI ↗ · more like this ·

Inspection is an important approach to reduce defects in software engineering artifacts. Reading techniques such as usage-based reading (UBR) can focus inspector attention on specific types of defects (missing and wrong information) and specific defect severity classes (critical, important and not important defects). For empirical investigation the replication of experiments can help increase the confidence in results. This work presents a large-scale external experiment replication in the UBR family of experiments in an academic environment. Additionally to experiment replication we introduce a new reading technique variant UBR-ir to investigate the impact of expert know-how with ranking of use cases on the number and severity of defects found. Main results of the study are: (a) UBR expert know-how had significant effects on inspection effort distribution, effectiveness, and…

Software Product Improvement with Inspection.

Stefan Biffl, Michael Halling

Software · Journal of clinical and diagnostic research : JCDR · · cited 11× · DOI ↗ · more like this ·

The ratio of the distance from the inferior border of the mandible to the superior border of the mandible(A) and the distance from the inferior border of the mandible to the inferior margin of the mental foramen (B) were less in the dentulous males than in the dentulous females. The comparison of the ratios was nonsignificant. The mean bone loss in edentulous females was found to be greater than the mean bone loss in edentulous males on comparison.

The Politics of Related Lending

Michael Halling, Pegaret Pichler, Alex Stomper

Political Science and International Relations · Journal of Financial and Quantitative Analysis · · cited 10× · DOI ↗ · more like this ·

Abstract We analyze the profitability of government-owned banks’ lending to their owners, using a unique data set of relatively homogeneous government-owned banks; the banks are all owned by similarly structured local governments in a single country. Making use of a natural experiment that altered the regulatory and competitive environment, we find evidence that such lending was used to transfer revenues from the banks to the governments. Some of the evidence is particularly pronounced in localities where the incumbent politicians face significant competition for reelection.

Software product improvement with inspection. A large-scale experiment on the influence of inspection processes on defect detection in software requirements documents

Stefan Biffl, Michael Halling

Information Systems · Proceedings of the 26th Euromicro Conference. EUROMICRO 2000. Informatics: Inventing the Future · · cited 9× · DOI ↗ · more like this ·

In the early stages of software development, inspection of software documents is the most effective quality assurance measure to detect defects and provides timely feedback on quality to developers and managers. The paper reports on a controlled experiment that investigates the effect of defect detection techniques on software product and inspection process quality. The experiment compares defect detection effectiveness and efficiency of a general reading technique that uses checklist based reading, and a systematic reading technique, scenario based reading, for requirements documents. On the individual level, effectiveness was found to be higher for the general reading technique, while the focus of the systematic reading technique led to a higher yield of severe defects compared to the general reading technique. On a group level, which combined inspectors' contributions, the advantage…

Investigating the influence of software inspection process parameters on inspection meeting performance

Michael Halling, Stefan Biffl

Information Systems · IEE Proceedings - Software · · cited 9× · DOI ↗ · more like this ·

The question of whether inspection meetings justify their cost has been discussed in several studies. However, it is still open as to how modern defect detection techniques and team size influence meeting performance, particularly with respect to different classes of defect severity. The influence of software inspection process parameters (defect detection technique, team size, meeting effort) on defect detection effectiveness is investigated, i.e. the number of defects found for 31 teams which inspected a requirements document, to shed light on the performance of inspection meetings. The sets of defects reported by each team after the individual preparation phase (nominal-team performance) and after the team meeting (real-team performance) are compared. The main findings are that nominal teams perform significantly more effectively than real teams for all defect classes. This implies…

An experiment family to investigate the defect detection effect of tool-support for requirements inspection

Michael Halling, Stefan Biffl, Paul Grünbacher

Information Systems · · cited 7× · DOI ↗ · more like this ·

The inspection of software products can help to find defects early in the development process and to gather valuable information on product quality. An inspection is rather resource intensive and involves several tedious tasks like navigating, sorting, or checking. Tool support is thus hoped to increase effectiveness and efficiency. However, little empirical work is available that directly compares paper-based (i.e., manual) and tool-based software inspections. Existing reports on tool support for inspection generally tend to focus on code inspections while little can be found on requirements or design inspection. We report on an experiment family: two experiments on paper-based inspection and a third experiment to empirically investigate the effect of tool support regarding defect detection effectiveness and inspection effort in an academic environment with 40 subjects. Main results of…

Investigating the effect of a second software inspection cycle. Cost-benefit data from a large-scale experiment on reinspection of a software requirements document

Stefan Biffl, Michael Halling, Monika Köhle

Information Systems · · cited 7× · DOI ↗ · more like this ·

The goal of software inspection is to identify defects and to measure the product and inspection process quality. Software development products that are suspected to contain a substantial number of defects after inspection may be subject to a second inspection cycle (re-inspection). So far, very few empirical results can be found on re-inspections. This paper reports on a controlled experiment that compares the effect of two inspection cycles. A software requirements document was re-inspected by 31 teams, after defects found during the initial inspection had been removed. We present data on the effectiveness, efficiency, net gain and return-on-investment from a second inspection cycle, and compare these results with data from the initial inspection. Models in the literature suggest decision criteria with regard to when to re-inspect, based on assumptions on the relationships of…

The role of valuation in value-based software engineering

Michael Halling

Information Systems · · cited 6× · DOI ↗ · more like this ·

Current state-of-the-practice and state-of-the-art in software engineering (SE) typically focuses on cost issues and technical considerations for decision-making, as costs are generally easier to measure than benefits. Value-based SE emphasizes the concept of 'value' in SE. However, so far the concept of value in SE is not well analyzed in its various dimensions. Furthermore, the process of measuring value, i.e. valuation, has mostly been discussed in the SE community from a mathematical perspective. In order to establish a comprehensive value-oriented valuation approach in SE we aim at applying valuation concepts from finance and economy, which try to appropriately quantify benefits, costs, and risks of a project or a project portfolio. We put a special focus on the value of information and individual preferences. We expect that such a value-oriented concept allow developing…

4.3.1 Formalizing Informal Stakeholder Requirements Inputs

Hasan Kitapci, Barry Boehm, Paul Grünbacher +2 more

Information Systems · INCOSE International Symposium · · cited 6× · DOI ↗ · more like this ·

Abstract Often, the stakeholders who can contribute the most value and realism to system requirements are the ones with the least time available to participate in the process. We have found the EasyWinWin requirement negotiation method and tools to be an effective way to involve such busy stakeholders. It avoids time‐consuming group wordsmithing, but results in relatively informal win‐win agreements (e.g., “24/7” or “anytime, anywhere” vs. more precise availability and accessibility requirements). For the past three years, we have been using EasyWinWin to capture informal requirements from stakeholders in an annual series of 15‐20 University of Southern California (USC) electronic services projects. In the context of these projects, we have been exploring alternative methods for formalizing these informal requirements inputs, including natural language processing, keyword analysis…

Investigating reinspection decision accuracy regarding product-quality and cost-benefit estimates

Stefan Biffl, Michael Halling

Information Systems · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · · cited 1× · DOI ↗ · more like this ·

After a software inspection the project manager has to decide whether a product has sufficient quality to pass on to the next software development stage or whether a second inspection cycle, a reinspection, is likely to sufficiently improve its quality. The reinspection decision of recent research focused on the estimation of product quality after inspection, which does not take in to account the effect of a reinspection. Thus we propose to use estimation models for the quality improvement during reinspection and the cost and benefit of a reinspection as basis for the reinspection decision. We evaluate the reinspection decision correctness of these models with time-stamped defect data from a large-scale controlled experiment on the inspection and reinspection of a software requirements document. The main finding of the investigation is that the product quality criterion is likely to…

A Model Toward Formalizing and Monitoring Compliance of Investment Funds Activities

Nicolas Sannier, Marcello Ceci, Sallam Abualhaija +2 more

Development · Open Repository and Bibliography (University of Luxembourg) · · cited 0× · DOI ↗ · more like this ·

Investment funds operate in a highly regulated sector and are thus required to act within strict constraints. Currently, compliance of fund activities is only checked through periodic inspections of the reports issued by the funds. This checking process is mostly performed manually and does not fully capture the data produced by the fund. Therefore, there is a need for providing automated solutions to support compliance monitoring of fund activities. We propose fulfilling this need using a model-driven approach. As a starting point, we create a conceptual model that formalizes the information types pertinent to compliance of fund activities. Building such a conceptual model requires analyzing multiple sources of compliance requirements, including both the applicable regulations and fund documents containing self-imposed requirements by the fund on itself. It also requires analyzing…

Investingating the Defect Detection Effectiveness and Cost Benefit of Nominal Inspection Teams

Stefan Biffl, Michael Halling

Information Systems · · cited 0× · OpenAlex ↗ · more like this ·

Abstract—Inspection is an effective but also expensive quality assurance activity to find defects early during software development. The defect detection process, team size, and staff hours invested can have a considerable impact on the defect detection effectiveness and cost-benefit of an inspection. In this paper, we use empirical data and a probabilistic model to estimate this impact for nominal (noncommunicating) inspection teams in an experiment context. Further, the analysis investigates how cutting off the inspection after a certain time frame would influence inspection performance. Main findings of the investigation are: 1) Using combinations of different reading techniques in a team is considerably more effective than using the best single technique only (regardless of the observed level of effort). 2) For optimizing the inspection performance, determining the optimal process…