arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mitchell Joblin

25 papers · 2015–2025

2015: 22016: 12017: 02018: 02019: 12020: 32021: 112022: 32023: 32024: 02025: 1
2015peak 11 in 20212025

Frequent co-authors

Papers

showing 1–25 of 25 RSS

TLogic: Temporal Logical Rules for Explainable Link Forecasting on Temporal Knowledge Graphs

Yushan Liu, Yunpu Ma, Marcel Hildebrandt +2 more

cs.LG · · cited 235× · arXiv ↗ · more like this ·

Conventional static knowledge graphs model entities in relational data as nodes, connected by edges of specific relation types. However, information and knowledge evolve continuously, and temporal dynamics emerge, which are expected to influence future situations. In temporal knowledge graphs, time information is integrated into the graph by equipping each edge with a timestamp or a time range. Embedding-based methods have been introduced for link prediction on temporal knowledge graphs, but they mostly lack explainability and comprehensible reasoning chains. Particularly, they are usually not designed to deal with link forecasting -- event prediction involving future timestamps. We address the task of link forecasting on temporal knowledge graphs and introduce TLogic, an explainable framework that is based on temporal logical rules extracted via temporal random walks. We compare TLogic…

Classifying Developers into Core and Peripheral: An Empirical Study on Count and Network Metrics

Mitchell Joblin, Sven Apel, Claus Hunsen +1 more

cs.SE · · cited 126× · arXiv ↗ · more like this ·

Knowledge about the roles developers play in a software project is crucial to understanding the project's collaborative dynamics. Developers are often classified according to the dichotomy of core and peripheral roles. Typically, operationalizations based on simple counts of developer activities (e.g., number of commits) are used for this purpose, but there is concern regarding their validity and ability to elicit meaningful insights. To shed light on this issue, we investigate whether commonly used operationalizations of core--peripheral roles produce consistent results, and we validate them with respect to developers' perceptions by surveying 166 developers. Improving over the state of the art, we propose a relational perspective on developer roles, using developer networks to model the organizational structure, and by examining core--peripheral roles in terms of developers' positions…

Reasoning on Knowledge Graphs with Debate Dynamics

Marcel Hildebrandt, Jorge Andres Quintero Serna, Yunpu Ma +3 more

cs.LG · · cited 60× · arXiv ↗ · more like this ·

We propose a novel method for automatic reasoning on knowledge graphs based on debate dynamics. The main idea is to frame the task of triple classification as a debate game between two reinforcement learning agents which extract arguments -- paths in the knowledge graph -- with the goal to promote the fact being true (thesis) or the fact being false (antithesis), respectively. Based on these arguments, a binary classifier, called the judge, decides whether the fact is true or false. The two agents can be considered as sparse, adversarial feature generators that present interpretable evidence for either the thesis or the antithesis. In contrast to other black-box methods, the arguments allow users to get an understanding of the decision of the judge. Since the focus of this work is to create an explainable method that maintains a competitive predictive accuracy, we benchmark our method…

From Developer Networks to Verified Communities: A Fine-Grained Approach

Mitchell Joblin, Wolfgang Mauerer, Sven Apel +2 more

Information Systems · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · · cited 52× · DOI ↗ · more like this ·

Effective software engineering demands a coordinated effort. Unfortunately, a comprehensive view on developer coordination is rarely available to support software-engineering decisions, despite the significant implications on software quality, software architecture, and developer productivity. We present a fine-grained, verifiable, and fully automated approach to capture a view on developer coordination, based on commit information and source-code structure, mined from version-control systems. We apply methodology from network analysis and machine learning to identify developer communities automatically. Compared to previous work, our approach is fine-grained, and identifies statistically significant communities using order-statistics and a community-verification technique based on graph conductance. To demonstrate the scalability and generality of our approach, we analyze ten…

In Search of Socio-Technical Congruence: A Large-Scale Longitudinal Study

Wolfgang Mauerer, Mitchell Joblin, Damian A. Tamburri +3 more

cs.SE · · cited 28× · arXiv ↗ · more like this ·

We report on a large-scale empirical study investigating the relevance of socio-technical congruence over key basic software quality metrics, namely, bugs and churn. In particular, we explore whether alignment or misalignment of social communication structures and technical dependencies in large software projects influences software quality. To this end, we have defined a quantitative and operational notion of socio-technical congruence, which we call socio-technical motif congruence (STMC). STMC is a measure of the degree to which developers working on the same file or on two related files, need to communicate. As socio-technical congruence is a complex and multi-faceted phenomenon, the interpretability of the results is one of our main concerns, so we have employed a careful mixed-methods statistical analysis. In particular, we provide analyses with similar techniques as employed by…

Power to the Relational Inductive Bias: Graph Neural Networks in Electrical Power Grids

Martin Ringsquandl, Houssem Sellami, Marcel Hildebrandt +4 more

cs.LG · · cited 24× · arXiv ↗ · more like this ·

The application of graph neural networks (GNNs) to the domain of electrical power grids has high potential impact on smart grid monitoring. Even though there is a natural correspondence of power flow to message-passing in GNNs, their performance on power grids is not well-understood. We argue that there is a gap between GNN research driven by benchmarks which contain graphs that differ from power grids in several important aspects. Additionally, inductive learning of GNNs across multiple power grid topologies has not been explored with real-world data. We address this gap by means of (i) defining power grid graph datasets in inductive settings, (ii) an exploratory analysis of graph properties, and (iii) an empirical study of the concrete learning task of state estimation on real-world power grids. Our results show that GNNs are more robust to noise with up to 400% lower error compared…

How Do Successful and Failed Projects Differ? A Socio-Technical Analysis

Mitchell Joblin, Sven Apel

Information Systems · ACM Transactions on Software Engineering and Methodology · · cited 23× · DOI ↗ · more like this ·

Software development is at the intersection of the social realm , involving people who develop the software, and the technical realm , involving artifacts (code, docs, etc.) that are being produced. It has been shown that a socio-technical perspective provides rich information about the state of a software project. In particular, we are interested in socio-technical factors that are associated with project success . For this purpose, we frame the task as a network classification problem. We show how a set of heterogeneous networks composed of social and technical entities can be jointly embedded in a single vector space enabling mathematically sound comparisons between distinct software projects. Our approach is specifically designed using intuitive metrics stemming from network analysis and statistics to ease the interpretation of results in the context of software engineering wisdom.…

A Recommender System for Complex Real-World Applications with Nonlinear Dependencies and Knowledge Graph Context

Marcel Hildebrandt, Swathi Shyam Sunder, Serghei Mogoreanu +4 more

Information Systems · Lecture notes in computer science · · cited 17× · DOI ↗ · more like this ·

Most latent feature methods for recommender systems learn to encode user preferences and item characteristics based on past user-item interactions. While such approaches work well for standalone items (e.g., books, movies), they are not as well suited for dealing with composite systems. For example, in the context of industrial purchasing systems for engineering solutions, items can no longer be considered standalone. Thus, latent representation needs to encode the functionality and technical features of the engineering solutions that result from combining the individual components. To capture these dependencies, expressive and context-aware recommender systems are required. In this paper, we propose NECTR, a novel recommender system based on two components: a tensor factorization model and an autoencoder-like neural network. In the tensor factorization component, context information of…

Automatic Core-Developer Identification on GitHub: A Validation Study

Thomas Böck, Nils Alznauer, Mitchell Joblin +1 more

Information Systems · ACM Transactions on Software Engineering and Methodology · · cited 16× · DOI ↗ · more like this ·

Many open-source software projects are self-organized and do not maintain official lists with information on developer roles. So, knowing which developers take core and maintainer roles is, despite being relevant, often tacit knowledge. We propose a method to automatically identify core developers based on role permissions of privileged events triggered in GitHub issues and pull requests. In an empirical study on 25/GitHub projects, (1) we validate the set of automatically identified core developers with a sample of project-reported developer lists, and (2) we use our set of identified core developers to assess the accuracy of state-of-the-art unsupervised developer classification methods. Our results indicate that the set of core developers, which we extracted from privileged issue events, is sound and the accuracy of state-of-the-art unsupervised classification methods depends mainly…

Hierarchical and Hybrid Organizational Structures in Open-source Software Projects: A Longitudinal Study

Mitchell Joblin, Barbara Eckl, Thomas Böck +3 more

Computer Science Applications · ACM Transactions on Software Engineering and Methodology · · cited 12× · DOI ↗ · more like this ·

Despite the absence of a formal process and a central command-and-control structure, developer organization in open-source software (OSS) projects are far from being a purely random process. Prior work indicates that, over time, highly successful OSS projects develop a hybrid organizational structure that comprises a hierarchical part and a non-hierarchical part. This suggests that hierarchical organization is not necessarily a global organizing principle and that a fundamentally different principle is at play below the lowest positions in the hierarchy. Given the vast proportion of developers are in the non-hierarchical part, we seek to understand the interplay between these two fundamentally differently organized groups, how this hybrid structure evolves, and the trajectory individual developers take through these structures over the course of their participation. We conducted a…

Learning Domain-Specific Edit Operations from Model Repositories with Frequent Subgraph Mining

Christof Tinnes, Timo Kehrer, Mitchell Joblin +3 more

cs.SE · · cited 8× · arXiv ↗ · more like this ·

Model transformations play a fundamental role in model-driven software development. They can be used to solve or support central tasks, such as creating models, handling model co-evolution, and model merging. In the past, various (semi-)automatic approaches have been proposed to derive model transformations from meta-models or from examples. These approaches require time-consuming handcrafting or recording of concrete examples, or they are unable to derive complex transformations. We propose a novel unsupervised approach, called Ockham, which is able to learn edit operations from model histories in model repositories. Ockham is based on the idea that meaningful edit operations will be the ones that compress the model differences. We evaluate our approach in two controlled experiments and one real-world case study of a large-scale industrial model-driven architecture project in the…

Synchronous development in open-source projects: A higher-level perspective

Thomas Böck, Claus Hunsen, Mitchell Joblin +1 more

Information Systems · Automated Software Engineering · · cited 5× · DOI ↗ · more like this ·

Abstract Mailing lists are a major communication channel for supporting developer coordination in open-source software projects. In a recent study, researchers explored temporal relationships (e.g., synchronization) between developer activities on source code and on the mailing list, relying on simple heuristics of developer collaboration (e.g., co-editing files) and developer communication (e.g., sending e-mails to the mailing list). We propose two methods for studying synchronization between collaboration and communication activities from a higher-level perspective, which captures the complex activities and views of developers more precisely than the rather technical perspective of previous work. On the one hand, we explore developer collaboration at the level of features (not files), which are higher-level concepts of the domain and not mere technical artifacts. On the other hand, we…

Data-Powered Positive Deviance during the SARS-CoV-2 Pandemic—An Ecological Pilot Study of German Districts

Joshua Driesen, Ziad El‐Khatib, Niklas Wulkow +5 more

Modeling and Simulation · International Journal of Environmental Research and Public Health · · cited 5× · DOI ↗ · more like this ·

We introduced the mixed-methods Data-Powered Positive Deviance (DPPD) framework as a potential addition to the set of tools used to search for effective response strategies against the SARS-CoV-2 pandemic. For this purpose, we conducted a DPPD study in the context of the early stages of the German SARS-CoV-2 pandemic. We used a framework of scalable quantitative methods to identify positively deviant German districts that is novel in the scientific literature on DPPD, and subsequently employed qualitative methods to identify factors that might have contributed to their comparatively successful reduction of the forward transmission rate. Our qualitative analysis suggests that quick, proactive, decisive, and flexible/pragmatic actions, the willingness to take risks and deviate from standard procedures, good information flows both in terms of data collection and public communication…

Integrating Logical Rules Into Neural Multi-Hop Reasoning for Drug Repurposing

Yushan Liu, Marcel Hildebrandt, Mitchell Joblin +2 more

cs.LG · · cited 5× · arXiv ↗ · more like this ·

The graph structure of biomedical data differs from those in typical knowledge graph benchmark tasks. A particular property of biomedical data is the presence of long-range dependencies, which can be captured by patterns described as logical rules. We propose a novel method that combines these rules with a neural multi-hop reasoning approach that uses reinforcement learning. We conduct an empirical study based on the real-world task of drug repurposing by formulating this task as a link prediction problem. We apply our method to the biomedical knowledge graph Hetionet and show that our approach outperforms several baseline methods.

Mining domain-specific edit operations from model repositories with applications to semantic lifting of model differences and change profiling

Christof Tinnes, Timo Kehrer, Mitchell Joblin +3 more

Software · Automated Software Engineering · · cited 4× · DOI ↗ · more like this ·

Abstract Model transformations are central to model-driven software development. Applications of model transformations include creating models, handling model co-evolution, model merging, and understanding model evolution. In the past, various (semi-)automatic approaches to derive model transformations from meta-models or from examples have been proposed. These approaches require time-consuming handcrafting or the recording of concrete examples, or they are unable to derive complex transformations. We propose a novel unsupervised approach, called Ockham , which is able to learn edit operations from model histories in model repositories. Ockham is based on the idea that meaningful domain-specific edit operations are the ones that compress the model differences. It employs frequent subgraph mining to discover frequent structures in model difference graphs. We evaluate our approach in two…

On Calibration of Graph Neural Networks for Node Classification

Tong Liu, Yushan Liu, Marcel Hildebrandt +3 more

cs.LG · · cited 2× · arXiv ↗ · more like this ·

Graphs can model real-world, complex systems by representing entities and their interactions in terms of nodes and edges. To better exploit the graph structure, graph neural networks have been developed, which learn entity and edge embeddings for tasks such as node classification and link prediction. These models achieve good performance with respect to accuracy, but the confidence scores associated with the predictions might not be calibrated. That means that the scores might not reflect the ground-truth probabilities of the predicted events, which would be especially important for safety-critical applications. Even though graph neural networks are used for a wide range of tasks, the calibration thereof has not been sufficiently explored yet. We investigate the calibration of graph neural networks for node classification, study the effect of existing post-processing calibration…

Debate Dynamics for Human-comprehensible Fact-checking on Knowledge Graphs

Marcel Hildebrandt, Jorge Andres Quintero Serna, Yunpu Ma +3 more

cs.LG · · cited 2× · arXiv ↗ · more like this ·

We propose a novel method for fact-checking on knowledge graphs based on debate dynamics. The underlying idea is to frame the task of triple classification as a debate game between two reinforcement learning agents which extract arguments -- paths in the knowledge graph -- with the goal to justify the fact being true (thesis) or the fact being false (antithesis), respectively. Based on these arguments, a binary classifier, referred to as the judge, decides whether the fact is true or false. The two agents can be considered as sparse feature extractors that present interpretable evidence for either the thesis or the antithesis. In contrast to black-box methods, the arguments enable the user to gain an understanding for the decision of the judge. Moreover, our method allows for interactive reasoning on knowledge graphs where the users can raise additional arguments or evaluate the debate…

Evolutionary Trends of Developer Coordination: A Network Approach

Mitchell Joblin, Sven Apel, Wolfgang Mauerer

cs.SE · · cited 2× · arXiv ↗ · more like this ·

Software evolution is a fundamental process that transcends the realm of technical artifacts and permeates the entire organizational structure of a software project. By means of a longitudinal empirical study of 18 large open-source projects, we examine and discuss the evolutionary principles that govern the coordination of developers. By applying a network-analytic approach, we found that the implicit and self-organizing structure of developer coordination is ubiquitously described by non-random organizational principles that defy conventional software-engineering wisdom. In particular, we found that: (a) developers form scale-free networks, in which the majority of coordination requirements arise among an extremely small number of developers, (b) developers tend to accumulate coordination requirements with more and more developers over time, presumably limited by an upper bound, and…

Task-Driven Knowledge Graph Filtering Improves Prioritizing Drugs for Repurposing

Florin Ratajczak, Mitchell Joblin, Martin Ringsquandl +1 more

Computational Theory and Mathematics · Research Square · · cited 1× · DOI ↗ · more like this ·

Abstract Background Drug repurposing aims at finding new targets for already developed drugs. It becomes more relevant as the cost of discovering new drugs steadily increases. To find new potential targets for a drug, an abundance of methods and existing biomedical knowledge from different domains can be leveraged. Recently, knowledge graphs have emerged in the biomedical domain that integrate information about genes, drugs, diseases and other biological domains. Knowledge graphs can be used to predict new connections between compounds and diseases, leveraging the interconnected biomedical data around them. While real world use cases such as drug repurposing are only interested in one specific relation type, widely used knowledge graph embedding models simultaneously optimize over all relation types in the graph. This can lead the models to underfit the data that is most relevant for…

Is perceived gender related to contributions and standing in open-source software projects?

Christian Hechtl, Mitchell Joblin, Sven Apel

Computer Science Applications · Empirical Software Engineering · · cited 0× · DOI ↗ · more like this ·

Abstract To date, the percentage of female developers that actively contribute to open-source software (OSS) projects is less than 10%. In recent years, researchers started searching for reasons for this imbalance. A question that arises in this space is how the (perceived) gender of a developer influences their contributions and standing in the organizational hierarchy of a project. Addressing this question, we have analyzed 20 popular OSS projects on GitHub . We found that the (perceived) gender of developers has only a negligible association with their project contributions (e.g., number of pull requests). In the same vein, women and men take similar positions in the organizational hierarchy, except for the top 10%, where men are still over-represented. So, while our results show a certain degree of gender balance with regard to contributions and standing, the leadership positions of…

Chapter 26. Combining Sub-Symbolic and Symbolic Methods for Explainability

Anna Himmelhuber, Stephan Grimm, Mitchell Joblin +2 more

Artificial Intelligence · Frontiers in artificial intelligence and applications · · cited 0× · DOI ↗ · more like this ·

Many important real-world data sets come in the form of graphs or networks, including social networks, knowledge graphs, protein-interaction networks, the World Wide Web and many more. Graph neural networks (GNNs) are connectionist models that capture the dependence structure induced by links via message passing between the nodes of graphs. Similarly to other connectionist models, GNNs lack transparency in their decision-making. Since the unprecedented levels of performance of such AI methods lead to increasing use in the daily life of humans, there is an emerging need to understand the decision-making process of such systems. While symbolic methods such as inductive logic learning come with explainability, they perform best when dealing with relatively small and precise data. Sub-symbolic methods such as graph neural networks are able to handle large datasets, have a higher tolerance…

Combining Sub-Symbolic and Symbolic Methods for Explainability

Anna Himmelhuber, Stephan Grimm, Sonja Zillner +3 more

cs.AI · · arXiv ↗ · more like this ·

Similarly to other connectionist models, Graph Neural Networks (GNNs) lack transparency in their decision-making. A number of sub-symbolic approaches have been developed to provide insights into the GNN decision making process. These are first important steps on the way to explainability, but the generated explanations are often hard to understand for users that are not AI experts. To overcome this problem, we introduce a conceptual approach combining sub-symbolic and symbolic methods for human-centric explanations, that incorporate domain knowledge and causality. We furthermore introduce the notion of fidelity as a metric for evaluating how close the explanation is to the GNN's internal decision making process. The evaluation with a chemical dataset and ontology shows the explanatory value and reliability of our method.

Demystifying Graph Neural Network Explanations

Anna Himmelhuber, Mitchell Joblin, Martin Ringsquandl +1 more

cs.LG · · arXiv ↗ · more like this ·

Graph neural networks (GNNs) are quickly becoming the standard approach for learning on graph structured data across several domains, but they lack transparency in their decision-making. Several perturbation-based approaches have been developed to provide insights into the decision making process of GNNs. As this is an early research area, the methods and data used to evaluate the generated explanations lack maturity. We explore these existing approaches and identify common pitfalls in three main areas: (1) synthetic data generation process, (2) evaluation metrics, and (3) the final presentation of the explanation. For this purpose, we perform an empirical study to explore these pitfalls along with their unintended consequences and propose remedies to mitigate their effects.

Generating Table Vector Representations

Aneta Koleva, Martin Ringsquandl, Mitchell Joblin +1 more

cs.LG · · arXiv ↗ · more like this ·

High-quality Web tables are rich sources of information that can be used to populate Knowledge Graphs (KG). The focus of this paper is an evaluation of methods for table-to-class annotation, which is a sub-task of Table Interpretation (TI). We provide a formal definition for table classification as a machine learning task. We propose an experimental setup and we evaluate 5 fundamentally different approaches to find the best method for generating vector table representations. Our findings indicate that although transfer learning methods achieve high F1 score on the table classification task, dedicated table encoding models are a promising direction as they appear to capture richer semantics.

Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphs

Yushan Liu, Marcel Hildebrandt, Mitchell Joblin +3 more

cs.LG · · arXiv ↗ · more like this ·

Biomedical knowledge graphs permit an integrative computational approach to reasoning about biological systems. The nature of biological data leads to a graph structure that differs from those typically encountered in benchmarking datasets. To understand the implications this may have on the performance of reasoning algorithms, we conduct an empirical study based on the real-world task of drug repurposing. We formulate this task as a link prediction problem where both compounds and diseases correspond to entities in a knowledge graph. To overcome apparent weaknesses of existing algorithms, we propose a new method, PoLo, that combines policy-guided walks based on reinforcement learning with logical rules. These rules are integrated into the algorithm by using a novel reward function. We apply our method to Hetionet, which integrates biomedical information from 29 prominent bioinformatics…