arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sebastian

7,994 papers · 1887–2024

1965: 21966: 01967: 21968: 11969: 11970: 31971: 01972: 11973: 11974: 01975: 01976: 31977: 31978: 01979: 41980: 11981: 21982: 21983: 41984: 21985: 41986: 31987: 51988: 61989: 121990: 61991: 41992: 141993: 111994: 201995: 221996: 221997: 281998: 501999: 602000: 572001: 572002: 1072003: 1052004: 1752005: 2462006: 2342007: 3002008: 3672009: 4102010: 5342011: 5762012: 7392013: 7722014: 8702015: 8842016: 5882017: 5612018: 812019: 32020: 22021: 22022: 62023: 12024: 6
1965peak 884 in 20152024

Frequent co-authors

Papers

showing 1–25 of 7,994 RSS

The Cityscapes Dataset for Semantic Urban Scene Understanding

Marius Cordts, Mohamed Omran, Sebastian Ramos +6 more

cs.CV · · cited 14,124× · arXiv ↗ · more like this ·

Visual understanding of complex urban street scenes is an enabling factor for a wide range of applications. Object detection has benefited enormously from large-scale datasets, especially in the context of deep learning. For semantic urban scene understanding, however, no current dataset adequately captures the complexity of real-world urban scenes. To address this, we introduce Cityscapes, a benchmark suite and large-scale dataset to train and test approaches for pixel-level and instance-level semantic labeling. Cityscapes is comprised of a large, diverse set of stereo video sequences recorded in streets from 50 different cities. 5000 of these images have high quality pixel-level annotations; 20000 additional images have coarse annotations to enable methods that leverage large volumes of weakly-labeled data. Crucially, our effort exceeds previous attempts in terms of dataset size…

From game design elements to gamefulness

Sebastian Deterding, Dan Dixon, Rilla Khaled +1 more

Sociology and Political Science · · cited 7,824× · DOI ↗ · more like this ·

Recent years have seen a rapid proliferation of mass-market consumer software that takes inspiration from video games. Usually summarized as "gamification", this trend connects to a sizeable body of existing concepts and research in human-computer interaction and game studies, such as serious games, pervasive games, alternate reality games, or playful design. However, it is not clear how "gamification" relates to these, whether it denotes a novel phenomenon, and how to define it. Thus, in this paper we investigate "gamification" and the historical origins of the term in relation to precursors and similar concepts. It is suggested that "gamified" applications provide insight into novel, gameful phenomena complementary to playful phenomena. Based on our research, we propose a definition of "gamification" as the use of game design elements in non-game contexts.

An overview of gradient descent optimization algorithms

Sebastian Ruder

cs.LG · · cited 7,075× · arXiv ↗ · more like this ·

Gradient descent optimization algorithms, while increasingly popular, are often used as black-box optimizers, as practical explanations of their strengths and weaknesses are hard to come by. This article aims to provide the reader with intuitions with regard to the behaviour of different algorithms that will allow her to put them to use. In the course of this overview, we look at different variants of gradient descent, summarize challenges, introduce the most common optimization algorithms, review architectures in a parallel and distributed setting, and investigate additional strategies for optimizing gradient descent.

On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation

Sebastian Bach, Alexander Binder, Grégoire Montavon +3 more

Computer Vision and Pattern Recognition · PLoS ONE · · cited 4,586× · DOI ↗ · more like this ·

Understanding and interpreting classification decisions of automated image classification systems is of high value in many applications, as it allows to verify the reasoning of the system and provides additional information to the human expert. Although machine learning methods are solving very successfully a plethora of tasks, they have in most cases the disadvantage of acting as a black box, not providing any information about what made them arrive at a particular decision. This work proposes a general solution to the problem of understanding classification decisions by pixel-wise decomposition of nonlinear classifiers. We introduce a methodology that allows to visualize the contributions of single pixels to predictions for kernel-based classifiers over Bag of Words features and for multilayered neural networks. These pixel contributions can be visualized as heatmaps and are provided…

Complex Embeddings for Simple Link Prediction

Théo Trouillon, Johannes Welbl, Sebastian Riedel +2 more

cs.AI · · cited 3,821× · arXiv ↗ · more like this ·

In statistical relational learning, the link prediction problem is key to automatically understand the structure of large knowledge bases. As in previous studies, we propose to solve this problem through latent factorization. However, here we make use of complex valued embeddings. The composition of complex embeddings can handle a large variety of binary relations, among them symmetric and antisymmetric relations. Compared to state-of-the-art models such as Neural Tensor Network and Holographic Embeddings, our approach based on complex embeddings is arguably simpler, as it only uses the Hermitian dot product, the complex counterpart of the standard dot product between real vectors. Our approach is scalable to large datasets as it remains linear in both space and time, while consistently outperforming alternative approaches on standard link prediction benchmarks.

An Overview of Multi-Task Learning in Deep Neural Networks

Sebastian Ruder

cs.LG · · cited 3,400× · arXiv ↗ · more like this ·

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL, particularly in deep neural networks. It introduces the two most common methods for MTL in Deep Learning, gives an overview of the literature, and discusses recent advances. In particular, it seeks to help ML practitioners apply MTL by shedding light on how MTL works and providing guidelines for choosing appropriate auxiliary tasks.

Robust Nonparametric Confidence Intervals for Regression-Discontinuity Designs

Sebastián Calónico, Matias D. Cattaneo, Rocío Titiunik

Statistics and Probability · Econometrica · · cited 3,007× · DOI ↗ · more like this ·

In the regression-discontinuity (RD) design, units are assigned to treatment based on whether their value of an observed covariate exceeds a known cutoff. In this design, local polynomial estimators are now routinely employed to construct confidence intervals for treatment effects. The performance of these confidence intervals in applications, however, may be seriously hampered by their sensitivity to the specific bandwidth employed. Available bandwidth selectors typically yield a “large” bandwidth, leading to data-driven confidence intervals that may be biased, with empirical coverage well below their nominal target. We propose new theory-based, more robust confidence interval estimators for average treatment effects at the cutoff in sharp RD, sharp kink RD, fuzzy RD, and fuzzy kink RD designs. Our proposed confidence intervals are constructed using a bias-corrected RD estimator…

Theano: A Python framework for fast computation of mathematical expressions

The Theano Development Team, Rami Al-Rfou, Guillaume Alain +110 more

cs.SC · · cited 2,382× · arXiv ↗ · more like this ·

Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has been one of the most used CPU and GPU mathematical compilers - especially in the machine learning community - and has shown steady performance improvements. Theano is being actively and continuously developed since 2008, multiple frameworks have been built on top of it and it has been used to produce many state-of-the-art machine learning models. The present article is structured as follows. Section I provides an overview of the Theano software and its community. Section II presents the principal features of Theano and how to use them, and compares them with other similar projects. Section III focuses on recently-introduced functionalities and improvements. Section IV compares the performance of Theano against…

PLIP – Fully automated Protein-Ligand Interaction Profiler

Sebastian Salentin, Sven B. Schreiber, V. Joachim Haupt +2 more

Computational Theory and Mathematics · Open MIND · · cited 2,293× · DOI ↗ · more like this ·

The characterization of interactions in protein–ligand complexes is essential for research in structural bioinformatics, drug discovery and biology. How-ever, comprehensive tools are not freely avail-able to the research community. Here, we present the protein–ligand interaction profiler (PLIP), a novel web service for fully automated detection and visualization of relevant non-covalent protein– ligand contacts in 3D structures, freely available at projects.biotec.tu-dresden.de/plip-web. The input is either a Protein Data Bank structure, a protein or ligand name, or a custom protein–ligand com-plex (e.g. from docking). In contrast to other tools, the rule-based PLIP algorithm does not require any structure preparation. It returns a list of detected in-teractions on single atom level, covering seven in-teraction types (hydrogen bonds, hydrophobic con-tacts, pi-stacking, pi-cation…

Is There Social Capital in a Social Network Site?: Facebook Use and College Students' Life Satisfaction, Trust, and Participation

Sebastián Valenzuela, Namsu Park, Kerk F. Kee

Communication · Journal of Computer-Mediated Communication · · cited 2,228× · DOI ↗ · more like this ·

This study examines if Facebook, one of the most popular social network sites among college students in the U.S., is related to attitudes and behaviors that enhance individuals' social capital. Using data from a random web survey of college students across Texas (n = 2,603), we find positive relationships between intensity of Facebook use and students' life satisfaction, social trust, civic engagement, and political participation. While these findings should ease the concerns of those who fear that Facebook has mostly negative effects on young adults, the positive and significant associations between Facebook variables and social capital were small, suggesting that online social networks are not the most effective solution for youth disengagement from civic duty and democracy.

f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization

Sebastian Nowozin, Botond Cseke, Ryota Tomioka

stat.ML · · cited 1,852× · arXiv ↗ · more like this ·

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models are expressive and allow efficient computation of samples and derivatives, but cannot be used for computing likelihoods or for marginalization. The generative-adversarial training method allows to train such models through the use of an auxiliary discriminative neural network. We show that the generative-adversarial approach is a special case of an existing more general variational divergence estimation approach. We show that any f-divergence can be used for training generative neural samplers. We discuss the benefits of various choices of divergence functions on training complexity and the quality of the obtained generative models.

Being Immersed in Social Networking Environment: Facebook Groups, Uses and Gratifications, and Social Outcomes

Namsu Park, Kerk F. Kee, Sebastián Valenzuela

Communication · CyberPsychology & Behavior · · cited 1,593× · DOI ↗ · more like this ·

A Web survey of 1,715 college students was conducted to examine Facebook Groups users' gratifications and the relationship between users' gratifications and their political and civic participation offline. A factor analysis revealed four primary needs for participating in groups within Facebook: socializing, entertainment, self-status seeking, and information. These gratifications vary depending on user demographics such as gender, hometown, and year in school. The analysis of the relationship between users' needs and civic and political participation indicated that, as predicted, informational uses were more correlated to civic and political action than to recreational uses.

Evaluating the visualization of what a Deep Neural Network has learned

Wojciech Samek, Alexander Binder, Grégoire Montavon +2 more

cs.CV · · cited 1,432× · arXiv ↗ · more like this ·

Deep Neural Networks (DNNs) have demonstrated impressive performance in complex machine learning tasks such as image classification or speech recognition. However, due to their multi-layer nonlinear structure, they are not transparent, i.e., it is hard to grasp what makes them arrive at a particular classification or recognition decision given a new unseen data sample. Recently, several approaches have been proposed enabling one to understand and interpret the reasoning embodied in a DNN for a single test image. These methods quantify the ''importance'' of individual pixels wrt the classification decision and allow a visualization in terms of a heatmap in pixel/input space. While the usefulness of heatmaps can be judged subjectively by a human, an objective quality measure is missing. In this paper we present a general methodology based on region perturbation for evaluating ordered…

Cooperation and Competition in the Evolution of ATP-Producing Pathways

Thomas Pfeiffer, Stefan Schuster, Sebastian Bonhoeffer

Sociology and Political Science · Science · · cited 1,385× · DOI ↗ · more like this ·

Heterotrophic organisms generally face a trade-off between rate and yield of adenosine triphosphate (ATP) production. This trade-off may result in an evolutionary dilemma, because cells with a higher rate but lower yield of ATP production may gain a selective advantage when competing for shared energy resources. Using an analysis of model simulations and biochemical observations, we show that ATP production with a low rate and high yield can be viewed as a form of cooperative resource use and may evolve in spatially structured environments. Furthermore, we argue that the high ATP yield of respiration may have facilitated the evolutionary transition from unicellular to undifferentiated multicellular organisms.

Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment

Sebastian Bosse, Dominique Maniry, Klaus-Robert Müller +2 more

cs.CV · · cited 1,231× · arXiv ↗ · more like this ·

We present a deep neural network-based approach to image quality assessment (IQA). The network is trained end-to-end and comprises ten convolutional layers and five pooling layers for feature extraction, and two fully connected layers for regression, which makes it significantly deeper than related IQA models. Unique features of the proposed architecture are that: 1) with slight adaptations it can be used in a no-reference (NR) as well as in a full-reference (FR) IQA setting and 2) it allows for joint learning of local quality and local weights, i.e., relative importance of local quality to the global quality estimate, in an unified framework. Our approach is purely data-driven and does not rely on hand-crafted features or other types of prior domain knowledge about the human visual system or image statistics. We evaluate the proposed approach on the LIVE, CISQ, and TID2013 databases as…

Ontology-Based Integration of Information — A Survey of Existing Approaches

Holger Wache, Thomas Vögele, Ubbo Visser +4 more

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 1,193× · OpenAlex ↗ · more like this ·

We review the use on ontologies for the integration of heterogeneous information sources. Based on an in-depth evaluation of existing approaches to this problem we discuss how ontologies are used to support the integration task. We evaluate and compare the languages used to represent the ontologies and the use of mappings between ontologies as well as to connect ontologies with information sources. We also ask for ontology engineering methods and tools used to develop ontologies for information integration. Based on the results of our analysis we summarize the state of the art in ontology-based information integration and name areas of further research activities. 1 Motivation The so-called information society demands for complete access to available information, which is often heterogeneous and distributed. In order to establish efficient information sharing, many technical problems…

High-dimensional Propensity Score Adjustment in Studies of Treatment Effects Using Health Care Claims Data

Sebastian Schneeweiß, Jeremy A. Rassen, Robert J. Glynn +3 more

Statistics and Probability · Epidemiology · · cited 1,148× · DOI ↗ · more like this ·

BACKGROUND: Adjusting for large numbers of covariates ascertained from patients' health care claims data may improve control of confounding, as these variables may collectively be proxies for unobserved factors. Here, we develop and test an algorithm that empirically identifies candidate covariates, prioritizes covariates, and integrates them into a propensity-score-based confounder adjustment model. METHODS: We developed a multistep algorithm to implement high-dimensional proxy adjustment in claims data. Steps include (1) identifying data dimensions, eg, diagnoses, procedures, and medications; (2) empirically identifying candidate covariates; (3) assessing recurrence of codes; (4) prioritizing covariates; (5) selecting covariates for adjustment; (6) estimating the exposure propensity score; and (7) estimating an outcome model. This algorithm was tested in Medicare claims data…

Detection of traffic signs in real-world images: The German traffic sign detection benchmark

Sebastian Houben, Johannes Stallkamp, Jan Salmen +2 more

Computer Vision and Pattern Recognition · Research at the University of Copenhagen (University of Copenhagen) · · cited 954× · DOI ↗ · more like this ·

Real-time detection of traffic signs, the task of pinpointing a traffic sign's location in natural images, is a challenging computer vision task of high industrial relevance. Various algorithms have been proposed, and advanced driver assistance systems supporting detection and recognition of traffic signs have reached the market. Despite the many competing approaches, there is no clear consensus on what the state-of-the-art in this field is. This can be accounted to the lack of comprehensive, unbiased comparisons of those methods. We aim at closing this gap by the “German Traffic Sign Detection Benchmark” presented as a competition at IJCNN 2013 (International Joint Conference on Neural Networks). We introduce a real-world benchmark data set for traffic sign detection together with carefully chosen evaluation metrics, baseline results, and a web-interface for comparing approaches. In…

Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments

Dmitri Dolgov, Sebastian Thrun, Michael Montemerlo +1 more

Computer Vision and Pattern Recognition · The International Journal of Robotics Research · · cited 950× · DOI ↗ · more like this ·

We describe a practical path-planning algorithm for an autonomous vehicle operating in an unknown semi-structured (or unstructured) environment, where obstacles are detected online by the robot’s sensors. This work was motivated by and experimentally validated in the 2007 DARPA Urban Challenge, where robotic vehicles had to autonomously navigate parking lots. The core of our approach to path planning consists of two phases. The first phase uses a variant of A* search (applied to the 3D kinematic state space of the vehicle) to obtain a kinematically feasible trajectory. The second phase then improves the quality of the solution via numeric non-linear optimization, leading to a local (and frequently global) optimum. Further, we extend our algorithm to use prior topological knowledge of the environment to guide path planning, leading to faster search and final trajectories better suited to…

Point-based value iteration: an anytime algorithm for POMDPs

Joëlle Pineau, Geoff Gordon, Sebastian Thrun

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 934× · OpenAlex ↗ · more like this ·

This paper introduces the Point-Based Value Iteration (PBVI) algorithm for POMDP planning. PBVI approximates an exact value iteration solution by selecting a small set of representative belief points and then tracking the value and its derivative for those points only. By using stochastic trajectories to choose belief points, and by maintaining only one value hyper-plane per point, PBVI successfully solves large problems: we present results on a robotic laser tag problem as well as three test domains from the literature.

Explaining NonLinear Classification Decisions with Deep Taylor Decomposition

Grégoire Montavon, Sebastian Bach, Alexander Binder +2 more

cs.LG · · cited 915× · arXiv ↗ · more like this ·

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods perform impressively well, they have a significant disadvantage, the lack of transparency, limiting the interpretability of the solution and thus the scope of application in practice. Especially DNNs act as black boxes due to their multilayer nonlinear structure. In this paper we introduce a novel methodology for interpreting generic multilayer neural networks by decomposing the network classification decision into contributions of its input elements. Although our focus is on image classification, the method is applicable to a broad set of input data, learning tasks and network architectures. Our method is based on deep Taylor decomposition and efficiently…

Pushing the EL envelope

Franz Baader, Sebastian Brandt, Carsten Lutz

Artificial Intelligence · Qucosa (Saxon State and University Library Dresden) · · cited 869× · OpenAlex ↗ · more like this ·

Recently, it has been shown that the small description logic (DL) EL, which allows for conjunction and existential restrictions, has better algorithmic properties than its counterpart FL0, which allows for conjunction and value restrictions. Whereas the subsumption problem in FL0 becomes already intractable in the presence of acyclic TBoxes, it remains tractable in EL even with general concept inclusion axioms (GCIs). On the one hand, we extend the positive result for EL by identifying a set of expressive means that can be added to EL without sacrificing tractability. On the other hand, we show that basically all other additions of typical DL constructors to EL with GCIs make subsumption intractable, and in most cases even EXPTIMEcomplete. In addition, we show that subsumption in FL0 with GCIs is EXPTIME-complete.

Spanner: Google's globally-distributed database

James C. Corbett, Jay B. Dean, Michael Epstein +9 more

Computer Networks and Communications · Operating Systems Design and Implementation · · cited 827× · DOI ↗ · more like this ·

Spanner is Google’s scalable, multi-version, globallydistributed, and synchronously-replicated database. It is the first system to distribute data at global scale and support externally-consistent distributed transactions. This paper describes how Spanner is structured, its feature set, the rationale underlying various design decisions, and a novel time API that exposes clock uncertainty. This API and its implementation are critical to supporting external consistency and a variety of powerful features: nonblocking reads in the past, lock-free read-only transactions, and atomic schema changes, across all of Spanner. 1

A Survey on Quality of Experience of HTTP Adaptive Streaming

Michael Seufert, Sebastian Egger, Martin Slanina +3 more

Computer Vision and Pattern Recognition · IEEE Communications Surveys & Tutorials · · cited 810× · DOI ↗ · more like this ·

Changing network conditions pose severe problems to video streaming in the Internet. HTTP adaptive streaming (HAS) is a technology employed by numerous video services that relieves these issues by adapting the video to the current network conditions. It enables service providers to improve resource utilization and Quality of Experience (QoE) by incorporating information from different layers in order to deliver and adapt a video in its best possible quality. Thereby, it allows taking into account end user device capabilities, available video quality levels, current network conditions, and current server load. For end users, the major benefits of HAS compared to classical HTTP video streaming are reduced interruptions of the video playback and higher bandwidth utilization, which both generally result in a higher QoE. Adaptation is possible by changing the frame rate, resolution, or…