arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nguyen

7,990 papers · 1968–2024

1968: 11969: 11970: 21971: 11972: 21973: 11974: 51975: 31976: 01977: 11978: 31979: 131980: 31981: 11982: 71983: 21984: 51985: 91986: 91987: 41988: 51989: 101990: 141991: 111992: 231993: 291994: 261995: 341996: 271997: 351998: 531999: 572000: 692001: 972002: 1662003: 1492004: 1632005: 1712006: 2032007: 2492008: 2782009: 3272010: 4752011: 4842012: 7282013: 7912014: 8082015: 8252016: 5442017: 6522018: 3972019: 22020: 32021: 22022: 52023: 12024: 1
1968peak 825 in 20152024

Frequent co-authors

Papers

showing 1–25 of 7,990 RSS

The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package

The Astropy Collaboration, A. M. Price-Whelan, B. M. Sipőcz +134 more

astro-ph.IM · · cited 6,697× · arXiv ↗ · more like this ·

The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project.

Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains

Elli Androulaki, Artem Barger, Vita Bortnikov +18 more

cs.DC · · cited 4,406× · arXiv ↗ · more like this ·

Fabric is a modular and extensible open-source system for deploying and operating permissioned blockchains and one of the Hyperledger projects hosted by the Linux Foundation (www.hyperledger.org). Fabric is the first truly extensible blockchain system for running distributed applications. It supports modular consensus protocols, which allows the system to be tailored to particular use cases and trust models. Fabric is also the first blockchain system that runs distributed applications written in standard, general-purpose programming languages, without systemic dependency on a native cryptocurrency. This stands in sharp contrast to existing blockchain platforms that require "smart-contracts" to be written in domain-specific languages or rely on a cryptocurrency. Fabric realizes the permissioned model using a portable notion of membership, which may be integrated with industry-standard…

Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images

Anh Nguyen, Jason Yosinski, Jeff Clune

cs.CV · · cited 3,569× · arXiv ↗ · more like this ·

Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on…

Understanding Neural Networks Through Deep Visualization

Jason Yosinski, Jeff Clune, Anh Nguyen +2 more

cs.CV · · cited 1,970× · arXiv ↗ · more like this ·

Recent years have produced great advances in training large, deep neural networks (DNNs), including notable successes in training convolutional neural networks (convnets) to recognize natural images. However, our understanding of how these models work, especially what computations they perform at intermediate layers, has lagged behind. Progress in the field will be further accelerated by the development of better tools for visualizing and interpreting neural nets. We introduce two such tools here. The first is a tool that visualizes the activations produced on each layer of a trained convnet as it processes an image or video (e.g. a live webcam stream). We have found that looking at live activations that change in response to user input helps build valuable intuitions about how convnets work. The second tool enables visualizing features at each layer of a DNN via regularized…

Applications of Deep Reinforcement Learning in Communications and Networking: A Survey

Nguyen Cong Luong, Dinh Thai Hoang, Shimin Gong +4 more

cs.NI · · cited 1,868× · arXiv ↗ · more like this ·

This paper presents a comprehensive literature review on applications of deep reinforcement learning in communications and networking. Modern networks, e.g., Internet of Things (IoT) and Unmanned Aerial Vehicle (UAV) networks, become more decentralized and autonomous. In such networks, network entities need to make decisions locally to maximize the network performance under uncertainty of network environment. Reinforcement learning has been efficiently used to enable the network entities to obtain the optimal policy including, e.g., decisions or actions, given their states when the state and action spaces are small. However, in complex and large-scale networks, the state and action spaces are usually large, and the reinforcement learning may not be able to find the optimal policy in reasonable time. Therefore, deep reinforcement learning, a combination of reinforcement learning with…

Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights

Dat Nguyen, Bernard Widrow

Artificial Intelligence · · cited 1,384× · DOI ↗ · more like this ·

The authors describe how a two-layer neural network can approximate any nonlinear function by forming a union of piecewise linear segments. A method is given for picking initial weights for the network to decrease training time. The authors have used the method to initialize adaptive weights over a large number of different training problems and have achieved major improvements in learning speed in every case. The improvement is best when a large number of hidden units is used with a complicated desired response. The authors have used the method to train the truck-backer-upper and were able to decrease the training time from about two days to four hours

State-of-the-art Speech Recognition With Sequence-to-Sequence Models

Chung-Cheng Chiu, Tara N. Sainath, Yonghui Wu +11 more

cs.CL · · cited 1,194× · arXiv ↗ · more like this ·

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural network. In previous work, we have shown that such architectures are comparable to state-of-theart ASR systems on dictation tasks, but it was not clear if such architectures would be practical for more challenging tasks such as voice search. In this work, we explore a variety of structural and optimization improvements to our LAS model which significantly improve performance. On the structural side, we show that word piece models can be used instead of graphemes. We also introduce a multi-head attention architecture, which offers improvements over the commonly-used single-head attention. On the optimization side, we explore synchronous training, scheduled…

Estimating divergence functionals and the likelihood ratio by convex risk minimization

XuanLong Nguyen, Martin J. Wainwright, Michael I. Jordan

math.ST · · cited 940× · arXiv ↗ · more like this ·

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the problem of estimating divergences to be tackled via convex empirical risk optimization. The resulting estimators are simple to implement, requiring only the solution of standard convex programs. We present an analysis of consistency and convergence for these estimators. Given conditions only on the ratios of densities, we show that our estimators can achieve optimal minimax rates for the likelihood ratio and the divergence functionals in certain regimes. We derive an efficient optimization algorithm for computing our estimates, and illustrate their convergence behavior and practical viability by simulations.

Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors

Ming Zeng, Le T. Nguyen, Bo Yu +4 more

Computer Vision and Pattern Recognition · · cited 855× · DOI ↗ · more like this ·

A variety of real-life mobile sensing applications are becoming available, especially in the life-logging, fitness tracking and health monitoring domains. These applications use mobile sensors embedded in smart phones to recognize human activities in order to get a better understanding of human beha

Single-Photon Switching and Entanglement of Solid-State Qubits in an Integrated Nanophotonic System

Alp Sipahigil, Ruffin E. Evans, Denis D. Sukachev +13 more

quant-ph · · cited 840× · arXiv ↗ · more like this ·

Efficient interfaces between photons and quantum emitters form the basis for quantum networks and enable nonlinear optical devices operating at the single-photon level. We demonstrate an integrated platform for scalable quantum nanophotonics based on silicon-vacancy (SiV) color centers coupled to nanoscale diamond devices. By placing SiV centers inside diamond photonic crystal cavities, we realize a quantum-optical switch controlled by a single color center. We control the switch using SiV metastable orbital states and verify optical switching at the single-photon level by using photon correlation measurements. We use Raman transitions to realize a single-photon source with a tunable frequency and bandwidth in a diamond waveguide. Finally, we create entanglement between two SiV centers by detecting indistinguishable Raman photons emitted into a single waveguide. Entanglement is verified…

A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network

Dai Quoc Nguyen, Tu Dinh Nguyen, Dat Quoc Nguyen +1 more

cs.CL · · cited 834× · arXiv ↗ · more like this ·

In this paper, we propose a novel embedding model, named ConvKB, for knowledge base completion. Our model ConvKB advances state-of-the-art models by employing a convolutional neural network, so that it can capture global relationships and transitional characteristics between entities and relations in knowledge bases. In ConvKB, each triple (head entity, relation, tail entity) is represented as a 3-column matrix where each column vector represents a triple element. This 3-column matrix is then fed to a convolution layer where multiple filters are operated on the matrix to generate different feature maps. These feature maps are then concatenated into a single feature vector representing the input triple. The feature vector is multiplied with a weight vector via a dot product to return a score. This score is then used to predict whether the triple is valid or not. Experiments show that…

Variational Continual Learning

Cuong V. Nguyen, Yingzhen Li, Thang D. Bui +1 more

stat.ML · · cited 826× · arXiv ↗ · more like this ·

This paper develops variational continual learning (VCL), a simple but general framework for continual learning that fuses online variational inference (VI) and recent advances in Monte Carlo VI for neural networks. The framework can successfully train both deep discriminative models and deep generative models in complex continual learning settings where existing tasks evolve over time and entirely new tasks emerge. Experimental results show that VCL outperforms state-of-the-art continual learning methods on a variety of tasks, avoiding catastrophic forgetting in a fully automatic way.

Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videos

Huy H. Nguyen, Junichi Yamagishi, Isao Echizen

cs.CV · · cited 824× · arXiv ↗ · more like this ·

Recent advances in media generation techniques have made it easier for attackers to create forged images and videos. State-of-the-art methods enable the real-time creation of a forged version of a single video obtained from a social network. Although numerous methods have been developed for detecting forged images and videos, they are generally targeted at certain domains and quickly become obsolete as new kinds of attacks appear. The method introduced in this paper uses a capsule network to detect various kinds of spoofs, from replay attacks using printed images or recorded videos to computer-generated videos using deep convolutional neural networks. It extends the application of capsule networks beyond their original intention to the solving of inverse graphics problems.

Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science

Decebal Constantin Mocanu, Elena Mocanu, Peter Stone +3 more

cs.NE · · cited 766× · arXiv ↗ · more like this ·

Through the success of deep learning in various domains, artificial neural networks are currently among the most used artificial intelligence methods. Taking inspiration from the network properties of biological neural networks (e.g. sparsity, scale-freeness), we argue that (contrary to general practice) artificial neural networks, too, should not have fully-connected layers. Here we propose sparse evolutionary training of artificial neural networks, an algorithm which evolves an initial sparse topology (Erdős-Rényi random graph) of two consecutive layers of neurons into a scale-free topology, during learning. Our method replaces artificial neural networks fully-connected layers with sparse ones before training, reducing quadratically the number of parameters, with no decrease in accuracy. We demonstrate our claims on restricted Boltzmann machines, multi-layer perceptrons, and…

Latent Embeddings for Zero-shot Classification

Yongqin Xian, Zeynep Akata, Gaurav Sharma +3 more

cs.CV · · cited 754× · arXiv ↗ · more like this ·

We present a novel latent embedding model for learning a compatibility function between image and class embeddings, in the context of zero-shot classification. The proposed method augments the state-of-the-art bilinear compatibility model by incorporating latent variables. Instead of learning a single bilinear map, it learns a collection of maps with the selection, of which map to use, being a latent variable for the current image-class pair. We train the model with a ranking based objective function which penalizes incorrect rankings of the true class for a given image. We empirically demonstrate that our model improves the state-of-the-art for various class embeddings consistently on three challenging publicly available datasets for the zero-shot setting. Moreover, our method leads to visually highly interpretable results with clear clusters of different fine-grained object properties…

Synthesizing the preferred inputs for neurons in neural networks via deep generator networks

Anh Nguyen, Alexey Dosovitskiy, Jason Yosinski +2 more

cs.NE · · cited 749× · arXiv ↗ · more like this ·

Deep neural networks (DNNs) have demonstrated state-of-the-art results on many pattern recognition tasks, especially vision classification problems. Understanding the inner workings of such computational brains is both fascinating basic science that is interesting in its own right - similar to why we study the human brain - and will enable researchers to further improve DNNs. One path to understanding how a neural network functions internally is to study what each of its neurons has learned to detect. One such method is called activation maximization (AM), which synthesizes an input (e.g. an image) that highly activates a neuron. Here we dramatically improve the qualitative state of the art of activation maximization by harnessing a powerful, learned prior: a deep generator network (DGN). The algorithm (1) generates qualitatively state-of-the-art synthetic images that look almost real…

SARAH: A Novel Method for Machine Learning Problems Using Stochastic Recursive Gradient

Lam M. Nguyen, Jie Liu, Katya Scheinberg +1 more

stat.ML · · cited 728× · arXiv ↗ · more like this ·

In this paper, we propose a StochAstic Recursive grAdient algoritHm (SARAH), as well as its practical variant SARAH+, as a novel approach to the finite-sum minimization problems. Different from the vanilla SGD and other modern stochastic methods such as SVRG, S2GD, SAG and SAGA, SARAH admits a simple recursive framework for updating stochastic gradient estimates; when comparing to SAG/SAGA, SARAH does not require a storage of past gradients. The linear convergence rate of SARAH is proven under strong convexity assumption. We also prove a linear convergence rate (in the strongly convex case) for an inner loop of SARAH, the property that SVRG does not possess. Numerical experiments demonstrate the efficiency of our algorithm.

Active learning using pre-clustering

Hieu T. Nguyen, A.W.M. Smeulders

Artificial Intelligence · Data Archiving and Networked Services (DANS) · · cited 653× · DOI ↗ · more like this ·

The paper is concerned with two-class active learning. While the common approach for collecting data in active learning is to select samples close to the classification boundary, better performance can be achieved by taking into account the prior data distribution. The main contribution of the paper is a formal framework that incorporates clustering into active learning. The algorithm first constructs a classifier on the set of the cluster representatives, and then propagates the classification decision to the other samples via a local noise model. The proposed model allows to select the most representative samples as well as to avoid repeatedly labeling samples in the same cluster. During the active learning process, the clustering is adjusted using the coarse-to-fine strategy in order to balance between the advantage of large clusters and the accuracy of the data representation. The…

Selection of <i>K</i> in <i>K</i> -means clustering

Duc Truong Pham, Stefan Dimov, Cuong Duc Nguyen

Artificial Intelligence · Proceedings of the Institution of Mechanical Engineers Part C Journal of Mechanical Engineering Science · · cited 596× · DOI ↗ · more like this ·

The K-means algorithm is a popular data-clustering algorithm. However, one of its drawbacks is the requirement for the number of clusters, K, to be specified before the algorithm is applied. This paper first reviews existing methods for selecting the number of clusters for the algorithm. Factors that affect this selection are then discussed and a new measure to assist the selection is proposed. The paper concludes with an analysis of the results of using the proposed measure to determine the number of clusters for the K-means algorithm for different data sets.

Comparing Problem-Based Learning with Case-Based Learning: Effects of a Major Curricular Shift at Two Institutions

Malathi Srinivasan, Michael S. Wilkes, Frazier T. Stevenson +2 more

Education · Academic Medicine · · cited 572× · DOI ↗ · more like this ·

PURPOSE: Problem-based learning (PBL) is now used at many medical schools to promote lifelong learning, open inquiry, teamwork, and critical thinking. PBL has not been compared with other forms of discussion-based small-group learning. Case-based learning (CBL) uses a guided inquiry method and provides more structure during small-group sessions. In this study, we compared faculty and medical students' perceptions of traditional PBL with CBL after a curricular shift at two institutions. METHOD: Over periods of three years, the medical schools at the University of California, Los Angeles (UCLA) and the University of California, Davis (UCD) changed first-, second-, and third-year Doctoring courses from PBL to CBL formats. Ten months after the shift (2001 at UCLA and 2004 at UCD), students and faculty who had participated in both curricula completed a 24-item questionnaire about their PBL…

Quantized overcomplete expansions in IR/sup N/: analysis, synthesis, and algorithms

Vivek K Goyal, Martin Vetterli, Nguyen T. Thao

Computer Vision and Pattern Recognition · IEEE Transactions on Information Theory · · cited 439× · DOI ↗ · more like this ·

Coefficient quantization has peculiar qualitative effects on representations of vectors in IR with respect to overcomplete sets of vectors. These effects are investigated in two settings: frame expansions (representations obtained by forming inner products with each element of the set) and matching pursuit expansions (approximations obtained by greedily forming linear combinations). In both cases, based on the concept of consistency, it is shown that traditional linear reconstruction methods are suboptimal, and better consistent reconstruction algorithms are given. The proposed consistent reconstruction algorithms were in each case implemented, and experimental results are included. For frame expansions, results are proven to bound distortion as a function of frame redundancy r and quantization step size for linear, consistent, and optimal reconstruction methods. Taken together, these…

An Efficient Method for Computing Traffic Equilibria in Networks with Asymmetric Transportation Costs

Sang Quang Nguyen, Clermont Dupuis

Transportation · Transportation Science · · cited 431× · DOI ↗ · more like this ·

In the presence of several user categories or transportation modes, or when transportation costs on each arc of a network depend on the flows on adjacent arcs, the traffic equilibrium problem may be expressed as a variational problem. Methods for determining traffic equilibria are then adaptations of techniques for solving variational inequalities. In this paper, we present a new convex optimization formulation for the general traffic equilibrium problem, and propose a simple iterative method for calculating traffic equilibria, which essentially involves postoptimizing a linear sub-problem at each iteration. Preliminary computational results are reported.

Information-Flow Analysis of Android Applications in DroidSafe

Michael I. Gordon, Deokhwan Kim, Jeff Perkins +3 more

Signal Processing · · cited 426× · DOI ↗ · more like this ·

Author(s): Michael I. Gordon, Deokhwan Kim, Jeff Perkins, Limei Gilhamy, Nguyen Nguyenz, Martin Rinard Download: Paper (PDF) Date: 8 Feb 2015 Document Type: Briefing Papers Additional Documents: Slides Associated Event: NDSS Symposium 2015 Abstract: We present DroidSafe, a static information flow analysis tool that reports potential leaks of sensitive information in Android applications. DroidSafe includes … Continued

OSNAP: Faster numerical linear algebra algorithms via sparser subspace embeddings

Jelani Nelson, Huy L. Nguyen

cs.DS · · cited 426× · arXiv ↗ · more like this ·

An "oblivious subspace embedding (OSE)" given some parameters eps,d is a distribution D over matrices B in R^{m x n} such that for any linear subspace W in R^n with dim(W) = d it holds that Pr_{B ~ D}(forall x in W ||B x||_2 in (1 +/- eps)||x||_2) > 2/3 We show an OSE exists with m = O(d^2/eps^2) and where every B in the support of D has exactly s=1 non-zero entries per column. This improves previously best known bound in [Clarkson-Woodruff, arXiv:1207.6365]. Our quadratic dependence on d is optimal for any OSE with s=1 [Nelson-Nguyen, 2012]. We also give two OSE's, which we call Oblivious Sparse Norm-Approximating Projections (OSNAPs), that both allow the parameter settings m = Õ(d/eps^2) and s = polylog(d)/eps, or m = O(d^{1+gamma}/eps^2) and s=O(1/eps) for any constant gamma>0. This m is nearly optimal since m >= d is required simply to no non-zero vector of W lands in the kernel of…

Rough Set Algorithms in Classification Problem

Jan G. Bazan, Hung Son Nguyen, Sinh Hoa Nguyen +2 more

Computational Theory and Mathematics · Studies in fuzziness and soft computing · · cited 426× · DOI ↗ · more like this ·

We we present some algorithms, based on rough set theory, that can be used for the problem of new cases classification. Most of the algorithms were implemented and included in Rosetta system [43]. We present several methods for computation of decision rules based on reducts. We discuss the problem of real value attribute discretization for increasing the performance of algorithms and quality of decision rules. Finally we deal with a problem of resolving conflicts between decision rules classifying a new case to different categories (classes). Keywords: knowledge discovery, rough sets, classification algorithms, reducts, decision rules, real value attribute discretization