arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sebastien Jean

44 papers · 1995–2026

1995: 11996: 01997: 01998: 01999: 02000: 12001: 12002: 12003: 12004: 32005: 12006: 02007: 22008: 12009: 02010: 12011: 22012: 02013: 22014: 72015: 32016: 32017: 42018: 12019: 62020: 12021: 02022: 02023: 12024: 02025: 02026: 1
1995peak 7 in 20142026

Frequent co-authors

Papers

showing 1–25 of 44 RSS

Theano: A Python framework for fast computation of mathematical expressions

The Theano Development Team, Rami Al-Rfou, Guillaume Alain +110 more

cs.SC · · cited 2,382× · arXiv ↗ · more like this ·

Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has been one of the most used CPU and GPU mathematical compilers - especially in the machine learning community - and has shown steady performance improvements. Theano is being actively and continuously developed since 2008, multiple frameworks have been built on top of it and it has been used to produce many state-of-the-art machine learning models. The present article is structured as follows. Section I provides an overview of the Theano software and its community. Section II presents the principal features of Theano and how to use them, and compares them with other similar projects. Section III focuses on recently-introduced functionalities and improvements. Section IV compares the performance of Theano against…

On Using Very Large Target Vocabulary for Neural Machine Translation

Sébastien Jean, Kyunghyun Cho, Roland Memisevic +1 more

cs.CL · · cited 1,045× · arXiv ↗ · more like this ·

Neural machine translation, a recently proposed approach to machine translation based purely on neural networks, has shown promising results compared to the existing approaches such as phrase-based statistical machine translation. Despite its recent success, neural machine translation has its limitation in handling a larger vocabulary, as training complexity as well as decoding complexity increase proportionally to the number of target words. In this paper, we propose a method that allows us to use a very large target vocabulary without increasing training complexity, based on importance sampling. We show that decoding can be efficiently done even with the model having a very large target vocabulary by selecting only a small subset of the whole target vocabulary. The models trained by the proposed approach are empirically found to outperform the baseline models with a small vocabulary…

Adversarial Learning for Neural Dialogue Generation

Jiwei Li, Will Monroe, Tianlin Shi +3 more

cs.CL · · cited 925× · arXiv ↗ · more like this ·

In this paper, drawing intuition from the Turing test, we propose using adversarial training for open-domain dialogue generation: the system is trained to produce sequences that are indistinguishable from human-generated dialogue utterances. We cast the task as a reinforcement learning (RL) problem where we jointly train two systems, a generative model to produce response sequences, and a discriminator---analagous to the human evaluator in the Turing test--- to distinguish between the human-generated dialogues and the machine-generated ones. The outputs from the discriminator are then used as rewards for the generative model, pushing the system to generate dialogues that mostly resemble human dialogues. In addition to adversarial training we describe a model for adversarial {\em evaluation} that uses success in fooling an adversary as a dialogue evaluation metric, while avoiding a…

Combining modality specific deep neural networks for emotion recognition in video

Samira Ebrahimi Kahou, Christopher Pal, Xavier Bouthillier +9 more

Computer Vision and Pattern Recognition · PolyPublie (École Polytechnique de Montréal) · · cited 382× · DOI ↗ · more like this ·

In this paper we present the techniques used for the University of Montréal's team submissions to the 2013 Emotion Recognition in the Wild Challenge. The challenge is to classify the emotions expressed by the primary human subject in short video clips extracted from feature length movies. This involves the analysis of video clips of acted scenes lasting approximately one-two seconds, including the audio track which may contain human voices as well as background music. Our approach combines multiple deep neural networks for different data modalities, including: (1) a deep convolutional neural network for the analysis of facial expressions within video frames; (2) a deep belief net to capture audio information; (3) a deep autoencoder to model the spatio-temporal information produced by the human actions depicted within the entire scene; and (4) a shallow network architecture focused on…

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

Jonathan Shen, Patrick Nguyen, Yonghui Wu +88 more

cs.LG · · cited 215× · arXiv ↗ · more like this ·

Lingvo is a Tensorflow framework offering a complete solution for collaborative deep learning research, with a particular focus towards sequence-to-sequence models. Lingvo models are composed of modular building blocks that are flexible and easily extensible, and experiment configurations are centralized and highly customizable. Distributed training and quantized inference are supported directly within the framework, and it contains existing implementations of a large number of utilities, helper functions, and the newest research ideas. Lingvo has been used in collaboration by dozens of researchers in more than 20 papers over the last two years. This document outlines the underlying design of Lingvo and serves as an introduction to the various pieces of the framework, while also offering examples of advanced features that showcase the capabilities of the framework.

Does Neural Machine Translation Benefit from Larger Context?

Sebastien Jean, Stanislas Lauly, Orhan Firat +1 more

stat.ML · · cited 155× · arXiv ↗ · more like this ·

We propose a neural machine translation architecture that models the surrounding text in addition to the source sentence. These models lead to better performance, both in terms of general translation quality and pronoun prediction, when trained on small corpora, although this improvement largely disappears when trained with a larger corpus. We also discover that attention-based neural machine translation is well suited for pronoun prediction and compares favorably with other approaches that were specifically designed for this task.

Montreal Neural Machine Translation Systems for WMT’15

Sébastien Jean, Orhan Fırat, Kyunghyun Cho +2 more

Artificial Intelligence · · cited 144× · DOI ↗ · more like this ·

Neural machine translation (NMT) systems have recently achieved results comparable to the state of the art on a few translation tasks, including EnglishFrench and EnglishGerman. The main purpose of the Montreal Institute for Learning Algorithms (MILA) submission to WMT'15 is to evaluate this new approach on a greater variety of language pairs. Furthermore, the human evaluation campaign may help us and the research community to better understand the behaviour of our systems. We use the RNNsearch architecture, which adds an attention mechanism to the encoderdecoder. We also leverage some of the recent developments in NMT, including the use of large vocabularies, unknown word replacement and, to a limited degree, the inclusion of monolingual language models.

Embedding Word Similarity with Neural Machine Translation

Felix Hill, Kyunghyun Cho, Sebastien Jean +2 more

cs.CL · · cited 64× · arXiv ↗ · more like this ·

Neural language models learn word representations, or embeddings, that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models, a recently-developed class of neural language model. We show that embeddings from translation models outperform those learned by monolingual models at tasks that require knowledge of both conceptual similarity and lexical-syntactic role. We further show that these effects hold when translating from both English to French and English to German, and argue that the desirable properties of translation embeddings should emerge largely independently of the source and target languages. Finally, we apply a new method for training neural translation models with very large vocabularies, and show that this vocabulary expansion algorithm results in minimal degradation of embedding quality. Our…

Not All Neural Embeddings are Born Equal

Felix Hill, KyungHyun Cho, Sebastien Jean +2 more

cs.CL · · cited 52× · arXiv ↗ · more like this ·

Neural language models learn word representations that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models. We show that translation-based embeddings outperform those learned by cutting-edge monolingual models at single-language tasks requiring knowledge of conceptual similarity and/or syntactic role. The findings suggest that, while monolingual models learn information about how concepts are related, neural-translation models better capture their true ontological status.

Adaptive Scheduling for Multi-Task Learning

Sébastien Jean, Orhan Firat, Melvin Johnson

cs.LG · · cited 51× · arXiv ↗ · more like this ·

To train neural machine translation models simultaneously on multiple tasks (languages), it is common to sample each task uniformly or in proportion to dataset sizes. As these methods offer little control over performance trade-offs, we explore different task scheduling approaches. We first consider existing non-adaptive techniques, then move on to adaptive schedules that over-sample tasks with poorer results compared to their respective baseline. As explicit schedules can be inefficient, especially if one task is highly over-sampled, we also consider implicit schedules, learning to scale learning rates or gradients of individual tasks instead. These techniques allow training multilingual models that perform better for low-resource language pairs (tasks with small amount of data), while minimizing negative effects on high-resource tasks.

Smart Card Operating Systems: Past, Present and Future

Damien Deville, Antoine Galland, Gilles Grimaud +1 more

Hardware and Architecture · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 38× · OpenAlex ↗ · more like this ·

Over the last twenty years, the software in smart cards has radically changed. This has happened for several reasons, smart card software was initially rigid and monolithic and has now become more flexible with a clear separation between ``operating system level'' and ``application level'' parts. What is more, application-level resources are now much more accessible (nearly to end user level). Nevertheless, smart cards have evolved separately from an ever more distributed ``outside world''. This paper presents two contributions to next-generation smart card operating systems. The first, called CAMILLE, relies on the exo-kernel approach to obtain extensibility, without compromising security, raising making operating systems accessible to application designers. The second, called AWARE, reveals the mismatch between the smart card…

Migration and labour market outcomes in OECD countries

Sébastien Jean, Orsetta Causa, Miguel Ángel Corona Jiménez +1 more

Sociology and Political Science · OECD Journal Economic Studies · · cited 34× · DOI ↗ · more like this ·

Immigration pressures are increasing in most OECD countries. This article investigates the consequences of immigration for natives’ labour market outcomes, as well as issues linked to immigrants’ integration in the host country labour market. Changes in the share of immigrants in the labour force may have a distributive impact on natives’ wages, and a temporary impact on unemployment. However, labour market integration of immigrants (as well as integration of second-generation immigrants both in terms of educational attainments and of labour market outcomes) remains the main challenge facing host economies. In both cases, product and labour market policies have a significant role to play in easing the economy’s adjustment to immigration.

Context-Aware Learning for Neural Machine Translation

Sébastien Jean, Kyunghyun Cho

cs.CL · · cited 20× · arXiv ↗ · more like this ·

Interest in larger-context neural machine translation, including document-level and multi-modal translation, has been growing. Multiple works have proposed new network architectures or evaluation schemes, but potentially helpful context is still sometimes ignored by larger-context translation models. In this paper, we propose a novel learning algorithm that explicitly encourages a neural translation model to take into account additional context using a multilevel pair-wise ranking loss. We evaluate the proposed learning algorithm with a transformer-based larger-context translation system on document-level translation. By comparing performance using actual and random contexts, we show that a model trained with the proposed algorithm is more sensitive to the additional context.

The virtual mesh

Laurent Alonso, François Cuny, Sébastien Jean +3 more

Computer Graphics and Computer-Aided Design · ACM Transactions on Graphics · · cited 14× · DOI ↗ · more like this ·

In this article, we introduce a general-purpose method for computing radiosity on scenes made of parametric surfaces with arbitrary trimming curves. In contrast with past approaches that require a tessellation of the input surfaces (be it made up of triangles or patches with simple trimming curves) or some form of geometric approximation, our method takes full advantage of the rich and compact mathematical representation of objects. At its core lies the virtual mesh , an abstraction of the input geometry that allows complex shapes to be illuminated as if they were simple primitives. The virtual mesh is a collection of normalized square domains to which the input surfaces are mapped while preserving their energy properties. Radiosity values are then computed on these supports before being lifted back to the original surfaces. To demonstrate the power of our method, we describe a…

Neural Machine Translation for Cross-Lingual Pronoun Prediction

Sébastien Jean, Stanislas Lauly, Orhan Fırat +1 more

Artificial Intelligence · · cited 13× · DOI ↗ · more like this ·

In this paper we present our systems for the DiscoMT 2017 cross-lingual pronoun prediction shared task. For all four language pairs, we trained a standard attention-based neural machine translation system as well as three variants that incorporate information from the preceding source sentence. We show that our systems, which are not specifically designed for pronoun prediction and may be used to generate complete sentence translations, generally achieve competitive results on this task.

Using some database principles to improve cooperation in multi-application smart cards

Sébastien Jean, Didier Donsez, Sylvain Lecomte

Computer Networks and Communications · · cited 8× · DOI ↗ · more like this ·

Smart cards evolve today at the rate of non-embedded computing. If twenty years were necessary, to integrate smart cards into the database principles, it took less than five years to embed Java. Emerging applications, such as loyalty ones, induce changes in smart card concepts. These applications are characterized by, the gathering of several partners who bring each one of their application part in order to offer global services to mobile users. Smart cards, which have been used as data servers for a long time, become now able to embed and run several collaborative applications. These applications lead to new requirements in embedded software lifecycle. It is indeed necessary for each partner to update his part without breaking the whole application. Moreover it is necessary to allow the evolution of the cooperation scheme (modifications of resource sharing or arrival of new partners).…

A component-based approach to distributed system management

Sara Bouchenak, Fabienne Boyer, Emmanuel Cecchet +3 more

Information Systems · · cited 6× · DOI ↗ · more like this ·

Clustering has become a de facto standard to scale distributed systems and applications. However, the administration and management of such systems still use ad-hoc techniques that partially fulfill the needs. The expertise needed to configure and tune these systems goes beyond the capacity of a single system administrator or software developer.We present a modular software infrastructure to build command and control loops to manage large scale distributed systems. Our approach uses a reflective component model in a systematic way for building a system model and every single stage in the supervision loop. This approach offers modularity, easy configuration, dynamic reconfiguration, as well as reusability. We illustrate how this architecture can be used to build self-manageable J2EE application server clusters.

Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing

Shufan Wang, Sebastien Jean, Sailik Sengupta +3 more

cs.AI · · cited 5× · arXiv ↗ · more like this ·

In executable task-oriented semantic parsing, the system aims to translate users' utterances in natural language to machine-interpretable programs (API calls) that can be executed according to pre-defined API specifications. With the popularity of Large Language Models (LLMs), in-context learning offers a strong baseline for such scenarios, especially in data-limited regimes. However, LLMs are known to hallucinate and therefore pose a formidable challenge in constraining generated content. Thus, it remains uncertain if LLMs can effectively perform task-oriented utterance-to-API generation where respecting API's structural and task-specific constraints is crucial. In this work, we seek to measure, analyze and mitigate such constraints violations. First, we identify the categories of various constraints in obtaining API-semantics from task-oriented utterances, and define fine-grained…

Log-Linear Reformulation of the Noisy Channel Model for Document-Level Neural Machine Translation

Sébastien Jean, Kyunghyun Cho

Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

We seek to maximally use various data sources, such as parallel and monolingual data, to build an effective and efficient documentlevel translation system. In particular, we start by considering a noisy channel approach By applying Bayes' rule strategically, we reformulate this approach as a log-linear combination of translation, sentence-level and documentlevel language model probabilities. In addition to using static coefficients for each term, this formulation alternatively allows for the learning of dynamic per-token weights to more finely control the impact of the language models. Using both static or dynamic coefficients leads to improvements over a context-agnostic baseline and a context-aware concatenation model.

Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation

Sébastien Jean, Ankur Bapna, Orhan Firat

cs.CL · · cited 5× · arXiv ↗ · more like this ·

Most neural machine translation systems still translate sentences in isolation. To make further progress, a promising line of research additionally considers the surrounding context in order to provide the model potentially missing source-side information, as well as to maintain a coherent output. One difficulty in training such larger-context (i.e. document-level) machine translation systems is that context may be missing from many parallel examples. To circumvent this issue, two-stage approaches, in which sentence-level translations are post-edited in context, have recently been proposed. In this paper, we instead consider the viability of filling in the missing context. In particular, we consider three distinct approaches to generate the missing context: using random contexts, applying a copy heuristic or generating it with a language model. In particular, the copy heuristic…

International trade under attack: what strategy for Europe? Bruegel Policy Contribution Issue n˚12 | August 2018

Sébastien Jean, P. Martín, André Sapir

Political Science and International Relations · Archive of European Integration (AEI) (University of Pittsburgh) · · cited 5× · OpenAlex ↗ · more like this ·

The multilateral trading system is seriously threatened by the country which has been its main inspirer, the United States. The US position is focused on bilateral trade imbalances presumably resulting from unbalanced trade policies, but it is flawed. Not only does it make little sense given the existence of global value chains, but it also misses its target: what matters most are aggregate trade surpluses and deficits, which depend above all on the differential between domestic investment and savings, and little on trade policy.

Assessing the Future of Smart Card Operating Systems

Damien Deville, Antoine Galland, Gilles Grimaud +1 more

Computer Networks and Communications · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 5× · OpenAlex ↗ · more like this ·

This paper aims at presenting past issues, present work, future challenges and work in progress in smart cards operating system design. Smart cards are built to be tamper-resistant platforms whose goal is to serve their owner and to ensure that all interactions between them and the different information systems they are likely to face with, are as safe as possible. The quest for tamper-resistance nowadays implies to confine the computation part in a very small piece of hardware. Consequently smart cards are very constrained nomadic devices. Despite this, they have become more than security tokens over the last twenty years, providing scaled down capabilities of "classical" computing (e.g. databases, virtual machines, . . . ). Nevertheless, evolutions of smart cards operating systems have not taken into account the fact that classical computing was also evolving. Now…

Échange international et marché du travail ( une revue critique des méthodes d' analyse)

Olivier Cortès, Sébastien Jean

Public Administration · Revue d économie politique · · cited 3× · DOI ↗ · more like this ·

<i>Chowan, dawdim, humao, hamei, khekhrii</i>, and <i>phut</i> are sun-dried starters used for preparation of alcoholic beverages in North East regions of India. We attempted to profile the mycobiome community in these starters by high-throughput sequencing (HTS) method. All fungal populations were found to be restricted to Ascomycota (67-99%), Zygomycota (0.7-29%), Basidiomycota (0.03-7%), and Chytridiomycota (0.0003%). We found 45 core operational taxonomic units (OTUs) which were universally present and were further weighed to 41 genera level and 22 species level taxonomy. A total number of 594 fungal species were detected by HTS including common species (224), unique species (133) and rare-species (237) in samples of starters. Unique species were recorded in <i>phut</i> (40 species), <i>khekhrii</i> (28), <i>hamei</i> (23), <i>dawdim</i> (21), <i>chowan</i> (13), and <i>humao</i>…

Une nouvelle guerre froide ? Quelle nouvelle guerre froide ? Le discours sur la fragmentation géoéconomique à l’épreuve des données

Sébastien Jean

Political Science and International Relations · Revue d économie financière · · cited 2× · DOI ↗ · more like this ·

Désormais, il est largement admis que l’économie mondiale devrait être considérée comme de plus en plus façonnée par des forces de fragmentation résultant de tensions géopolitiques. Cet article jette un nouveau regard sur ce narratif, à l’aide de données sur le commerce international. Si une analyse agrégée corrobore le discours d’une nouvelle guerre froide, selon lequel le commerce international est de plus en plus considéré comme divisé en deux blocs, il ne s’agit, en réalité, que d’un mélange de résultats très différents. Loin d’être une tendance généralisée, la fragmentation géoéconomique des flux commerciaux n’est significative que dans certains « points chauds » : le commerce extérieur de la Russie et les échanges bilatéraux entre la Chine et les États-Unis, pour lesquels l’impact est considérable. En dehors de ces « points chauds », rien n’indique que les tensions géopolitiques…

The Surprising Sluggishness of French Exports: Reviewing Competitiveness and its Determinants

Charlotte Emlinger, Sébastien Jean, Vincent Vicard

Political Science and International Relations · Econstor (Econstor) · · cited 2× · OpenAlex ↗ · more like this ·

The large deterioration in France's current account balance during the euro's first decade was mainly due to its poor export performances. Although there have been no more market share losses since 2012, French export growth lags behind that of our European partners. Given that labor cost have grown more slowly in France than in Germany since 2011, the sluggishness of French export performance appears surprising. To date, however, the rebalancing of labor costs under way only represents between a quarter and a third of the divergence observed between 1999 and the crisis. Moreover, whether through social contribution exemptions in France or Germany's introduction of a minimum wage, the relative decrease has mainly concerned low wage brackets, which have little influence on exports. Such limited "catch-up" is symptomatic of the difficulty that the Eurozone has in implementing coordinated…