arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Hugues Berry

41 papers · 2005–2026

2005: 42006: 22007: 42008: 32009: 52010: 52011: 32012: 22013: 12014: 02015: 12016: 02017: 02018: 12019: 02020: 22021: 02022: 02023: 02024: 32025: 22026: 3
2005peak 5 in 20092026

Frequent co-authors

Papers

showing 1–25 of 41 RSS

Interdisciplinary Research in Artificial Intelligence: Challenges and Opportunities

Rémy Kusters, Dusan Misevic, Hugues Berry +9 more

Artificial Intelligence · Frontiers in Big Data · · cited 118× · DOI ↗ · more like this ·

The use of artificial intelligence (AI) in a variety of research fields is speeding up multiple digital revolutions, from shifting paradigms in healthcare, precision medicine and wearable sensing, to public services and education offered to the masses around the world, to future cities made optimally efficient by autonomous driving. When a revolution happens, the consequences are not obvious straight away, and to date, there is no uniformly adapted framework to guide AI research to ensure a sustainable societal transition. To answer this need, here we analyze three key challenges to interdisciplinary AI research, and deliver three broad conclusions: 1) future development of AI should not only impact other scientific domains but should also take inspiration and benefit from other fields of science, 2) AI research must be accompanied by decision explainability, dataset bias transparency…

Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons

Benoit Siri, Mathias Quoy, Bruno Delord +2 more

q-bio.NC · · cited 78× · arXiv ↗ · more like this ·

The aim of the present paper is to study the effects of Hebbian learning in random recurrent neural networks with biological connectivity, i.e. sparse connections and separate populations of excitatory and inhibitory neurons. We furthermore consider that the neuron dynamics may occur at a (shorter) time scale than synaptic plasticity and consider the possibility of learning rules with passive forgetting. We show that the application of such Hebbian learning leads to drastic changes in the network dynamics and structure. In particular, the learning rule contracts the norm of the weight matrix and yields a rapid decay of the dynamics complexity and entropy. In other words, the network is rewired by Hebbian learning into a new synaptic structure that emerges with learning on the basis of the correlations that progressively build up between neurons. We also observe that, within this…

Reconciling specialization and flexibility through compound circuits

Sami Yehia, Sylvain Girbal, Hugues Berry +1 more

Hardware and Architecture · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 43× · DOI ↗ · more like this ·

While parallelism and multi-cores are receiving much attention as a major scalability path, customization is another, orthogonal and complementary, scalability path which can target not easily parallelizable programs or program sections. The key assets of customization are cost and power efficiency. The key limitation of customization is flexibility. However, we argue that there is no perfect balance between efficiency and flexibility, each system vendor may want to strike a different such balance. In this article, we present a method for achieving any desired balance between flexibility and efficiency by automatically combining any set of individual customization circuits into a larger compound circuit. This circuit is significantly more cost efficient than the simple union of all target circuits, and is configurable to behave as any of the target circuits, while avoiding the routing…

French Roadmap for complex Systems 2008-2009

Paul Bourgine, David Chavalarias, Edith Perrier +78 more

nlin.AO · · cited 33× · arXiv ↗ · more like this ·

This second issue of the French Complex Systems Roadmap is the outcome of the Entretiens de Cargese 2008, an interdisciplinary brainstorming session organized over one week in 2008, jointly by RNSC, ISC-PIF and IXXI. It capitalizes on the first roadmap and gathers contributions of more than 70 scientists from major French institutions. The aim of this roadmap is to foster the coordination of the complex systems community on focused topics and questions, as well as to present contributions and challenges in the complex systems sciences and complexity science to the public, political and industrial spheres.

Chaos in computer performance

Hugues Berry, Daniel Gracia Pérez, Olivier Temam

nlin.AO · · cited 31× · arXiv ↗ · more like this ·

Modern computer microprocessors are composed of hundreds of millions of transistors that interact through intricate protocols. Their performance during program execution may be highly variable and present aperiodic oscillations. In this paper, we apply current nonlinear time series analysis techniques to the performances of modern microprocessors during the execution of prototypical programs. Our results present pieces of evidence strongly supporting that the high variability of the performance dynamics during the execution of several programs display low-dimensional deterministic chaos, with sensitivity to initial conditions comparable to textbook models. Taken together, these results show that the instantaneous performances of modern microprocessors constitute a complex (or at least complicated) system and would benefit from analysis with modern tools of nonlinear and complexity…

The impact of network topology on self-organizing maps

Fei Jiang, Hugues Berry, Marc Schoenauer

Artificial Intelligence · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 11× · DOI ↗ · more like this ·

In this paper, we study instances of complex neural networks, i.e. neural networks with complex topologies. We use Self-Organizing Map neural networks whose neighborhood relationships are defined by a complex network, to classify handwritten digits. We show that topology has a small impact on performance and robustness to neuron failures, at least at long learning times. Performance may however be increased (by almost $10\%$) by evolutionary optimization of the network topology. In our experimental conditions, the evolved networks are more random than their parents, but display a more heterogeneous degree distribution.

CMA: Chip multi-accelerator

Dominik Auras, Sylvain Girbal, Hugues Berry +2 more

Hardware and Architecture · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 10× · DOI ↗ · more like this ·

Custom acceleration has been a standard choice in embedded systems thanks to the power density and performance efficiency it provides. Parallelism is another orthogonal scalability path that efficiently overcomes the increasing limitation of frequency scaling in current general-purpose architectures. In this paper we propose a multi-accelerator architecture that combines the best of both worlds, parallelism and custom acceleration, while addressing the programmability inconvenience of heterogeneous multiprocessing systems. A Chip Multi-Accelerator (CMA) is a regular parallel architecture where each core is complemented with a custom accelerator to speed up specific functions. Furthermore, by using techniques to efficiently merge more than one custom accelerator together, we are able to cram as many accelerators as needed by the application or a domain of applications. We demonstrate our…

Unsupervised learning of echo state networks

Fei Jiang, Hugues Berry, Marc Schoenauer

Artificial Intelligence · · cited 9× · DOI ↗ · more like this ·

A possible alternative to fine topology tuning for Neural Network (NN) optimization is to use Echo State Networks (ESNs), recurrent NNs built upon a large reservoir of sparsely randomly connected neurons. The promises of ESNs have been fulfilled for supervised learning tasks, but unsupervised learning tasks, such as control problems, require more flexible optimization methods. We propose here to apply state-of-the-art methods in evolutionary continuous parameter optimization, to the evolutionary learning of ESN. First, a standard supervised learning problem is used to validate our approach and compare it to the standard quadratic one. The classical double pole balancing control problem is then used to demonstrate that unsupervised evolutionary learning of ESNs yields results that compete with the best topology-learning methods.

A memory interface for multi-purpose multi-stream accelerators

Sylvain Girbal, Olivier Temam, Sami Yehia +2 more

Hardware and Architecture · · cited 5× · DOI ↗ · more like this ·

Power and programming challenges make heterogeneous multi-cores composed of cores and ASICs an attractive alternative to homogeneous multi-cores. Recently, multi-purpose loop-based generated accelerators have emerged as an especially attractive accelerator option. They have several assets: short design time (automatic generation), flexibility (multi-purpose) but low configuration and routing overhead (unlike FPGAs), computational performance (operations are directly mapped to hardware), and a focus on memory throughput by leveraging loop constructs. However, with multiple streams, the memory behavior of such accelerators can become at least as complex as that of superscalar processors, while they still need to retain the memory ordering predictability and throughput efficiency of DMAs. In this article, we show how to design a memory interface for multi-purpose accelerators which…

An FPGA design for the stochastic Greenberg-Hastings cellular automata

Nikolaos Vlassopoulos, Nazim Fatès, Hugues Berry +1 more

Computational Theory and Mathematics · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 5× · DOI ↗ · more like this ·

The stochastic Greenberg-Hastings cellular automaton is a model that mimics the propagation of reaction-diffusion waves in active media. Notably, this model undergoes a phase transition when the probability of excitation of a cell varies. We developed a specific FPGA design to study the critical behavior of this model. Using dedicated architectural optimizations, we obtain a significant speed-up with respect to software simulation for lattice sizes of 512×512. We exploited this speed-up to obtain improved estimations of the critical threshold. Our results indicate the existence of an asymptotic value of this threshold when the number of cell states increases.

Budgeted region sampling (BeeRS): do not separate sampling from warm-up, and then spend wisely your simulation budget

Daniel Gracia Pérez, Hugues Berry, Olivier Temam

Hardware and Architecture · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 3× · DOI ↗ · more like this ·

While the recent surge of research articles on sampling started with rather large sample sizes, it has later shifted to very small intervals, and it is now converging to intermediate sizes, and even to varying sizes. With 100M samples, warm-up is not an issue, at least with current cache sizes. However, with significantly smaller samples, warm-up becomes critical, especially when the sampling target accuracy is of the order of a few percent. However, in most sampling research works, warm-up has largely been treated as a separate issue. In this article, we advocate for an integrated approach at (simulator-based) warm-up and sampling. Instead of separating warm-up and sampling, we take exactly the opposite approach, provide a common instruction budget for warm-up and sampling, and we attempt to spend it as wisely as possible on either one. This budget and integrated approach at warm-up…

IDDCA: A New Clustering Approach For Sampling

Daniel Gracia Pérez, Hugues Berry, Olivier Temam

Hardware and Architecture · · cited 2× · OpenAlex ↗ · more like this ·

Abstract. Clustering methods are machine-learning algorithms that can be used to easily select the most representative samples within a huge program trace. k-means is a popular clustering method for sampling. While k-means performs well, it has several shortcomings: (1) it depends on a random initialization, so that clustering results may vary across runs; (2) the maximal number of clusters is a user-selected parameter, but its optimal value can be benchmark/trace-dependent; (3) k-means is a multi-pass algorithm which may be less practical for a large number of intervals. To solve these issues, we adapted an alternative clustering method, called DCA, to the issue of sampling. Unlike k-means, DCA and its sampling-specific adaptation ID-DCA do not require the user to be exposed to internal clustering parameters: it dynamically defines the number of clusters for each target program and the…

Stream and Memory Hierarchy Design for Multi-Purpose Accelerators

Sylvain Girbal, Sami Yehia, Hugues Berry +1 more

Hardware and Architecture · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 1× · OpenAlex ↗ · more like this ·

Abstract—Power and programming challenges make heterogeneous multi-cores composed of cores and ASICs an attractive alternative to homogeneous multi-cores. Re-cently, multi-purpose loop-based generated accelerators have emerged as an especially attractive accelerator option. They have several assets: short design time (automatic generation), flexibility (multi-purpose) but low configura-tion and routing overhead (unlike FPGAs), computational performance (operations are directly mapped to hardware), and a focus on memory throughput by leveraging loop constructs. However, with multiple streams, the memory behavior of such accelerators can become at least as complex as that of superscalar processors, while they still need to retain the memory ordering predictability and throughput efficiency of DMAs. In this article, we show how to design a memory interface for multi-purpose accelerators…

Optimising the topology of complex neural networks

Fei Jiang, Hugues Berry, Marc Schoenauer

cs.NE · · cited 1× · arXiv ↗ · more like this ·

In this paper, we study instances of complex neural networks, i.e. neural netwo rks with complex topologies. We use Self-Organizing Map neural networks whose n eighbourhood relationships are defined by a complex network, to classify handwr itten digits. We show that topology has a small impact on performance and robus tness to neuron failures, at least at long learning times. Performance may howe ver be increased (by almost 10%) by artificial evolution of the network topo logy. In our experimental conditions, the evolved networks are more random than their parents, but display a more heterogeneous degree distribution.

A Sampling Method Focusing on Practicality

Daniel Pérez, Hugues Berry, Olivier Temam

Hardware and Architecture · IEEE Micro · · cited 1× · DOI ↗ · more like this ·

This sampling technique, which is hardware-independent and almost entirely transparent to the user, employs a budget-based approach that jointly considers warm-up and sampling costs, presents them as a single parameter to the user, and distributes simulated instructions between warm-up and sampling based on region partitioning and clustering information. Although it focuses on practicality, the technique delivers nearly state-of-the-art speed and accuracy. In this article, we explain how even the most successful of the existing sampling techniques fall short on practicality, especially when it comes to warm-up. We propose a more practical alternative: a sampling technique that focuses specifically on transparency, while also delivering nearly state-of-the-art speed and accuracy. The technique offers a hardware-independent, integrated approach to warm-up and sampling that requires no…

Characterizing Self-Developing Biological Neural Networks: A First Step Towards their Application To Computing Systems

Hugues Berry, Olivier Temam

q-bio.NC · · cited 1× · arXiv ↗ · more like this ·

Carbon nanotubes are often seen as the only alternative technology to silicon transistors. While they are the most likely short-term one, other longer-term alternatives should be studied as well. While contemplating biological neurons as an alternative component may seem preposterous at first sight, significant recent progress in CMOS-neuron interface suggests this direction may not be unrealistic; moreover, biological neurons are known to self-assemble into very large networks capable of complex information processing tasks, something that has yet to be achieved with other emerging technologies. The first step to designing computing systems on top of biological neurons is to build an abstract model of self-assembled biological neural networks, much like computer architects manipulate abstract models of transistors and circuits. In this article, we propose a first model of the structure…

Accounting for Missed Events in the Bayesian Modeling of IP3R Multimodal Gating

Schayma Ben Marzougui, Audrey Denizot, Hugues Berry

q-bio.QM · · cited 0× · arXiv ↗ · more like this ·

The Inositol 1,4,5-trisphosphate receptor channel (IP 3 R) is an important calcium channel involved in calcium-induced calcium release, playing a prominent role in intracellular calcium signaling. However, accurately characterizing its gating behavior remains a challenge, particularly due to the temporal resolution of patch clamp techniques that is not large enough to detect all short-lived events. This limitation can significantly bias the inference of kinetic models describing the receptor activity. To address this issue, we focused on the quantitative analysis of IP 3 R gating behavior using patch clamp data, with particular attention to missed events. We modeled IP 3 R channel gating using Hierarchical Markov chains and used a Bayesian approach that integrates missed event correction directly into the likelihood function, enabling more accurate parameter inference and model…

A Coupled Neural Field Model for the Standard Consolidation Theory

Lisa Blum Moyse, Hugues Berry

q-bio.NC · · cited 0× · arXiv ↗ · more like this ·

The standard consolidation theory states that short-term memories located in the hippocampus enable the consolidation of long-term memories in the neocortex. In other words, the neocortex slowly learns long-term memories with a transient support of the hippocampus that quickly learns unstable memories. However, it is not clear yet what could be the neurobiological mechanisms underlying these differences in learning rates and memory time-scales. Here, we propose a novel modelling approach of the standard consolidation theory, that focuses on its potential neurobiological mechanisms. In addition to synaptic plasticity and spike frequency adaptation, our model incorporates adult neurogenesis in the dentate gyrus as well as the difference in size between the neocortex and the hippocampus, that we associate with distance-dependent synaptic plasticity. We also take into account the…

and neural nets

Fei Jiang, Hugues Berry, Marc Schoenauer +3 more

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

A possible alternative to fine topology tuning for Neural Network (NN) optimization is to use Echo State Networks (ESNs), recurrent NNs built upon a large reservoir of sparsely randomly connected neurons. The promises of ESNs have been fulfilled for supervised learning tasks, but unsupervised learning tasks, such as control problems, require more flexible optimization methods. We propose here to apply stateof-the-art methods in evolutionary continuous parameter optimization, to the evolutionary learning of ESN. First, a standard supervised learning problem is used to validate our approach and compare it to the standard quadratic one. The classical double pole balancing control problem is then used to demonstrate that unsupervised evolutionary learning of ESNs yields results that compete with the best topologylearning methods.

Author manuscript, published in "1st Workshop on SoC Architecture, Accelerators and Workloads (SAW-1) (2010)" Stream and Memory Hierarchy Design for Multi-Purpose Accelerators

Sylvain Girbal, Sami Yehia, Hugues Berry +1 more

Hardware and Architecture · · cited 0× · OpenAlex ↗ · more like this ·

Abstract—Power and programming challenges make heterogeneous multi-cores composed of cores and ASICs an attractive alternative to homogeneous multi-cores. Recently, multi-purpose loop-based generated accelerators have emerged as an especially attractive accelerator option. They have several assets: short design time (automatic generation), flexibility (multi-purpose) but low configuration and routing overhead (unlike FPGAs), computational performance (operations are directly mapped to hardware), and a focus on memory throughput by leveraging loop constructs. However, with multiple streams, the memory behavior of such accelerators can become at least as complex as that of superscalar processors, while they still need to retain the memory ordering predictability and throughput efficiency of DMAs. In this article, we show how to design a memory interface for multi-purpose accelerators…

Author manuscript, published in "IWNC'09 (2009)" Critical phenomena in a discrete stochastic reaction-diffusion medium ∗

Nazim Fatès, Hugues Berry

Computational Theory and Mathematics · · cited 0× · OpenAlex ↗ · more like this ·

reaction-diffusion media, stochastic cellular automata, phase tran-keywords: sitions We study the steady states of a reaction-diffusion medium modelled by a stochastic 2D cellular automaton. We consider the Greenberg-Hastings model where noise and topological irregularities of the grid are taken into account. The decrease of the probability of excitation changes qualitatively the behaviour of the system from an “active ” to an “extinct ” steady state. Simulations show that this change occurs near a critical threshold; it is identified as a nonequilibrium phase transition which belongs to the directed percolation universality class. We test the robustness of the phenomenon by introducing persistent defects in the topology: directed percolation behaviour is conserved. Using experimental and analytical tools, we suggest that the critical threshold varies as the inverse of the average…

Author manuscript, published in "International Conference on Parallel Problem Solving From Nature (2008)" Supervised and Evolutionary Learning of Echo State Networks

Fei Jiang, Hugues Berry, Marc Schoenauer

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

Abstract. A possible alternative to topology fine-tuning for Neural Network (NN) optimization is to use Echo State Networks (ESNs), recurrent NNs built upon a large reservoir of sparsely randomly connected neurons. The promises of ESNs have been fulfilled for supervised learning tasks, but unsupervised ones, e.g. control problems, require more flexible optimization methods – such as Evolutionary Algorithms. This paper proposes to apply CMA-ES, the state-of-the-art method in evolutionary continuous parameter optimization, to the evolutionary learning of ESN parameters. First, a standard supervised learning problem is used to validate the approach and compare it to the standard one. But the flexibility of Evolutionary optimization allows us to optimize not only the outgoing weights but also, or alternatively, other ESN parameters, sometimes leading to improved results. The classical…

Author manuscript, published in "Genetic and Evolutionary Computation Conference (2008)" Unsupervised Learning of Echo State Networks: Balancing the Double Pole

Fei Jiang, Hugues Berry, Marc Schoenauer +1 more

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

A possible alternative to fine topology tuning for Neural Network (NN) optimization is to use Echo State Networks (ESNs), recurrent NNs built upon a large reservoir of sparsely randomly connected neurons. The promises of ESNs have been fulfilled for supervised learning tasks, but unsupervised learning tasks, such as control problems, require more flexible optimization methods. We propose here to apply stateof-the-art methods in evolutionary continuous parameter optimization, to the evolutionary learning of ESN. First, a standard supervised learning problem is used to validate our approach and compare it to the standard quadratic one. The classical double pole balancing control problem is then used to demonstrate that unsupervised evolutionary learning of ESNs yields results that compete with the best topologylearning methods.

New Results - Assemblies of neuron models and simulation

Romain Brette, Bruno Cessac, Olivier Faugeras +9 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

A small Babesia gibsoni-like parasite was identified and isolated as the cause of clinical babesiosis in a dog from Oklahoma. Because this was potentially the first documented case of B. gibsoni infection in Oklahoma, further characterization was warranted, and the 18S nuclear small subunit ribosomal RNA gene was sequenced. Sequence comparison with other piroplasms from dogs showed significant nucleotide sequence differences between this isolate and both B. canis and B. gibsoni. These findings demonstrate that in domestic dogs in North America there are at least 2 "small" B. gibsoni-like organisms with distinct nucleotide sequences and that the geographic distribution of the "small" canine Babesia species may be wider than previously recognized.