arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Frederic Font

39 papers · 2008–2026

2008: 12009: 02010: 12011: 22012: 32013: 22014: 12015: 12016: 22017: 12018: 22019: 42020: 32021: 22022: 02023: 12024: 42025: 52026: 4
2008peak 5 in 20252026

Frequent co-authors

Papers

showing 1–25 of 39 RSS

FSD50K: An Open Dataset of Human-Labeled Sound Events

Eduardo Fonseca, Xavier Favory, Jordi Pons +2 more

cs.SD · · cited 795× · arXiv ↗ · more like this ·

Most existing datasets for sound event recognition (SER) are relatively small and/or domain-specific, with the exception of AudioSet, based on over 2M tracks from YouTube videos and encompassing over 500 sound classes. However, AudioSet is not an open dataset as its official release consists of pre-computed audio features. Downloading the original audio tracks can be problematic due to YouTube videos gradually disappearing and usage rights issues. To provide an alternative benchmark dataset and thus foster SER research, we introduce FSD50K, an open dataset containing over 51k audio clips totalling over 100h of audio manually labeled using 200 classes drawn from the AudioSet Ontology. The audio clips are licensed under Creative Commons licenses, making the dataset freely distributable (including waveforms). We provide a detailed description of the FSD50K creation process, tailored to the…

Freesound technical demo

Frederic Font, Gerard Roma, Xavier Serra

Signal Processing · Repositori digital de la UPF (Universitat Pompeu Fabra) · · cited 301× · DOI ↗ · more like this ·

Freesound is an online collaborative sound database where people with diverse interests share recorded sound samples under Creative Commons licenses. It was started in 2005 and it is being maintained to support diverse research projects and as a service to the overall research and artistic community. In this demo we want to introduce Freesound to the multimedia community and show its potential as a research resource. We begin by describing some general aspects of Freesound, its architecture and functionalities, and then explain potential usages that this framework has for research applications.

General-purpose Tagging of Freesound Audio with AudioSet Labels: Task Description, Dataset, and Baseline

Eduardo Fonseca, Manoj Plakal, Frederic Font +4 more

cs.SD · · cited 174× · arXiv ↗ · more like this ·

This paper describes Task 2 of the DCASE 2018 Challenge, titled "General-purpose audio tagging of Freesound content with AudioSet labels". This task was hosted on the Kaggle platform as "Freesound General-Purpose Audio Tagging Challenge". The goal of the task is to build an audio tagging system that can recognize the category of an audio clip from a subset of 41 diverse categories drawn from the AudioSet Ontology. We present the task, the dataset prepared for the competition, and a baseline system.

Learning Sound Event Classifiers from Web Audio with Noisy Labels

Eduardo Fonseca, Manoj Plakal, Daniel P. W. Ellis +3 more

cs.SD · · cited 129× · arXiv ↗ · more like this ·

As sound event classification moves towards larger datasets, issues of label noise become inevitable. Web sites can supply large volumes of user-contributed audio and metadata, but inferring labels from this metadata introduces errors due to unreliable inputs, and limitations in the mapping. There is, however, little research into the impact of these errors. To foster the investigation of label noise in sound event classification we present FSDnoisy18k, a dataset containing 42.5 hours of audio across 20 sound classes, including a small amount of manually-labeled data and a larger quantity of real-world noisy data. We characterize the label noise empirically, and provide a CNN baseline system. Experiments suggest that training with large amounts of noisy data can outperform training with smaller amounts of carefully-labeled data. We also show that noise-robust loss functions can be…

Audio tagging with noisy labels and minimal supervision

Eduardo Fonseca, Manoj Plakal, Frederic Font +2 more

cs.SD · · cited 104× · arXiv ↗ · more like this ·

This paper introduces Task 2 of the DCASE2019 Challenge, titled "Audio tagging with noisy labels and minimal supervision". This task was hosted on the Kaggle platform as "Freesound Audio Tagging 2019". The task evaluates systems for multi-label audio tagging using a large set of noisy-labeled data, and a much smaller set of manually-labeled data, under a large vocabulary setting of 80 everyday sound classes. In addition, the proposed dataset poses an acoustic mismatch problem between the noisy train set and the test set due to the fact that they come from different web audio sources. This can correspond to a realistic scenario given by the difficulty in gathering large amounts of manually labeled data. We present the task setup, the FSDKaggle2019 dataset prepared for this scientific evaluation, and a baseline system consisting of a convolutional neural network. All these resources are…

The Internet of Sounds: Convergent Trends, Insights, and Future Directions

Luca Turchet, Mathieu Lagrange, Cristina Rottondi +6 more

Signal Processing · IEEE Internet of Things Journal · · cited 82× · DOI ↗ · more like this ·

Current sound-based practices and systems developed in both academia and industry point to convergent research trends that bring together the field of Sound and Music Computing with that of the Internet of Things. This paper proposes a vision for the emerging field of the Internet of Sounds (IoS), which stems from such disciplines. The IoS relates to the network of Sound Things, i.e., devices capable of sensing, acquiring, processing, actuating, and exchanging data serving the purpose of communicating sound-related information. In the IoS paradigm, which merges under a unique umbrella the emerging fields of the Internet of Musical Things and the Internet of Audio Things, heterogeneous devices dedicated to musical and non-musical tasks can interact and cooperate with one another and with other things connected to the Internet to facilitate sound-based services and applications that are…

An Interpretable Deep Learning Model for Automatic Sound Classification

Pablo Zinemanas, Martín Rocamora, Marius Miron +2 more

Signal Processing · Electronics · · cited 62× · DOI ↗ · more like this ·

Deep learning models have improved cutting-edge technologies in many research areas, but their black-box structure makes it difficult to understand their inner workings and the rationale behind their predictions. This may lead to unintended effects, such as being susceptible to adversarial attacks or the reinforcement of biases. There is still a lack of research in the audio domain, despite the increasing interest in developing deep learning models that provide explanations of their decisions. To reduce this gap, we propose a novel interpretable deep learning model for automatic sound classification, which explains its predictions based on the similarity of the input to a set of learned prototypes in a latent space. We leverage domain knowledge by designing a frequency-dependent similarity measure and by considering different time-frequency resolutions in the feature space. The proposed…

Freesound 2: An Improved Platform for Sharing Audio Clips

Vincent Akkermans, Frederic Font Corbera, Jordi Funollet +4 more

Signal Processing · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · · cited 41× · OpenAlex ↗ · more like this ·

Freesound.org is an online collaborative sound database where people from different disciplines share recorded sound clips under Creative Commons licenses. It was started in 2005 and it is being further developed by the Music Technology Group (MTG) of the Universitat Pompeu Fabra. Freesound’s initial goal was to give support to sound researchers, who often have trouble finding large royalty-free sound databases to test their algorithms, and to sound artists, who use pre-recorded sounds in their pieces. After six years since its inception, Freesound has become one of the most popular sites for sharing sound snippets. It serves around 30,000 unique visits per day and has more than two million registered users accessing the more than 120,000 uploaded sounds. Perhaps more importantly, there is a highly engaged community of users continuously contributing to the site, not only uploading…

Audio Commons: bringing Creative Commons audio content to the creative industries

Frederic Font, Tim Brookes, György Fazekas +7 more

Signal Processing · Surrey Research Insight Open Access (The University of Surrey) · · cited 19× · OpenAlex ↗ · more like this ·

Significant amounts of user-generated audio content, such as sound effects, musical samples and music pieces, are uploaded to online repositories and made available under open licenses. Moreover, a constantly increasing amount of multimedia content, originally released with traditional licenses, is becoming public domain as its license expires. Nevertheless, the creative industries are not yet using much of all this content in their media productions. There is still a lack of familiarity and understanding of the legal context of all this open content, but there are also problems related with its accessibility. A big percentage of this content remains unreachable either because it is not published online or because it is not well organised and annotated. In this paper we present the Audio Commons Initiative, which is aimed at promoting the use of open audio content and at developing…

Folksonomy-Based Tag Recommendation for Collaborative Tagging Systems

Frederic Font, Joan Serrà, Xavier Serra

Computer Vision and Pattern Recognition · International Journal on Semantic Web and Information Systems · · cited 16× · DOI ↗ · more like this ·

Collaborative tagging has emerged as a common solution for labelling and organising online digital content. However, collaborative tagging systems typically suffer from a number of issues such as tag scarcity or ambiguous labelling. As a result, the organisation and browsing of tagged content is far from being optimal. In this work the authors present a general scheme for building a folksonomy-based tag recommendation system to help users tagging online content resources. Based on this general scheme, the authorse describe eight tag recommendation methods and extensively evaluate them with data coming from two real-world large-scale datasets of tagged images and sound clips. Their results show that the proposed methods can effectively recommend relevant tags, given a set of input tags and tag co-occurrence information. Moreover, the authors show how novel strategies for selecting the…

Analysis of the Impact of a Tag Recommendation System in a Real-World Folksonomy

Frederic Font, Joan Serrà, Xavier Serra

Signal Processing · ACM Transactions on Intelligent Systems and Technology · · cited 15× · DOI ↗ · more like this ·

Collaborative tagging systems have emerged as a successful solution for annotating contributed resources to online sharing platforms, facilitating searching, browsing, and organizing their contents. To aid users in the annotation process, several tag recommendation methods have been proposed. It has been repeatedly hypothesized that these methods should contribute to improving annotation quality and reducing the cost of the annotation process. It has been also hypothesized that these methods should contribute to the consolidation of the vocabulary of collaborative tagging systems. However, to date, no empirical and quantitative result supports these hypotheses. In this work, we deeply analyze the impact of a tag recommendation system in the folksonomy of Freesound, a real-world and large-scale online sound sharing platform. Our results suggest that tag recommendation effectively…

Small world networks and creativity in audio clip sharing

Gerard Roma, Perfecto Herrera, Massimiliano Zanin +3 more

Communication · International Journal of Social Network Mining · · cited 9× · DOI ↗ · more like this ·

Sharing communities are changing the way audio clips are obtained in several areas, ranging from music to game design. The motivations for people to record and upload sounds to these sites are likely to be related to social factors. In this paper, we describe several networks that can be extracted from user activities in these systems. We propose the notion of creativity as an objective for this kind of community, and how some indicators of creativity can be extracted. We investigate the relationship between the network properties and the creative outcome indicators through an empirical analysis of data from Freesound.org, a widely used website for sharing audio clips.

Characterization of the Freesound online community

Frederic Font, Gerard Roma, Perfecto Herrera +1 more

Communication · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · · cited 8× · DOI ↗ · more like this ·

There are many online communities with member-generated and openly available multimedia content. Their success depends on having active contributing users and on producing useful content. With this criterion, the community of sound practitioners that has emerged in Freesound is a successful case of interest to be studied. But to understand it and support it further we need an appropriate analysis methodology. In this paper we propose some qualitative and quantitative approaches for its characterization, focusing on the analysis of organizational structure, shared goals, user interactions and vocabulary sharing. We think that the proposed approach can be applied to other online communities with similar characteristics.

SOURCE: a Freesound Community Music Sampler

Frederic Font

Computer Vision and Pattern Recognition · Repositori digital de la UPF (Universitat Pompeu Fabra) · · cited 7× · DOI ↗ · more like this ·

SOURCE is an open-source hardware music sampler powered by Freesound’s collection of near 500k Creative Commons sounds contributed by a community of thousands of people around the world. SOURCE provides a hardware interface with Freesound and implements different methods to search and load sounds into the sampler. We see SOURCE as a proof of concept device that can be used as and extendable base system on top of which further research on the interaction between hardware devices and online large sound collections can be carried out. This paper describes the architecture of SOURCE and the different ways in which it interacts with Freesound. Even though we have not carried out a formal evaluation of SOURCE our informal tests show that SOURCE can be successfully integrated into a live music performance setup, and influence the creative process in interesting ways by being able to quickly…

Freesound explorer: make music while discovering freesound!

Giuseppe Bandiera, Frederic Font Corbera

Computer Vision and Pattern Recognition · Repositori digital de la UPF (Universitat Pompeu Fabra) · · cited 7× · OpenAlex ↗ · more like this ·

Freesound Explorer is a visual interface for exploring Freesound content in a two-dimensional space and creating music by linking content in that space.Freesound Explorer is implemented as a web application which takes advantage of modern web technologies including the Web Audio API and the Web MIDI API.This extended abstract describes Freesound Explorer's features and provides some technical details about its implementation.

Leveraging Online Audio Commons Content for Media Production

Anna Xambó, Frederic Font, György Fazekas +1 more

Computer Vision and Pattern Recognition · DMU Open Research Archive (De Montfort University) · · cited 5× · DOI ↗ · more like this ·

With the advent of online audio resources and web technologies, digital tools for sound designers and music producers are changing. The Internet provides access to hundreds of thousands of digital audio files, from human- and nature-related environmental sounds, instrument samples and sound effects, to produced songs ready to use in media production. In relation to the vast amount of creative content available online, an emerging community has forged a culture of sharing. Creative Commons (CC) appears as a legal framework to support such initiative enabling the reuse and remix of creative artifacts. Through exploring five use cases, we discuss key concepts and challenges related to the use of Audio Commons content for linear media production.

ANALYSIS OF THE FOLKSONOMY OF FREESOUND

Frederic Font, Xavier Serra

Signal Processing · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · · cited 5× · OpenAlex ↗ · more like this ·

User generated content shared in online communities is often described using collaborative tagging systems where users assign labels to content resources. As a result, a folksonomy emerges that relates a number of tags with the resources they label and the users that have used them. In this paper we analyze the folksonomy of Freesound, an online audio clip sharing site which contains more than two million users and 150,000 user-contributed sound samplescovering a wide variety of sounds. By following methodologies taken from similar studies, we compute some metrics that characterize the folksonomy both at the globallevel and at the tag level. In this manner, we are able to betterunderstand the behavior of the folksonomy as a whole, and also obtain some indicators that can be used as metadata for describing tags themselves. We expect that such a methodology for characterizing folksonomies…

Extending tagging ontologies with domain specific knowledge

Frederic Font, Sergio Oramas, György Fazekas +1 more

Artificial Intelligence · International Semantic Web Conference · · cited 4× · OpenAlex ↗ · more like this ·

Abstract. Currently proposed tagging ontologies are mostly focused on the definition of a common schema for representing the agents involved in a tagging process. In this paper we describe preliminary research around the idea of extending tagging ontologies by incorporating some domain specific class definitions and relations. We illustrate our idea with a par-ticular use case where a tag recommendation system is driven by such an ontology. Besides our use case, we believe that such extended tagging ontologies can bring more meaningful structure into folksonomies and improve browsing and organisation functionalities of online platforms relying on tagging systems.

Search Result Clustering in Collaborative Sound Collections

Xavier Favory, Frederic Font, Xavier Serra

cs.IR · · cited 3× · arXiv ↗ · more like this ·

The large size of nowadays' online multimedia databases makes retrieving their content a difficult and time-consuming task. Users of online sound collections typically submit search queries that express a broad intent, often making the system return large and unmanageable result sets. Search Result Clustering is a technique that organises search-result content into coherent groups, which allows users to identify useful subsets in their results. Obtaining coherent and distinctive clusters that can be explored with a suitable interface is crucial for making this technique a useful complement of traditional search engines. In our work, we propose a graph-based approach using audio features for clustering diverse sound collections obtained when querying large online databases. We propose an approach to assess the performance of different features at scale, by taking advantage of the…

Facilitating the Manual Annotation of Sounds When Using Large Taxonomies

Xavier Favory, Eduardo Fonseca, Frederic Font +1 more

cs.IR · · cited 3× · arXiv ↗ · more like this ·

Properly annotated multimedia content is crucial for supporting advances in many Information Retrieval applications. It enables, for instance, the development of automatic tools for the annotation of large and diverse multimedia collections. In the context of everyday sounds and online collections, the content to describe is very diverse and involves many different types of concepts, often organised in large hierarchical structures called taxonomies. This makes the task of manually annotating content arduous. In this paper, we present our user-centered development of two tools for the manual annotation of audio content from a wide range of types. We conducted a preliminary evaluation of functional prototypes involving real users. The goal is to evaluate them in a real context, engage in discussions with users, and inspire new ideas. A qualitative analysis was carried out including…

DESIGN AND EVALUATION OF A VISUALIZATION INTERFACE FOR QUERYING LARGE UNSTRUCTURED SOUND DATABASES

Frederic Font Corbera

Signal Processing · · cited 3× · OpenAlex ↗ · more like this ·

Search is an underestimated problem that plays a big role in any application dealing with large databases. The extensive and heterogeneous our data is, the harder is to find exactly what we are looking for. This idea resembles the data availability paradox stated by Woods [45]: more and data is available, but our ability to interpret what is available has not increased. Then the question arises: is it really useful to collect a big dataset even if we do not have the ability to successfully navigate among it? According to Morville and Callender [27], search is a grand challenge that can be succeeded with courage and vision. A good searching tool completely improves the exploitation we can do of our information resources. As a consequence, commonly used search methods must evolve. Search goal is than finding, search should become a conversation process where answers change the questions.…

Evaluation of Deep Audio Representations for Semantic Sound Similarity

R. Oguz Araz, Dmitry Bogdanov, Pablo Alonso-Jiménez +1 more

Signal Processing · Repositori digital de la UPF (Universitat Pompeu Fabra) · · cited 2× · DOI ↗ · more like this ·

Navigating large audio collections presents a significant challenge due to the intricate nature of sound properties and the varied needs of users. To enhance user experience, audio-sharing platforms offer a sound similarity function, which leverages vector-based representations of audio clips to facilitate the retrieval of sounds. This study evaluates the retrieval performances of one manually engineered audio representation and thirteen deep audio embeddings in the semantic sound similarity task. By employing a diverse range of models, our research investigates the effects of utilizing different input modalities and training objectives. In the process, we explore various design choices for integrating embeddings into sound similarity systems. Our evaluation is based on objective ranked performance metrics that incorporate sound classes and sound families, complemented by preliminary…

The Freesound Loop Dataset and Annotation Tool

Antonio Ramires, Frederic Font, Dmitry Bogdanov +7 more

eess.AS · · cited 2× · arXiv ↗ · more like this ·

Music loops are essential ingredients in electronic music production, and there is a high demand for pre-recorded loops in a variety of styles. Several commercial and community databases have been created to meet this demand, but most are not suitable for research due to their strict licensing. We present the Freesound Loop Dataset (FSLD), a new large-scale dataset of music loops annotated by experts. The loops originate from Freesound, a community database of audio recordings released under Creative Commons licenses, so the audio in our dataset may be redistributed. The annotations include instrument, tempo, meter, key and genre tags. We describe the methodology used to assemble and annotate the data, and report on the distribution of tags in the data and inter-annotator agreement. We also present to the community an online loop annotator tool that we developed. To illustrate the…

Model-agnostic Approaches to Handling Noisy Labels When Training Sound Event Classifiers

Eduardo Fonseca, Frederic Font, Xavier Serra

cs.SD · · cited 2× · arXiv ↗ · more like this ·

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from online repositories, where labels are inferred through automated heuristics applied to the audio content or metadata. While learning from noisy labels has been an active area of research in computer vision, it has received little attention in sound event classification. Most recent computer vision approaches against label noise are relatively complex, requiring complex networks or extra data resources. In this work, we evaluate simple and efficient model-agnostic approaches to handling noisy labels when training sound event classifiers, namely label smoothing regularization, mixup and noise-robust loss functions. The main advantage of these methods is that…

Application-Oriented Distributed Sensor Network

P. Mari, Frederic Font, Miguel Dom +1 more

Computer Networks and Communications · · cited 2× · DOI ↗ · more like this ·

Biological research in agriculture needs a lot of specialized electronic sensors in order to fulfill different goals, like as: climate monitoring, soil and fruit assessment, control of insects and diseases, chemical pollutants, identification and control of weeds, crop tracking, and so on. That research must be supported by consistent biological models able to simulate diverse environmental conditions, in order to predict the right human actions before risky biological damage could be irreversible. In this paper is described an experimental distributed network based on climatic an biological wireless sensors, for providing real measurements in order to validate different biological models used for viticulture applications. Firstly is introduced the experimental network for field automatic data acquisition, as a system based in a distributed process. Following, the design of the wireless…