arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Esteban Clua

159 papers · 2001–2026

2001: 12002: 12003: 12004: 12005: 02006: 22007: 12008: 72009: 162010: 82011: 72012: 112013: 42014: 162015: 122016: 82017: 52018: 42019: 72020: 82021: 82022: 62023: 102024: 62025: 52026: 4
2001peak 16 in 20092026

Frequent co-authors

Papers

showing 1–25 of 159 RSS

Minimizing cyber sickness in head mounted display systems: design guidelines and applications

Thiago M. Porcino, Esteban W. Clua, Cristina N. Vasconcelos +2 more

cs.HC · · cited 116× · arXiv ↗ · more like this ·

We are experiencing an upcoming trend of using head mounted display systems in games and serious games, which is likely to become an established practice in the near future. While these systems provide highly immersive experiences, many users have been reporting discomfort symptoms, such as nausea, sickness, and headaches, among others. When using VR for health applications, this is more critical, since the discomfort may interfere a lot in treatments. In this work we discuss possible causes of these issues, and present possible solutions as design guidelines that may mitigate them. In this context, we go deeper within a dynamic focus solution to reduce discomfort in immersive virtual environments, when using first-person navigation. This solution applies an heuristic model of visual attention that works in real time. This work also discusses a case study (as a first-person spatial…

Semiotic Inspection of a Game for Children with Down Syndrome

André Brandão, Daniela Trevisan, Lenisa Brandão +5 more

Human-Computer Interaction · · cited 43× · DOI ↗ · more like this ·

There are not many initiatives in the area of gamedevelopment for children with special needs, specially childrenwith Down syndrome. The major purpose of our research isto promote cognitive development of disabled children in thecontext of inclusive education. In order to do so, we addressaspects of interaction, communication and game design instimulating selected cognitive abilities. By using a Human-Computer Interaction method based on the Inspection ofEvaluation, it was possible to study and understand userinteraction with the interface and thus examine the positiveaspects as well as the communicability problems found withthe JECRIPE game - a game developed specially for childrenwith Down syndrome in pre-scholar age.

gRmobile: A Framework for Touch and Accelerometer Gesture Recognition for Mobile Games

Mark Joselli, Esteban Clua

Human-Computer Interaction · · cited 42× · DOI ↗ · more like this ·

Mobile phone games are usually design to be able to play using the traditional number pads of the handsets. This is stressfully difficult for the user interaction and consequently for the game design. Because of that, one of the most desired features of a mobile games is the usage of few buttons as possible. Nowadays, with the evolution of the mobile phones, more types of user interaction are appearing, like touch and accelerometer input. With these features, game developers have new forms of exploring the user input, being necessary to adapt or create new kinds of game play. With mobile phones equipped with 3D accelerometers, developers can use the simple motion of the device to control the game or use complex accelerated gestures. And with mobile phones equipped with the touch feature, they can use a simple touch or a complex touch gesture recognitions. For the gesture to be…

A cybersickness review: causes, strategies, and classification methods

Thiago Porcino, Daniela Trevisan, Esteban Clua

Human-Computer Interaction · Journal on Interactive Systems · · cited 35× · DOI ↗ · more like this ·

Virtual reality (VR) and head-­mounted displays are continually gaining popularity in various fields such as education, military, entertainment, and health. Although such technologies provide a high sense of immersion, they can also trigger symptoms of discomfort. This condition is called cybersickness (CS) and is quite popular in recent virtual reality research. In this work we first present a review of the literature on theories of discomfort manifestations usually attributed to virtual reality environments. Following, we reviewed existing strategies aimed at minimizing CS problems and discussed how the CS measurement has been conducted based on subjective, bio­signal (or objective), and users profile data. We also describe and discuss related works that are aiming to mitigate cybersickness problems using deep and symbolic machine learning approaches. Although some works used methods…

Automatic Dynamic Task Distribution between CPU and GPU for Real-Time Systems

Mark Joselli, Marcelo Zamith, Esteban Clua +7 more

Hardware and Architecture · · cited 34× · DOI ↗ · more like this ·

The increase of computational power of programmable GPU (Graphics Processing Unit) brings new concepts for using these devices for generic processing. Hence, with the use of the CPU and the GPU for data processing come new ideas that deals with distribution of tasks among CPU and GPU, such as automatic distribution. The importance of the automatic distribution of tasks between CPU and GPU lies in three facts. First, automatic task distribution enables the applications to use the best of both processors. Second, the developer does not have to decide which processor will do the work, allowing the automatic task distribution system to choose the best option for the moment. And third, sometimes, the application can be slowed down by other processes if the CPU or GPU is already overloaded. Based on these facts, this paper presents new schemes for efficient automatic task distribution between…

Minimizing cybersickness in head-mounted display systems: causes and strategies review

Thiago Porcino, Daniela Trevisan, Esteban Clua

Human-Computer Interaction · · cited 33× · DOI ↗ · more like this ·

Virtual reality has become popular in games and training applications because of the mass use of head-mounted displays for audiences in various segments such as education, military, entertainment, and games. Despite such devices producing a high sense of immersion and presence, they also cause discomfort to users in uncomfortable sensations called cybersickness (CS). We reviewed the literature on theories of discomfort manifestations usually attributed to virtual reality environments in this work. Additionally, we reviewed existing strategies aimed at minimizing CS problems by dividing them into 10 groups of causes: locomotion, acceleration, a field of view, depth of field, rotational movements, exposure time, static rest frames, postural instability, latency lag, and degree of control. Additionally, we discuss how the CS measurement has been conducted based on subjective, objective…

A COMPARISON BETWEEN BACKGROUND SUBTRACTION ALGORITHMS USING A CONSUMER DEPTH CAMERA

Klaus Greff, André Brandão, Stephan Krauß +2 more

Computer Vision and Pattern Recognition · · cited 28× · DOI ↗ · more like this ·

Background subtraction is an important preprocessing step in many modern Computer Vision systems. Much work has been done especially in the field of color image based foreground segmentation. But the task is not an easy one so, state of the art background subtraction algorithms are complex both in programming logic and in run time. Depth cameras might offer a compelling alternative to those approaches, because depth information seems to be better suited for the task. But this topic has not been studied much yet, even though the release of Microsoft’s Kinect has brought depth cameras to the public attention. In this paper we strive to fill this gap, by examining some well known background subtraction algorithms for the use with depth images. We propose some necessary adaptions and evaluate them on three different video sequences using ground truth data. The best choice turns out to be a…

Niche vs. breadth: Calculating expertise over time through a fine-grained analysis

José Ricardo da Silva, Esteban Clua, Leonardo Murta +1 more

Information Systems · · cited 27× · DOI ↗ · more like this ·

Identifying expertise in a project is essential for task allocation, knowledge dissemination, and risk management, among other activities. However, keeping a detailed record of such expertise at class and method levels is cumbersome due to project size, evolution, and team turnover. Existing approaches that automate this task have limitations in terms of the number and granularity of elements that can be analyzed and the analysis timeframe. In this paper, we introduce a novel technique to identify expertise for a given project, package, file, class, or method by considering not only the total number of edits that a developer has made, but also the spread of their changes in an artifact over time, and thereby the breadth of their expertise. We use Dominoes - our GPU-based approach for exploratory repository analysis - for expertise identification over any given granularity and time…

A new physics engine with automatic process distribution between CPU-GPU

Mark Joselli, Esteban Clua, Anselmo Montenegro +2 more

Hardware and Architecture · · cited 27× · DOI ↗ · more like this ·

The Graphics Processing Units or simply GPUs have evolved into extremely powerful and flexible processors. This flexibility and power have allowed new concepts in general purpose computation to emerge. This paper presents a new architecture for physics engines focusing on the simulation of rigid bodies with some of its methods implemented on the GPU. Sending physics computation to the GPU enables the unloading of the required computations from the CPU, allowing it to process other tasks and optimizations. Another important reason for using the GPU is to allow physics engines to process a higher number of bodies in the simulation. It also presents an automatic process distribution scheme between CPU and GPU. The importance of the automatic distribution for physics simulation arises from the fact that, sometimes, the simulated scene characteristics may change during the simulation and by…

An adaptative game loop architecture with automatic distribution of tasks between CPU and GPU

Mark Joselli, Marcelo Zamith, Esteban Clua +6 more

Hardware and Architecture · Computers in entertainment · · cited 25× · DOI ↗ · more like this ·

This article presents a new architecture to implement all game loop models for games and real-time applications that use the GPU as a mathematics and physics coprocessor, working in parallel processing mode with the CPU. The presented model applies automatic task distribution concepts. The architecture can apply a set of heuristics defined in Lua scripts in order to get acquainted with the best processor for handling a given task. The model applies the GPGPU (general-purpose computation on GPUs) paradigm. In this article we propose an architecture that acquires knowledge about the hardware by running tasks in each processor and, by studying their performance over time, finding the best processor for a group of tasks.

Using the gameplay and user data to predict and identify causes of cybersickness manifestation in virtual reality games

Thiago Porcino, Erick Oliveira Rodrigues, Alexandre Silva +2 more

cs.HC · · cited 22× · arXiv ↗ · more like this ·

Virtual reality (VR) is an imminent trend in games, education, entertainment, military, and health applications, as the use of head-mounted displays is accessible to everyone. While VR provides immersive experiences, it still does not offer an entirely perfect situation, mainly due to cybersickness (CS) issues. In this work, we propose a novel approach for predicting upcoming CS symptoms. Our solution is able to suggest whether the user of VR is entering into an illness situation. We adopted random forest classifiers and validated our solution using 16 different machine-learning techniques, which presented the best results. For training purposes, we built our own dataset through a CS profile questionnaire that we also propose in the present work. The questionnaire is focused on registering and identifying the user's susceptibility to CS, considering their historical conditions and also…

An architecture for game interaction using mobile

Mark Joselli, José Ricardo da Silva, Marcelo Zamith +4 more

Human-Computer Interaction · · cited 22× · DOI ↗ · more like this ·

One of the most important factors in digital games is the immersion of the players to enhance their experience in the virtual world created by games. This immersion can be achieved in different ways, such as graphics effects, realistic physics, artificial intelligence and even from user inputs. The Nintendo Wii controller, Sony Playstation Move controller and Microsoft Xbox Kinect, to name a few, present new forms of user interaction using the player's movements, which has led to new forms of gameplay, as well as great forms of feedback. In addition, mobile devices are providing new features, like accelerometers, touch screens, cameras and GPS, which allow new forms of interaction in games played on these devices. In response to this evolution, this paper presents a multi-platform architecture that supports a desktop game being controlled by mobile devices, using their built-in features…

Capturing Game Telemetry with Provenance

Troy Kohwalter, Leonardo Murta, Esteban Clua

Artificial Intelligence · · cited 20× · DOI ↗ · more like this ·

The outcome of a game session is derived from a series of events, decisions, and interactions that are made during the game. Many processes and techniques have been developed by the game industry in order to understand this outcome. A successful method is game analytics, which aims at understanding the player behavior patterns to improve game quality and enhance the player experience. However, the current methods for analytics are not sufficient to capture the underlying cause-and-effect influences that shape the outcome of a game session. These relationships allow developers and designers to better identify possible mistakes in the gameplay design or to fine-tune their games. In a recent work, Kohwalter et al. introduced a conceptual framework based on provenance to capture these relationships and manually instantiated such framework in some games. In this paper, we propose a concrete…

A game loop architecture for the GPU used as a math coprocessor in real-time applications

Marcelo P. M. Zamith, Esteban Clua, Aura Conci +5 more

Hardware and Architecture · Computers in entertainment · · cited 20× · DOI ↗ · more like this ·

This article concerns the use of a graphics processor unit (GPU) as a math co-processor in real-time applications in special games and physics simulations. To validate this approach, we present a new game loop architecture that employs GPUs for general-purpose computations (GPGPUs). A critical issue here is the process distribution between the CPU and the GPU. The architecture consists of a model for distribution, and our implementation offers many advantages in comparison to other approaches without the GPGPU stage. This architecture can be used either by a general-purpose language such as the Compute Unified Device Architecture (CUDA), or shader languages such as the High-Level Shader Language (HLSL) and the OpenGL Shading Language (GLSL). Although the architecture proposed here aims at supporting mathematics and physics on the GPU, it is possible to adapt any kind of generic…

A Simple Architecture for Digital Games on Demand Using Low Performance Resources under a Cloud Computing Paradigm

Diego Cordeiro Barboza, H. P. de Lima, Esteban Clua +1 more

Information Systems · · cited 18× · DOI ↗ · more like this ·

Cloud computing is becoming an increasingly viable source of low cost computing power for developers and users in diverse areas. Services from the creation of presentations, spreadsheets and text processing, to picture and video editing, and more recently high performance scientific computing are some examples of systems currently available in the cloud. While these applications are typically executed in the form of batch jobs, responsiveness or timeliness is not usually an issue. Executing interactive applications, i.e. applications that require real time responsiveness in the cloud, however, is more challenging and still not so common in this environment.This work proposes and evaluates the feasibility of building a simple off-the-shelf architecture for an on demand gaming service. Our proposal consists on running an appropriate remote server in the cloud so that the client need only…

Dynamic Game Difficulty Balancing in Real Time Using Evolutionary Fuzzy Cognitive Maps

Lizeth Joseline Fuentes Perez, Luciano Arnaldo Romero Calla, Luis Valente +2 more

Artificial Intelligence · · cited 16× · DOI ↗ · more like this ·

Players may cease from playing a chosen game sooner than expected for many reasons. One of the most important is related to the way game designers and developers calibrate game challenge levels. In practice, players have different skill levels and may find usual predetermined difficult levels as too easy or too hard, becoming frustrated or bored. The result may be decreased motivation to keep on playing the game, which means reduced engagement. An approach to mitigate this issue is dynamic game difficulty balancing (DGB), which is a process that adjusts gameplay parameters in real-time according to the current player skill level. In this paper we propose a real-time solution to DGB using Evolutionary Fuzzy Cognitive Maps, for dynamically balancing a game difficulty, helping to provide a well balanced level of challenge to the player. Evolutionary Fuzzy Cognitive Maps are based on…

Comparison of Reinforcement and Imitation Learning algorithms in autonomous sailboat Digital Twins

Rodrigo Picinini Méxas, Fabiana Rodrigues Leta, Esteban Clua

Artificial Intelligence · IEEE Latin America Transactions · · cited 14× · DOI ↗ · more like this ·

This project aims to study the performance of two reinforcement machine learning algorithms, namely the Proximal Policy Optimization and Soft Actor Critic, in the simulation of autonomous sailboats and their response to different wind directions while avoiding obstacles detected by image analysis and following defined target check-points. Also, the effect of the imitation learning algorithms Behavioral Cloning and Generative Adversarial Imitation Learning combined with the first mentioned algorithms is studied. The proposed scenarios consist of areas filled with random static or moving obstacles and with the presence of favorable or crosswinds. The motivation for the project comes from the lack of studies of the mentioned algorithms in autonomous sailboats, issue which the current study tries to address. The Unity platform and ML-Agents machine learning toolkit are used for development…

Player Behavior Profiling through Provenance Graphs and Representation Learning

Sidney Araujo Melo, Troy Kohwalter, Esteban Clua +2 more

Computer Vision and Pattern Recognition · · cited 14× · DOI ↗ · more like this ·

Arguably, player behavior profiling is one of the most relevant tasks of Game Analytics. However, to fulfill the needs of this task, gameplay data should be handled so that the player behavior can be profiled and even understood. Usually, gameplay data is stored as raw log-like files, from which gameplay metrics are computed. However, gameplay metrics have been commonly used as input to classify player behavior with two drawbacks: (1) gameplay metrics are mostly handcrafted and (2) they might not be adequate for fine-grain analysis as they are just computed after key events, such as stage or game completion. In this paper, we present a novel approach for player profiling based on provenance graphs, an alternative to log-like files that model causal relationships between entities in game. Our approach leverages recent advances in deep learning over graph representation of player states…

Maximizing the GPU resource usage by reordering concurrent kernels submission

Rommel Cruz, Cristiana Bentes, Bernardo Breder +4 more

Hardware and Architecture · Concurrency and Computation Practice and Experience · · cited 14× · DOI ↗ · more like this ·

Summary The increasing amount of resources available on current GPUs sparked new interest in the problem of sharing its resources by different kernels. While new generations of GPUs support concurrent kernel execution, their scheduling decisions are taken by the hardware at runtime. The hardware decisions, however, heavily depend on the order at which the kernels are submitted to execution. In this work, we propose a novel optimization approach to reorder the kernels invocation focusing on maximizing the resources utilization, improving the average turnaround time. We model the kernel assignments to the hardware resources as a series of knapsack problems and use a dynamic programming approach to solve them. We evaluate our method using kernels with different sizes and resource requirements. Our results show significant gains in the average turnaround time and system throughput compared…

Smart composition of game objects using dependency injection

Erick Baptista Passos, Jonhnny Weslley S. Sousa, Esteban Clua +2 more

Sociology and Political Science · Computers in entertainment · · cited 14× · DOI ↗ · more like this ·

Most game engines are based on inheritance of game objects and/or componentization of behaviors. While this approach enables clear visualization of the system architecture, good code reuse, and fast prototyping, it brings some issues, mostly related to the high dependency between game objects/components instances. This dependency often leads to static casts and null pointer references that are difficult to debug. In this article we propose the use of the dependency injection design pattern to safely initialize game objects and lessen the programmer's role in handling these issues both during the prototyping and production phases. Since these dependencies are attributes of game objects and the injection occurs only at the initialization pass, there is no performance penalty at the game loop.

Real Time Pathfinding with Genetic Algorithm

Alex Fernandes da Veiga Machado, Ulysses O. Santos, H Vale +4 more

Computer Vision and Pattern Recognition · · cited 12× · DOI ↗ · more like this ·

This paper presents a method to optimize the process of finding paths using a model based on genetic algorithms and A* for real time systems, such as video games, virtual reality environments. The proposed solution uses obstacle pattern detection based on online training system that is generally used in systems with real time requirements and in dynamic environments. The architecture, named Real Time Path finding with Genetic Algorithm (RTP-GA), uses a Genetic Algorithm in order to create an agent adapted to the environment that is able to optimize the search for paths even in the presence of obstacles. In specific cases, the RTP-GA architecture presents a complexity that is better than A* algorithm.

Parallel processing between GPU and CPU: Concepts in a game architecture

Marcelo Zamith, Esteban Clua, Aura Conci +3 more

Hardware and Architecture · · cited 12× · DOI ↗ · more like this ·

This paper presents a new game loop architecture concept that employs graphics processors (GPUs) for general- purpose computation (GPGPU). A critical issue in this field is the concept of process distribution between CPU and GPU. The presented architecture consists in a very efficient model for distribution, and it was mainly designed to support math and physics on the GPU, but any kind of generic computation can be easily adapted.

A guideline proposal for minimizing cybersickness in VR-based serious games and applications

Thiago Porcino, Derek Reilly, Esteban Clua +1 more

cs.HC · · cited 11× · arXiv ↗ · more like this ·

Head-mounted displays (HMDs) are popular immersive tools in general, not limited to entertainment but also for education, military, and serious games for health. While these displays have strong popularity, they still have user experience issues, triggering possible symptoms of discomfort to users. This condition is known as cybersickness (CS) and is one of the most popular research topics tied to virtual reality (VR) issues. We first present the main strategies focused on minimizing cybersickness problems in virtual reality. Following this, we propose a guideline framework based on CS causes such as locomotion, acceleration, the field of view, depth of field, degree of freedom, exposition use time, latency-lag, static rest frame, and camera rotation. Additionally, serious games applications and broader categories of games can also adopt it. Additionally, we categorized the imminent…

Parallel Image Segmentation Using Reduction-Sweeps on Multicore Processors and GPUs

Renato Farias, Ricardo Farias, Ricardo Marroquim +1 more

Computer Vision and Pattern Recognition · · cited 11× · DOI ↗ · more like this ·

In this paper we introduce the Reduction Sweep algorithm, a novel graph-based image segmentation algorithm that is designed for easy parallelization. It is based on a clustering approach focusing on local image characteristics. Each pixel is compared with its neighbors in an implicitly independent manner, and those deemed sufficiently similar according to a color criterion are joined. We achieve fast execution times while still maintaining the visual quality of the results. The algorithm is presented in four different implementations: sequential CPU, parallel CPU, GPU, and hybrid CPU-GPU. We compare the execution times of the four versions with each other and with other closely related image segmentation algorithms.

A Flocking Boids Simulation and Optimization Structure for Mobile Multicore Architectures

Mark Joselli, Erick Baptista Passos, José Ricardo Silva +3 more

Computer Networks and Communications · · cited 11× · OpenAlex ↗ · more like this ·

During the past few years, mobile phones and other mobile devices have gone from simple phone and messaging devices to high end smartphones with serious computing capabilities. Nowadays, most of these devices are equipped with multicore processors like dual- core CPUs and GPUs, which are designed for both low power consumption and high performance computation. Moreover, most devices still lack libraries for generic multicore computing usage, such as CUDA or OpenCL. However, computing certain specific kind of tasks in these mobile GPUs, and other available multicores processors, may be faster and much more efficient than their single threaded CPU counterparts. In this work, we present a novel approach for flocking boids simulation based on the Android renderscript API. We describe and implement a custom neighborhood grid, and present results with a simple game based on this platform.