arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Rodolfo Valiente

19 papers · 2017–2024

2017: 32018: 02019: 22020: 22021: 52022: 42023: 22024: 1
2017peak 5 in 20212024

Frequent co-authors

Papers

showing 1–19 of 19 RSS

Robust Perception and Visual Understanding of Traffic Signs in the Wild

Rodolfo Valiente, Darren Chan, Alan R. Perry +4 more

Computer Vision and Pattern Recognition · IEEE Open Journal of Intelligent Transportation Systems · · cited 16× · DOI ↗ · more like this ·

As autonomous vehicles (AVs) become increasingly prevalent on the roads, their ability to accurately interpret and understand traffic signs is crucial for ensuring reliable navigation. While most previous research has focused on addressing specific aspects of the problem, such as sign detection and text extraction, the development of a comprehensive visual processing method for traffic sign understanding remains largely unexplored. In this work, we propose a robust and scalable traffic sign perception system that seamlessly integrates the essential sensor signal processing components, including sign detection, text extraction, and text recognition. Furthermore, we propose a novel method to estimate the sign relevance with respect to the ego vehicle, by computing the 3D orientation of the sign from the 2D image. This critical step enables AVs to prioritize the detected signs based on…

Automatic Text Recognition in Web Images

Rodolfo Valiente, José Gutierrez, Marcelo T. Sadaike +1 more

Computer Vision and Pattern Recognition · · cited 5× · DOI ↗ · more like this ·

Web images play an important role in delivering multimedia content on the Web. The text embedded in web images carry semantic information related to layout and content of the pages. Statistics show that there is a significant need to detect and recognize text from web images. This paper presents an architecture that efficiently integrates localization, extraction and recognition algorithms applied to text recognition in web images. In the recognition step is proposed a procedure based on super-resolution and an iterative method for improving the performance. The approach is implemented and evaluated using Matlab and cloud computing, making the system flexible, scalable and robust in detecting texts from complex web images with different orientations, dimensions and colors. Competitive results are presented, both in precision and recognition rate, when compared with other systems in the…

Representing Realistic Human Driver Behaviors using a Finite Size Gaussian Process Kernel Bank

Hossein Nourkhiz Mahjoub, Arash Raftari, Rodolfo Valiente +2 more

eess.SP · · cited 1× · arXiv ↗ · more like this ·

The performance of cooperative vehicular applications is tightly dependent on the reliability of the underneath Vehicle-to-Everything (V2X) communication technology. V2X standards, such as Dedicated Short-Range Communications (DSRC) and Cellular-V2X (C-V2X), which are passing their research phase before being mandated in the US, are supposed to serve as reliable circulatory systems for the time-critical information in vehicular networks; however, they are still heavily suffering from scalability issues in real traffic scenarios. The technology-agnostic notion of Model-Based Communications (MBC) has been proposed in our previous works as a promising paradigm to address the scalability issue and its performance, while acquiring different modeling strategies, has been vastly studied. In this work, the modeling capabilities of a powerful non-parametric Bayesian inference scheme, i.e.…

Mechanism for Structuring the Data from a Generic Identity Document Image using Semantic Analysis

José Gutierrez, Rodolfo Valiente, Marcelo T. Sadaike +3 more

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

Nowadays, the enormous variety of identity documents that exist makes it difficult to standardize a system capable of extracting all the information of interest presented by them. Therefore, systems that use templates to classify information based on their positions are limited by the number of templates they could recognize. Thus, in this paper, a novel mechanism intended to automatically classify the major information of interest exposed by generic identity documents is presented. The proposal is created to be easily adaptable to any system capable of detecting and extracting text information from an identity document image. To assign meaning to the text extracted from the identity document, the proposal is based on a novel mechanism to structuring the data using semantic analysis. The mechanism consists of two main steps, first, all the text data are classified as sentences or near…

Competence-Aware AI Agents with Metacognition for Unknown Situations and Environments (MUSE)

Rodolfo Valiente, Praveen K. Pilly

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Metacognition, defined as the awareness and regulation of one's cognitive processes, is central to human adaptability in unknown situations. In contrast, current autonomous agents often struggle in novel environments due to their limited capacity for adaptation. We hypothesize that metacognition is a critical missing ingredient in autonomous agents for the cognitive flexibility needed to tackle unfamiliar challenges. Given the broad scope of metacognitive abilities, we focus on competence awareness and strategy selection. To this end, we propose the Metacognition for Unknown Situations and Environments (MUSE) framework to integrate metacognitive processes of self-assessment and self-regulation into autonomous agents. We present two implementations of MUSE: one based on world modeling and another leveraging large language models (LLMs). Our system continually learns to assess its…

Improvement of Response Time by Running Games on a Cloud Gaming System with Layer Vatcher and Movement Prediction

Marcelo T. Sadaike, José Gutierrez, Rodolfo Valiente +1 more

Computer Vision and Pattern Recognition · · cited 0× · DOI ↗ · more like this ·

With the growing video games industry, new markets and technologies are emerging. Electronic games of the new generation are increasingly requiring more processing and powerful video cards. The solution that is gaining more prominence is Cloud Gaming, which the player performs a command, the information is sent and processed remotely on a cloud, then the images return as a video stream back to the player using the Internet. To improve the Quality of Experience (QoE), it is proposed a model that reduces the response time between the player command and the stream of the resulting game scenes through a framework called Cloud Manager. The game must be encoded in different layers so that the Cloud Manager can use layer caching techniques, in the background, and future state prediction using a prediction matrix, in the character layer, in order to reduce the network bandwidth usage, bitrate…

Optimized Control-Centric Communication in Cooperative Adaptive Cruise Control Systems

Mahdi Razzaghpour, Shahriar Shahram, Rodolfo Valiente +2 more

cs.MA · · arXiv ↗ · more like this ·

In this study, we explore an innovative approach to enhance cooperative driving in vehicle platooning systems through the use of vehicle-to-everything (V2X) communication technologies. As Connected and Autonomous Vehicles (CAVs) integrate into increasingly dense traffic networks, the challenge of efficiently managing communication resources becomes crucial. Our focus is on optimizing communication strategies to support the growing network of interconnected vehicles without compromising traffic safety and efficiency. We introduce a novel control-aware communication framework designed to reduce communication overhead while maintaining essential performance standards in vehicle platoons. This method pivots from traditional periodic communication to more adaptable aperiodic or event-triggered schemes. Additionally, we integrate Model-Based Communication (MBC) to enhance vehicle perception…

Context-Aware Target Classification with Hybrid Gaussian Process prediction for Cooperative Vehicle Safety systems

Rodolfo Valiente, Arash Raftari, Hossein Nourkhiz Mahjoub +3 more

cs.RO · · arXiv ↗ · more like this ·

Vehicle-to-Everything (V2X) communication has been proposed as a potential solution to improve the robustness and safety of autonomous vehicles by improving coordination and removing the barrier of non-line-of-sight sensing. Cooperative Vehicle Safety (CVS) applications are tightly dependent on the reliability of the underneath data system, which can suffer from loss of information due to the inherent issues of their different components, such as sensors failures or the poor performance of V2X technologies under dense communication channel load. Particularly, information loss affects the target classification module and, subsequently, the safety application performance. To enable reliable and robust CVS systems that mitigate the effect of information loss, we proposed a Context-Aware Target Classification (CA-TC) module coupled with a hybrid learning-based predictive modeling technique…

Learning-based social coordination to improve safety and robustness of cooperative autonomous vehicles in mixed traffic

Rodolfo Valiente, Behrad Toghi, Mahdi Razzaghpour +2 more

cs.RO · · arXiv ↗ · more like this ·

It is expected that autonomous vehicles(AVs) and heterogeneous human-driven vehicles(HVs) will coexist on the same road. The safety and reliability of AVs will depend on their social awareness and their ability to engage in complex social interactions in a socially accepted manner. However, AVs are still inefficient in terms of cooperating with HVs and struggle to understand and adapt to human behavior, which is particularly challenging in mixed autonomy. In a road shared by AVs and HVs, the social preferences or individual traits of HVs are unknown to the AVs and different from AVs, which are expected to follow a policy, HVs are particularly difficult to forecast since they do not necessarily follow a stationary policy. To address these challenges, we frame the mixed-autonomy problem as a multi-agent reinforcement learning (MARL) problem and propose an approach that allows AVs to learn…

Prediction-aware and Reinforcement Learning based Altruistic Cooperative Driving

Rodolfo Valiente, Mahdi Razzaghpour, Behrad Toghi +2 more

cs.RO · · arXiv ↗ · more like this ·

Autonomous vehicle (AV) navigation in the presence of Human-driven vehicles (HVs) is challenging, as HVs continuously update their policies in response to AVs. In order to navigate safely in the presence of complex AV-HV social interactions, the AVs must learn to predict these changes. Humans are capable of navigating such challenging social interaction settings because of their intrinsic knowledge about other agents behaviors and use that to forecast what might happen in the future. Inspired by humans, we provide our AVs the capability of anticipating future states and leveraging prediction in a cooperative reinforcement learning (RL) decision-making framework, to improve safety and robustness. In this paper, we propose an integration of two essential and earlier-presented components of AVs: social navigation and prediction. We formulate the AV decision-making process as a RL problem…

Robustness and Adaptability of Reinforcement Learning based Cooperative Autonomous Driving in Mixed-autonomy Traffic

Rodolfo Valiente, Behrad Toghi, Ramtin Pedarsani +1 more

cs.RO · · arXiv ↗ · more like this ·

Building autonomous vehicles (AVs) is a complex problem, but enabling them to operate in the real world where they will be surrounded by human-driven vehicles (HVs) is extremely challenging. Prior works have shown the possibilities of creating inter-agent cooperation between a group of AVs that follow a social utility. Such altruistic AVs can form alliances and affect the behavior of HVs to achieve socially desirable outcomes. We identify two major challenges in the co-existence of AVs and HVs. First, social preferences and individual traits of a given human driver, e.g., selflessness and aggressiveness are unknown to an AV, and it is almost impossible to infer them in real-time during a short AV-HV interaction. Second, contrary to AVs that are expected to follow a policy, HVs do not necessarily follow a stationary policy and therefore are extremely hard to predict. To alleviate the…

Towards Learning Generalizable Driving Policies from Restricted Latent Representations

Behrad Toghi, Rodolfo Valiente, Ramtin Pedarsani +1 more

cs.RO · · arXiv ↗ · more like this ·

Training intelligent agents that can drive autonomously in various urban and highway scenarios has been a hot topic in the robotics society within the last decades. However, the diversity of driving environments in terms of road topology and positioning of the neighboring vehicles makes this problem very challenging. It goes without saying that although scenario-specific driving policies for autonomous driving are promising and can improve transportation safety and efficiency, they are clearly not a universal scalable solution. Instead, we seek decision-making schemes and driving policies that can generalize to novel and unseen environments. In this work, we capitalize on the key idea that human drivers learn abstract representations of their surroundings that are fairly similar among various driving scenarios and environments. Through these representations, human drivers are able to…

Altruistic Maneuver Planning for Cooperative Autonomous Vehicles Using Multi-agent Advantage Actor-Critic

Behrad Toghi, Rodolfo Valiente, Dorsa Sadigh +2 more

cs.RO · · arXiv ↗ · more like this ·

With the adoption of autonomous vehicles on our roads, we will witness a mixed-autonomy environment where autonomous and human-driven vehicles must learn to co-exist by sharing the same road infrastructure. To attain socially-desirable behaviors, autonomous vehicles must be instructed to consider the utility of other vehicles around them in their decision-making process. Particularly, we study the maneuver planning problem for autonomous vehicles and investigate how a decentralized reward structure can induce altruism in their behavior and incentivize them to account for the interest of other autonomous and human-driven vehicles. This is a challenging problem due to the ambiguity of a human driver's willingness to cooperate with an autonomous vehicle. Thus, in contrast with the existing works which rely on behavior models of human drivers, we take an end-to-end approach and let the…

Cooperative Autonomous Vehicles that Sympathize with Human Drivers

Behrad Toghi, Rodolfo Valiente, Dorsa Sadigh +2 more

cs.RO · · arXiv ↗ · more like this ·

Widespread adoption of autonomous vehicles will not become a reality until solutions are developed that enable these intelligent agents to co-exist with humans. This includes safely and efficiently interacting with human-driven vehicles, especially in both conflictive and competitive scenarios. We build up on the prior work on socially-aware navigation and borrow the concept of social value orientation from psychology -- that formalizes how much importance a person allocates to the welfare of others -- in order to induce altruistic behavior in autonomous driving. In contrast with existing works that explicitly model the behavior of human drivers and rely on their expected response to create opportunities for cooperation, our Sympathetic Cooperative Driving (SymCoDrive) paradigm trains altruistic agents that realize safe and smooth traffic flow in competitive driving scenarios only from…

Social Coordination and Altruism in Autonomous Driving

Behrad Toghi, Rodolfo Valiente, Dorsa Sadigh +2 more

cs.RO · · arXiv ↗ · more like this ·

Despite the advances in the autonomous driving domain, autonomous vehicles (AVs) are still inefficient and limited in terms of cooperating with each other or coordinating with vehicles operated by humans. A group of autonomous and human-driven vehicles (HVs) which work together to optimize an altruistic social utility -- as opposed to the egoistic individual utility -- can co-exist seamlessly and assure safety and efficiency on the road. Achieving this mission without explicit coordination among agents is challenging, mainly due to the difficulty of predicting the behavior of humans with heterogeneous preferences in mixed-autonomy environments. Formally, we model an AV's maneuver planning in mixed-autonomy traffic as a partially-observable stochastic game and attempt to derive optimal policies that lead to socially-desirable outcomes using a multi-agent reinforcement learning framework.…

Impact of Communication Loss on MPC based Cooperative Adaptive Cruise Control and Platooning

Mahdi Razzaghpour, Shahriar Shahram, Rodolfo Valiente +1 more

eess.SY · · arXiv ↗ · more like this ·

Cooperative driving, enabled by communication between automated vehicle systems, is expected to significantly contribute to transportation safety and efficiency. Cooperative Adaptive Cruise Control (CACC) and platooning are two of the main cooperative driving applications that are currently under study. These applications offer significant improvements over current advanced driver assistant systems such as adaptive cruise control (ACC). The primary motivation of CACC and Platooning is to reduce traffic congestion and improve traffic flow, traffic throughput, and highway capacity. These applications need an efficient controller to consider the computational cost and ensure driving comfort and high responsiveness. The advantage of Model Predictive Control is that we can realize high control performance since all constrain for these applications can be explicitly dealt with through solving…

A Maneuver-based Urban Driving Dataset and Model for Cooperative Vehicle Applications

Behrad Toghi, Divas Grover, Mahdi Razzaghpour +5 more

eess.SP · · arXiv ↗ · more like this ·

Short-term future of automated driving can be imagined as a hybrid scenario in which both automated and human-driven vehicles co-exist in the same environment. In order to address the needs of such road configuration, many technology solutions such as vehicular communication and predictive control for automated vehicles have been introduced in the literature. Both aforementioned solutions rely on driving data of the human driver. In this work, we investigate the currently available driving datasets and introduce a real-world maneuver-based driving dataset that is collected during our urban driving data collection campaign. We also provide a model that embeds the patterns in maneuver-specific samples. Such model can be employed for classification and prediction purposes.

Real-Time Hardware-In-the-Loop Emulation Framework for DSRC-based Connected Vehicle Applications

Ghayoor Shah, Rodolfo Valiente, Nitish Gupta +4 more

cs.NI · · arXiv ↗ · more like this ·

The rapid growth of connected and automated vehicle (CAV) solutions have made a significant impact on the safety of intelligent transportation systems. However, similar to any other emerging technology, thorough testing and evaluation studies are of paramount importance for the effectiveness of these solutions. Due to the safety-critical nature of this problem, large-scale real-world field tests do not seem to be a feasible and practical option. Thus, employing simulation and emulation approaches are preferred in the development phase of the safety-related applications in CAVs. Such methodologies not only mitigate the high cost of deploying large number of real vehicles, but also enable researchers to exhaustively perform repeatable tests in various scenarios. Software simulation of very large-scale vehicular scenarios is mostly a time consuming task and as a matter of fact, any…

Controlling Steering Angle for Cooperative Self-driving Vehicles utilizing CNN and LSTM-based Deep Networks

Rodolfo Valiente, Mahdi Zaman, Sedat Ozer +1 more

cs.CV · · arXiv ↗ · more like this ·

A fundamental challenge in autonomous vehicles is adjusting the steering angle at different road conditions. Recent state-of-the-art solutions addressing this challenge include deep learning techniques as they provide end-to-end solution to predict steering angles directly from the raw input images with higher accuracy. Most of these works ignore the temporal dependencies between the image frames. In this paper, we tackle the problem of utilizing multiple sets of images shared between two autonomous vehicles to improve the accuracy of controlling the steering angle by considering the temporal dependencies between the image frames. This problem has not been studied in the literature widely. We present and study a new deep architecture to predict the steering angle automatically by using Long-Short-Term-Memory (LSTM) in our deep architecture. Our deep architecture is an end-to-end network…