Shayan Jawed

GraFITi: Graphs for Forecasting Irregularly Sampled Time Series

Vijaya Krishna Yalavarthi, Kiran Madhusudhanan, Randolf Scholz +5 more

Signal Processing · Proceedings of the AAAI Conference on Artificial Intelligence · 24 Mar 2024 · cited 17× · DOI ↗ · more like this ·

Forecasting irregularly sampled time series with missing values is a crucial task for numerous real-world applications such as healthcare, astronomy, and climate sciences. State-of-the-art approaches to this problem rely on Ordinary Differential Equations (ODEs) which are known to be slow and often require additional features to handle missing values. To address this issue, we propose a novel model using Graphs for Forecasting Irregularly Sampled Time Series with missing values which we call GraFITi. GraFITi first converts the time series to a Sparsity Structure Graph which is a sparse bipartite graph, and then reformulates the forecasting problem as the edge weight prediction task in the graph. It uses the power of Graph Neural Networks to learn the graph and predict the target edge weights. GraFITi has been tested on 3 real-world and 1 synthetic irregularly sampled time series dataset…

MultiRec: A Multi-Relational Approach for Unique Item Recommendation in Auction Systems

Ahmed Nabih Zaki Rashed, Shayan Jawed, Lars Schmidt-Thieme +1 more

Information Systems · 19 Sep 2020 · cited 14× · DOI ↗ · more like this ·

In auction-based systems such as in used car centers and online auction websites, users usually bid on items, and those items get sold to their highest bidders. In these settings, every item is unique and can be sold only once, which means users’ purchase histories will be unique, and no common items will exist across them. On the other hand, items will not have any historical sales at all. Such extreme settings pose a significant challenge to the current recommender systems models that rely on historical user-item interactions. While some of those models will not be applicable altogether, such as the matrix factorization models, neighborhood models, and even the naive most-popular model, the rest will need to rely only on items’ attributes. In this paper, we address the challenges of auction-based item recommendation by proposing a simple multi-relational recommender model (MultiRec)…

GQFormer: A Multi-Quantile Generative Transformer for Time Series Forecasting

Shayan Jawed, Lars Schmidt-Thieme

Signal Processing · 2022 IEEE International Conference on Big Data (Big Data) · 17 Dec 2022 · cited 5× · DOI ↗ · more like this ·

We propose GQFormer, a probabilistic time series forecasting method that models the quantile function of the forecast distribution. Our methodology is rooted in the Implicit Quantile modeling approach, where samples from the Uniform distribution $\mathcal{U}\left( {0,1} \right)$ are reparameterized to quantile values of the target distribution. This allows implicit generative quantile modeling without any prior assumptions on the data distribution like Gaussianity, common in prior works. Our work is distinguished from prior quantile forecasting methods by novel methodological advances that relate to directly modeling the correlations among multiple quantile estimations at each forecasting horizon. To this end, we firstly develop a parameters haring architecture that implicitly models multiple quantile estimations efficiently and secondly regularize these through a novel multi-task loss…

Multi-step Forecasting via Multi-task Learning

Shayan Jawed, Ahmed Nabih Zaki Rashed, Lars Schmidt-Thieme

Signal Processing · IEEE Conference Proceedings · December 2019 · cited 2× · DOI ↗ · more like this ·

Multi-task learning is an established approach for improving the generalization of a model. We explore multi-task learning in the context of time series forecasting. Specifically, we look into a multivariate setting where main and auxiliary series are to be forecasted for multi-step ahead. This results in an interesting multi-task learning problem formulation where the learning tasks come from future horizon of main and auxiliary series both. Our proposed method relies firstly on enumerating multiple Convolutional network architectures to balance the number of shared and non-shared layers between different time series tasks. Also, as multi-step strategies minimize forecast errors over the complete horizon, loss functions would be at different scales based on model uncertainty for near versus distant future. For this reason we propose a factorization of the weight vector for the learning…

Hyperparameter Tuning MLPs for Probabilistic Time Series Forecasting

Kiran Madhusudhanan, Shayan Jawed, Lars Schmidt-Thieme

cs.LG · 7 Mar 2024 · cited 1× · arXiv ↗ · more like this ·

Time series forecasting attempts to predict future events by analyzing past trends and patterns. Although well researched, certain critical aspects pertaining to the use of deep learning in time series forecasting remain ambiguous. Our research primarily focuses on examining the impact of specific hyperparameters related to time series, such as context length and validation strategy, on the performance of the state-of-the-art MLP model in time series forecasting. We have conducted a comprehensive series of experiments involving 4800 configurations per dataset across 20 time series forecasting datasets, and our findings demonstrate the importance of tuning these parameters. Furthermore, in this work, we introduce the largest metadataset for timeseries forecasting to date, named TSBench, comprising 97200 evaluations, which is a twentyfold increase compared to previous works in the field.…

Forecasting Early with Meta Learning

Shayan Jawed, Kiran Madhusudhanan, Vijaya Krishna Yalavarthi +1 more

cs.LG · 19 Jul 2023 · arXiv ↗ · more like this ·

In the early observation period of a time series, there might be only a few historic observations available to learn a model. However, in cases where an existing prior set of datasets is available, Meta learning methods can be applicable. In this paper, we devise a Meta learning method that exploits samples from additional datasets and learns to augment time series through adversarial learning as an auxiliary task for the target dataset. Our model (FEML), is equipped with a shared Convolutional backbone that learns features for varying length inputs from different datasets and has dataset specific heads to forecast for different output lengths. We show that FEML can meta learn across datasets and by additionally learning on adversarial generated samples as auxiliary samples for the target dataset, it can improve the forecasting performance compared to single task learning, and various…

Forecasting Irregularly Sampled Time Series using Graphs

Vijaya Krishna Yalavarthi, Kiran Madhusudhanan, Randolf Sholz +5 more

cs.LG · May 2023 · arXiv ↗ · more like this ·

Forecasting irregularly sampled time series with missing values is a crucial task for numerous real-world applications such as healthcare, astronomy, and climate sciences. State-of-the-art approaches to this problem rely on Ordinary Differential Equations (ODEs) which are known to be slow and often require additional features to handle missing values. To address this issue, we propose a novel model using Graphs for Forecasting Irregularly Sampled Time Series with missing values which we call GraFITi. GraFITi first converts the time series to a Sparsity Structure Graph which is a sparse bipartite graph, and then reformulates the forecasting problem as the edge weight prediction task in the graph. It uses the power of Graph Neural Networks to learn the graph and predict the target edge weights. GraFITi has been tested on 3 real-world and 1 synthetic irregularly sampled time series dataset…

Auxiliary Quantile Forecasting with Linear Networks

Shayan Jawed, Lars Schmidt-Thieme

cs.LG · 5 Dec 2022 · arXiv ↗ · more like this ·

We propose a novel multi-task method for quantile forecasting with shared Linear layers. Our method is based on the Implicit quantile learning approach, where samples from the Uniform distribution $\mathcal{U}(0, 1)$ are reparameterized to quantile values of the target distribution. We combine the implicit quantile and input time series representations to directly forecast multiple quantile estimations for multiple horizons jointly. Prior works have adopted a Linear layer for the direct estimation of all forecasting horizons in a multi-task learning setup. We show that following similar intuition from multi-task learning to exploit correlations among forecast horizons, we can model multiple quantile estimates as auxiliary tasks for each of the forecast horizon to improve forecast accuracy across the quantile estimates compared to modeling only a single quantile estimate. We show…

A.I. and Data-Driven Mobility at Volkswagen Financial Services AG

Shayan Jawed, Mofassir ul Islam Arif, Ahmed Rashed +8 more

cs.AI · 9 Feb 2022 · arXiv ↗ · more like this ·

Machine learning is being widely adapted in industrial applications owing to the capabilities of commercially available hardware and rapidly advancing research. Volkswagen Financial Services (VWFS), as a market leader in vehicle leasing services, aims to leverage existing proprietary data and the latest research to enhance existing and derive new business processes. The collaboration between Information Systems and Machine Learning Lab (ISMLL) and VWFS serves to realize this goal. In this paper, we propose methods in the fields of recommender systems, object detection, and forecasting that enable data-driven decisions for the vehicle life-cycle at VWFS.

Data-Driven Vehicle Trajectory Forecasting

Shayan Jawed, Eya Boumaiza, Josif Grabocka +1 more

cs.CV · 9 Feb 2019 · arXiv ↗ · more like this ·

An active area of research is to increase the safety of self-driving vehicles. Although safety cannot be guarenteed completely, the capability of a vehicle to predict the future trajectories of its surrounding vehicles could help ensure this notion of safety to a greater deal. We cast the trajectory forecast problem in a multi-time step forecasting problem and develop a Convolutional Neural Network based approach to learn from trajectory sequences generated from completely raw dataset in real-time. Results show improvement over baselines.

Frequent co-authors

Papers