arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Cise Midoglu

55 papers · 2015–2026

2015: 32016: 22017: 22018: 22019: 32020: 12021: 62022: 112023: 42024: 132025: 62026: 2
2015peak 13 in 20242026

Frequent co-authors

Papers

showing 1–25 of 55 RSS

Automated Event Detection and Classification in Soccer: The Potential of Using Multiple Modalities

Olav Andre Nergård Rongved, Markus Stige, Steven A. Hicks +6 more

Computer Vision and Pattern Recognition · Machine Learning and Knowledge Extraction · · cited 33× · DOI ↗ · more like this ·

Detecting events in videos is a complex task, and many different approaches, aimed at a large variety of use-cases, have been proposed in the literature. Most approaches, however, are unimodal and only consider the visual information in the videos. This paper presents and evaluates different approaches based on neural networks where we combine visual features with audio features to detect (spot) and classify events in soccer videos. We employ model fusion to combine different modalities such as video and audio, and test these combinations against different state-of-the-art models on the SoccerNet dataset. The results show that a multimodal approach is beneficial. We also analyze how the tolerance for delays in classification and spotting time, and the tolerance for prediction accuracy, influence the results. Our experiments show that using multiple modalities improves event detection…

Soccer Game Summarization using Audio Commentary, Metadata, and Captions

Sushant Gautam, Cise Midoglu, Saeed Shafiee Sabet +2 more

Computer Vision and Pattern Recognition · Duo Research Archive (University of Oslo) · · cited 26× · DOI ↗ · more like this ·

Soccer is one of the most popular sports globally, and the amount of soccer-related content worldwide, including video footage, audio commentary, team/player statistics, scores, and rankings, is enormous and rapidly growing. Consequently, the generation of multimodal summaries is of tremendous interest for broadcasters and fans alike, as a large percentage of audiences prefer to follow only the main highlights of a game. However, annotating important events and producing summaries often requires expensive equipment and a lot of tedious, cumbersome, manual labour. In this context, recent developments in Artificial Intelligence (AI) have shown great potential. The goal of this work is to create an automated soccer game summarization pipeline using AI. In particular, our focus is on the generation of complete game summaries in continuous text format with length constraints, based on raw…

Dissecting the performance of YouTube video streaming in mobile networks

Anika Schwind, Cise Midoglu, Özgü Alay +2 more

Computer Vision and Pattern Recognition · International Journal of Network Management · · cited 20× · DOI ↗ · more like this ·

Summary Video streaming applications constitute a significant portion of the Internet traffic today, with mobile accounting for more than half of the online video views. The high share of video in the current Internet traffic mix has prompted many studies that examine video streaming through measurements. However, streaming performance depends on many different factors at different layers of the TCP/IP stack. For example, browser selection at the application layer or the choice of protocol in transport layer can have significant impact on the video performance. Furthermore, video performance heavily depends on the underlying network conditions (eg, network and link layers). For mobile networks, the conditions vary significantly, since each operator has a different deployment strategy and configuration. In this paper, we focus on YouTube and carry out a comprehensive study investigating…

AI-Based Sports Highlight Generation for Social Media

Cise Midoglu, Saeed Shafiee Sabet, Mehdi Houshmand Sarkhoosh +5 more

Computer Vision and Pattern Recognition · Duo Research Archive (University of Oslo) · · cited 19× · DOI ↗ · more like this ·

Social media plays a significant role for sports organizations with millions of active fans, but publishing highlights is often a tedious manual operation. With the development of AI, new tools are available for content generation and personalization to engage audiences. We propose an AI-based multimedia production framework for the automatic publishing of soccer and ice hockey highlights on social media, and disseminate our experiences with developing dedicated pipelines for event detection and classification, player detection and tracking, highlight clipping, cropping, thumbnail generation, game summarization, caption generation, and social media sharing.

Opportunities and challenges of using crowdsourced measurements for mobile network benchmarking a case study on RTR open data

Cise Midoglu, Philipp Svoboda

Computer Science Applications · 2016 SAI Computing Conference (SAI) · · cited 19× · DOI ↗ · more like this ·

Crowdsourcing is a novel paradigm which has applications in a plethora of disciplines including software development, public administration, and communication technologies. In the field of telecommunications, crowdsourcing makes a viable addition to state of the art benchmarking methods for mobile networks, when combined with mobile sensing approaches to employ smartphones as end nodes. In this paper, we review the opportunities and challenges of using crowdsourced measurements from smartphones for benchmarking mobile networks, and demonstrate some of these generic aspects using an open data set containing over two million entries. We show that there is a big potential to distributing performance measurements towards the peripherals of the network, but in order to achieve accurate benchmarking, the collection of data has to be complemented with appropriate signal processing. Our study…

AI-Based Video Clipping of Soccer Events

Joakim Olav Valand, Haris Kadragic, Steven A. Hicks +6 more

Computer Vision and Pattern Recognition · Machine Learning and Knowledge Extraction · · cited 14× · DOI ↗ · more like this ·

The current gold standard for extracting highlight clips from soccer games is the use of manual annotations and clippings, where human operators define the start and end of an event and trim away the unwanted scenes. This is a tedious, time-consuming, and expensive task, to the extent of being rendered infeasible for use in lower league games. In this paper, we aim to automate the process of highlight generation using logo transition detection, scene boundary detection, and optional scene removal. We experiment with various approaches, using different neural network architectures on different datasets, and present two models that automatically find the appropriate time interval for extracting goal events. These models are evaluated both quantitatively and qualitatively, and the results show that we can detect logo and scene transitions with high accuracy and generate highlight clips…

Multimodal AI-Based Summarization and Storytelling for Soccer on Social Media

Mehdi Houshmand Sarkhoosh, Sushant Gautam, Cise Midoglu +2 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

The rapid advancement of technology has been revolutionizing the field of sports media, where there is a growing need for sophisticated data processing methods. Current methodologies for extracting information from soccer broadcast videos to generate game highlights and summaries for social media are predominantly manual and rely heavily on text-based NLP techniques, overlooking the rich visual and auditory information available. In response to this challenge, our research introduces SoccerSum, a tool that innovates in the field by integrating computer vision, audio analysis with advanced language models like GPT-4. This multimodal approach enables automated, enriched content summarization, including detection of players and key field elements, thereby enhancing the metadata used in summarization algorithms. SoccerSum uniquely combines textual and visual data, offering a comprehensive…

Automated Clipping of Soccer Events using Machine Learning

Joakim Olav Valand, Haris Kadragic, Steven A. Hicks +6 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

Extracting highlight clips from soccer matches requires tedious, time-consuming, and expensive manual labor. Human operators need to search for appropriate clipping points and trim away the unwanted scenes. In our work, we aim for an automated process for generating event highlights. In particular, we develop AI-models for scene boundary detection and logo detection. Using different datasets, we present two models that automatically find the appropriate time interval for goal event extraction. The models are evaluated quantitatively, and the results show that we find the logo and scene shifts with high accuracy. Our event clipping methodology is a potential building block for a larger, fully-automated sports broadcast production pipeline.

Using 3D Convolutional Neural Networks for Real-time Detection of Soccer Events

Olav Andre Nergård Rongved, Steven A. Hicks, Vajira Thambawita +6 more

Computer Vision and Pattern Recognition · International Journal of Semantic Computing · · cited 12× · DOI ↗ · more like this ·

Developing systems for the automatic detection of events in video is a task which has gained attention in many areas including sports. More specifically, event detection for soccer videos has been studied widely in the literature. However, there are still a number of shortcomings in the state-of-the-art such as high latency, making it challenging to operate at the live edge. In this paper, we present an algorithm to detect events in soccer videos in real time, using 3D convolutional neural networks. We test our algorithm on three different datasets from SoccerNet, the Swedish Allsvenskan, and the Norwegian Eliteserien. Overall, the results show that we can detect events with high recall, low latency, and accurate time estimation. The trade-off is a slightly lower precision compared to the current state-of-the-art, which has higher latency and performs better when a less accurate time…

The same, only different: Contrasting mobile operator behavior from crowdsourced dataset

Konstantinos Kousias, Cise Midoglu, Özgü Alay +3 more

Computer Science Applications · University of Thessaly Institutional Repository (University of Thessaly) · · cited 12× · DOI ↗ · more like this ·

Crowdsourcing mobile network performance evaluation is rapidly gaining popularity, with new applications aiming to deliver more accurate and reliable results every day. From the perspective of end-users, these utilities help them estimate the performance of their service provider in terms of throughput, latency and other key performance indicators of the network. In this paper, we build ORCA: Operator Classifier, a Machine Learning (ML) based framework to define and determine the behavior of Mobile Network Operators (MNOs) from crowdsourced datasets. We investigate whether one can differentiate MNOs by using crowdsourced end-to-end network measurements. We consider different performance metrics (e.g. Download (DL)/Upload (UL) data rate, latency, signal strength) and study the impact of them individually but also collectively on differentiating MNOs. We use RTR Open Data, an open dataset…

MMSys'21 Grand Challenge on Detecting Cheapfakes

Shivangi Aneja, Cise Midoglu, Duc-Tien Dang-Nguyen +5 more

cs.MM · · cited 9× · arXiv ↗ · more like this ·

Cheapfake is a recently coined term that encompasses non-AI ("cheap") manipulations of multimedia content. Cheapfakes are known to be more prevalent than deepfakes. Cheapfake media can be created using editing software for image/video manipulations, or even without using any software, by simply altering the context of an image/video by sharing the media alongside misleading claims. This alteration of context is referred to as out-of-context (OOC) misuse} of media. OOC media is much harder to detect than fake media, since the images and videos are not tampered. In this challenge, we focus on detecting OOC images, and more specifically the misuse of real photographs with conflicting image captions in news items. The aim of this challenge is to develop and benchmark models that can be used to detect whether given samples (news image and associated captions) are OOC, based on the recently…

An Open Dataset of Operational Mobile Networks

Ali Safari Khatouni, Martino Trevisan, Danilo Giordano +5 more

Computer Networks and Communications · ArTS Archivio della ricerca di Trieste (University of Trieste https://www.units.it/) · · cited 9× · DOI ↗ · more like this ·

Mobile networks have become ubiquitous and the primary means to access the Internet, and the traffic they generate has rapidly increased over the last years. The technology and service diversity in mobile networks call for extensive and accurate measurements to ensure the proper functioning of the networks and rapidly spot impairments. However, the measurement of mobile networks is complicated by their scale, and, thus, expensive, especially due to the diversity of deployments, technologies, and web services. In this paper, we present and provide access to the largest open international mobile network dataset collected using the MONROE platform spanning six countries, 27 mobile network operators, and 120 measurement nodes. We use them to run measurements targeting several web services from January 2018 to December 2019, collecting millions of TCP and UDP flows using these commercial…

SmartCrop: AI-Based Cropping of Soccer Videos

Sayed Mohammad Majidi Dorcheh, Mehdi Houshmand Sarkhoosh, Cise Midoglu +5 more

Computer Vision and Pattern Recognition · · cited 8× · DOI ↗ · more like this ·

In the rapidly evolving landscape of digital platforms, the need for optimizing media representations to cater to various aspect ratios is palpable. In this paper, we pioneer an approach that utilizes object detection, scene detection, outlier detection, and interpolation for smart cropping. Using soccer as a case study, our primary goal is to capture the frame salience using object (player and ball) detection and tracking using AI models. To improve the object detection and tracking, we rely on scene understanding and explore various outlier detection and interpolation techniques. Our pipeline, called SmartCrop, is efficient, and supports various configurations for object tracking, interpolation, and outlier detection to find the best point-of-interest to be used as the cropping center of the video frame. An objective evaluation of the performance of individual pipeline components has…

Automatic thumbnail selection for soccer videos using machine learning

Andreas Husa, Cise Midoglu, Malek Hammou +5 more

Computer Vision and Pattern Recognition · Duo Research Archive (University of Oslo) · · cited 8× · DOI ↗ · more like this ·

Thumbnail selection is a very important aspect of online sport video presentation, as thumbnails capture the essence of important events, engage viewers, and make video clips attractive to watch. Traditional solutions in the soccer domain for presenting highlight clips of important events such as goals, substitutions, and cards rely on the manual or static selection of thumbnails. However, such approaches can result in the selection of sub-optimal video frames as snapshots, which degrades the overall quality of the video clip as perceived by viewers, and consequently decreases viewership, not to mention that manual processes are expensive and time consuming. In this paper, we present an automatic thumbnail selection system for soccer videos which uses machine learning to deliver representative thumbnails with high relevance to video content and high visual quality in near real-time. Our…

Evaluation Framework for Real-Time Adaptive 360-Degree Video Streaming over 5G Networks

Cise Midoglu, Özgü Alay, Carsten Griwodz

Computer Vision and Pattern Recognition · Duo Research Archive (University of Oslo) · · cited 8× · DOI ↗ · more like this ·

The end-to-end distribution of real-time 360-degree video needs to be evaluated in a wholesome manner, considering all aspects from video capture to encoding, delivery, and playback, as well as timely and appropriate analytics, with a focus on end-user Quality of Experience (QoE). This requires a measurement framework which allows for the collection of metrics from multiple dimensions at the same time. In this work, we propose such a framework for evaluating real-time adaptive 360\degree video streaming over an experimental Fifth Generation (5G) network, which allows for the investigation of different aspects of the end-to-end video delivery chain.

PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clips

Håkon Maric Solberg, Mehdi Houshmand Sarkhoosh, Sushant Gautam +3 more

cs.CV · · cited 7× · arXiv ↗ · more like this ·

In the rapidly evolving field of sports analytics, the automation of targeted video processing is a pivotal advancement. We propose PlayerTV, an innovative framework which harnesses state-of-the-art AI technologies for automatic player tracking and identification in soccer videos. By integrating object detection and tracking, Optical Character Recognition (OCR), and color analysis, PlayerTV facilitates the generation of player-specific highlight clips from extensive game footage, significantly reducing the manual labor traditionally associated with such tasks. Preliminary results from the evaluation of our core pipeline, tested on a dataset from the Norwegian Eliteserien league, indicate that PlayerTV can accurately and efficiently identify teams and players, and our interactive Graphical User Interface (GUI) serves as a user-friendly application wrapping this functionality for…

SoccerRAG: Multimodal Soccer Information Retrieval via Natural Queries

Aleksander Theo Strand, Sushant Gautam, Cise Midoglu +1 more

cs.IR · · cited 7× · arXiv ↗ · more like this ·

The rapid evolution of digital sports media necessitates sophisticated information retrieval systems that can efficiently parse extensive multimodal datasets. This paper introduces SoccerRAG, an innovative framework designed to harness the power of Retrieval Augmented Generation (RAG) and Large Language Models (LLMs) to extract soccer-related information through natural language queries. By leveraging a multimodal dataset, SoccerRAG supports dynamic querying and automatic data validation, enhancing user interaction and accessibility to sports archives. Our evaluations indicate that SoccerRAG effectively handles complex queries, offering significant improvements over traditional retrieval systems in terms of accuracy and user engagement. The results underscore the potential of using RAG and LLMs in sports analytics, paving the way for future advancements in the accessibility and…

The SoccerSum Dataset for Automated Detection, Segmentation, and Tracking of Objects on the Soccer Pitch

Mehdi Houshmand Sarkhoosh, Sushant Gautam, Cise Midoglu +3 more

Computer Vision and Pattern Recognition · · cited 7× · DOI ↗ · more like this ·

This paper introduces SoccerSum, a novel dataset aimed at enhancing object detection and segmentation in video frames depicting the soccer pitch, using footage from the Norwegian Eliteserien league across 2021-2023. With the goal of detecting elements beyond common entities in existing datasets, such as the soccer ball, players and referees, this dataset includes additional annotations for the goal net, corner flag posts, and the penalty mark. SoccerSum also includes the segmentation of key pitch areas such as the penalty and goal boxes for the same frame sequences. Comprising 750 frames annotated with 10 classes for advanced analysis, SoccerSum offers compatibility with existing frameworks, providing a rich dataset for the development of computer vision algorithms. This dataset not only serves as a resource for improving sports analytics, but also introduces a new application for…

AI-Based Cropping of Ice Hockey Videos for Different Social Media Representations

Mehdi Houshmand Sarkhoosh, Sayed Mohammad Majidi Dorcheh, Cise Midoglu +5 more

Computer Vision and Pattern Recognition · IEEE Access · · cited 7× · DOI ↗ · more like this ·

Sports multimedia is among the most prominent types of content distributed across social media today, and the retargeting of videos for diverse aspect ratios is essential for a suitable representation on different social media platforms. In this respect, ice hockey is quite challenging due to its agile movement pattern and speed, and because the main reference point (puck) is very small. In this paper, we introduce a novel pipeline for intelligent video cropping tailored for ice hockey. Our main goal is to identify regions of interest in video frames by detecting and tracking the hockey puck using state-of-the-art AI models. Our pipeline employs scene detection, object detection, outlier detection, and smoothing as key features. Our proposed pipeline called SmartCrop-H is not only highly efficient and configurable with respect to target aspect ratios, but also addresses the automation…

Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks

Cise Midoglu, Anatoliy Zabrovskiy, Özgü Alay +3 more

Computer Vision and Pattern Recognition · Duo Research Archive (University of Oslo) · · cited 7× · DOI ↗ · more like this ·

Video streaming is one of the top traffic contributors in the Internet and a frequent research subject. It is expected that streaming traffic will grow 4-fold for video globally and 9-fold for mobile video between 2017 and 2022. In this paper, we present an automatized measurement framework for evaluating video streaming QoE in operational broadband networks, using headless streaming with a Docker-based client, and a server-side implementation allowing for the use of multiple video players and adaptation algorithms. Our framework allows for integration with the acsMONROE testbed and Bitmovin Analytics, which bring on the possibility to conduct large-scale measurements in different networks, including mobility scenarios, and monitor different parameters in the application, transport, network, and physical layers in real-time.

SoccerNet-Echoes: A Soccer Game Audio Commentary Dataset

Sushant Gautam, Mehdi Houshmand Sarkhoosh, Jan Held +7 more

cs.SD · · cited 5× · arXiv ↗ · more like this ·

The application of Automatic Speech Recognition (ASR) technology in soccer offers numerous opportunities for sports analytics. Specifically, extracting audio commentaries with ASR provides valuable insights into the events of the game, and opens the door to several downstream applications such as automatic highlight generation. This paper presents SoccerNet-Echoes, an augmentation of the SoccerNet dataset with automatically generated transcriptions of audio commentaries from soccer game broadcasts, enhancing video content with rich layers of textual information derived from the game audio using ASR. These textual commentaries, generated using the Whisper model and translated with Google Translate, extend the usefulness of the SoccerNet dataset in diverse applications such as enhanced action spotting, automatic caption generation, and game summarization. By incorporating textual data…

SmartCrop-H

Mohammad Majidi, Mehdi Houshmand Sarkhoosh, Cise Midoglu +4 more

Computer Vision and Pattern Recognition · Duo Research Archive (University of Oslo) · · cited 5× · DOI ↗ · more like this ·

Sports multimedia plays a central role in captivating audiences on social media platforms. However, fast-paced sports such as ice hockey pose unique challenges due to their swift gameplay and the small puck size, making object tracking-based video adaptation for social media a complex task. In this context, we introduce SmartCrop-H, an innovative ice hockey video cropping tool powered by advanced AI models. It excels at tracking the puck and ensuring that crucial gameplay remains the center of attention, regardless of the desired target aspect ratio. The tool combines various techniques including object detection, scene detection, outlier detection, and smoothing, to deliver high-quality ratio-adapted videos. In this demonstration, we showcase SmartCrop-H in real-world scenarios through an intuitive step-by-step Graphical User Interface (GUI) that vividly illustrates how the tool works.…

Comparison of Crowdsourced and Remote Subjective User Studies: A Case Study of Investigative Child Interviews

Saeed Shafiee Sabet, Cise Midoglu, Syed Zohaib Hassan +6 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Crowdsourced and remote user studies have recently gained popularity as alternatives to traditional laboratory studies. However, they are subject to unreliability, and it is challenging to ensure that valid results are collected, especially when conducting user studies with experts. Experts are a sparse resource, usually having busy schedules and heavy workloads, and are not necessarily geographically close. They are therefore often unwilling to participate in studies which require physical attendance. In this paper, we compare three alternative methods: crowd sourced user study with non-experts, remote user study with non-experts, and remote user study with domain experts, for a use case involving investigative child interview training. We present the results from three subjective studies about the perception of AI-generated child avatars, which is developed using various technologies…

ACM Multimedia Grand Challenge on Detecting Cheapfakes

Shivangi Aneja, Cise Midoglu, Duc-Tien Dang-Nguyen +5 more

cs.MM · · cited 4× · arXiv ↗ · more like this ·

Cheapfake is a recently coined term that encompasses non-AI (``cheap'') manipulations of multimedia content. Cheapfakes are known to be more prevalent than deepfakes. Cheapfake media can be created using editing software for image/video manipulations, or even without using any software, by simply altering the context of an image/video by sharing the media alongside misleading claims. This alteration of context is referred to as out-of-context (OOC) misuse of media. OOC media is much harder to detect than fake media, since the images and videos are not tampered. In this challenge, we focus on detecting OOC images, and more specifically the misuse of real photographs with conflicting image captions in news items. The aim of this challenge is to develop and benchmark models that can be used to detect whether given samples (news image and associated captions) are OOC, based on the recently…

HOST-ATS

Andreas Husa, Cise Midoglu, Malek Hammou +2 more

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

We present HOST-ATS, a holistic system for the automatic selection and evaluation of soccer video thumbnails, which is composed of a dashboard-controlled machine learning (ML) pipeline, and a dynamic user survey. The ML pipeline uses logo detection, close-up shot detection, face detection, image quality prediction, and blur detection to automatically select thumbnails from soccer videos in near real-time, and can be configured via a graphical user interface. The web-based dynamic user survey can be employed to qualitatively evaluate the thumbnails selected by the pipeline. The survey is fully configurable and easy to update via continuous integration, allowing for the dynamic aggregation of participant responses to different sets of multimedia assets. We demonstrate the configuration and execution of the ML pipeline via the custom dashboard, and the agile (re-)deployment of the user…