Author

Simone Milani

105 papers · 2003–2026

2003peak 8 in 20122026

Frequent co-authors

Papers

showing 1–25 of 105 RSS

An overview on video forensics

Simone Milani, Marco Fontani, Paolo Bestagini +4 more

Computer Vision and Pattern Recognition · APSIPA Transactions on Signal and Information Processing · 2012 · cited 258× · DOI ↗ · more like this ·

The broad availability of tools for the acquisition and processing of multimedia signals has recently led to the concern that images and videos cannot be considered a trustworthy evidence, since they can be altered rather easily. This possibility raises the need to verify whether a multimedia content, which can be downloaded from the internet, acquired by a video surveillance system, or received by a digital TV broadcaster, is original or not. To cope with these issues, signal processing experts have been investigating effective video forensic strategies aimed at reconstructing the processing history of the video data under investigation and validating their origins. The key assumption of these techniques is that most alterations are not reversible and leave in the reconstructed signal some "footprints", which can be analyzed in order to identify the previous processing steps. This…

Local tampering detection in video sequences

Paolo Bestagini, Simone Milani, Marco Tagliasacchi +1 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · September 2013 · cited 151× · DOI ↗ · more like this ·

Video sequences are often believed to provide stronger forensic evidence than still images, e.g., when used in lawsuits. However, a wide set of powerful and easy-to-use video authoring tools is today available to anyone. Therefore, it is possible for an attacker to maliciously forge a video sequence, e.g., by removing or inserting an object in a scene. These forms of manipulation can be performed with different techniques. For example, a portion of the original video may be replaced by either a still image repeated in time or, in more complex cases, by a video sequence. Moreover, the attacker might use as source data either a spatio-temporal region of the same video, or a region taken from an external sequence. In this paper we present the analysis of the footprints left when tampering with a video sequence, and propose a detection algorithm that allows a forensic analyst to reveal…

Discriminating multiple JPEG compression using first digit features

Simone Milani, Marco Tagliasacchi, Stefano Tubaro

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · March 2012 · cited 78× · DOI ↗ · more like this ·

The analysis of double-compressed images is a problem largely studied by the multimedia forensics community, as it might be exploited, e.g., for tampering localization or source device identification. In many practical scenarios, e.g. photos uploaded on blogs, on-line albums, and photo sharing Web sites, images might be compressed several times. However, the identification of the number of compression stages applied to an image remains an open issue. This paper proposes a forensic method based on the analysis of the distribution of the first significant digits of DCT coefficients, which is modeled according to Benford's law. The method relies on a set of Support Vector Machine (SVM) classifiers and allows us to accurately identify the number of compression stages applied to an image. Up to four consecutive compression stages were considered in the experimental validation. The proposed…

Video codec identification

Paolo Bestagini, Ahmed Allam, Simone Milani +2 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · March 2012 · cited 57× · DOI ↗ · more like this ·

Video content is routinely acquired and distributed in digital format. Therefore, it is customary to have the content encoded multiple times. In this paper we consider a processing chain of two coding steps and we propose a method that aims at identifying the type of codec used in the first step, by analyzing its coding-based footprints. The method relies on the fact that lossy coding is an almost idempotent operation, i.e., re-encoding the reconstructed sequence with the same codec and coding parameters produces a sequence that is highly correlated with the input one. As a consequence, it is possible to analyze this sort of correlation to identify the first codec provided that the second codec does not introduce severe quality degradation. The proposed solution finds several applications in the field of multi-media forensics, e.g. to identify the device that generated the original…

Multiple compression detection for video sequences

Simone Milani, Paolo Bestagini, Marco Tagliasacchi +1 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · September 2012 · cited 51× · DOI ↗ · more like this ·

Nowadays, thanks to the increasingly availability of powerful processors and user friendly applications, the editing of video sequences is becoming more and more frequent. Moreover, after each editing step, any video object is almost always encoded in order to store it using a less amount of memory. For this reason, inferring the number of compression steps that have been applied to such a multimedia object is an important clue in order to assess its authenticity. In this paper we propose a method to recover the number of compression steps applied to a video sequence. In order to accomplish this goal, we make use of a classifier based on multiple Support Vector Machines (SVM) exploiting the Benford's law. Indeed, the feature vectors used to train and test the SVM are based on the statistics of the most significant digit of quantized transform coefficients. The proposed method is tested…

Codec and GOP Identification in Double Compressed Videos

Paolo Bestagini, Simone Milani, Marco Tagliasacchi +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · 14 Mar 2016 · cited 50× · DOI ↗ · more like this ·

Video content is routinely acquired and distributed in a digital compressed format. In many cases, the same video content is encoded multiple times. This is the typical scenario that arises when a video, originally encoded directly by the acquisition device, is then re-encoded, either after an editing operation, or when uploaded to a sharing website. The analysis of the bitstream reveals details of the last compression step (i.e., the codec adopted and the corresponding encoding parameters), while masking the previous compression history. Therefore, in this paper, we consider a processing chain of two coding steps, and we propose a method that exploits coding-based footprints to identify both the codec and the size of the group of pictures (GOPs) used in the first coding step. This sort of analysis is useful in video forensics, when the analyst is interested in determining the…

On the use of Benford's law to detect GAN-generated images

Nicolò Bonettini, Paolo Bestagini, Simone Milani +1 more

cs.CV · 16 Apr 2020 · cited 49× · arXiv ↗ · more like this ·

The advent of Generative Adversarial Network (GAN) architectures has given anyone the ability of generating incredibly realistic synthetic imagery. The malicious diffusion of GAN-generated images may lead to serious social and political consequences (e.g., fake news spreading, opinion formation, etc.). It is therefore important to regulate the widespread distribution of synthetic imagery by developing solutions able to detect them. In this paper, we study the possibility of using Benford's law to discriminate GAN-generated images from natural photographs. Benford's law describes the distribution of the most significant digit for quantized Discrete Cosine Transform (DCT) coefficients. Extending and generalizing this property, we show that it is possible to extract a compact feature vector from an image. This feature vector can be fed to an extremely simple classifier for GAN-generated…

A Depth Image Coder Based on Progressive Silhouettes

Simone Milani, G. Calvagno

Computer Vision and Pattern Recognition · IEEE Signal Processing Letters · 24 Jun 2010 · cited 38× · DOI ↗ · more like this ·

An efficient compression of depth maps proves to be a crucial element in the transmission and storage of 3-D scenes. However, the peculiarities of geometry information make the traditional coding paradigms for natural images less effective for the coding of depth images. The letter presents a novel coding scheme that employs an oversegmentation of the input depth image into a huge set of small regions. These regions are then fused together according to the target number of objects that the algorithm needs to identify in the representation. This procedure is iterated more than once generating several refinement layers that permit obtaining a progressively-increasing quality in the scene. Experimental results show that in most cases the proposed approach reaches a better coding performance with respect to previous coding methods.

Multi-Clue Image Tampering Localization

Lorenzo Gaborini, Paolo Bestagini, Simone Milani +2 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · December 2014 · cited 37× · DOI ↗ · more like this ·

Image tampering is nowadays at everyone's reach. This has determined an urgent need of tools capable of revealing such alterations. Unfortunately, while forgeries can be operated in many different ways, forensic tools usually focus on one specific kind of forgeries. Therefore, an effective strategy for tampering detection and localization requires to merge the output of many different forensic tools. In this paper, we propose an algorithm for image tampering localization, based on the fusion of three separate detectors: i) one based on PRNU, working when we have at least a few of pictures shot with the same camera; ii) one based on PatchMatch; iii) one exploiting image phylogeny analysis, in case we have a set of near-duplicate images to analyze. The method is validated against the dataset released by the IEEE Information Forensics and Security Technical Committee for the First Image…

Detection of temporal interpolation in video sequences

Paolo Bestagini, S. Battaglia, Simone Milani +2 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · May 2013 · cited 34× · DOI ↗ · more like this ·

Nowadays, considering the availability of relatively cheap devices and powerful editing software, video tampering is a relatively easy task. Video sequences can be tampered with by performing, e.g., temporal splicing. However, if the sequences spliced together do not share the same frame rate, they have to be temporally interpolated beforehand. This operation is often made using motion compensated interpolators, which allow to minimize visual artifacts. In this paper we propose a detector of this kind of interpolation. Moreover, the detector is capable of identifying the interpolation factor used, allowing an analyst to uncover the original frame rate of a sequence. This method relies on the analysis of the correlation introduced by the filter adopted by the interpolator. Results show that detection is successful, provided that the number of observed interpolated frames is large enough.…

Demosaicing strategy identification via eigenalgorithms

Simone Milani, Paolo Bestagini, Marco Tagliasacchi +1 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · May 2014 · cited 30× · DOI ↗ · more like this ·

The identification of the camera that has acquired a specific image can be performed via several device-related footprints. Among these, it is possible to look for the traces left by the adopted color demosaicing strategy, which varies according to the camera model and vendor. The paper presents an identification strategy that re-processes the analyzed image with a set of distinctive CFA interpolation algorithms (eigenalgorithms) and, according to the correlation of the output with the original image, builds a set of features that permits identifying the algorithm. The proposed solution performs well with respect to other state-of-the-art solutions also when the analyzed image is severely compressed.

Efficient depth map compression exploiting segmented color data

Simone Milani, Pietro Zanuttigh, Marco Zamarin +1 more

Computer Vision and Pattern Recognition · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · July 2011 · cited 28× · DOI ↗ · more like this ·

3D video representations usually associate to each view a depth map with the corresponding geometric information. Many compression schemes have been proposed for multi-view video and for depth data, but the exploitation of the correlation between the two representations to enhance compression performances is still an open research issue. This paper presents a novel compression scheme that exploits a segmentation of the color data to predict the shape of the different surfaces in the depth map. Then each segment is approximated with a parameterized plane. In case the approximation is sufficiently accurate for the target bit rate, the surface coefficients are compressed and transmitted. Otherwise, the region is coded using a standard H.264/AVC Intra coder. Experimental results show that the proposed scheme permits to outperformthe standardH.264/AVC Intra codec on depth data and can be…

An Accurate Low-Complexity Rate Control Algorithm Based on $(\rho, E_{q})$-Domain

Simone Milani, Luca Celetto, G.A. Mian

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · February 2008 · cited 27× · DOI ↗ · more like this ·

The standard H.264/AVC defines an efficient coding architecture both for coding applications where bandwidth or storage capacity is limited (e.g., video telephony or video conferencing over mobile channels and devices) and for applications that require high reconstruction quality and bit rate (e.g., HDTV). Since its main applications concern video communication over time-varying bandwidth channels, the bit rate has to be controlled with scalable algorithms that can be implemented on low resource devices. The paper describes a rate control algorithm that needs reduced memory area and complexity compared to other ones. The number of coded bits for each frame is accurately predicted through the percentage of null quantized transform coefficients, which is related to the quantization step via the energy of the quantized signal. It is possible to design a rate control algorithm based on this…

Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking

Sebastiano Verde, Marco Marcon, Simone Milani +1 more

Computer Vision and Pattern Recognition · Sensors · 14 Dec 2020 · cited 26× · DOI ↗ · more like this ·

Internet of Things (IoT) applications play a relevant role in today's industry in sharing diagnostic data with off-site service teams, as well as in enabling reliable predictive maintenance systems. Several interventions scenarios, however, require the physical presence of a human operator: Augmented Reality (AR), together with a broad-band connection, represents a major opportunity to integrate diagnostic data with real-time in-situ acquisitions. Diagnostic information can be shared with remote specialists that are able to monitor and guide maintenance operations from a control room as if they were in place. Furthermore, integrating heterogeneous sensors with AR visualization displays could largely improve operators' safety in complex and dangerous industrial plants. In this paper, we present a complete setup for a remote assistive maintenance intervention based on 5G networking and…

Who is my parent? Reconstructing video sequences from partially matching shots

Silvia Lameri, Paolo Bestagini, Andrew W. Mellon +4 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · October 2014 · cited 24× · DOI ↗ · more like this ·

Nowadays, a significant fraction of the available video content is created by reusing already existing online videos. In these cases, the source video is seldom reused as is. Conversely, it is typically time clipped to extract only a subset of the original frames, and other transformations are commonly applied (e.g., cropping, logo insertion, etc.). In this paper, we analyze a pool of videos related to the same event or topic. We propose a method that aims at automatically reconstructing the content of the original source videos, i.e., the parent sequences, by splicing together sets of near-duplicate shots seemingly extracted from the same parent sequence. The result of the analysis shows how content is reused, thus revealing the intent of content creators, and enables us to reconstruct a parent sequence also when it is no longer available online. In doing so, we make use of a…

Image phylogeny through dissimilarity metrics fusion

Andrea Melloni, Paolo Bestagini, Simone Milani +3 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · December 2014 · cited 23× · DOI ↗ · more like this ·

Nowadays, multimedia objects can be easily modified, shared, and distributed, thus determining the widespread diffusion of multiple near-duplicate versions, i.e., objects obtained applying a set of processing operations to original content. This is the case of images downloaded from sharing platforms, modified (e.g., by performing color correction, splicing, etc.) and re-distributed. The evolution of a group of near-duplicate images (i.e., their phylogeny) is a powerful clue to determine both image authenticity and its origin. For this reason, the forensics community has proposed a set of possible solutions to perform phylogenetic analyses based on image dissimilarity computation. Here, we compare different image dissimilarity metrics, and propose a set of original strategies for image phylogeny tree reconstruction. The validation of the proposed methods is performed on a dataset of…

A rate control algorithm for the H.264 encoder

Simone Milani, Luca Celetto, G.A. Mian

Signal Processing · Research Padua Archive (University of Padua) · 2003 · cited 23× · OpenAlex ↗ · more like this ·

intended for video transmission in all areas where bandwidth or storage capacity is limited (e.g. video telephony or video conferencing over mobile channels and devices). Since its main applications concern video communication over time-varying bandwidth channels, the bit rate has to be controlled with scalable algorithms that can be implemented on low resource devices. The paper describes a rate control algorithm that needs reduced memory area and complexity compared to other ones. The number of coded bits for each frame can be accurately predicted through the percentage of null quantized coefficients. It is possible to reduce the hardware requirements of the original technique through a parametric model: in this way coefficient statistics storage is not needed and the whole rate control algorithm becomes more suitable for low-resource devices. I.

Fast point cloud compression via reversible cellular automata block transform

Simone Milani

Computer Graphics and Computer-Aided Design · Padua Research Archive (University of Padova) · September 2017 · cited 21× · DOI ↗ · more like this ·

Augmented and mixed reality applications require efficient tools permitting the compression and the visualization of 3D object at a limited computational cost. To this purpose, 3D point cloud representations have been widely used, together with an octree-based hierarchical organization of data that enables a multi-resolution visualization. This paper presents a voxel coding strategy based on a hierarchical Cellular Automata block reversible transform which permits obtaining a multi-resolution representation of the input volume and a higher compression gain with respect to the state-of-the-art octree strategies. The proposed solution also proves to be more flexible in defining multiple layers and more effective in preserving 3D volume quality when the stream is partially decoded.

A saliency-based rate control for people detection in video

Simone Milani, Riccardo Bernardini, R. Rinaldo

Computer Vision and Pattern Recognition · Research Padua Archive (University of Padua) · May 2013 · cited 21× · DOI ↗ · more like this ·

Most of latest-generation multimedia systems are equipped with increasingly-effective object detection algorithms (e.g., intelligent video surveillance systems, augmented reality applications, sharing platforms for multimedia data, etc.). Unfortunately, images and video are usually available in compressed formats, which makes object detection more difficult because of the additional distortion noise. In this paper we show that it is possible to mitigate this problem by introducing a rate allocation algorithm that preserves important details for object identification algorithms. We propose a saliency map that identifies crucial elements for detectors. Then, we map saliency values to the value of the quantization parameter to be used by the video coder. Experimental results on HEVC coder show that the proposed rate control algorithm improves the accuracy with respect to the standard…

Antiforensics attacks to Benford's law for the detection of double compressed images

Simone Milani, Marco Tagliasacchi, Stefano Tubaro

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · May 2013 · cited 20× · DOI ↗ · more like this ·

Researchers have been recently challenging the robustness of forensic algorithms by designing antiforensic strategies that try to fool them. In this paper, we propose an antiforensic strategy that targets double image compression detectors based on Benford's law (or first digit law). The proposed approach is able to modify the first digit statistics of the considered data (a double compressed image) to fool single/double compression detectors based on Benford's law. In this way, the proposed strategy tries to mimick the effects of a single compression with limited additional distortion. The presented algorithm performs better than previous state-of-the-art antiforensic strategies and can be easily extended to other fraud detection methods.

Adaptive denoising filtering for object detection applications

Simone Milani, Riccardo Bernardini, R. Rinaldo

Computer Vision and Pattern Recognition · Padua Research Archive (University of Padova) · September 2012 · cited 18× · DOI ↗ · more like this ·

The widespread of augmented reality applications, cognitive video surveillance, autonomous or supportive navigation systems, has increased the importance of accurate object detection algorithms. However, the presence of noise depending on the characteristics of the acquisition device, on lighting intensity and directions, and on weather conditions, could severely degrade the performance of such applications. As a matter of fact, effective ad-hoc denoising strategies are required since traditional noise removal algorithms designed to improve the quality of the image, could even worsen the accuracy of detection. This paper presents a low-cost adaptive filtering strategy that adapts the characteristics of the filter depending on the impact of each image region on the feature sets. This solution permits improving the correct detection percentage of approximately 30%with respect to using…

Video Codec Forensics Based on Convolutional Neural Networks

Sebastiano Verde, Luca Bondi, Paolo Bestagini +3 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · 7 Sep 2018 · cited 17× · DOI ↗ · more like this ·

The recent development of multimedia has made video editing accessible to everyone. Unfortunately, forensic analysis tools capable of detecting traces left by video processing operations in a blind fashion are still at their beginnings. One of the reasons is that videos are customary stored and distributed in a compressed format, and codec-related traces tends to mask previous processing operations. In this paper, we propose to capture video codec traces through convolutional neural networks (CNNs) and exploit them as an asset. Specifically, we train two CNN s to extract information about the used video codec and coding quality, respectively. Building upon these CNN s, we propose a system to detect and localize temporal splicing for video sequences generated from the concatenation of different video segments, which are characterized by inconsistent coding schemes and/or parameters…

Phylogenetic analysis of near-duplicate images using processing age metrics

Simone Milani, Marco Fontana, Paolo Bestagini +1 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · March 2016 · cited 17× · DOI ↗ · more like this ·

Recent researches on image forensics have led to the design of algorithms to study the phylogenetic relationship between near-duplicate (ND) images. The proposed solutions aim at reconstructing the image phylogeny tree (IPT), and they have immediate applications in security, law and copyright enforcement, and news tracking services. Anyway, the effectiveness of such strategies strictly depends on the accuracy in characterizing image similarities. In this paper, we show that it is possible to take into account additional information to better reconstruct the IPT. More specifically, we propose a set of features that blindly model the processing age of an image, i.e., how much an image has been edited in its lifetime. By exploiting these features, it is possible to improve the performance of IPT reconstruction by increasing the accuracy and reducing the computational complexity.

Multiple Description Distributed Video Coding Using Redundant Slices and Lossy Syndromes

Simone Milani, G. Calvagno

Computer Vision and Pattern Recognition · IEEE Signal Processing Letters · 11 Sep 2009 · cited 17× · DOI ↗ · more like this ·

During the last years, video coding designers have proposed robust coding approaches that combine Multiple Description Coding (MDC) schemes with Distributed Video Coding (DVC) principles. In this way, it is possible to obtain a better error resilience since the distortion drifting through the sequence is significantly mitigated by the DVC coding unit. The paper presents a Multiple Description Distributed Video Coder (MDDVC) that codes the input video signal generating a set of "lossy" syndromes for each pixel block and creates different descriptions multiplexing primary and redundant video packets. Experimental results show that at high loss probabilities the proposed solution improves the results of the original MDC approach.

A Low-Complexity Cross-Layer Optimization Algorithm for Video Communication Over Wireless Networks

Simone Milani, G. Calvagno

Signal Processing · IEEE Transactions on Multimedia · 2 Jun 2009 · cited 17× · DOI ↗ · more like this ·

Recent years have witnessed a rapid increment in video applications over wireless networks including on-demand video streaming and video phoning. This growth has also brought the need to find a good compromise in the conflict between resource limitations affecting mobile devices and the desire for high-quality multimedia services. It is possible to face this problem adopting a cross-layer strategy that jointly tunes the parameters of each layer in the network protocol stack. In this optimization strategy, complexity is one of the most significant issues because of the limited computational resources and power supply. The paper presents a low-complexity cross-layer algorithm that is able to jointly tune the parameters of different protocol layers by adopting simple but effective models. The quality of the reconstructed video sequence, the produced bit rate, and the service class…