arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Tianli Yu

12 papers · 2000–2025

2000: 12001: 22002: 12003: 02004: 12005: 02006: 12007: 02008: 12009: 02010: 02011: 12012: 02013: 02014: 02015: 02016: 12017: 02018: 02019: 02020: 02021: 02022: 02023: 12024: 02025: 2
2000peak 2 in 20012025

Frequent co-authors

Papers

showing 1–12 of 12 RSS

PaLI-3 Vision Language Models: Smaller, Faster, Stronger

Xi Chen, Xiao Wang, Lucas Beyer +16 more

cs.CV · · cited 160× · arXiv ↗ · more like this ·

This paper presents PaLI-3, a smaller, faster, and stronger vision language model (VLM) that compares favorably to similar models that are 10x larger. As part of arriving at this strong performance, we compare Vision Transformer (ViT) models pretrained using classification objectives to contrastively (SigLIP) pretrained ones. We find that, while slightly underperforming on standard image classification benchmarks, SigLIP-based PaLI shows superior performance across various multimodal benchmarks, especially on localization and visually-situated text understanding. We scale the SigLIP image encoder up to 2 billion parameters, and achieves a new state-of-the-art on multilingual cross-modal retrieval. We hope that PaLI-3, at only 5B parameters, rekindles research on fundamental pieces of complex VLMs, and could fuel a new generation of scaled-up models.

Retrieval of video clips using global motion information

Tianli Yu, Yu‐Jin Zhang

Computer Vision and Pattern Recognition · Electronics Letters · · cited 32× · DOI ↗ · more like this ·

A new scheme is proposed to extract a global motion model from a general video sequence. Since global camera motion often conveys the semantic meaning of a video's content, these global model parameters are used as features for video retrieval. Experimental results show that the scheme is quite effective in locating video segments with similar motion content in football game sequences.

<title>Motion feature extraction for content-based video sequence retrieval</title>

Tianli Yu, Yu‐Jin Zhang

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 5× · DOI ↗ · more like this ·

In this paper we present a region based approach for Short Term Motion analysis and retrieval of video sequences. Our feature extraction scheme converts the motion information of a video frame pair into a combination of different symbols. First the system analyzes the global and local motion to get a dense optical flow field for every frame pair. The local optical flow field is segmented using an affine model based region growing method. The affine model parameters of the segmented regions as well as the region size from a 7 dimensional space, which is partitioned by a vector quanitzer. Each region is then mapped to a code book symbol of the quantizer. With a group of symbols representing each frame pair, we borrow the Vector Space Model and TF*IDF scoring from text document retrieval to index and retrieve their motion information. Preliminary experimental results are shown in the…

<title>Summarizing motion contents of the video clip using moving edge overlaid frame (MEOF)</title>

Tianli Yu, Yu‐Jin Zhang

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 2× · DOI ↗ · more like this ·

How to quickly and effectively exchange video information with the user is a major task for video searching engine's user interface. In this paper, we proposed to use Moving Edge Overlaid Frame (MEOF) image to summarize both the local object motion and global camera motion information of the video clip into a single image. MEOF will supplement the motion information that is generally dropped by the key frame representation, and it will enable faster perception for the user than viewing the actual video. The key technology of our MEOF generating algorithm involves the global motion estimation (GME). In order to extract the precise global motion model from general video, our GME module takes two stages, the match based initial GME and the gradient based GME refinement. The GME module also maintains a sprite image that will be aligned with the new input frame in the background after the…

Towards Compute-Optimal Many-Shot In-Context Learning

Shahriar Golchin, Yanfei Chen, Rujun Han +7 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Long-context large language models (LLMs) are able to process inputs containing up to several million tokens. In the scope of in-context learning (ICL), this translates into using hundreds/thousands of demonstrations in the input prompt, enabling many-shot ICL. In practice, a fixed set of demonstrations is often selected at random in many-shot settings due to (1) high inference costs, (2) the benefits of caching and reusing computations, and (3) the similar performance offered by this strategy compared to others when scaled. In this work, we propose two straightforward strategies for demonstration selection in many-shot ICL that improve performance with minimal computational overhead. Our first method combines a small number of demonstrations, selected based on their similarity to each test sample, with a disproportionately larger set of random demonstrations that are cached. The second…

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

Gheorghe Comanici, Eric Bieber, Mike Schaekermann +3432 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

In this report, we introduce the Gemini 2.X model family: Gemini 2.5 Pro and Gemini 2.5 Flash, as well as our earlier Gemini 2.0 Flash and Flash-Lite models. Gemini 2.5 Pro is our most capable model yet, achieving SoTA performance on frontier coding and reasoning benchmarks. In addition to its incredible coding and reasoning skills, Gemini 2.5 Pro is a thinking model that excels at multimodal understanding and it is now able to process up to 3 hours of video content. Its unique combination of long context, multimodal and reasoning capabilities can be combined to unlock new agentic workflows. Gemini 2.5 Flash provides excellent reasoning abilities at a fraction of the compute and latency requirements and Gemini 2.0 Flash and Flash-Lite provide high performance at low latency and cost. Taken together, the Gemini 2.X model generation spans the full Pareto frontier of model capability vs…

1Subject Category: image processing, image motion analysis, motion estimation, image processing, image sequences Retrieve video clips using the global motion information

Tianli Yu, Yujin Zhang

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

In this paper, a new scheme is proposed to extract the global motion model from general video sequence. Since global camera motion often conveys the semantic meaning of the video’s content, these global model parameters are used as features for video retrieval. Experimental results show our scheme is quite effective in locating video segments with similar motion content in football game sequences. Introduction: In general video sequences, the movement of the camera always follows the place where the important activity goes on. This means the camera motion contains cues of the semantic meaning of the video, especially in some constrained domain. One good example of this is the football game. In football game video, the camera’s movement is often focusing on the trajectory of the football and the position of the players. This information could be used as the feature for the retrieval of…

B.: Kernelized Structural Svm Learning for Supervised Object Segmentation

Luca Bertelli, Tianli Yu, Diem Vu +2 more

Computer Vision and Pattern Recognition · · cited 0× · OpenAlex ↗ · more like this ·

Object segmentation needs to be driven by top-down knowledge to produce semantically meaningful results. In this paper, we propose a supervised segmentation approach that tightly integrates object-level top down information with low-level image cues. The information from the two levels is fused under a kernelized structural SVM learning framework. We defined a novel nonlinear kernel for comparing two image-segmentation masks. This kernel combines four different kernels: the object similarity kernel, the object shape kernel, the per-image color distribution kernel, and the global color distribution kernel. Our experiments show that the structured SVM algorithm finds bad segmentations of the training examples given the current scoring function and punishes these bad segmentations to lower scores than the example (good) segmentations. The result is a segmentation algorithm that not only…

SHAPE FROM COLOR CONSISTENCY USING NODE CUT

Ning Xu, Tianli Yu, Narendra Ahuja

Computer Vision and Pattern Recognition · · cited 0× · OpenAlex ↗ · more like this ·

In this paper, we present a method to estimate the shape of a three dimensional (3D) object by enforcing color consistency in the views of object points in images acquired from different viewpoints. The estimated shape and color information of the object can be used to render new views of the object. We first construct a 3D voxel space and assign to each voxel a photo inconsistency value, and then represent this voxel space using a node capacitated graph. We use s-t node cut to obtain a surface that minimizes the summation of photo inconsistency values of surface voxels. Experimental results for simulated and real objects are provided. We also simulate how the calibration errors of camera intrinsic and extrinsic parameters affect the performance of our algorithm. 1.

Sparse lumigraph relighting by illumination and reflectance estimation from multi-view images, Eurograpics Symposium on Rendering (EGSR

Tianli Yu, Hongcheng Wang, Narendra Ahuja

Computer Graphics and Computer-Aided Design · · cited 0× · OpenAlex ↗ · more like this ·

and generate the final composite image (right). Abstract We present a novel image-based modeling technique which allows simultaneous estimation of illumination, diffuse, and specular albedo maps using only object geometry and multi-view images captured under a single, unknown illumination setting. 1

N.: Recovering shape and reflectance model of nonlambertian objects from multiple views

Tianli Yu, Ning Xu, Narendra Ahuja

Computer Graphics and Computer-Aided Design · · cited 0× · OpenAlex ↗ · more like this ·

This paper proposes an algorithm to simultaneously estimate both the 3D shape and parameters of a surface reflectance model from multiple views of an object made of a single material. The algorithm is based on a multiple view shape from shading method. The shape of the object is represented by a triangular mesh. The Phong reflectance model is used to model the surface reflectance. We iteratively find the shape and reflectance parameters that best fit all input images. The estimates of shape and reflectance model are gradually refined by subdividing triangles in the mesh into smaller ones. The estimation takes into account both self-occlusion and self-shadowing. Analysis shows that the accuracy of reflectance estimation is limited by the triangle size in the shape model. We also propose to use Richardson extrapolation to overcome this and further refine the reflectance model estimate.…

Combining video mosaic and edge overlap techniques for condensing information in a video clip to a single frame

Yu‐Jin Zhang, Tianli Yu

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 0× · DOI ↗ · more like this ·

A method for summarizing the information of a video clip into a single image is proposed. Two kinds of information in video clips can be distinguished, one is related to background contents and other is related to foreground object motion. For condensing foreground object motion information, a new technique based on edge overlap is described. The edges of moving objects in a set of consecutive frames are detected and then suitably overlapped on the composite background to show the movement of objects along time axis. The background variation caused by camera motion is captured and different scenes are connected using video mosaic technique. By combined use of video mosaic and edge overlap techniques, a VM&EO frame is generated, which sums up both the background contents and object motion information. Thus, such a frame can be used to represent the video clip in a compact and meaningful…