arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Xintong Yu

23 papers · 2014–2026

2014: 22015: 02016: 02017: 02018: 12019: 22020: 02021: 12022: 52023: 32024: 12025: 32026: 5
2014peak 5 in 20222026

Frequent co-authors

Papers

showing 1–23 of 23 RSS

ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts

Zhida Feng, Zhenyu Zhang, Xintong Yu +12 more

cs.CV · · cited 165× · arXiv ↗ · more like this ·

Recent progress in diffusion models has revolutionized the popular technology of text-to-image generation. While existing approaches could produce photorealistic high-resolution images with text conditions, there are still several open problems to be solved, which limits the further improvement of image fidelity and text relevancy. In this paper, we propose ERNIE-ViLG 2.0, a large-scale Chinese text-to-image diffusion model, to progressively upgrade the quality of generated images by: (1) incorporating fine-grained textual and visual knowledge of key elements in the scene, and (2) utilizing different denoising experts at different denoising stages. With the proposed mechanisms, ERNIE-ViLG 2.0 not only achieves a new state-of-the-art on MS-COCO with zero-shot FID score of 6.75, but also significantly outperforms recent models in terms of image fidelity and image-text alignment, with…

METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation

Ruixin Hong, Hongming Zhang, Xintong Yu +1 more

cs.CL · · cited 42× · arXiv ↗ · more like this ·

Knowing the reasoning chains from knowledge to the predicted answers can help construct an explainable question answering (QA) system. Advances on QA explanation propose to explain the answers with entailment trees composed of multiple entailment steps. While current work proposes to generate entailment trees with end-to-end generative models, the steps in the generated trees are not constrained and could be unreliable. In this paper, we propose METGEN, a Module-based Entailment Tree GENeration framework that has multiple modules and a reasoning controller. Given a question and several supporting knowledge, METGEN can iteratively generate the entailment tree by conducting single-step entailment with separate modules and selecting the reasoning flow with the controller. As each module is guided to perform a specific type of entailment reasoning, the steps generated by METGEN are more…

Smart-Data-Glove-Based Gesture Recognition for Amphibious Communication

Liufeng Fan, Zhan Zhang, Biao Zhu +3 more

Human-Computer Interaction · Micromachines · · cited 16× · DOI ↗ · more like this ·

This study has designed and developed a smart data glove based on five-channel flexible capacitive stretch sensors and a six-axis inertial measurement unit (IMU) to recognize 25 static hand gestures and ten dynamic hand gestures for amphibious communication. The five-channel flexible capacitive sensors are fabricated on a glove to capture finger motion data in order to recognize static hand gestures and integrated with six-axis IMU data to recognize dynamic gestures. This study also proposes a novel amphibious hierarchical gesture recognition (AHGR) model. This model can adaptively switch between large complex and lightweight gesture recognition models based on environmental changes to ensure gesture recognition accuracy and effectiveness. The large complex model is based on the proposed SqueezeNet-BiLSTM algorithm, specially designed for the land environment, which will use all the…

Optimizing Top-<inline-formula> <tex-math notation="LaTeX">$k$ </tex-math> </inline-formula> Multiclass SVM via Semismooth Newton Algorithm

Dejun Chu, Rui Lü, Jin Li +3 more

Artificial Intelligence · IEEE Transactions on Neural Networks and Learning Systems · · cited 9× · DOI ↗ · more like this ·

Top- performance has recently received increasing attention in large data categories. Advances, like a top- multiclass support vector machine (SVM), have consistently improved the top- accuracy. However, the key ingredient in the state-of-the-art optimization scheme based upon stochastic dual coordinate ascent relies on the sorting method, which yields complexity. In this paper, we leverage the semismoothness of the problem and propose an optimized top- multiclass SVM algorithm, which employs semismooth Newton algorithm for the key building block to improve the training speed. Our method enjoys a local superlinear convergence rate in theory. In practice, experimental results confirm the validity. Our algorithm is four times faster than the existing method in large synthetic problems; Moreover, on real-world data sets it also shows significant improvement in training time.

What You See is What You Get: Visual Pronoun Coreference Resolution in Dialogues

Xintong Yu, Hongming Zhang, Yangqiu Song +2 more

cs.CL · · cited 6× · arXiv ↗ · more like this ·

Grounding a pronoun to a visual object it refers to requires complex reasoning from various information sources, especially in conversational scenarios. For example, when people in a conversation talk about something all speakers can see, they often directly use pronouns (e.g., it) to refer to it without previous introduction. This fact brings a huge challenge for modern natural language understanding systems, particularly conventional context-based pronoun coreference models. To tackle this challenge, in this paper, we formally define the task of visual-aware pronoun coreference resolution (PCR) and introduce VisPro, a large-scale dialogue PCR dataset, to investigate whether and how the visual information can help resolve pronouns in dialogues. We then propose a novel visual-aware PCR model, VisCoref, for this task and conduct comprehensive experiments and case studies on our dataset.…

Hand Gesture Recognition System Using the Dynamic Vision Sensor

Yu‐Feng Hu, Ziteng Li, Xinpeng Li +4 more

Human-Computer Interaction · · cited 5× · DOI ↗ · more like this ·

With the rapid development of computer vision and artificial intelligence, human-computer interaction has become an inevitable part of people’s lives. Gestures can bring more natural, comfortable, and effective communication between people and machines. However, in some complex scenarios, such as rooms with looming lighting, the robustness and universality of hand gesture recognition based on traditional cameras are insufficient, and the supporting algorithms tend to underperform in real-time, especially for embedded devices. This article explores methods of implementing gesture recognition based on Dynamic Vision Sensor (DVS). We obtained frame data by event-based accumulation and time-based accumulation. Then we apply preprocessing techniques such as sub-time window and overlapping frame to achieve higher accuracy on hand gesture recognition with the DVS. In this paper, we built a…

Exophoric Pronoun Resolution in Dialogues with Topic Regularization

Xintong Yu, Hongming Zhang, Yangqiu Song +3 more

cs.CL · · cited 4× · arXiv ↗ · more like this ·

Resolving pronouns to their referents has long been studied as a fundamental natural language understanding problem. Previous works on pronoun coreference resolution (PCR) mostly focus on resolving pronouns to mentions in text while ignoring the exophoric scenario. Exophoric pronouns are common in daily communications, where speakers may directly use pronouns to refer to some objects present in the environment without introducing the objects first. Although such objects are not mentioned in the dialogue text, they can often be disambiguated by the general topics of the dialogue. Motivated by this, we propose to jointly leverage the local context and global topics of dialogues to solve the out-of-text PCR problem. Extensive experiments demonstrate the effectiveness of adding topic regularization for resolving exophoric pronouns.

Learning Event Extraction From a Few Guideline Examples

Ruixin Hong, Hongming Zhang, Xintong Yu +1 more

Artificial Intelligence · IEEE/ACM Transactions on Audio Speech and Language Processing · · cited 3× · DOI ↗ · more like this ·

Existing fully supervised event extraction models achieve advanced performance with large-scale labeled data. However, when new event types emerge and annotations are scarce, it is hard for the supervised models to master the new types with limited annotations. In contrast, humans can learn to understand new event types with only a few examples in the event extraction guideline. In this paper, we work on a challenging yet more realistic setting, the few-example event extraction. It requires models to learn event extraction with only a few sentences in guidelines as training data, so that we do not need to collect large-scale annotations each time when new event types emerge. As models tend to overfit when trained with only a few examples, we propose knowledge-guided data augmentation to generate valid and diverse sentences from the guideline examples. To help models better leverage the…

Image Captioning with Partially Rewarded Imitation Learning

Xintong Yu, Tszhang Guo, Kun Fu +3 more

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

Current state-of-the-art image captioning algorithms have achieved great progress via reinforcement learning or generative adversarial nets, with hand-craft metrics such as CIDEr as the reward for the former and signals from adversarial discriminative networks for the latter. Despite the high scores on metrics or improvement in diversity gained from the application of these methods, they suffer from distinction with human-written sentences and drop of ratings on metrics respectively.In this paper, we propose a novel training objective for image captioning that consists of two parts representing explicit and implicit knowledge respectively. Optimizing the new reward partially with imitation learning, we devise an algorithm in which the caption generator is trained to maximize the combination of CIDEr and predictions from adversarial discriminator. Experiments on MSCOCO dataset…

EP-Mem: Elastic Privacy Memory for Social Relationship-Aware LLM Agents

Fengzhou Sun, Yuan Zhang, Xintong Yu +1 more

cs.AI · · cited 1× · arXiv ↗ · more like this ·

Large language model (LLM) agents face critical privacy risks when acting as delegates in human-agent-human communication. To prevent such breaches, agents must understand users' social relationships and adhere to context-dependent social information disclosure boundaries. Current studies on agent memory privacy focus on instantaneous interactions, leaving the long-term relational disclosure problem unexplored. In this paper, we propose EP-Mem, an Elastic Privacy Memory architecture that reframes privacy as user-owned boundary control across social roles. EP-Mem introduces (1) token-level memory driven by user-configurable a privacy policy that stratifies persons and events, combining domain-level default circulation rules with fact-level whitelist/blacklist exceptions; and (2) a pluggable sidecar with a privacy engine that aligns disclosure controls with memory across summary, detail…

Finding a Summary for All Maximal Bicliques

Xintong Yu, Rui Zhou, Xiaofan Li +2 more

Geometry and Topology · · cited 1× · DOI ↗ · more like this ·

The number of bicliques in a bipartite graph may grow exponentially as its vertices increase. A biclique summary is a subset of all maximal bicliques and can somehow represent all maximal bicliques. In practical application scenarios, a summary helps users obtain more representative results. Due to its compact size, it enables users to efficiently locate and select the information they need. For instance, in the biomedical field, when researchers explore relationships between genes and proteins, they are often faced with an excessive number of combinations. Using a summary of these gene-protein relationships not only provides more representative insights but also significantly reduces the time needed for analysis. To find such representative maximal bicliques faster, we propose a method to determine whether to terminate the current search by computing lower bounds. We begin by…

A Resizing Method for 3D Visualization of Digital Elevation Models

Wei Yang, Kun Hou, Xintong Yu +1 more

Computer Graphics and Computer-Aided Design · TELKOMNIKA Indonesian Journal of Electrical Engineering · · cited 1× · DOI ↗ · more like this ·

The diversity and versatility of display devices today imposes new demands on digital elevation models (DEMs). This paper proposes a resizing method for 3D visualization of DEMs based on topographic feature. The proposed method improves seaming carving algorithm to resize DEMs instead of images according to the characterristics of DEMs. The proposed resizing method considers not only geometric constraints but also the characteristics of DEMs. Being different from the traditional reduction and expansion methods, the method not only resizes DEMs, but also preserves the characteristics of Digital Elevation Model. The method is implemented and experiments are carried out on actual DEM data. It can be seen from the comparison with scaling method that the proposed method is efficient and provides better 3D visualization of DEMs. DOI : http://dx.doi.org/10.11591/telkomnika.v12i5.4044

Foreground segmentation based on multi-resolution and matting

Xintong Yu, Xiaohan Liu, Yisong Chen

cs.CV · · cited 1× · arXiv ↗ · more like this ·

We propose a foreground segmentation algorithm that does foreground extraction under different scales and refines the result by matting. First, the input image is filtered and resampled to 5 different resolutions. Then each of them is segmented by adaptive figure-ground classification and the best segmentation is automatically selected by an evaluation score that maximizes the difference between foreground and background. This segmentation is upsampled to the original size, and a corresponding trimap is built. Closed-form matting is employed to label the boundary region, and the result is refined by a final figure-ground classification. Experiments show the success of our method in treating challenging images with cluttered background and adapting to loose initial bounding-box.

Visual Communication Characteristics and Practice of Minimalist Brand LOGO

Xintong Yu

Computer Graphics and Computer-Aided Design · Springer Link (Chiba Institute of Technology) · · cited 0× · DOI ↗ · more like this ·

The consumer market has now taken a distinctly youthful trend and the aesthetics manifested in the society have turned towards elegant labor to minimalism. Being one of the essential visual elements of brands, logos have a problem with appropriating colors to convey the message and attract young consumers. The high saturation of colors has a high impact but is easily visual tiredness and does not go well with the palette of the Gen Z generation of subtlety and simplicity. Low-saturation colors depict a high-end harmonious sound using gentle, subtle images in accordance with the aesthetic choice of young consumers. They minimize visual stimulation and maximize acceptance and comfort and can therefore be useful in minimalist logo design. In the form of multi-industry case studies, the present paper examines the descriptive aspects of minimalist logos in graphics, color, and typography. It…

The Application of Mixed Media in Painting and a Comparison of Visual Effects

Xintong Yu

Computer Graphics and Computer-Aided Design · Art Horizons · · cited 0× · DOI ↗ · more like this ·

This research investigates the strategic integration of mixed media techniques in painting and its impact on visual effects and viewer perception. It addresses the research question of how different mixed media approaches comparatively achieve specific aesthetic outcomes, considering their advantages and disad-vantages. Building upon the historical evolution of mixed media and theoretical frameworks of materiality and intermediality, the study identifies and catego-rizes common mixed media techniques used in painting. It analyzes the visual effects produced by specific media combinations, such as texture, color, and depth, and investigates how these techniques influence viewer perception and emotional response. The research employs a comparative analysis to evaluate the strengths and weaknesses of different approaches in achieving aesthetic goals. Addressing gaps in existing research…

Efficient Text-Guided 3D-Aware Generation With Score Distillation on 3D Distribution

Yiji Cheng, Fei Yin, Xiaoke Huang +5 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 0× · DOI ↗ · more like this ·

Text-to-3D generation enables the creation of 3D content with infinite possibilities. Existing methods typically involve training 3D generative models, which suffer from poor semantic alignment due to the scarcity of paired 3D data, or optimizing a 3D representation with 2D diffusion guidance, resulting in slow inference, low diversity, and Janus problems. In this paper, we introduce InstantDreamer, a model designed for text-guided 3D-aware generation in a single forward pass without requiring paired training datasets, thereby enhancing efficiency. To accomplish this, we extend score distillation to learn a 3D-aware semantics distribution. We distill priors from diffusion models into a 3D-aware generator, amortizing the optimization time required for new prompts and eliminating the necessity of paired training data. We equip the generator with hierarchical semantics conditioning…

Keep

Xintong Yu

Sociology and Political Science · Advances in business strategy and competitive advantage book series · · cited 0× · DOI ↗ · more like this ·

This case study explores Keep, a pioneering company in the Chinese fitness industry known for its innovative approach to blending technology with fitness solutions. Founded by Wang Ning, Keep revolutionized home fitness during the COVID-19 pandemic by introducing interactive live classes and expanding its digital offerings. The study examines Keep's strategic adaptations amid market challenges, such as shifting from offline gyms to collaborative ventures with traditional fitness centers. It highlights Keep's successful integration of gamification and virtual events to enhance user engagement and retention. The case also delves into Wang Ning's entrepreneurial journey, emphasizing his vision to democratize access to fitness through accessible, tech-driven solutions. Through rigorous analysis of Keep's business strategies, technological innovations, and market positioning, this case study…

An Exploration of Child-Friendly Block Renewal based on the Experience of London Borough of Hackney

Xintong Yu

Sociology and Political Science · Journal of innovation and development · · cited 0× · DOI ↗ · more like this ·

With the continuous progress of the society, children's needs for urban space have received continuous attention from all walks of life. The construction of child-friendly cities has become an important index to measure the level of civilization and development of cities. The development of child-friendly cities has become one of the strategies to solve the unbalanced and inadequate social development. At present, there are many inconveniences for children in China's urban space, and it is still necessary to improve the construction of blocks suitable for children's activities. Driven by the child-friendly concept, it is necessary to actively build city block space with priority, safety and fun for children to actively participate in Xiaoxihu block in Nanjing, China needs to be further improved in child-friendly construction. Through learning from the construction experience of London…

Efficient Text-Guided 3D-Aware Portrait Generation with Score Distillation Sampling on Distribution

Yiji Cheng, Fei Yin, Xiaoke Huang +5 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Text-to-3D is an emerging task that allows users to create 3D content with infinite possibilities. Existing works tackle the problem by optimizing a 3D representation with guidance from pre-trained diffusion models. An apparent drawback is that they need to optimize from scratch for each prompt, which is computationally expensive and often yields poor visual fidelity. In this paper, we propose DreamPortrait, which aims to generate text-guided 3D-aware portraits in a single-forward pass for efficiency. To achieve this, we extend Score Distillation Sampling from datapoint to distribution formulation, which injects semantic prior into a 3D distribution. However, the direct extension will lead to the mode collapse problem since the objective only pursues semantic alignment. Hence, we propose to optimize a distribution with hierarchical condition adapters and GAN loss regularization. For…

UniPool: A Globally Shared Expert Pool for Mixture-of-Experts

Minbin Huang, Han Shi, Chuanyang Zheng +5 more

cs.LG · · arXiv ↗ · more like this ·

Modern Mixture-of-Experts (MoE) architectures allocate expert capacity through a rigid per-layer rule: each transformer layer owns a separate expert set. This convention couples depth scaling with linear expert-parameter growth and assumes that every layer needs isolated expert capacity. However, recent analyses and our routing probe challenge this allocation rule: replacing a deeper layer's learned top-k router with uniform random routing drops downstream accuracy by only 1.0-1.6 points across multiple production MoE models. Motivated by this redundancy, we propose UniPool, an MoE architecture that treats expert capacity as a global architectural budget by replacing per-layer expert ownership with a single shared pool accessed by independent per-layer routers. To enable stable and balanced training under sharing, we introduce a pool-level auxiliary loss that balances expert utilization…

ERNIE 5.0 Technical Report

Haifeng Wang, Hua Wu, Tian Wu +435 more

cs.CL · · arXiv ↗ · more like this ·

In this report, we introduce ERNIE 5.0, a natively autoregressive foundation model desinged for unified multimodal understanding and generation across text, image, video, and audio. All modalities are trained from scratch under a unified next-group-of-tokens prediction objective, based on an ultra-sparse mixture-of-experts (MoE) architecture with modality-agnostic expert routing. To address practical challenges in large-scale deployment under diverse resource constraints, ERNIE 5.0 adopts a novel elastic training paradigm. Within a single pre-training run, the model learns a family of sub-models with varying depths, expert capacities, and routing sparsity, enabling flexible trade-offs among performance, model size, and inference latency in memory- or time-constrained scenarios. Moreover, we systematically address the challenges of scaling reinforcement learning to unified foundation…

Experimental Assortments for Choice Estimation and Nest Identification

Xintong Yu, Will Ma, Michael Zhao

stat.ME · · arXiv ↗ · more like this ·

What assortments (subsets of items) should be offered, to collect data for estimating a choice model over $n$ total items? We propose a structured, non-adaptive experiment design requiring only $O(\log n)$ distinct assortments, each offered repeatedly, that consistently outperforms randomized and other heuristic designs across an extensive numerical benchmark that estimates multiple different choice models under a variety of (possibly mis-specified) ground truths. We then focus on Nested Logit choice models, which cluster items into "nests" of close substitutes. Whereas existing Nested Logit estimation procedures assume the nests to be known and fixed, we present a new algorithm to identify nests based on collected data, which when used in conjunction with our experiment design, guarantees correct identification of nests under any Nested Logit ground truth. Our experiment design was…

VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution

Xintong Yu, Hongming Zhang, Ruixin Hong +2 more

cs.CL · · arXiv ↗ · more like this ·

The visual dialog task requires an AI agent to interact with humans in multi-round dialogs based on a visual environment. As a common linguistic phenomenon, pronouns are often used in dialogs to improve the communication efficiency. As a result, resolving pronouns (i.e., grounding pronouns to the noun phrases they refer to) is an essential step towards understanding dialogs. In this paper, we propose VD-PCR, a novel framework to improve Visual Dialog understanding with Pronoun Coreference Resolution in both implicit and explicit ways. First, to implicitly help models understand pronouns, we design novel methods to perform the joint training of the pronoun coreference resolution and visual dialog tasks. Second, after observing that the coreference relationship of pronouns and their referents indicates the relevance between dialog rounds, we propose to explicitly prune the irrelevant…