arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Cun Mu

19 papers · 2013–2026

2013: 22014: 22015: 02016: 12017: 42018: 32019: 22020: 02021: 02022: 02023: 12024: 22025: 12026: 1
2013peak 4 in 20172026

Frequent co-authors

Papers

showing 1–19 of 19 RSS

Discrete Graph Hashing

Wei Liu, Cun Mu, Sanjiv Kumar +1 more

Computer Vision and Pattern Recognition · Neural Information Processing Systems · · cited 491× · OpenAlex ↗ · more like this ·

Hashing has emerged as a popular technique for fast nearest neighbor search in gi-gantic databases. In particular, learning based hashing has received considerable attention due to its appealing storage and search efficiency. However, the perfor-mance of most unsupervised learning based hashing methods deteriorates rapidly as the hash code length increases. We argue that the degraded performance is due to inferior optimization procedures used to achieve discrete binary codes. This paper presents a graph-based unsupervised hashing model to preserve the neigh-borhood structure of massive data in a discrete code space. We cast the graph hashing problem into a discrete optimization framework which directly learns the binary codes. A tractable alternating maximization algorithm is then proposed to explicitly deal with the discrete constraints, yielding high-quality codes to well capture the…

Successive Rank-One Approximations for Nearly Orthogonally Decomposable Symmetric Tensors

Cun Mu, Daniel Hsu, Donald Goldfarb

math.NA · · cited 30× · arXiv ↗ · more like this ·

Many idealized problems in signal processing, machine learning and statistics can be reduced to the problem of finding the symmetric canonical decomposition of an underlying symmetric and orthogonally decomposable (SOD) tensor. Drawing inspiration from the matrix case, the successive rank-one approximations (SROA) scheme has been proposed and shown to yield this tensor decomposition exactly, and a plethora of numerical methods have thus been developed for the tensor rank-one approximation problem. In practice, however, the inevitable errors (say) from estimation, computation, and modeling necessitate that the input tensor can only be assumed to be a nearly SOD tensor---i.e., a symmetric tensor slightly perturbed from the underlying SOD tensor. This article shows that even in the presence of perturbation, SROA can still robustly recover the symmetric canonical decomposition of the…

Towards Practical Visual Search Engine within Elasticsearch

Cun Mu, Jun Zhao, Guang Yang +2 more

cs.CV · · cited 20× · arXiv ↗ · more like this ·

In this paper, we describe our end-to-end content-based image retrieval system built upon Elasticsearch, a well-known and popular textual search engine. As far as we know, this is the first time such a system has been implemented in eCommerce, and our efforts have turned out to be highly worthwhile. We end up with a novel and exciting visual search solution that is extremely easy to be deployed, distributed, scaled and monitored in a cost-friendly manner. Moreover, our platform is intrinsically flexible in supporting multimodal searches, where visual and textual information can be jointly leveraged in retrieval. The core idea is to encode image feature vectors into a collection of string tokens in a way such that closer vectors will share more string tokens in common. By doing that, we can utilize Elasticsearch to efficiently retrieve similar images based on similarities within encoded…

Greedy Approaches to Symmetric Orthogonal Tensor Decomposition

Cun Mu, Daniel Hsu, Donald Goldfarb

math.NA · · cited 12× · arXiv ↗ · more like this ·

Finding the symmetric and orthogonal decomposition (SOD) of a tensor is a recurring problem in signal processing, machine learning and statistics. In this paper, we review, establish and compare the perturbation bounds for two natural types of incremental rank-one approximation approaches. Numerical experiments and open questions are also presented and discussed.

Revisiting Skip-Gram Negative Sampling Model with Rectification

Cun Mu, Guang Yang, Zheng Yan

cs.CL · · cited 9× · arXiv ↗ · more like this ·

We revisit skip-gram negative sampling (SGNS), one of the most popular neural-network based approaches to learning distributed word representation. We first point out the ambiguity issue undermining the SGNS model, in the sense that the word vectors can be entirely distorted without changing the objective value. To resolve the issue, we investigate the intrinsic structures in solution that a good word embedding model should deliver. Motivated by this, we rectify the SGNS model with quadratic regularization, and show that this simple modification suffices to structure the solution in the desired manner. A theoretical justification is presented, which provides novel insights into quadratic regularization . Preliminary experiments are also conducted on Google's analytical reasoning task to support the modified SGNS model.

Toward Guaranteed Illumination Models for Non-Convex Objects

Yuqian Zhang, Cun Mu, Han-wen Kuo +1 more

cs.CV · · cited 9× · arXiv ↗ · more like this ·

Illumination variation remains a central challenge in object detection and recognition. Existing analyses of illumination variation typically pertain to convex, Lambertian objects, and guarantee quality of approximation in an average case sense. We show that it is possible to build V(vertex)-description convex cone models with worst-case performance guarantees, for non-convex Lambertian objects. Namely, a natural verification test based on the angle to the constructed cone guarantees to accept any image which is sufficiently well-approximated by an image of the object under some admissible lighting condition, and guarantees to reject any image that does not have a sufficiently good approximation. The cone models are generated by sampling point illuminations with sufficient density, which follows from a new perturbation bound for point images in the Lambertian model. As the number of…

LLM360: Towards Fully Transparent Open-Source LLMs

Zhengzhong Liu, Aurick Qiao, Willie Neiswanger +25 more

cs.CL · · cited 3× · arXiv ↗ · more like this ·

The recent surge in open-source Large Language Models (LLMs), such as LLaMA, Falcon, and Mistral, provides diverse options for AI practitioners and researchers. However, most LLMs have only released partial artifacts, such as the final model weights or inference code, and technical reports increasingly limit their scope to high-level design choices and surface statistics. These choices hinder progress in the field by degrading transparency into the training of LLMs and forcing teams to rediscover many details in the training process. We present LLM360, an initiative to fully open-source LLMs, which advocates for all training code and data, model checkpoints, and intermediate results to be made available to the community. The goal of LLM360 is to support open and collaborative AI research by making the end-to-end LLM training process transparent and reproducible by everyone. As a first…

An Empirical Comparison of FAISS and FENSHSES for Nearest Neighbor Search in Hamming Space

Cun Mu, Binwei Yang, Zheng Yan

cs.LG · · cited 3× · arXiv ↗ · more like this ·

In this paper, we compare the performances of FAISS and FENSHSES on nearest neighbor search in Hamming space--a fundamental task with ubiquitous applications in nowadays eCommerce. Comprehensive evaluations are made in terms of indexing speed, search latency and RAM consumption. This comparison is conducted towards a better understanding on trade-offs between nearest neighbor search systems implemented in main memory and the ones implemented in secondary memory, which is largely unaddressed in literature.

Fast and Exact Nearest Neighbor Search in Hamming Space on Full-Text Search Engines

Cun Mu, Jun Zhao, Guang Yang +2 more

cs.IR · · cited 1× · arXiv ↗ · more like this ·

A growing interest has been witnessed recently from both academia and industry in building nearest neighbor search (NNS) solutions on top of full-text search engines. Compared with other NNS systems, such solutions are capable of effectively reducing main memory consumption, coherently supporting multi-model search and being immediately ready for production deployment. In this paper, we continue the journey to explore specifically how to empower full-text search engines with fast and exact NNS in Hamming space (i.e., the set of binary codes). By revisiting three techniques (bit operation, subs-code filtering and data preprocessing with permutation) in information retrieval literature, we develop a novel engineering solution for full-text search engines to efficiently accomplish this special but important NNS task. In the experiment, we show that our proposed approach enables full-text…

Towards More Relevant Product Search Ranking with Fulfillment Intent Understanding

Jingxu Xu, Xinyi M. Liu, Yang Yu +3 more

Information Systems · · cited 0× · DOI ↗ · more like this ·

E-commerce retailers increasingly offer diverse fulfillment options (e.g., in-store pickup, same-day delivery from store, standard shipping from fulfillment centers and marketplace sellers), creating a need for search systems that understand and cater to individual customer preferences. This paper addresses the challenge of incorporating fulfillment intent into product search ranking. We propose a model that predicts customer fulfillment intent based on the search query, past user interactions, and other contextual information. A fulfillment match signal is introduced to quantify the alignment between a product's available fulfillment methods and the predicted customer intent. Integrating this signal into the ranking process ensures that search results prioritize products matching the user's preferred fulfillment type. Offline and online experiments demonstrate the efficacy of our…

Towards More Relevant Product Search Ranking Via Large Language Models: An Empirical Study

Qi Liu, Atul Singh, Jingbo Liu +2 more

cs.IR · · cited 0× · arXiv ↗ · more like this ·

Training Learning-to-Rank models for e-commerce product search ranking can be challenging due to the lack of a gold standard of ranking relevance. In this paper, we decompose ranking relevance into content-based and engagement-based aspects, and we propose to leverage Large Language Models (LLMs) for both label and feature generation in model training, primarily aiming to improve the model's predictive capability for content-based relevance. Additionally, we introduce different sigmoid transformations on the LLM outputs to polarize relevance scores in labeling, enhancing the model's ability to balance content-based and engagement-based relevances and thus prioritize highly relevant items overall. Comprehensive online tests and offline evaluations are also conducted for the proposed design. Our work sheds light on advanced strategies for integrating LLMs into e-commerce product search…

Using Negative Curvature in Solving Nonlinear Programs

Donald Goldfarb, Cun Mu, John Wright +1 more

math.OC · · cited 0× · arXiv ↗ · more like this ·

Minimization methods that search along a curvilinear path composed of a non-ascent nega- tive curvature direction in addition to the direction of steepest descent, dating back to the late 1970s, have been an effective approach to finding a stationary point of a function at which its Hessian is positive semidefinite. For constrained nonlinear programs arising from recent appli- cations, the primary goal is to find a stationary point that satisfies the second-order necessary optimality conditions. Motivated by this, we generalize the approach of using negative curvature directions from unconstrained optimization to nonlinear ones. We focus on equality constrained problems and prove that our proposed negative curvature method is guaranteed to converge to a stationary point satisfying second-order necessary conditions. A possible way to extend our proposed negative curvature method to…

Structured Tensor Recovery and Decomposition

Cun Mu

Computational Mathematics · Columbia Academic Commons (Columbia University) · · cited 0× · DOI ↗ · more like this ·

Tensors, a.k.a. multi-dimensional arrays, arise naturally when modeling higher-order objects and relations. Among ubiquitous applications including image processing, collaborative filtering, demand forecasting and higher-order statistics, there are two recurring themes in general: tensor recovery and tensor decomposition. The first one aims to recover the underlying tensor from incomplete information; the second one is to study a variety of tensor decompositions to represent the array more concisely and moreover to capture the salient characteristics of the underlying data. Both topics are respectively addressed in this thesis. Chapter 2 and Chapter 3 focus on low-rank tensor recovery (LRTR) from both theoretical and algorithmic perspectives. In Chapter 2, we first provide a negative result to the sum of nuclear norms (SNN) model---an existing convex model widely used for LRTR; then we…

B(j)

Wei Liu, Cun Mu, Sanjiv Kumar +1 more

Mathematical Physics · · cited 0× · OpenAlex ↗ · more like this ·

holds for any integer j ≥ 0, and both {f(B(j))} and {B(j)} converge. Proof. Since the B-subproblem in Eq. (5) of the main paper is to maximize a continuous function over a compact (i.e., closed and bounded) set, its optimal objective function value f ∗ is finite. As B(j) is feasible for each j, the sequence {f(B(j))} is bounded from above.

Scaling and Stabilizing Large-Scale Embedding-Based Retrieval

Zhen Yang, Juexin Lin, Hongwei Shang +8 more

cs.IR · · arXiv ↗ · more like this ·

Embedding-based retrieval (EBR) is foundational to large-scale e-commerce search, yet its effectiveness is often constrained by the quality of training signals and the representational capacity of the encoder. Standard dual-encoders suffer from a training-inference gap: they are optimized on narrow candidate pools but must discriminate against hundreds of millions of items during inference. Furthermore, while transitioning to higher-capacity backbones can mitigate this gap, simply replacing a mature model can lead to inconsistent retrieval behavior and a loss of the domain-specific knowledge established in previous iterations. In this paper, we present a unified pipeline deployed at Walmart that addresses both signal quality and model evolution. Our contributions are two-fold: (1) Hybrid Hard Negative Mining: We integrate Online Cross-Batch Sampling to increase negative diversity by an…

Long or Short or Both? An Exploration on Lookback Time Windows of Behavioral Features in Product Search Ranking

Qi Liu, Atul Singh, Jingbo Liu +3 more

cs.IR · · arXiv ↗ · more like this ·

Customer shopping behavioral features are core to product search ranking models in eCommerce. In this paper, we investigate the effect of lookback time windows when aggregating these features at the (query, product) level over history. By studying the pros and cons of using long and short time windows, we propose a novel approach to integrating these historical behavioral features of different time windows. In particular, we address the criticality of using query-level vertical signals in ranking models to effectively aggregate all information from different behavioral features. Anecdotal evidence for the proposed approach is also provided using live product search traffic on Walmart.com.

A Machine Learning Approach to Shipping Box Design

Guang Yang, Cun Mu

stat.ML · · arXiv ↗ · more like this ·

Having the right assortment of shipping boxes in the fulfillment warehouse to pack and ship customer's online orders is an indispensable and integral part of nowadays eCommerce business, as it will not only help maintain a profitable business but also create great experiences for customers. However, it is an extremely challenging operations task to strategically select the best combination of tens of box sizes from thousands of feasible ones to be responsible for hundreds of thousands of orders daily placed on millions of inventory products. In this paper, we present a machine learning approach to tackle the task by formulating the box design problem prescriptively as a generalized version of weighted $k$-medoids clustering problem, where the parameters are estimated through a variety of descriptive analytics. We test this machine learning approach on fulfillment data collected from…

Scalable Robust Matrix Recovery: Frank-Wolfe Meets Proximal Methods

Cun Mu, Yuqian Zhang, John Wright +1 more

math.OC · · arXiv ↗ · more like this ·

Recovering matrices from compressive and grossly corrupted observations is a fundamental problem in robust statistics, with rich applications in computer vision and machine learning. In theory, under certain conditions, this problem can be solved in polynomial time via a natural convex relaxation, known as Compressive Principal Component Pursuit (CPCP). However, all existing provable algorithms for CPCP suffer from superlinear per-iteration cost, which severely limits their applicability to large scale problems. In this paper, we propose provable, scalable and efficient methods to solve CPCP with (essentially) linear per-iteration cost. Our method combines classical ideas from Frank-Wolfe and proximal methods. In each iteration, we mainly exploit Frank-Wolfe to update the low-rank component with rank-one SVD and exploit the proximal step for the sparse term. Convergence results and…

Square Deal: Lower Bounds and Improved Relaxations for Tensor Recovery

Cun Mu, Bo Huang, John Wright +1 more

stat.ML · · arXiv ↗ · more like this ·

Recovering a low-rank tensor from incomplete information is a recurring problem in signal processing and machine learning. The most popular convex relaxation of this problem minimizes the sum of the nuclear norms of the unfoldings of the tensor. We show that this approach can be substantially suboptimal: reliably recovering a $K$-way tensor of length $n$ and Tucker rank $r$ from Gaussian measurements requires $Ω(r n^{K-1})$ observations. In contrast, a certain (intractable) nonconvex formulation needs only $O(r^K + nrK)$ observations. We introduce a very simple, new convex relaxation, which partially bridges this gap. Our new formulation succeeds with $O(r^{\lfloor K/2 \rfloor}n^{\lceil K/2 \rceil})$ observations. While these results pertain to Gaussian measurements, simulations strongly suggest that the new norm also outperforms the sum of nuclear norms for tensor completion from a…