Author

Lin Shao

181 papers · 1999–2026

1999peak 21 in 20262026

Frequent co-authors

Papers

showing 1–25 of 181 RSS

Feedback-driven interactive exploration of large multidimensional data supported by visual classifier

Michael Behrisch, Fatih Korkmaz, Lin Shao +1 more

Computer Vision and Pattern Recognition · October 2014 · cited 69× · DOI ↗ · more like this ·

The extraction of relevant and meaningful information from multivariate or high-dimensional data is a challenging problem. One reason for this is that the number of possible representations, which might contain relevant information, grows exponentially with the amount of data dimensions. Also, not all views from a possibly large view space, are potentially relevant to a given analysis task or user. Focus+Context or Semantic Zoom Interfaces can help to some extent to efficiently search for interesting views or data segments, yet they show scalability problems for very large data sets. Accordingly, users are confronted with the problem of identifying interesting views, yet the manual exploration of the entire view space becomes ineffective or even infeasible. While certain quality metrics have been proposed recently to identify potentially interesting views, these often are defined in a…

Concept2Robot: Learning Manipulation Concepts from Instructions and Human Demonstrations

Lin Shao, Toki Migimatsu, Qiang Zhang +2 more

Computer Vision and Pattern Recognition · 30 Jun 2020 · cited 54× · DOI ↗ · more like this ·

We aim to endow a robot with the ability to learn manipulation concepts that link natural language instructions to motor skills.Our goal is to learn a single multi-task policy that takes as input a natural language instruction and an image of the initial scene and outputs a robot motion trajectory to achieve the specified task.This policy has to generalize over different instructions and environments.Our insight is that we can approach this problem through Learning from Demonstration by leveraging large-scale video datasets of humans performing manipulation actions.Thereby, we avoid more time-consuming processes such as teleoperation or kinesthetic teaching.We also avoid having to manually design task-specific rewards.We propose a two-stage learning process where we first learn single-task policies through reinforcement learning.The reward is provided by scoring how well the robot…

Interactive Regression Lens for Exploring Scatter Plots

Lin Shao, Ajay Mahajan, Tobias Schreck +1 more

Computer Vision and Pattern Recognition · Computer Graphics Forum · June 2017 · cited 47× · DOI ↗ · more like this ·

Abstract Data analysis often involves finding models that can explain patterns in data, and reduce possibly large data sets to more compact model‐based representations. In Statistics, many methods are available to compute model information. Among others, regression models are widely used to explain data. However, regression analysis typically searches for the best model based on the global distribution of data. On the other hand, a data set may be partitioned into subsets, each requiring individual models. While automatic data subsetting methods exist, these often require parameters or domain knowledge to work with. We propose a system for visual‐interactive regression analysis for scatter plot data, supporting both global and local regression modeling. We introduce a novel regression lens concept, allowing a user to interactively select a portion of data, on which regression analysis…

Motion-based Object Segmentation based on Dense RGB-D Scene Flow

Lin Shao, Parth Shah, Vikranth Dwaracherla +1 more

cs.RO · April 2018 · cited 40× · arXiv ↗ · more like this ·

Given two consecutive RGB-D images, we propose a model that estimates a dense 3D motion field, also known as scene flow. We take advantage of the fact that in robot manipulation scenarios, scenes often consist of a set of rigidly moving objects. Our model jointly estimates (i) the segmentation of the scene into an unknown but finite number of objects, (ii) the motion trajectories of these objects and (iii) the object scene flow. We employ an hourglass, deep neural network architecture. In the encoding stage, the RGB and depth images undergo spatial compression and correlation. In the decoding stage, the model outputs three images containing a per-pixel estimate of the corresponding object center as well as object translation and rotation. This forms the basis for inferring the object segmentation and final object scene flow. To evaluate our model, we generated a new and challenging…

OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining

Yuran Wang, Siqiao Huang, Mingleyang Li +21 more

cs.RO · 7 Sep 2026 · cited 39× · arXiv ↗ · more like this ·

World-Action Models inherit world knowledge from video-generative priors, and channel it into executable control signals through embodied experience. Existing systems, however, are monolithic: the generative backbone, visual representation, architecture, information flow, inference procedure, and training data are tightly coupled, obscuring which design choices matter and why. We introduce OpenWAM, an open research stack that turns world-action pretraining into a controlled experimental program. OpenWAM-Infra factorizes the WAM design space into composable modules with unified training, inference, deployment, and evaluation. On this substrate, OpenWAM-Study examines three questions through controlled experiments: what to inherit, how world and action learning interact, and how their synergy scales; and distills three principles: upstream knowledge transfers through a sufficiently…

Visual-Interactive Search for Soccer Trajectories to Identify Interesting Game Situations

Lin Shao, Dominik Sacha, Benjamin Neldner +2 more

Computer Vision and Pattern Recognition · Electronic Imaging · 14 Feb 2016 · cited 29× · DOI ↗ · more like this ·

Recently, sports analytics has turned into an important research area of visual analytics and may provide interesting findings, such as the best player of the season, for various kinds of sports. Soccer is a very popular and tactical game, which also attracted great attention in the last few years. However, the search for complex game movements is a very crucial and challenging task. We present a system for searching trajectory data in soccer matches by means of an interactive search interface that enables the user to sketch a situation of interest. Furthermore, we apply a domain specific prefiltering process to extract a set of local movement segments, which are similar to a given sketch. Our approach comprises single-trajectory, multi-trajectory, and event-specific search functions based on two different similarity measures. To demonstrate the usefulness of our approach, we define a…

Guided Sketching for Visual Search and Exploration in Large Scatter Plot Spaces

Lin Shao, Michael Behrisch, Tobias Schreck +4 more

Computer Vision and Pattern Recognition · TUbilio (Technical University of Darmstadt) · 2014 · cited 25× · DOI ↗ · more like this ·

Recently, there has been an interest in methods for filtering large scatter plot spaces for interesting patterns. However, user interaction remains crucial in starting an explorative analysis in a large scatter plot space. We introduce an approach for explorative search and navigation in large sets of scatter plot diagrams. By means of a sketch-based query interface, users can start the exploration process by providing a visual example of the pattern they are interested in. A shadow-drawing approach provides suggestions for possibly relevant patterns while query drawing takes place, supporting the visual search process. We apply the approach on a large real-world data set, demonstrating the principal functionality and usefulness of our technique.

Visual Exploration of Large Scatter Plot Matrices by Pattern Recommendation based on Eye Tracking

Lin Shao, Nelson Silva, Eva Eggeling +1 more

Computer Vision and Pattern Recognition · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · 9 Mar 2017 · cited 23× · DOI ↗ · more like this ·

The Scatter Plot Matrix (SPLOM) is a well-known technique for visual analysis of high-dimensional data. However, one problem of large SPLOMs is that typically not all views are potentially relevant to a given analysis task or user. The matrix itself may contain structured patterns across the dimensions, which could interfere with the investigation for unexplored views. We introduce a new concept and prototype implementation for an interactive recommender system supporting the exploration of large SPLOMs based on indirectly obtained user feedback from user eye tracking. Our system records the patterns that are currently under exploration based on gaze times, recommending areas of the SPLOM containing potentially new, unseen patterns for successive exploration. We use an image-based dissimilarity measure to recommend patterns that are visually dissimilar to previously seen ones, to guide…

Evaluation Method of IT English Blended Teaching Quality Based on the Data Mining Algorithm

Lin Shao

Information Systems · Journal of Mathematics · 31 Dec 2021 · cited 19× · DOI ↗ · more like this ·

As the mixed education model gradually becomes widespread in various universities in Japan, the evaluation of the quality of IT English mixed education has become a very important issue, and it is worth considering the corresponding evaluation method. In this paper, we use a data mining algorithm to implement an evaluation method for the interconversion of quantitative data and qualitative concepts and use the IT English mixed teaching model to evaluate and analyze the teaching quality of the course. The evaluation method is feasible and provides a mixing method. Evaluation of the quality of education. Reference method.

Interactive Visual Exploration of Local Patterns in Large Scatterplot Spaces

Mohammad Chegini, Lin Shao, Robert J. Gregor +3 more

Computer Vision and Pattern Recognition · Computer Graphics Forum · June 2018 · cited 13× · DOI ↗ · more like this ·

Abstract Analysts often use visualisation techniques like a scatterplot matrix (SPLOM) to explore multivariate datasets. The scatterplots of a SPLOM can help to identify and compare two‐dimensional global patterns. However, local patterns which might only exist within subsets of records are typically much harder to identify and may go unnoticed among larger sets of plots in a SPLOM. This paper explores the notion of local patterns and presents a novel approach to visually select, search for, and compare local patterns in a multivariate dataset. Model‐based and shape‐based pattern descriptors are used to automatically compare local regions in scatterplots to assist in the discovery of similar local patterns. Mechanisms are provided to assess the level of similarity between local patterns and to rank similar patterns effectively. Moreover, a relevance feedback module is used to suggest…

A Novel Method of Software Vulnerability Detection based on Fuzzing Technique

Xiaosong Zhang, Lin Shao, Jiong Zheng

Signal Processing · December 2008 · cited 12× · DOI ↗ · more like this ·

Buffer overflow vulnerabilities can cause attacks that result in serious consequences. However the techniques of buffer overflow vulnerability detection are limited to manual analysis, binary-patch comparison, fuzzing and so on. They rely on manual analysis, thus cause high overhead. In this paper, we propose a novel method of detection of buffer overflow vulnerabilities, which is based on fuzzing, data-flow dynamic analysis and automated exception analysis. This new method effectively improves the detection of unknown security vulnerabilities (0 Day). Moreover, it is more automated and has better performance in finding new security vulnerabilities.

ClusterNet: 3D Instance Segmentation in RGB-D Images

Lin Shao, Ye Tian, Jeannette Bohg

cs.RO · July 2018 · cited 9× · arXiv ↗ · more like this ·

We propose a method for instance-level segmentation that uses RGB-D data as input and provides detailed information about the location, geometry and number of individual objects in the scene. This level of understanding is fundamental for autonomous robots. It enables safe and robust decision-making under the large uncertainty of the real-world. In our model, we propose to use the first and second order moments of the object occupancy function to represent an object instance. We train an hourglass Deep Neural Network (DNN) where each pixel in the output votes for the 3D position of the corresponding object center and for the object's size and pose. The final instance segmentation is achieved through clustering in the space of moments. The object-centric training loss is defined on the output of the clustering. Our method outperforms the state-of-the-art instance segmentation method on…

Guiding the Exploration of Scatter Plot Data Using Motif-Based Interest Measures

Lin Shao, Timo Schleicher, Michael Behrisch +3 more

Computer Vision and Pattern Recognition · September 2015 · cited 8× · DOI ↗ · more like this ·

Finding interesting patterns in large scatter plot spaces is a challenging problem and becomes even more difficult with increasing number of dimensions. Previous approaches for exploring large scatter plot spaces like e.g., the well-known Scagnostics approach, mainly focus on ranking scatter plots based on their global properties. However, often local patterns contribute significantly to the interestingness of a scatter plot. We are proposing a novel approach for the automatic determination of interesting views in scatter plot spaces based on analysis of local scatter plot segments. Specifically, we automatically classify similar local scatter plot segments, which we call scatter plot motifs. Inspired by the well-known tf-idf approach from information retrieval, we compute local and global quality measures based on certain frequency properties of the local motifs. We show how we can use…

Practical Perception and Quality Evaluation for Teaching of Dynamic Visual Communication Design in the Context of Digital Media

Aiping Li, Xiaoji Zhang, Lin Shao

Computer Graphics and Computer-Aided Design · International Journal of Emerging Technologies in Learning (iJET) · 10 May 2022 · cited 7× · DOI ↗ · more like this ·

In the age of the Internet, the teaching of dynamic visual communication design (DVCD) is an irresistible trend for the innovation of visual art teaching. The DVCD teaching quality can be improved to a new level by providing feedbacks to applications with the data on students’ needs for practical perception (PPN). However, the current practical perception and service applications rarely tackle the feature extraction and application of high-level needs for practical perception in the context of digital media. To solve the problem, this paper explores the practical perception and quality evaluation for DVCD teaching in the context of digital media. Specifically, the students’ PPN feature extraction problem was described in the field of DVCD teaching, and fuzzy clustering was introduced to extract students’ PPN features. Then, the authors detailed the dynamic evolution of students’ PPN in…

The Correlation Between Teachers' Visual Digital Media Design Ability and Effective Teaching

Lin Shao, Wendi Zhang, Aiping Li +1 more

Computer Graphics and Computer-Aided Design · International Journal of Emerging Technologies in Learning (iJET) · 20 Jan 2022 · cited 7× · DOI ↗ · more like this ·

Enhancing teachers' visual digital media design ability is conductive to improving the effectiveness of classroom teaching of art design major. Thoroughly exploring, discussing, and studying the correlation between teachers' visual digital media design ability and effective teaching is a requirement for the professional development of art design teachers, and it is a very meaningful job for cultivating high-quality art design professionals. To this end, this paper aims to study the correlation between teachers’ visual digital media design ability and effective teaching. At first, this paper constructed an Evaluation Index System (EIS) for evaluating teachers’ visual digital media design ability, and gave the calculation methods and steps of the evaluation model based on the entropy weight TOPSIS method; then, the paper employed a Bayesian Convolutional Neural Network (BCNN) and made…

Aircraft Pose Recognition Using Locally Linear Embedding

Wenting Yuan, Peng Jia, Luping Wang +1 more

Computer Vision and Pattern Recognition · 2009 · cited 7× · DOI ↗ · more like this ·

Locally linear embedding (LLE) is a prevalent manifold learning method in pattern recognition and machine learning. It preserves the intrinsic structure information of data set and has been widely applied to feature extraction and dimensionality reduction. This paper introduces LLE to aircraft pose recognition. The representative motion poses of an aircraft in the air are analyzed. Unfolding results of aircraft images in different poses show LLE has a natural connection to clustering. Moreover, we employ back propagation neural networks and nearest neighbor algorithms to classify the input samples after dimensionality reduction. Computer simulation testifies the efficiency and accuracy of LLE in aircraft pose recognition.

Prospect of the development of Northeast Tiger and Leopard National Park based on the theory of rewilding: Comments on the thought and practice of wilderness protection

Hongxin Wang, Jun-lin SHAO, Shu-ting YU +2 more

Sociology and Political Science · 自然资源学报 · 2021 · cited 6× · DOI ↗ · more like this ·

Abstract: Establishing a protected area system centered on national parks is a theoretical and practical innovation to promote the strategy of "Five in One". Through the analysis of the origin, development process, and practice of the thought of wilderness protection, this paper expounds the internal relationship between wilderness and protected area system. On this basis, this paper reviews "3C" Model, trophic rewilding and "TSD" Model in rewilding theory and analyzes the Master Plan of Northeast Tiger and Leopard National Park (2017-2025) (Draft for Comments) with NVivo. The Plan conforms to rewilding theory and reflects the idea of wilderness protection characterized by trophic rewilding. It also involves strong artificial intervention and shows marked features of ecological rewilding. It is an inevitable requirement to place emphasis on wilderness and rewilding when urbanization and…

GRAC: Self-Guided and Self-Regularized Actor-Critic

Lin Shao, Yifan You, Mengyuan Yan +2 more

cs.LG · September 2020 · cited 6× · arXiv ↗ · more like this ·

Deep reinforcement learning (DRL) algorithms have successfully been demonstrated on a range of challenging decision making and control tasks. One dominant component of recent deep reinforcement learning algorithms is the target network which mitigates the divergence when learning the Q function. However, target networks can slow down the learning process due to delayed function updates. Our main contribution in this work is a self-regularized TD-learning method to address divergence without requiring a target network. Additionally, we propose a self-guided policy improvement method by combining policy-gradient with zero-order optimization to search for actions associated with higher Q-values in a broad neighborhood. This makes learning more robust to local noise in the Q function approximation and guides the updates of our actor network. Taken together, these components define GRAC, a…

Schwarz Method for Penalized Quasi-Likelihood in Generalized Additive Models

Guangbao Guo, Lin Shao-ling

Statistics and Probability · Communication in Statistics- Theory and Methods · 12 May 2010 · cited 6× · DOI ↗ · more like this ·

The topic is penalized quasi-maximum likelihood estimation in generalized additive models by an approximation using a sequence of sub-models, here called blocks. The Schwarz method uses a sequence of sub-models, The technique might be useful to model comparison, where the fitted values from a sub-model are used as starting values for a larger model. We show that the algorithm method converges in canonical link of generalized additive models, and a theorem about bound condition of sub-models convergence with uncanonical link.

Study Film and Television Postproduction and Innovation Strategy Based on an Artificial Intelligence Algorithm

Jing Han, Lin Shao

Computer Graphics and Computer-Aided Design · Mobile Information Systems · 2 Aug 2022 · cited 5× · DOI ↗ · more like this ·

In the process of choosing the best scheme in the artificial intelligence algorithm, it is impossible to accurately judge the nonlinear relationship between the innovation strategy and the film and television postproduction scheme. An improved artificial intelligence algorithm based on the integration of dynamic factors and the artificial intelligence algorithm is proposed to reduce the disturbance ability of the artificial intelligence algorithm and improve the analysis level of film and television postproduction and innovation strategy. Firstly, the initial innovation strategy set of the production set is established by using dynamic factors, which makes it discrete and reduces the influence of the scheme selection error on the results. Then, the production set is divided into dynamic subproduction sets by using the film and television production theory, and each subproduction set…

Facial Movements Recognition Using Multichannel EMG Signals

Lin Shao

Human-Computer Interaction · June 2019 · cited 4× · DOI ↗ · more like this ·

With the development of intelligent wearable technology, the need for more effective and practical human-computer interaction becomes more and more urgent. The main purpose of this paper is to recognize rich facial movements with multi-channel EMG signals and try to apply them in human-computer interaction. In offline data analysis, we tested a variety of features and classification algorithms. In the two sets of facial motion recognition, the accuracy of 11 facial motion recognition can reach 98.3% and 98.8%, respectively. In the test based on the online typing system, an average accuracy of 83.9% was also achieved.

Visual Exploration of Hierarchical Data Using Degree-of-Interest Controlled by Eye-Tracking

Nelson Silva, Lin Shao, Tobias Schreck +2 more

Computer Vision and Pattern Recognition · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · 25 Nov 2016 · cited 4× · OpenAlex ↗ · more like this ·

Effective visual exploration of large data sets is an important problem. A standard technique for mapping large data sets is to use hierarchical data representations (trees, or dendrograms) that users may navigate. If the data sets get large, so do the hierarchies, and effective methods for the navigation are required. Traditionally, users navigate visual representations using desktop interaction modalities, including mouse interaction. Motivated by recent availability of low-cost eye-tracker systems, we investigate application possibilities to use eye-tracking for controlling the visual-interactive data exploration process. We implemented a proof-of-concept system for visual exploration of hierarchic data, exemplified by scatter plot diagrams which are to be explored for grouping and similarity relationships. The exploration includes usage of degree-of-interest based distortion…

A Metastability Risk Prediction and Mitigation Technique for Clock-Domain Crossing With Single-Stage Synchronizer in Near-Threshold-Voltage Multivoltage/ Frequency-Domain Network-on-Chip

Chuxiong Lin, Weifeng He, Yanan Sun +4 more

Computer Networks and Communications · IEEE Journal of Solid-State Circuits · 23 Jun 2023 · cited 3× · DOI ↗ · more like this ·

For a network-on-chip (NoC) with multiple voltage/frequency domains, metastability hurts the reliability during the clock-domain crossing, especially in the near-threshold-voltage (NTV) region. Conventional multistage synchronizers reduce the probability of metastability but have a high latency penalty. This article presents a technique titled metastability risk prediction and mitigation (MPAM) that predicts the near-future metastability risks by a triple-phase clock monitoring circuitry and mitigates them by a metastability-free clock scheme. Therefore, the MPAM enables only one flip-flop for data synchronization without degrading the reliability against metastability, thus improving the latency and throughput of NoC. We prototyped a 2-by-2 NoC test chip with four independent voltage/frequency domains in a 40-nm low-power (LP) process, featuring the MPAM technique. The measurement…

SAM-RL: Sensing-Aware Model-Based Reinforcement Learning via Differentiable Physics-Based Simulation and Rendering

Jun Lv, Yunhai Feng, Cheng Zhang +3 more

cs.RO · October 2022 · cited 3× · arXiv ↗ · more like this ·

Model-based reinforcement learning (MBRL) is recognized with the potential to be significantly more sample-efficient than model-free RL. How an accurate model can be developed automatically and efficiently from raw sensory inputs (such as images), especially for complex environments and tasks, is a challenging problem that hinders the broad application of MBRL in the real world. In this work, we propose a sensing-aware model-based reinforcement learning system called SAM-RL. Leveraging the differentiable physics-based simulation and rendering, SAM-RL automatically updates the model by comparing rendered images with real raw images and produces the policy efficiently. With the sensing-aware learning pipeline, SAM-RL allows a robot to select an informative viewpoint to monitor the task process. We apply our framework to real world experiments for accomplishing three manipulation tasks…

Eye Gaze on Scatterplot: Concept and First Results of Recommendations for Exploration of SPLOMs Using Implicit Data Selection

Nils Rodrigues, Lin Shao, Jia Jun Yan +2 more

Computer Vision and Pattern Recognition · Fraunhofer-Publica (Fraunhofer-Gesellschaft) · 27 May 2022 · cited 3× · DOI ↗ · more like this ·

We propose a three-step concept and visual design for supporting the visual exploration of high-dimensional data in scatterplots through eye-tracking. First, we extract subsets in the underlying data using existing classifications, automated clustering algorithms, or eye-tracking. For the latter, we map gaze to the underlying data dimensions in the scatterplot. Clusters of data points that have been the focus of the viewers’ gaze are marked as clusters of interest (eye-mind hypothesis). In a second step, our concept extracts various properties from statistics and scagnostics from the clusters. The third step uses these measures to compare the current data clusters from the main scatterplot to the same data in other dimensions. The results enable analysts to retrieve similar or dissimilar views as guidance to explore the entire data set. We provide a proof-of-concept implementation as a…