arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Stan Lipovetsky

77 papers · 2001–2026

2001: 22002: 12003: 22004: 22005: 42006: 12007: 32008: 42009: 22010: 32011: 02012: 32013: 22014: 22015: 32016: 02017: 12018: 12019: 12020: 102021: 52022: 12023: 72024: 72025: 82026: 2
2001peak 10 in 20202026

Frequent co-authors

Papers

showing 1–25 of 77 RSS

Analysis of regression in game theory approach

Stan Lipovetsky, Michael Conklin

Statistics and Probability · Applied Stochastic Models in Business and Industry · · cited 653× · DOI ↗ · more like this ·

Abstract Working with multiple regression analysis a researcher usually wants to know a comparative importance of predictors in the model. However, the analysis can be made difficult because of multicollinearity among regressors, which produces biased coefficients and negative inputs to multiple determination from presum ably useful regressors. To solve this problem we apply a tool from the co‐operative games theory, the Shapley Value imputation. We demonstrate the theoretical and practical advantages of the Shapley Value and show that it provides consistent results in the presence of multicollinearity. Copyright © 2001 John Wiley & Sons, Ltd.

Pareto 80/20 law: derivation via random partitioning

Stan Lipovetsky

Statistics and Probability · International Journal of Mathematical Education in Science and Technology · · cited 66× · DOI ↗ · more like this ·

The Pareto 80/20 Rule, also known as the Pareto principle or law, states that a small number of causes (20%) is responsible for a large percentage (80%) of the effect. Although widely recognized as a heuristic rule, this proportion has not been theoretically based. The article considers derivation of this 80/20 rule and some other standard quotients from the mean and its interval estimation for the total value defined by the product of two variables in the random partitioning model.

Ridge regression in two‐parameter solution

Stan Lipovetsky, W. Michael Conklin

Statistics and Probability · Applied Stochastic Models in Business and Industry · · cited 61× · DOI ↗ · more like this ·

Abstract We consider simultaneous minimization of the model errors, deviations from orthogonality between regressors and errors, and deviations from other desired properties of the solution. This approach corresponds to a regularized objective that produces a consistent solution not prone to multicollinearity. We obtain a generalization of the ridge regression to two‐parameter model that always outperforms a regular one‐parameter ridge by better approximation, and has good properties of orthogonality between residuals and predicted values of the dependent variable. The results are very convenient for the analysis and interpretation of the regression. Numerical runs prove that this technique works very well. The examples are considered for marketing research problems. Copyright © 2005 John Wiley & Sons, Ltd.

Entropy Criterion In Logistic Regression And Shapley Value Of Predictors

Stan Lipovetsky

Statistics and Probability · Journal of Modern Applied Statistical Methods · · cited 32× · DOI ↗ · more like this ·

Entropy criterion is used for constructing a binary response regression model with a logistic link. This approach yields a logistic model with coefficients proportional to the coefficients of linear regression. Based on this property, the Shapley value estimation of predictors’ contribution is applied for obtaining robust coefficients of the linear aggregate adjusted to the logistic model. This procedure produces a logistic regression with interpretable coefficients robust to multicollinearity. Numerical results demonstrate theoretical and practical advantages of the entropy-logistic regression.

Predictor relative importance and matching regression parameters

Stan Lipovetsky, W. Michael Conklin

Statistics and Probability · Journal of Applied Statistics · · cited 31× · DOI ↗ · more like this ·

Predictor importance in applied regression modeling gives the main operational tools for managers and decision-makers. The paper considers estimation of predictors' importance in regression using measures introduced in works by Gibson and R. Johnson (GJ), then modified by Green, Carroll, and DeSarbo, and developed further by J. Johnson (JJ). These indices of importance are based on the orthonormal decomposition of the data matrix, and the work shows how to improve this approximation. Using predictor importance, the regression coefficients can also be adjusted to reach the best data fit and to be meaningful and interpretable. The results are compared with the robust to multicollinearity, but computationally difficult, Shapley value regression (SVR). They show that the JJ index is good for importance estimation, but the GJ index outperforms it if both predictor importance and coefficients…

Tractable Measure of Component Overlap for Gaussian Mixture Models

Ewa Nowakowska, Jacek Koronacki, Stan Lipovetsky

math.ST · · cited 22× · arXiv ↗ · more like this ·

The ability to quantify distinctness of a cluster structure is fundamental for certain simulation studies, in particular for those comparing performance of different classification algorithms. The intrinsic integral measure based on the overlap of corresponding mixture components is often analytically intractable. This is also the case for Gaussian mixture models with unequal covariance matrices when space dimension $d > 1$. In this work we focus on Gaussian mixture models and at the sample level we assume the class assignments to be known. We derive a measure of component overlap based on eigenvalues of a generalized eigenproblem that represents Fisher's discriminant task. We explain rationale behind it and present simulation results that show how well it can reflect the behavior of the integral measure in its linear approximation. The analyzed coefficient possesses the advantage of…

DECISION MAKING BY VARIABLE CONTRIBUTION IN DISCRIMINANT, LOGIT, AND REGRESSION ANALYSES

Stan Lipovetsky, Michael Conklin

Statistics and Probability · International Journal of Information Technology & Decision Making · · cited 21× · DOI ↗ · more like this ·

Comparative contribution of predictors in multivariate statistical models is widely used for decision making on the importance of the variables for the aims of analysis and prediction. However, the analysis can be made difficult because of the predictors' multicollinearity that distorts estimates for coefficients in the linear aggregate. To solve the problem of the robust evaluation of the predictors' contribution, we apply the Shapley Value regression analysis that provides consistent results in the presence of multicollinearity both for regression and discriminant functions. We also show how the linear discriminant function can be constructed as a multiple regression, and how the logistic regression can be approximated by linear regression that helps to obtain the variables contribution in the linear aggregate.

Meaningful regression analysis in adjusted coefficients Shapley value model

Stan Lipovetsky, W. Michael Conklin

Statistics and Probability · Model Assisted Statistics and Applications · · cited 20× · DOI ↗ · more like this ·

Coefficients of ordinary least squares (OLS) multiple regression present the best linear combination of the independent variables for fitting a dependent variable. However, the OLS model had never been designed to produce meaningful individual predic

Enhance-synergism and suppression effects in multiple regression

Stan Lipovetsky, W. Michael Conklin

Statistics and Probability · International Journal of Mathematical Education in Science and Technology · · cited 16× · DOI ↗ · more like this ·

Relations between pairwise correlations and the coefficient of multiple determination in regression analysis are considered. The conditions for the occurrence of enhance-synergism and suppression effects when multiple determination becomes bigger than the total of squared correlations of the dependent variable with the regressors are discussed. It is shown that such effects can occur just for stochastic relations among the variables that have non-transitive signs of pairwise correlations. Consideration of these problems facilitates better understanding the properties of regression.

Optimal Lp-Metric for Minimizing Powered Deviations in Regression

Stan Lipovetsky

Statistics and Probability · Journal of Modern Applied Statistical Methods · · cited 15× · DOI ↗ · more like this ·

Minimizations by least squares or by least absolute deviations are well known criteria in regression modeling. In this work the criterion of generalized mean by powered deviations is suggested. If the parameter of the generalized mean equals one or two, the fitting corresponds to the least absolute or the least squared deviations, respectively. Varying the power parameter yields an optimum value for the objective with a minimum possible residual error. Estimation of a most favorable value of the generalized mean parameter shows that it almost does not depend on data. The optimal power always occurs to be close to 1.7, so these powered deviations should be used for a better regression fit.

Regression By Data Segments Via Discriminant Analysis

Stan Lipovetsky, Michael Conklin

Statistics and Probability · Journal of Modern Applied Statistical Methods · · cited 14× · DOI ↗ · more like this ·

It is known that two-group linear discriminant function can be constructed via binary regression. In this article, it is shown that the opposite relation is also relevant – it is possible to present multiple regression as a linear combination of a main part, based on the pooled variance, and Fisher discriminators by data segments. Presenting regression as an aggregate of the discriminators allows one to decompose coefficients of the model into sum of several vectors related to segments. Using this technique provides an understanding of how the total regression model is composed of the regressions by the segments with possible opposite directions of the dependency on the predictors.

How Good is Best? Multivariate Case of Ehrenberg-Weisberg Analysis of Residual Errors in Competing Regressions

Stan Lipovetsky

Statistics and Probability · Journal of Modern Applied Statistical Methods · · cited 13× · DOI ↗ · more like this ·

A.S.C. Ehrenberg first noticed and S. Weisberg then formalized a property of pairwise regression to keep its quality almost at the same level of precision while the coefficients of the model could vary over a wide span of values. This paper generalizes the estimates of the percent change in the residual standard deviation to the case of competing multiple regressions. It shows that in contrast to the simple pairwise model, the coefficients of multiple regression can be changed over a wider range of the values including the opposite by signs coefficients. Consideration of these features facilitates better understanding the properties of regression and opens a possibility to modify the obtained regression coefficients into meaningful and interpretable values using additional criteria. Several competing modifications of the linear regression with interpretable coefficients are described…

Incremental net effects in multiple regression

Stan Lipovetsky, Michael Conklin

Statistics and Probability · International Journal of Mathematical Education in Science and Technology · · cited 13× · DOI ↗ · more like this ·

A regular problem in regression analysis is estimating the comparative importance of the predictors in the model. This work considers the ‘net effects’, or shares of the predictors in the coefficient of the multiple determination, which is a widely used characteristic of the quality of a regression model. Estimation of ;the net effects can be a difficult task because multicollinearity among the regressors can produce negative inputs to multiple determination. This paper suggests estimating the incremental net effects as subsequent marginal inputs to the coefficient of multiple determination, and it is shown that the results coincide with estimation by cooperative game theory. This approach guarantees positive and interpretable net effects, which offers a better interpretation of the regression results.

Multivariate least squares and its relation to other multivariate techniques

Stan Lipovetsky, Asher Tishler, W. Michael Conklin

Statistics and Probability · Applied Stochastic Models in Business and Industry · · cited 13× · DOI ↗ · more like this ·

Abstract We consider multivariate least squares (LS) for the estimation of the connection between two data sets and show how LS is related to other multivariate techniques regularly used to analyse large data sets. LS methods are shown to be equivalent, or similar, to principal components, canonical correlations and its modifications, including a variant of the partial LS. LS approach provides a convenient unified framework for a general description and comparison of various multivariate methods, facilitates their understanding, and helps to identify their usefulness for various real‐world applications. As an example we estimate and discuss the relations between data sets containing managerial variables and success measures. Copyright © 2002 John Wiley & Sons, Ltd.

MANOVA, LDA, and FA criteria in clusters parameter estimation

Stan Lipovetsky

Statistics and Probability · Cogent Mathematics · · cited 11× · DOI ↗ · more like this ·

Multivariate analysis of variance (MANOVA) and linear discriminant analysis (LDA) apply such well-known criteria as the Wilks’ lambda, Lawley–Hotelling trace, and Pillai’s trace test for checking quality of the solutions. The current paper suggests using these criteria for building objectives for finding clusters parameters because optimizing such objectives corresponds to the best distinguishing between the clusters. Relation to Joreskog’s classification for factor analysis (FA) techniques is also considered. The problem can be reduced to the multinomial parameterization, and solution can be found in a nonlinear optimization procedure which yields the estimates for the cluster centers and sizes. This approach for clustering works with data compressed into covariance matrix so can be especially useful for big data.

DATA FUSION IN SEVERAL ALGORITHMS

Stan Lipovetsky

Statistics and Probability · Advances in Adaptive Data Analysis · · cited 11× · DOI ↗ · more like this ·

Data fusion consists of the process of integrating several datasets with some common variables, and other variables available only in partial datasets. The main problem of data fusion can be described as follows. From one source, having X 0 and Y 0 datasets (with N 0 observations by multiple x and y variables, n and m of those, respectively), and from another source, having X 1 data (with N 1 observations by the same nx-variables), we need to estimate the missing portion of the Y 1 data (of size N 1 by m variables) in order to combine all the data into one set. Several algorithms are considered in this work, including estimation of weights proportional to the distances from each ith observation in the X 1 "recipients" dataset to all observations in the X 0 "donors" dataset. Or we can use a sample balancing technique with the maximum effective base performed by applying ridge-regression…

Equidistant regression modeling

Stan Lipovetsky

Statistics and Probability · Model Assisted Statistics and Applications · · cited 11× · DOI ↗ · more like this ·

A criterion of equalizing residual squares is considered for regression modeling, and its results are compared with the ordinary least squares and least absolute deviations regression models. Equalized residuals yield a model with the minimum mean di

Readability Indices Structure and Optimal Features

Stan Lipovetsky

Artificial Intelligence · Axioms · · cited 9× · DOI ↗ · more like this ·

The work considers formal structure and features of the readability indices widely employed in various information and education fields, including theory of communication, cognitive psychology, linguistics, and multiple applications. In spite of the importance and popularity of readability indices in practical research, their intrinsic properties have not yet been sufficiently investigated. This paper aims to fill this gap between the theory and application of these indices by presenting them in a uniform expression which permits analyzing their features and deriving new properties that are useful in practice. Three theorems are proved for relations between the units of a text structure. The general characteristics are illustrated by numerical examples which can be helpful for researchers and practitioners.

MEANINGFUL REGRESSION COEFFICIENTS BUILT BY DATA GRADIENTS

Stan Lipovetsky

Statistics and Probability · Advances in Adaptive Data Analysis · · cited 9× · DOI ↗ · more like this ·

Multiple regression's coefficients define change in the dependent variable due to a predictor's change while all other predictors are constant. Rearranging data to paired differences of observations and keeping only biggest changes yield a matrix of a single variable change, which is close to orthogonal design, so there is no impact of multicollinearity on the regression. A similar approach is used for meaningful coefficients of nonlinear regressions with coefficients of half-elasticity, elasticity, and odds' elasticity due the gradients in each predictor. In contrast to regular linear and nonlinear regressions, the suggested technique produces interpretable coefficients not prone to multicollinearity effects.

Comparison among different patterns of priority vectors estimation methods

Stan Lipovetsky

Statistics and Probability · International Journal of Mathematical Education in Science and Technology · · cited 9× · DOI ↗ · more like this ·

Benford's law of the ‘first digits’ states that in spite of intuitively expected equal frequency of 1/9 of the decimal digits r = 1, … , 9 appearance on the first place of any number, various empirical studies shows another pattern of these frequencies distribution, which is log10(1 + 1/r). The article considers this law and other designs of data generation for pair comparison matrices, and several estimation techniques for the priority vectors. Among those are Analytic Hierarchy Process (AHP), Simple Multi-Attribute Rating Technique (SMART), and several additional approaches of the multiple criteria decision making. The closeness of a priority vector evaluated by a data elicited from an expert to one or another pattern helps to identify a nature of the data comparison process.

Dual‐ and triple‐mode matrix approximation and regression modelling

Stan Lipovetsky, W. Michael Conklin

Signal Processing · Applied Stochastic Models in Business and Industry · · cited 9× · DOI ↗ · more like this ·

Abstract We propose a dual‐ and triple‐mode least squares for matrix approximation. This technique applied to the singular value decomposition produces the classical solution with a new interpretation. Applied to regression modelling, this approach corresponds to a regularized objective and yields a new solution with properties of a ridge regression. The results for regression are robust and suggest a convenient tool for the analysis and interpretation of the model coefficients. Numerical results are given for a marketing research data set. Copyright © 2003 John Wiley & Sons, Ltd.