arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mazumder

1,247 papers · 1753–2026

1967: 11968: 01969: 01970: 01971: 01972: 01973: 01974: 01975: 01976: 01977: 01978: 11979: 11980: 01981: 01982: 01983: 01984: 11985: 11986: 01987: 31988: 21989: 21990: 01991: 11992: 31993: 01994: 41995: 31996: 71997: 41998: 21999: 22000: 72001: 42002: 62003: 92004: 82005: 132006: 142007: 72008: 132009: 152010: 262011: 422012: 142013: 412014: 512015: 362016: 632017: 502018: 792019: 492020: 822021: 842022: 702023: 882024: 1082025: 1092026: 120
1967peak 120 in 20262026

Frequent co-authors

Papers

showing 1–25 of 1,247 RSS

Memory Fusion Network for Multi-view Sequential Learning

Amir Zadeh, Paul Pu Liang, Navonil Mazumder +3 more

cs.LG · · cited 982× · arXiv ↗ · more like this ·

Multi-view sequential learning is a fundamental problem in machine learning dealing with multi-view sequences. In a multi-view sequence, there exists two forms of interactions between different views: view-specific interactions and cross-view interactions. In this paper, we present a new neural architecture for multi-view sequential learning called the Memory Fusion Network (MFN) that explicitly accounts for both interactions in a neural architecture and continuously models them through time. The first component of the MFN is called the System of LSTMs, where view-specific interactions are learned in isolation through assigning an LSTM function to each view. The cross-view interactions are then identified using a special attention mechanism called the Delta-memory Attention Network (DMAN) and summarized through time with a Multi-view Gated Memory. Through extensive experimentation, MFN…

Impact of Rumors and Misinformation on COVID-19 in Social Media

Samia Tasnim, Md Mahbub Hossain, Hoimonty Mazumder

Sociology and Political Science · Journal of Preventive Medicine and Public Health · · cited 743× · DOI ↗ · more like this ·

The coronavirus disease 2019 (COVID-19) pandemic has not only caused significant challenges for health systems all over the globe but also fueled the surge of numerous rumors, hoaxes, and misinformation, regarding the etiology, outcomes, prevention, and cure of the disease. Such spread of misinformation is masking healthy behaviors and promoting erroneous practices that increase the spread of the virus and ultimately result in poor physical and mental health outcomes among individuals. Myriad incidents of mishaps caused by these rumors have been reported globally. To address this issue, the frontline healthcare providers should be equipped with the most recent research findings and accurate information. The mass media, healthcare organization, community-based organizations, and other important stakeholders should build strategic partnerships and launch common platforms for disseminating…

Fortunate Sons: New Estimates of Intergenerational Mobility in the United States Using Social Security Earnings Data

Bhashkar Mazumder

Sociology and Political Science · The Review of Economics and Statistics · · cited 683× · DOI ↗ · more like this ·

Previous studies, relying on short-term averages of fathers' earnings, have estimated the intergenerational elasticity (IGE) in earnings to be approximately 0.4. Due to persistent transitory fluctuations, these estimates have been biased down by approximately 30% or more. Using administrative data containing the earnings histories of parents and children, the IGE is estimated to be around 0.6. This suggests that the United States is substantially less mobile than previous research indicated. Estimates of intergenerational mobility are significantly lower for families with little or no wealth, offering empirical support for theoretical models that predict differences due to borrowing constraints.

Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares

Trevor Hastie, Rahul Mazumder, Jason Lee +1 more

stat.ME · · cited 613× · arXiv ↗ · more like this ·

The matrix-completion problem has attracted a lot of attention, largely as a result of the celebrated Netflix competition. Two popular approaches for solving the problem are nuclear-norm-regularized matrix approximation (Candes and Tao, 2009, Mazumder, Hastie and Tibshirani, 2010), and maximum-margin matrix factorization (Srebro, Rennie and Jaakkola, 2005). These two procedures are in some cases solving equivalent problems, but with quite different algorithms. In this article we bring the two approaches together, leading to an efficient algorithm for large matrix factorization and completion that outperforms both of these. We develop a software package "softImpute" in R for implementing our approaches, and a distributed version for very large matrices using the "Spark" cluster programming environment.

Exact covariance thresholding into connected components for large-scale Graphical Lasso

Rahul Mazumder, Trevor Hastie

stat.ML · · cited 237× · arXiv ↗ · more like this ·

We consider the sparse inverse covariance regularization problem or graphical lasso with regularization parameter $ρ$. Suppose the co- variance graph formed by thresholding the entries of the sample covariance matrix at $ρ$ is decomposed into connected components. We show that the vertex-partition induced by the thresholded covariance graph is exactly equal to that induced by the estimated concentration graph. This simple rule, when used as a wrapper around existing algorithms, leads to enormous performance gains. For large values of $ρ$, our proposal splits a large graphical lasso problem into smaller tractable problems, making it possible to solve an otherwise infeasible large scale graphical lasso problem.

Intergenerational Economic Mobility in the United States, 1940 to 2000

Daniel Aaronson, Bhashkar Mazumder

Sociology and Political Science · The Journal of Human Resources · · cited 228× · DOI ↗ · more like this ·

We estimate trends in intergenerational economic mobility by matching men in the Census to synthetic parents in the prior generation. We find that mobility increased from 1950 to 1980 but has declined sharply since 1980. While our estimator places greater weight on location effects than the standard intergenerational coefficient, the size of the bias appears to be small. Our preferred results suggest that earnings are regressing to the mean more slowly now than at any time since World War II, causing economic differences between families to become more persistent. However, current rates of positional mobility appear historically normal.

DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning

Hussein Hazimeh, Zhe Zhao, Aakanksha Chowdhery +5 more

cs.LG · · cited 214× · arXiv ↗ · more like this ·

The Mixture-of-Experts (MoE) architecture is showing promising results in improving parameter sharing in multi-task learning (MTL) and in scaling high-capacity neural networks. State-of-the-art MoE models use a trainable sparse gate to select a subset of the experts for each input example. While conceptually appealing, existing sparse gates, such as Top-k, are not smooth. The lack of smoothness can lead to convergence and statistical performance issues when training with gradient-based methods. In this paper, we develop DSelect-k: a continuously differentiable and sparse gate for MoE, based on a novel binary encoding formulation. The gate can be trained using first-order methods, such as stochastic gradient descent, and offers explicit control over the number of experts to select. We demonstrate the effectiveness of DSelect-k on both synthetic and real MTL datasets with up to $128$…

The Persistent Effect of U.S. Civil Rights Protests on Political Attitudes

Soumyajit Mazumder

Political Science and International Relations · American Journal of Political Science · · cited 206× · DOI ↗ · more like this ·

Abstract Protests can engender significant institutional change. Can protests also continue to shape a nation's contemporary politics outside of more formalized channels? I argue that social movements can not only beget institutional change, but also long‐run, attitudinal change. Using the case of the U.S. civil rights movement, I develop a theory in which protests can shift attitudes and these attitudes can persist. Data from over 150,000 survey respondents provide evidence consistent with the theory. Whites from counties that experienced historical civil rights protests are more likely to identify as Democrats and support affirmative action, and less likely to harbor racial resentment against blacks. These individual‐level results are politically meaningful—counties that experienced civil rights protests are associated with greater Democratic Party vote shares even today. This study…

Does "AI" stand for augmenting inequality in the era of covid-19 healthcare?

David Leslie, Anjali Mazumder, Aidan Peppin +2 more

cs.CY · · cited 205× · arXiv ↗ · more like this ·

Among the most damaging characteristics of the covid-19 pandemic has been its disproportionate effect on disadvantaged communities. As the outbreak has spread globally, factors such as systemic racism, marginalisation, and structural inequality have created path dependencies that have led to poor health outcomes. These social determinants of infectious disease and vulnerability to disaster have converged to affect already disadvantaged communities with higher levels of economic instability, disease exposure, infection severity, and death. Artificial intelligence (AI) technologies are an important part of the health informatics toolkit used to fight contagious disease. AI is well known, however, to be susceptible to algorithmic biases that can entrench and augment existing inequality. Uncritically deploying AI in the fight against covid-19 thus risks amplifying the pandemic's adverse…

Target-Sensitive Memory Networks for Aspect Sentiment Classification

Shuai Wang, Sahisnu Mazumder, Bing Liu +2 more

Artificial Intelligence · · cited 195× · DOI ↗ · more like this ·

Aspect sentiment classification (ASC) is a fundamental task in sentiment analysis. Given an aspect/target and a sentence, the task classifies the sentiment polarity expressed on the target in the sentence. Memory networks (MNs) have been used for this task recently and have achieved state-of-the-art results. In MNs, attention mechanism plays a crucial role in detecting the sentiment context for the given target. However, we found an important problem with the current MNs in performing the ASC task. Simply improving the attention mechanism will not solve it. The problem is referred to as target-sensitive sentiment, which means that the sentiment polarity of the (detected) context is dependent on the given target and it cannot be inferred from the context alone. To tackle this problem, we propose the targetsensitive memory networks (TMNs). Several alternative techniques are designed for…

Multi-level Multiple Attentions for Contextual Multimodal Sentiment Analysis

Soujanya Poria, Erik Cambria, Devamanyu Hazarika +3 more

Computer Vision and Pattern Recognition · · cited 193× · DOI ↗ · more like this ·

Multimodal sentiment analysis involves identifying sentiment in videos and is a developing field of research. Unlike current works, which model utterances individually, we propose a recurrent model that is able to capture contextual information among utterances. In this paper, we also introduce attentionbased networks for improving both context learning and dynamic feature fusion. Our model shows 6-8% improvement over the state of the art on a benchmark dataset.

Few-Shot Lifelong Learning

Pratik Mazumder, Pravendra Singh, Piyush Rai

cs.CV · · cited 162× · arXiv ↗ · more like this ·

Many real-world classification problems often have classes with very few labeled training samples. Moreover, all possible classes may not be initially available for training, and may be given incrementally. Deep learning models need to deal with this two-fold problem in order to perform well in real-life situations. In this paper, we propose a novel Few-Shot Lifelong Learning (FSLL) method that enables deep learning models to perform lifelong/continual learning on few-shot data. Our method selects very few parameters from the model for training every new set of classes instead of training the full model. This helps in preventing overfitting. We choose the few parameters from the model in such a way that only the currently unimportant parameters get selected. By keeping the important parameters in the model intact, our approach minimizes catastrophic forgetting. Furthermore, we minimize…

DataPerf: Benchmarks for Data-Centric AI Development

Mark Mazumder, Colby Banbury, Xiaozhe Yao +42 more

cs.LG · · cited 161× · arXiv ↗ · more like this ·

Machine learning research has long focused on models rather than datasets, and prominent datasets are used for common ML tasks without regard to the breadth, difficulty, and faithfulness of the underlying problems. Neglecting the fundamental importance of data has given rise to inaccuracy, bias, and fragility in real-world applications, and research is hindered by saturation across existing dataset benchmarks. In response, we present DataPerf, a community-led benchmark suite for evaluating ML datasets and data-centric algorithms. We aim to foster innovation in data-centric AI through competition, comparability, and reproducibility. We enable the ML community to iterate on datasets, instead of just architectures, and we provide an open, online platform with multiple rounds of challenges to support this iterative development. The first iteration of DataPerf contains five benchmarks…

A nonparametric analysis of black-white differences in intergenerational income mobility in the United States

Debopam Bhattacharya, Bhashkar Mazumder

Sociology and Political Science · Quantitative Economics · · cited 152× · DOI ↗ · more like this ·

Lower intergenerational income mobility for blacks is a likely cause behind the persistent interracial gap in economic status in the United States.However, few studies have analyzed black-white differences in intergenerational income mobility and the factors that determine these differences.This is largely due to the absence of appropriate methodological tools.We develop nonparametric methods to estimate the effects of covariates on two measures of mobility.We first consider the traditional transition probability of movement across income quantiles.We then introduce a new measure of upward mobility which is the probability that an adult child's relative position exceeds that of the parents.Conducting statistical inference on these mobility measures and the effects of covariates on them requires nontrivial modifications of standard nonparametric regression theory since the dependent…

Does Education Improve Health? A Reexamination of the Evidence from Compulsory Schooling Laws

Bhashkar Mazumder

Sociology and Political Science · RePEc: Research Papers in Economics · · cited 143× · OpenAlex ↗ · more like this ·

This article analyzes the impact of compulsory schooling laws early in the twentieth century on long-term health. The author finds no compelling evidence for a causal link between education and health using this research design. Further, the results suggest that only a small fraction of health conditions are affected by education, and several of those are conditions, such as sight and hearing, where economic theories don?t appear to be relevant.

Fertility Transitions Along the Extensive and Intensive Margins

Daniel Aaronson, Fabian Lange, Bhashkar Mazumder

Gender Studies · American Economic Review · · cited 140× · DOI ↗ · more like this ·

By allowing for an extensive margin in the standard quantity-quality model, we generate new insights into fertility transitions. We test the model on Southern black women affected by a large-scale school construction program. Consistent with our model, women facing improved schooling opportunities for their children were more likely to have at least one child but chose to have smaller families overall. By contrast, women who themselves obtained more schooling due to the program delayed childbearing along both the extensive and intensive margins and entered higher quality occupations, consistent with education raising opportunity costs of child rearing. (JEL I20, J13, J15, J16, J24)

The Impact of Rosenwald Schools on Black Achievement

Daniel Aaronson, Bhashkar Mazumder

Education · Journal of Political Economy · · cited 130× · DOI ↗ · more like this ·

The black-white gap in schooling among southern-born men narrowed sharply between the world wars. From 1914 to 1931, nearly 5,000 schools were constructed as part of the Rosenwald Rural Schools Initiative. Using census data and World War II records, we find that the Rosenwald program accounts for a sizable portion of the educational gains of rural southern blacks. We find significant effects on school attendance, literacy, years of schooling, cognitive test scores, and northern migration. The gains are highest in the most disadvantaged counties, suggesting that schooling treatments have the largest impact among those with limited access to education.

From Immigrants to Americans: Race and Assimilation during the Great Migration

Vasiliki Fouka, Soumyajit Mazumder, Marco Tabellini

Sociology and Political Science · The Review of Economic Studies · · cited 123× · DOI ↗ · more like this ·

Abstract How does the arrival of a new minority group affect the social acceptance and outcomes of existing minorities? We study this question in the context of the First Great Migration. Between 1915 and 1930, 1.5 million African Americans moved from the U.S. South to Northern urban centres, which were home to millions of European immigrants arrived in previous decades. We formalize and empirically test the hypothesis that the inflows of Black Americans changed perceptions of outgroup distance among native-born whites, reducing the barriers to the social integration of European immigrants. Predicting Black in-migration with a version of the shift-share instrument, we find that immigrants living in areas that received more Black migrants experienced higher assimilation along a range of outcomes, such as naturalization rates and intermarriages with native-born spouses. Evidence from the…

<i>In Utero</i>Ramadan Exposure and Children's Academic Performance

Douglas Almond, Bhashkar Mazumder, Reyn van Ewijk

Education · The Economic Journal · · cited 118× · DOI ↗ · more like this ·

A large literature has linked the in utero environment to health in adulthood. We consider how prenatal nutrition may shape human capital acquisition in childhood, utilising the month-long Ramadan fast as a natural experiment. In student register data for Pakistani and Bangladeshi families in England, we examine whether Ramadan's overlap with pregnancy affects subsequent academic outcomes at age 7. We find that test scores are 0.05-0.08 standard deviations lower for students exposed to Ramadan in early pregnancy. Our results suggest that brief prenatal investments may be more cost effective than traditional educational interventions in improving academic performance.

A Comparison of Intergenerational Mobility Curves in Germany, Norway, Sweden, and the US

Espen Bratberg, Jonathan M. Davis, Bhashkar Mazumder +3 more

Sociology and Political Science · Scandinavian Journal of Economics · · cited 114× · DOI ↗ · more like this ·

Abstract We examine intergenerational mobility differences between Germany, Norway, Sweden, and the US. Using ranks, we find that the US is substantially less intergenerationally mobile than the three European countries and that the most mobile region of the US is less mobile than the least mobile regions of Norway and Sweden. Using a linear estimator of income share mobility, we find that the four countries have very similar rates of intergenerational mobility. However, when we use non‐parametric versions of rank and income share mobility, we find that the US tends to experience lower upward mobility at the bottom of the income distribution than Norway and Sweden.

The Tree Ensemble Layer: Differentiability meets Conditional Computation

Hussein Hazimeh, Natalia Ponomareva, Petros Mol +2 more

cs.LG · · cited 98× · arXiv ↗ · more like this ·

Neural networks and tree ensembles are state-of-the-art learners, each with its unique statistical and computational advantages. We aim to combine these advantages by introducing a new layer for neural networks, composed of an ensemble of differentiable decision trees (a.k.a. soft trees). While differentiable trees demonstrate promising results in the literature, they are typically slow in training and inference as they do not support conditional computation. We mitigate this issue by introducing a new sparse activation function for sample routing, and implement true conditional computation by developing specialized forward and backward propagation algorithms that exploit sparsity. Our efficient algorithms pave the way for jointly training over deep and wide tree ensembles using first-order methods (e.g., SGD). Experiments on 23 classification datasets indicate over 10x speed-ups…

A Computational Framework for Multivariate Convex Regression and its Variants

Rahul Mazumder, Arkopal Choudhury, Garud Iyengar +1 more

stat.CO · · cited 94× · arXiv ↗ · more like this ·

We study the nonparametric least squares estimator (LSE) of a multivariate convex regression function. The LSE, given as the solution to a quadratic program with $O(n^2)$ linear constraints ($n$ being the sample size), is difficult to compute for large problems. Exploiting problem specific structure, we propose a scalable algorithmic framework based on the augmented Lagrangian method to compute the LSE. We develop a novel approach to obtain smooth convex approximations to the fitted (piecewise affine) convex LSE and provide formal bounds on the quality of approximation. When the number of samples is not too large compared to the dimension of the predictor, we propose a regularization scheme --- Lipschitz convex regression --- where we constrain the norm of the subgradients, and study the rates of convergence of the obtained LSE. Our algorithmic framework is simple and flexible and can…

Estimating the Intergenerational Elasticity and Rank Association in the United States: Overcoming the Current Limitations of Tax Data

Bhashkar Mazumder

Sociology and Political Science · Research in labor economics · · cited 89× · DOI ↗ · more like this ·

Ideal estimates of the intergenerational elasticity (IGE) in income require a large panel of income data covering the entire working lifetimes for two generations. Previous studies have demonstrated that using short panels and covering only certain portions of the life cycle can lead to considerable bias. I address these biases by using the PSID and constructing long time averages centered at age 40 in both generations. I find that the IGE in family income in the United States is likely greater than 0.6 suggesting a relatively low rate of intergenerational mobility in the United States. I find similar sized estimates for the IGE in labor income. These estimates support the prior findings of Mazumder (2005a, b) and are also similar to comparable estimates reported by Mitnik et al. (2015). In contrast, a recent influential study by Chetty, Hendren, Kline, Saez (2014) using tax data that…

Economic Impacts of Coronavirus Disease (COVID-19) in Developing Countries

Tahmina Tasnim Rodela, Samia Tasnim, Hoimonty Mazumder +3 more

Modeling and Simulation · RePEc: Research Papers in Economics · · cited 82× · DOI ↗ · more like this ·

The coronavirus disease (COVID-19) has critically impacted global health systems and economies, especially in developing countries. Those countries have been struggling to address the preexisting burden of diseases with limited resources, which will become even more challenging during COVID-19. The economic implications related to COVID-19 in those countries include a high cost of care, market failures in pluralistic health systems, high out-of-pocket expenses, the added burden of noncommunicable diseases, missed economic opportunities, and socioeconomic consequences like unemployment and poverty. It is essential to assess the prevalent gaps, mobilize resources, strengthen health systems financing and leadership, enhance research capacities informing evidence-based policymaking, and foster effective partnerships for addressing health and economic disparities due to COVID-19.

Transmission dynamics of the COVID-19 epidemic in India and modeling optimal lockdown exit strategies

Mohak Gupta, Rishika Mohanta, Aditi Rao +9 more

Modeling and Simulation · International Journal of Infectious Diseases · · cited 77× · DOI ↗ · more like this ·

decreased from 1·67 on March 30 to 1·16 on April 22. We observed that the delay from the date of lockdown relaxation to the start of the second wave increases as lockdown is extended farther after the first wave peak-this delay is longer if lockdown is relaxed gradually. Aggressive measures such as lockdowns may be inherently enough to suppress an outbreak; however, other measures need to be scaled up as lockdowns are relaxed. Lower levels of social distancing when coupled with a testing ramp-up could achieve similar outbreak control as an aggressive social distancing regime where testing was not increased.