arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Irfan

4,750 papers · 1920–2026

1967: 01968: 01969: 01970: 21971: 01972: 01973: 01974: 01975: 01976: 11977: 21978: 01979: 01980: 11981: 01982: 61983: 31984: 01985: 61986: 11987: 01988: 11989: 11990: 41991: 21992: 01993: 11994: 61995: 51996: 61997: 91998: 91999: 132000: 182001: 132002: 362003: 222004: 322005: 302006: 482007: 772008: 752009: 722010: 882011: 962012: 1372013: 1642014: 1722015: 1932016: 2102017: 2692018: 3742019: 5162020: 6262021: 6742022: 2992023: 862024: 912025: 1112026: 130
1967peak 674 in 20212026

Frequent co-authors

Papers

showing 1–25 of 4,750 RSS

Graphcut textures

Vivek Kwatra, Arno Schödl, Irfan Essa +2 more

Computer Vision and Pattern Recognition · · cited 1,244× · DOI ↗ · more like this ·

In this paper we introduce a new algorithm for image and video texture synthesis. In our approach, patch regions from a sample image or video are transformed and copied to the output and then stitched together along optimal seams to generate a new (and typically larger) output. In contrast to other techniques, the size of the patch is not chosen a-priori, but instead a graph cut technique is used to determine the optimal patch region for any given offset between the input and output texture. Unlike dynamic programming, our graph cut technique for seam optimization is applicable in any dimension. We specifically explore it in 2D and 3D to perform video texture synthesis in addition to regular image synthesis. We present approximative offset search techniques that work well in conjunction with the presented patch size optimization. We show results for synthesizing regular, random, and…

One-Shot Learning for Semantic Segmentation

Amirreza Shaban, Shray Bansal, Zhen Liu +2 more

cs.CV · · cited 921× · arXiv ↗ · more like this ·

Low-shot learning methods for image classification support learning from sparse data. We extend these techniques to support dense semantic image segmentation. Specifically, we train a network that, given a small set of annotated images, produces parameters for a Fully Convolutional Network (FCN). We use this FCN to perform dense pixel-level prediction on a test image for the new semantic class. Our architecture shows a 25% relative meanIoU improvement compared to the best baseline methods for one-shot segmentation on unseen classes in the PASCAL VOC 2012 dataset and is at least 3 times faster.

Coding, analysis, interpretation, and recognition of facial expressions

Irfan Essa, Alex Pentland

Computer Vision and Pattern Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 915× · DOI ↗ · more like this ·

We describe a computer vision system for observing facial motion by using an optimal estimation optical flow method coupled with geometric, physical and motion-based dynamic models describing the facial structure. Our method produces a reliable parametric representation of the face's independent muscle action groups, as well as an accurate estimate of facial motion. Previous efforts at analysis of facial expression have been based on the facial action coding system (FACS), a representation developed in order to allow human psychologists to code expression from static pictures. To avoid use of this heuristic coding scheme, we have used our computer vision system to probabilistically characterize facial motion and muscle activation in an experimental population, thus deriving a new, more accurate, representation of human facial expressions that we call FACS+. Finally, we show how this…

A near–quantum-limited Josephson traveling-wave parametric amplifier

Chris Macklin, Kevin P. O’Brien, David Hover +5 more

Artificial Intelligence · Science · · cited 810× · DOI ↗ · more like this ·

Detecting single-photon level signals—carriers of both classical and quantum information—is particularly challenging for low-energy microwave frequency excitations. Here we introduce a superconducting amplifier based on a Josephson junction transmission line. Unlike current standing-wave parametric amplifiers, this traveling wave architecture robustly achieves high gain over a bandwidth of several gigahertz with sufficient dynamic range to read out 20 superconducting qubits. To achieve this performance, we introduce a subwavelength resonant phase-matching technique that enables the creation of nonlinear microwave devices with unique dispersion relations. We benchmark the amplifier with weak measurements, obtaining a high quantum efficiency of 75% (70% including noise added by amplifiers following the Josephson amplifier). With a flexible design based on compact lumped elements, this…

Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation

Lijun Yu, José Lezama, Nitesh B. Gundavarapu +13 more

cs.CV · · cited 716× · arXiv ↗ · more like this ·

While Large Language Models (LLMs) are the dominant models for generative tasks in language, they do not perform as well as diffusion models on image and video generation. To effectively use LLMs for visual generation, one crucial component is the visual tokenizer that maps pixel-space inputs to discrete tokens appropriate for LLM learning. In this paper, we introduce MAGVIT-v2, a video tokenizer designed to generate concise and expressive tokens for both videos and images using a common token vocabulary. Equipped with this new tokenizer, we show that LLMs outperform diffusion models on standard image and video generation benchmarks including ImageNet and Kinetics. In addition, we demonstrate that our tokenizer surpasses the previously top-performing video tokenizer on two more tasks: (1) video compression comparable to the next-generation video codec (VCC) according to human…

DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames

Erik Wijmans, Abhishek Kadian, Ari Morcos +5 more

cs.CV · · cited 680× · arXiv ↗ · more like this ·

We present Decentralized Distributed Proximal Policy Optimization (DD-PPO), a method for distributed reinforcement learning in resource-intensive simulated environments. DD-PPO is distributed (uses multiple machines), decentralized (lacks a centralized server), and synchronous (no computation is ever stale), making it conceptually simple and easy to implement. In our experiments on training virtual robots to navigate in Habitat-Sim, DD-PPO exhibits near-linear scaling -- achieving a speedup of 107x on 128 GPUs over a serial implementation. We leverage this scaling to train an agent for 2.5 Billion steps of experience (the equivalent of 80 years of human experience) -- over 6 months of GPU-time training in under 3 days of wall-clock time with 64 GPUs. This massive-scale training not only sets the state of art on Habitat Autonomous Navigation Challenge 2019, but essentially solves the…

Efficient hierarchical graph-based video segmentation

Matthias Grundmann, Vivek Kwatra, Mei Han +1 more

Computer Vision and Pattern Recognition · SMARTech Repository (Georgia Institute of Technology) · · cited 631× · DOI ↗ · more like this ·

We present an efficient and scalable technique for spatiotemporal segmentation of long video sequences using a hierarchical graph-based algorithm. We begin by over-segmenting a volumetric video graph into space-time regions grouped by appearance. We then construct a “region graph” over the obtained segmentation and iteratively repeat this process over multiple levels to create a tree of spatio-temporal segmentations. This hierarchical approach generates high quality segmentations, which are temporally coherent with stable region boundaries, and allows subsequent applications to choose from varying levels of granularity. We further improve segmentation quality by using dense optical flow to guide temporal connections in the initial graph. We also propose two novel approaches to improve the scalability of our technique: (a) a parallel out-of-core algorithm that can process volumes much…

Texture optimization for example-based synthesis

Vivek Kwatra, Irfan Essa, Aaron Bobick +1 more

Computer Graphics and Computer-Aided Design · ACM Transactions on Graphics · · cited 609× · DOI ↗ · more like this ·

We present a novel technique for texture synthesis using optimization. We define a Markov Random Field (MRF)-based similarity metric for measuring the quality of synthesized texture with respect to a given input sample. This allows us to formulate the synthesis problem as minimization of an energy function, which is optimized using an Expectation Maximization (EM)-like algorithm. In contrast to most example-based techniques that do region-growing, ours is a joint optimization approach that progressively refines the entire texture. Additionally, our approach is ideally suited to allow for controllable synthesis of textures. Specifically, we demonstrate controllability by animating image textures using flow fields. We allow for general two-dimensional flow fields that may dynamically change over time. Applications of this technique include dynamic texturing of fluid animations and…

Video textures

Arno Schödl, Richard Szeliski, David Salesin +1 more

Computer Vision and Pattern Recognition · · cited 577× · DOI ↗ · more like this ·

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a video texture may be repeated from time to time, the video sequence as a whole is never repeated exactly. Video textures can be used in place of digital photos to infuse a static image with dynamic qualities and explicit actions. We present techniques for analyzing a video clip to extract its structure, and for synthesizing a new, similar looking video of arbitrary length. We combine video textures with view morphing techniques to obtain 3D video textures. We also introduce video-based animation, in which the synthesis of video textures can be guided by a user through high-level interactive controls. Applications of video textures and their…

VideoPoet: A Large Language Model for Zero-Shot Video Generation

Dan Kondratyuk, Lijun Yu, Xiuye Gu +28 more

cs.CV · · cited 565× · arXiv ↗ · more like this ·

We present VideoPoet, a language model capable of synthesizing high-quality video, with matching audio, from a large variety of conditioning signals. VideoPoet employs a decoder-only transformer architecture that processes multimodal inputs -- including images, videos, text, and audio. The training protocol follows that of Large Language Models (LLMs), consisting of two stages: pretraining and task-specific adaptation. During pretraining, VideoPoet incorporates a mixture of multimodal generative objectives within an autoregressive Transformer framework. The pretrained LLM serves as a foundation that can be adapted for a range of video generation tasks. We present empirical results demonstrating the model's state-of-the-art capabilities in zero-shot video generation, specifically highlighting VideoPoet's ability to generate high-fidelity motions. Project page…

Quantum Simulators: Architectures and Opportunities

Ehud Altman, Kenneth R. Brown, Giuseppe Carleo +34 more

quant-ph · · cited 524× · arXiv ↗ · more like this ·

Quantum simulators are a promising technology on the spectrum of quantum devices from specialized quantum experiments to universal quantum computers. These quantum devices utilize entanglement and many-particle behaviors to explore and solve hard scientific, engineering, and computational problems. Rapid development over the last two decades has produced more than 300 quantum simulators in operation worldwide using a wide variety of experimental platforms. Recent advances in several physical architectures promise a golden age of quantum simulators ranging from highly optimized special purpose simulators to flexible programmable devices. These developments have enabled a convergence of ideas drawn from fundamental physics, computer science, and device engineering. They have strong potential to address problems of societal importance, ranging from understanding vital chemical processes…

Computation of Molecular Spectra on a Quantum Processor with an Error-Resilient Algorithm

James Colless, Vinay Ramasesh, Dar Dahlen +6 more

Artificial Intelligence · Physical Review X · · cited 480× · DOI ↗ · more like this ·

Harnessing the full power of nascent quantum processors requires the efficient management of a limited number of quantum bits with finite coherent lifetimes. Hybrid algorithms, such as the variational quantum eigensolver (VQE), leverage classical resources to reduce the required number of quantum gates. Experimental demonstrations of VQE have resulted in calculation of Hamiltonian ground states, and a new theoretical approach based on a quantum subspace expansion (QSE) has outlined a procedure for determining excited states that are central to dynamical processes. We use a superconducting-qubit-based processor to apply the QSE approach to the H 2 molecule, extracting both ground and excited states without the need for auxiliary qubits or additional minimization. Further, we show that this extended protocol can mitigate the effects of incoherent errors, potentially enabling larger-scale…

Robust determination of molecular spectra on a quantum processor

James I. Colless, Vinay V. Ramasesh, Dar Dahlen +5 more

quant-ph · · cited 455× · arXiv ↗ · more like this ·

Harnessing the full power of nascent quantum processors requires the efficient management of a limited number of quantum bits with finite lifetime. Hybrid algorithms leveraging classical resources have demonstrated promising initial results in the efficient calculation of Hamiltonian ground states--an important eigenvalue problem in the physical sciences that is often classically intractable. In these protocols, a Hamiltonian is parsed and evaluated term-wise with a shallow quantum circuit, and the resulting energy minimized using classical resources. This reduces the number of consecutive logical operations that must be performed on the quantum hardware before the onset of decoherence. We demonstrate a complete implementation of the Variational Quantum Eigensolver (VQE), augmented with a novel Quantum Subspace Expansion, to calculate the complete energy spectrum of the H2 molecule with…

Teachers’ Elementary School in Online Learning of COVID-19 Pandemic Conditions

Irfan Fauzi, Iman Hermawan Sastra Khusuma

Education · JURNAL IQRA · · cited 433× · DOI ↗ · more like this ·

The article aimed to explain in detail the perspectives of elementary school teachers about online learning in a COVID-19 pandemic condition. This study used a quantitative approach. The subjects in this study were 45 teachers in Banten and West Java. The results of this study indicated that teachers understand the context of online learning, but in implementation there are various problems found, including 1) availability of facilities, 2) network and internet usage, 3) planning, implementation, and evaluation of learning, and 4) collaboration with parents. Online learning help teachers in the COVID-19 pandemic period, but felt to be ineffective, even 80% of teachers feel dissatisfied thorough online learning. This research was expected to be an evaluation material for various parties including education policy makers in conducting online learning, besides this research can also…

MAGVIT: Masked Generative Video Transformer

Lijun Yu, Yong Cheng, Kihyuk Sohn +8 more

cs.CV · · cited 409× · arXiv ↗ · more like this ·

We introduce the MAsked Generative VIdeo Transformer, MAGVIT, to tackle various video synthesis tasks with a single model. We introduce a 3D tokenizer to quantize a video into spatial-temporal visual tokens and propose an embedding method for masked video token modeling to facilitate multi-task learning. We conduct extensive experiments to demonstrate the quality, efficiency, and flexibility of MAGVIT. Our experiments show that (i) MAGVIT performs favorably against state-of-the-art approaches and establishes the best-published FVD on three video generation benchmarks, including the challenging Kinetics-600. (ii) MAGVIT outperforms existing methods in inference time by two orders of magnitude against diffusion models and by 60x against autoregressive models. (iii) A single MAGVIT model supports ten diverse generation tasks and generalizes across videos from different visual domains. The…

MOTIVASI BELAJAR MAHASISWA PADA PEMBELAJARAN DARING SELAMA PANDEMIK COVID-19

Yani Fitriyani, Irfan Fauzi, Mia Zultrianti Sari

Education · Profesi Pendidikan Dasar · · cited 403× · DOI ↗ · more like this ·

Motivation is an important factor in the success of learning, including online learning. This study aims to explain in detail how the objective motivational conditions experienced by students in online learning during the Covid-19 pandemic. This study uses a quantitative approach with a survey method. The study was conducted at Universitas Kuningan involving 80 sixth semester students in the Elementary School Teacher Education study program. Data collection techniques in this study using survey technique with a Likert scale. Survey is made in google form so that it is easily accessible by students. The data analysis is to use a percentage of data, then interpret the presentation score and analyze it in depth. The results of this study indicate that the learning motivation of sixth semester students of the elementary school teacher education program at Universitas Kuningan is very good…

Factors for Successful e‑Government Adoption: a Conceptual Framework

Vinod Kumar, Bhasker Mukerji, Irfan Butt

Political Science and International Relations · Electronic Journal of e-Government · · cited 354× · OpenAlex ↗ · more like this ·

Abstract – Canada has been the world’s leader in e-Government maturity for the last five years. The global average for government website usage by citizens is about 30%. In Canada, this statistic is over 51%. The vast majority of Canadians visit government websites to obtain information, rather than interacting or transacting with the government. It seems that the rate of adoption of e-Government has globally fallen below expectations although some countries are doing better than others. Clearly, a better understanding of why and how citizens use government websites, and their general dispositions towards e-Government is an important research issue. This paper initiates discussion of this issue by proposing a conceptual model of e-Government adoption that places users as the focal point for e-Government adoption strategy.

Factors Affecting Students' Academic Performance

Irfan Mushtaq, Shabana Nawaz Khan

Education · Global Journal of Management and Business Research · · cited 349× · OpenAlex ↗ · more like this ·

Many practical studies are carried out to investigate factors affecting college students' performance. The focus of this research is that student performance in intermediate examination is linked with students' outline consisted of his approach towards communication, learning facilities, proper guidance and family stress. The research is based on student profile developed on the bases of information and data collected through assessment from students of a group of private colleges.

Auto-directed video stabilization with robust L1 optimal camera paths

Matthias Grundmann, Vivek Kwatra, Irfan Essa

Computer Vision and Pattern Recognition · SMARTech Repository (Georgia Institute of Technology) · · cited 342× · DOI ↗ · more like this ·

We present a novel algorithm for automatically applying constrainable, L1-optimal camera paths to generate stabilized videos by removing undesired motions. Our goal is to compute camera paths that are composed of constant, linear and parabolic segments mimicking the camera motions employed by professional cinematographers. To this end, our algorithm is based on a linear programming framework to minimize the first, second, and third derivatives of the resulting camera path. Our method allows for video stabilization beyond the conventional filtering of camera paths that only suppresses high frequency jitter. We incorporate additional constraints on the path of the camera directly in our algorithm, allowing for stabilized and retargeted videos. Our approach accomplishes this without the need of user interaction or costly 3D reconstruction of the scene, and works as a post-process for…

Artificial Intelligence and Its Role in Education

Sayed Fayaz Ahmad, Mohd Khairil Rahmat, Muhammad Shujaat Mubarik +2 more

Artificial Intelligence · Sustainability · · cited 309× · DOI ↗ · more like this ·

The objective of this study is to explore the role of artificial intelligence applications (AIA) in education. AI applications provide the solution in many ways to the exponential rise of modern-day challenges, which create difficulties in access to education and learning. They play a significant role in forming social robots (SR), smart learning (SL), and intelligent tutoring systems (ITS) to name a few. The review indicates that the education sector should also embrace the modern methods of teaching and the necessary technology. Looking into the flow, the education sector organizations need to adopt AI technologies as a necessity of the day and education. The study needs to be tested statistically for better understanding and to make the findings more generalized in the future.

A practical approach for recognizing eating moments with wrist-mounted inertial sensing

Edison Thomaz, Irfan Essa, Gregory D. Abowd

Computer Vision and Pattern Recognition · PubMed · · cited 301× · DOI ↗ · more like this ·

Recognizing when eating activities take place is one of the key challenges in automated food intake monitoring. Despite progress over the years, most proposed approaches have been largely impractical for everyday usage, requiring multiple on-body sensors or specialized devices such as neck collars for swallow detection. In this paper, we describe the implementation and evaluation of an approach for inferring eating moments based on 3-axis accelerometry collected with a popular off-the-shelf smartwatch. Trained with data collected in a semi-controlled laboratory setting with 20 subjects, our system recognized eating moments in two free-living condition studies (7 participants, 1 day; 1 participant, 31 days), with F-scores of 76.1% (66.7% Precision, 88.8% Recall), and 71.3% (65.2% Precision, 78.6% Recall). This work represents a contribution towards the implementation of a practical…

Divine Boundaries: How Religion Shapes Citizens’ Attitudes Toward Immigrants

Eric L. McDaniel, Irfan Nooruddin, Allyson F. Shortle

Sociology and Political Science · American Politics Research · · cited 292× · DOI ↗ · more like this ·

How does religion affect one’s attitudes toward immigrants? Scholars have shown that members of minor religious groups are less anti-immigrant than members of majority affiliations and that Evangelical Protestants are particularly hostile. Other scholars have demonstrated that increased religiosity reduces immigrant animus. Here, we argue that religion affects immigration attitudes via a distinct religiously informed interpretation of America’s national identity, which we call Christian nationalism. Christian nationalists believe that America has a divinely inspired mission and link its success to God’s favor. Using social identity complexity theory, we argue that citizens who ascribe to this worldview should be least tolerant of those they perceive as symbolic threats to American national identity. We assess this claim using the 2006 Pew Immigration Attitudes Survey and the 2008…

Academic and Administrative Role of Artificial Intelligence in Education

Sayed Fayaz Ahmad, Muhammad Mansoor Alam, Mohd Khairil Rahmat +2 more

Computer Science Applications · Sustainability · · cited 280× · DOI ↗ · more like this ·

The aim of the article is to explore the academic and administrative applications of Artificial Intelligence. Teachers have the main responsibility of teaching in any educational setting. But there are various other tasks to be performed by the teachers as well. Besides academic duty, most of the teacher’s time and educational resources are dedicated to administrative works. Artificial Intelligence Applications (AIA) are not only assisting education academically and administratively but also enhance their effectiveness. AIA provides help to teachers in various types of tasks in the shape of Learning Analytics (LA), Virtual Reality (VR), Grading/Assessments (G/A), and Admissions. It minimizes the administrative tasks of a teacher to invest more in teaching and guiding students. In the current era, where there are a lot of tasks associated with the teaching profession, AIA adds a…

Exploiting human actions and object context for recognition tasks

Darnell Moore, Irfan Essa, M.H. Hayes

Computer Vision and Pattern Recognition · SMARTech Repository (Georgia Institute of Technology) · · cited 277× · DOI ↗ · more like this ·

Our goal is to exploit human motion and object context to perform action recognition and object classification. Towards this end, we introduce a framework for recognizing actions and objects by measuring image-, object- and action-based information from video. Hidden Markov models are combined with object context to classify hand actions, which are aggregated by a Bayesian classifier to summarize activities. We also use Bayesian methods to differentiate the class of unknown objects by evaluating detected actions along with low-level, extracted object features. Our approach is appropriate for locating and classifying objects under a variety of conditions including full occlusion. We show experiments where both familiar and previously unseen objects are recognized using action and context information.

SIT: A Lightweight Encryption Algorithm for Secure Internet of Things

Muhammad Usman, Irfan Ahmed, M. Imran Aslam +2 more

cs.CR · · cited 274× · arXiv ↗ · more like this ·

The Internet of Things (IoT) being a promising technology of the future is expected to connect billions of devices. The increased number of communication is expected to generate mountains of data and the security of data can be a threat. The devices in the architecture are essentially smaller in size and low powered. Conventional encryption algorithms are generally computationally expensive due to their complexity and requires many rounds to encrypt, essentially wasting the constrained energy of the gadgets. Less complex algorithm, however, may compromise the desired integrity. In this paper we propose a lightweight encryption algorithm named as Secure IoT (SIT). It is a 64-bit block cipher and requires 64-bit key to encrypt the data. The architecture of the algorithm is a mixture of feistel and a uniform substitution-permutation network. Simulations result shows the algorithm provides…