arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Kinsner

233 papers · 1974–2024

1974: 11975: 01976: 11977: 01978: 01979: 01980: 01981: 11982: 11983: 01984: 01985: 01986: 01987: 11988: 31989: 01990: 01991: 01992: 01993: 01994: 31995: 01996: 01997: 21998: 01999: 02000: 02001: 02002: 452003: 152004: 132005: 62006: 72007: 62008: 62009: 92010: 72011: 112012: 122013: 102014: 82015: 52016: 52017: 12018: 52019: 62020: 202021: 72022: 82023: 52024: 3
1974peak 45 in 20022024

Frequent co-authors

Papers

showing 1–25 of 233 RSS

From opencl to high-performance hardware on FPGAS

Tomasz Czajkowski, Utku Aydonat, Dmitry Denisenko +6 more

Hardware and Architecture · · cited 239× · DOI ↗ · more like this ·

We present an OpenCL compilation framework to generate high-performance hardware for FPGAs. For an OpenCL application comprising a host program and a set of kernels, it compiles the host program, generates Verilog HDL for each kernel, compiles the circuit using Altera Complete Design Suite 12.0, and downloads the compiled design onto an FPGA.We can then run the application by executing the host program on a Windows(tm)-based machine, which communicates with kernels on an FPGA using a PCIe interface. We implement four applications on an Altera Stratix IV and present the throughput and area results for each application. We show that we can achieve a clock frequency in excess of 160MHz on our benchmarks, and that OpenCL computing paradigm is a viable design entry method for high-performance computing applications on FPGAs.

Contemporary Cybernetics and Its Facets of Cognitive Informatics and Computational Intelligence

Yingxu Wang, Witold Kinsner, Du Zhang

Artificial Intelligence · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · · cited 146× · DOI ↗ · more like this ·

This paper explores the architecture, theoretical foundations, and paradigms of contemporary cybernetics from perspectives of cognitive informatics (CI) and computational intelligence. The modern domain and the hierarchical behavioral model of cybernetics are elaborated at the imperative, autonomic, and cognitive layers. The CI facet of cybernetics is presented, which explains how the brain may be mimicked in cybernetics via CI and neural informatics. The computational intelligence facet is described with a generic intelligence model of cybernetics. The compatibility between natural and cybernetic intelligence is analyzed. A coherent framework of contemporary cybernetics is presented toward the development of transdisciplinary theories and applications in cybernetics, CI, and computational intelligence.

Multifractal modelling of radio transmitter transients for classification

Donita Massengill Shaw, Witold Kinsner

Signal Processing · · cited 120× · DOI ↗ · more like this ·

This paper presents a method of extracting and modelling radio transmitter transients for classification. It is motivated by the real possibility of identifying radio transmitters used in violation of federal and international regulations. A system has been developed which takes the beginning of a radio transmission and separates it from ambient channel noise using a multifractal segmentation technique. Then, significant features are extracted from the transient and a more compact multifractal model is obtained. Finally, this model is analysed by a neural network for classification. Preliminary results indicate that classification using multifractal models is feasible. More specifically, a probabilistic neural network has been trained using 160 out of 415 available transients. Testing the system with the remaining 255 transients produced results in which 92.5% of the transients were…

Transient analysis and genetic algorithms for classification

J. Toonstra, Witold Kinsner

Artificial Intelligence · · cited 107× · DOI ↗ · more like this ·

This paper presents a method of generating unique fingerprints of radio transmitter turn-on transients. The fingerprinting system consists of the application of multiresolution wavelet analysis used to characterize the features contained in the transient followed by the use of a genetic algorithm to extract the wavelet coefficients that represent critical features of the transient. To measure the ability of the system to generate efficient and unique fingerprints, a neural network is used to classify the transients by their fingerprints. To test the noise sensitivity of the system, noisy transients were applied to a trained neural network, the network was able to positively classify noisy transients with 20 dB signal to noise ratios (SNR) and up. Experiments with real radio transients show that the system is able generate uniqiue fingerprints for absolute classification by a neural…

A radio transmitter fingerprinting system ODO-1

J. Toonstra, Witold Kinsner

Signal Processing · · cited 98× · DOI ↗ · more like this ·

This paper presents a new method for the capture, analysis, and classification of radio transmitter transients. This method involves the use of a capturing subsystem consisting of an Icom IC-R7000 communications receiver and a Sound Blaster 16 sound card running on a PC. The radio transients are sampled at 44,100 samples per second and have 16 bits accuracy. Once the transmitter transient has been captured, a genetic algorithm selects the critical features from the wavelet coefficients for classification. The selected wavelet coefficients are considered to be fingerprints, and are presented to a back propagation neural network for transmitter classification. The capturing and analysis system, ODO-1, is able to classify both transients of the same model type as well as individual transmitters with 100% accuracy on a small data base of transmitter fingerprints.

A Doctrine of Cognitive Informatics (CI)

Yingxu Wang, Witold Kinsner, James A. Anderson +9 more

Artificial Intelligence · Fundamenta Informaticae · · cited 95× · DOI ↗ · more like this ·

Cognitive informatics (CI) is the transdisciplinary enquiry of cognitive and information sciences that investigates into the internal information processing mechanisms and processes of the brain and natural intelligence, and their engineering applications via an interdisciplinary approach. CI develops a coherent set of fundamental theories and denotational mathematics, which form the foundation for most information and knowledge based science and engineering disciplines such as computer science, cognitive science, neuropsychology, systems science, cybernetics, software engineering, knowledge engineering, and computational intelligence. This paper reviews the central doctrine of CI and its applications. The theoretical framework of CI is described on the architecture of CI and its denotational mathematic means. A set of theories and formal models of CI is presented in order to explore…

Perspectives on Cognitive Informatics and Cognitive Computing

Yingxu Wang, George Baciu, Yiyu Yao +9 more

Artificial Intelligence · International Journal of Cognitive Informatics and Natural Intelligence · · cited 82× · DOI ↗ · more like this ·

Cognitive informatics is a transdisciplinary enquiry of computer science, information sciences, cognitive science, and intelligence science that investigates the internal information processing mechanisms and processes of the brain and natural intelligence, as well as their engineering applications in cognitive computing. Cognitive computing is an emerging paradigm of intelligent computing methodologies and systems based on cognitive informatics that implements computational intelligence by autonomous inferences and perceptions mimicking the mechanisms of the brain. This article presents a set of collective perspectives on cognitive informatics and cognitive computing, as well as their applications in abstract intelligence, computational intelligence, computational linguistics, knowledge representation, symbiotic computing, granular computing, semantic computing, machine learning, and…

A Unified Approach To Fractal Dimensions

Witold Kinsner

Artificial Intelligence · Journal of Information Technology Research · · cited 71× · DOI ↗ · more like this ·

Many scientific papers treat the diversity of fractal dimensions as mere variations on either the same theme or a single definition. There is a need for a unified approach to fractal dimensions for there are fundamental differences between their definitions. This paper presents a new description of three essential classes of fractal dimensions based on: (1) morphology, (2) entropy, and (3) transforms, all unified through the generalized-entropy-based Rényi fractal dimension spectrum. It discusses practical algorithms for computing 15 different fractal dimensions representing the classes. Although the individual dimensions have already been described in the literature, the unified approach presented in this paper is unique in terms of (1) its progressive development of the fractal dimension concept, (2) similarity in the definitions and expressions, (3) analysis of the relation between…

Detecting Advanced Persistent Threats using Fractal Dimension based Machine Learning Classification

Sana Siddiqui, Muhammad Salman Khan, Ken Ferens +1 more

Computer Networks and Communications · · cited 67× · DOI ↗ · more like this ·

Advanced Persistent Threats (APTs) are a new breed of internet based smart threats, which can go undetected with the existing state of-the-art internet traffic monitoring and protection systems. With the evolution of internet and cloud computing, a new generation of smart APT attacks has also evolved and signature based threat detection systems are proving to be futile and insufficient. One of the essential strategies in detecting APTs is to continuously monitor and analyze various features of a TCP/IP connection, such as the number of transferred packets, the total count of the bytes exchanged, the duration of the TCP/IP connections, and details of the number of packet flows. The current threat detection approaches make extensive use of machine learning algorithms that utilize statistical and behavioral knowledge of the traffic. However, the performance of these algorithms is far from…

Perspectives on the Field of Cognitive Informatics and its Future Development

Yingxu Wang, Bernard Widrow, Bo Zhang +6 more

Artificial Intelligence · International Journal of Cognitive Informatics and Natural Intelligence · · cited 65× · DOI ↗ · more like this ·

The contemporary wonder of sciences and engineering has recently refocused on the beginning point of: how the brain processes internal and external information autonomously and cognitively rather than imperatively like conventional computers. Cognitive Informatics (CI) is a transdisciplinary enquiry of computer science, information sciences, cognitive science, and intelligence science that investigates the internal information processing mechanisms and processes of the brain and natural intelligence, as well as their engineering applications in cognitive computing. This paper reports a set of eight position statements presented in the plenary panel of IEEE ICCI’10 on Cognitive Informatics and Its Future Development contributed from invited panelists who are part of the world’s renowned researchers and scholars in the field of cognitive informatics and cognitive computing.

Towards Cognitive Machines

Witold Kinsner

Artificial Intelligence · International Journal of Cognitive Informatics and Natural Intelligence · · cited 61× · DOI ↗ · more like this ·

Numerous attempts are being made to develop machines that could act not only autonomously, but also in an increasingly intelligent and cognitive manner. Such cognitive machines ought to be aware of their environments, which include not only other machines, but also human beings. Such machines ought to understand the meaning of information in more human-like ways by grounding knowledge in the physical world and in the machines’ own goals. The motivation for developing such machines range from self-evidenced practical reasons such as the expense of computer maintenance, to wearable computing in health care, and gaining a better understanding of the cognitive capabilities of the human brain. To achieve such an ambitious goal requires solutions to many problems, ranging from human perception, attention, concept creation, cognition, consciousness, executive processes guided by emotions and…

Brain-Inspired Systems: A Transdisciplinary Exploration on Cognitive Cybernetics, Humanity, and Systems Science Toward Autonomous Artificial Intelligence

Yingxu Wang, Witold Kinsner, Sam Kwong +7 more

Artificial Intelligence · IEEE Systems Man and Cybernetics Magazine · · cited 58× · DOI ↗ · more like this ·

Brain-inspired cognitive systems (BCSs) are an emerging field of cybernetics, cognitive science, and system science. BCSs study not only the intelligence science foundations of artificial intelligence (AI) and cognitive systems, but also formal models of the brain embodied by computational intelligence. This article presents the brain and intelligence science foundations of BCS toward hybrid intelligent systems and the symbiotic intelligence of humanity. It explores the transdisciplinary theoretical foundations of system, brain, intelligence, knowledge, cybernetic, and cognitive sciences toward the next generation of knowledge processors beyond classic data processors for autonomous computing systems. A BCS provides an overarching platform for cognitive cybernetics, humanity, and systems to enable emerging hybrid societies shared by humans and intelligent machines.

Cognitive Informatics and Cognitive Computing in Year 10 and Beyond

Yingxu Wang, Robert C. Berwick, S. Haykin +5 more

Artificial Intelligence · International Journal of Cognitive Informatics and Natural Intelligence · · cited 49× · DOI ↗ · more like this ·

Cognitive Informatics (CI) is a transdisciplinary enquiry of computer science, information sciences, cognitive science, and intelligence science that investigates into the internal information processing mechanisms and processes of the brain and natural intelligence, as well as their engineering applications in cognitive computing. The latest advances in CI leads to the establishment of cognitive computing theories and methodologies, as well as the development of Cognitive Computers (CogC) that perceive, infer, and learn. This paper reports a set of nine position statements presented in the plenary panel of IEEE ICCI*CC’11 on Cognitive Informatics in Year 10 and Beyond contributed from invited panelists who are part of the world’s renowned researchers and scholars in the field of cognitive informatics and cognitive computing.

Speech and image signal compression with wavelets

Witold Kinsner, Armein Z. R. Langi

Computer Vision and Pattern Recognition · · cited 41× · DOI ↗ · more like this ·

The authors consider time-frequency multiresolution analysis based on wavelets, as it applies to speech/audio and image/video signal compression. They compare the wavelet analysis to the traditional short-window techniques used in signal compression. The performance of the discrete wavelet transform in terms of the bit rates and signal quality is comparable to that for other techniques such as the discrete cosine transform (DCT) for images and code-excited linear predictive coding (CELP) for speech, but with much less computational burden. Experiments with an image and Daubechies's four-coefficient wavelet show that truncation of wavelet coefficients as high as 90% still produces 30-dB peak signal-to-noise ratio (PSNR) quality. This is better than DCT. In an experiment on a male spoken sentence, the scheme reaches a 12.82-dB segmental signal-to-noise ratio (SEGSNR) at a rate of less…

Chaotic simulated annealing in multilayer feedforward networks

Don W. Shaw, Witold Kinsner

Artificial Intelligence · · cited 37× · DOI ↗ · more like this ·

This paper presents a method of chaotic simulated annealing for avoiding and subsequently escaping from local minima in the training of multilayer feedforward neural networks. A modified form of the standard simulated annealing algorithm is implemented using both Gaussian random numbers and various types of strange chaotic attractors for perturbation of network weight parameters. Specifically, the attractor generated by the logistic equation, Henon's (1976) attractor Rossler's attractor, and the Lorenz attractor are used at different initial conditions and parametric variations for chaotic perturbations. The variance fractal dimension is used as a quantitative measure of the geometric properties of the strange chaotic attractors. It is shown that, for this application, chaotic simulated annealing using the logistic equation is up to 600 percent faster than conventional simulated…

OpenCL for FPGAs: Prototyping a Compiler

Tomasz Czajkowski, David Neto, Michael Kinsner +7 more

Hardware and Architecture · · cited 36× · OpenAlex ↗ · more like this ·

Hardware acceleration using FPGAs has shown orders of magnitude reduction in runtime of computationally-intensive applications in comparison to traditional stand-alone computers [1]. This is possible because on an FPGA many computations can be performed at the same time in a trulyparallel fashion. However, parallel computation at a hardware level requires a great deal of expertise, which limits the adoption of FPGA-based acceleration platforms. A recent interest to enable software programmers to use GPUs for general-purpose computing has spawned an interest in developing languages for this purpose. OpenCL is one such language that enables a programmer to specify parallelism at a high level and put together an application that can take advantage of low-level hardware acceleration. In this paper, we present a framework to support OpenCL compilation to FPGAs. We begin with two case studies…

Separation performance of ICA on simulated EEG and ECG signals contaminated by noise

Murray Potter, N. Gadhok, Witold Kinsner

Signal Processing · · cited 36× · DOI ↗ · more like this ·

Evaluates the performance of the extended-infomax independent component analysis (ICA) algorithm in a simulated biomedical blind source separation problem. Independent signals representing an alphawave and a heartbeat are generated and then mixed linearly in the presence of white or pink noise to simulate a one-minute recording of an electroencephalogram and electrocardiogram. The selected ICA algorithm separates the white and pink noises equally well. The maximum estimation signal-to-noise ratio of the source estimates is equivalent to the added noise level, so the separation is optimum to second-order. The higher-order demixing performance, as measured by the Amari index, indicates that when the noise contamination exceeds the mixing contamination the ICA separation is reduced. These results represent a lower bound to the performance of extended-infomax ICA in noisy, time-correlated…

Challenges in the Design of Adaptive, Intelligent and Cognitive Systems

Witold Kinsner

Artificial Intelligence · · cited 34× · DOI ↗ · more like this ·

Numerous attempts are being made to develop machines that could act not only autonomously, but also in an increasingly intelligent and cognitive manner. Such cognitive machines ought to be aware of their environments which include not only other machines, but also human beings. Such machines ought to understand the meaning of information in more human-like ways by grounding knowledge in the physical world and in the machines' own goals. The motivation for developing such machines range from self-evidenced practical reasons such as the expense of computer maintenance, to wearable computing in health care, and gaining a better understanding of the cognitive capabilities of the human brain. To achieve such an ambitious goal requires solutions to many problems, ranging from human perception, attention, concept creation, cognition, consciousness, executive processes guided by emotions and…

Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?

Witold Kinsner

Artificial Intelligence · International Journal of Cognitive Informatics and Natural Intelligence · · cited 33× · DOI ↗ · more like this ·

This article provides a review of Shannon and other entropy measures in evaluating the quality of materials used in perception, cognition, and learning processes. Energy-based metrics are not suitable for cognition, as energy itself does not carry information. Instead, morphological (structural and contextual) metrics as well as entropy-based multi-scale metrics should be considered in cognitive informatics. Appropriate data and signal transformation processes are defined and discussed in the perceptual framework followed by various classes of information and entropies suitable for characterization of data, signals, and distortion. Other entropies are also described including the Rényi generalized entropy spectrum, Kolmogorov complexity measure, Kolmogorov-Sinai entropy, and Prigogine entropy for evolutionary dynamical systems. Although such entropy-based measures are suitable for many…

Computer-aided personalized system of instruction: an effective and economical method for short- and long-distance education

Joseph J. Pear, Witold Kinsner

Artificial Intelligence · PeerJ Computer Science · · cited 33× · DOI ↗ · more like this ·

When a well-trained model learns a new class, the data distribution differences between the new and old classes inevitably cause catastrophic forgetting in order to perform better in the new class. This behavior differs from human learning. In this article, we propose a class incremental object detection method for remote sensing images to address the problem of catastrophic forgetting caused by distribution differences among different classes. First, we introduce a class similarity distillation (CSD) loss based on the similarity between new and old class prototypes, ensuring the model's plasticity to learn new classes and stability to detect old classes. Second, to better extract class similarity features, we propose a global similarity distillation (GSD) loss that maximizes the mutual information between the new class feature and old class features. Additionally, we present a region…

Data Parallel C++

Ben Ashbaugh, Alexey Bader, James Brodman +5 more

Hardware and Architecture · · cited 32× · DOI ↗ · more like this ·

SYCL™ is a heterogeneous programming framework built on top of modern C++. Data Parallel C++, recently introduced as part of Intel's oneAPI project, is an implementation of SYCL. Data Parallel C++ (DPC++) is being developed as an open-source project on top of Clang and LLVM. It combines C++, SYCL, and new extensions to improve programmer productivity when writing highly performant code for heterogeneous architectures.

Signal classification through multifractal analysis and complex domain neural networks

Witold Kinsner, Vincent C. K. Cheung, Kevin Cannons +2 more

Artificial Intelligence · · cited 32× · DOI ↗ · more like this ·

This paper describes a system capable of classifying stochastic, self-affine, nonstationary signals produced by nonlinear systems. The classification and analysis of these signals is important because they are generated by many real-world processes. The first stage of the signal classification process entails the transformation of the signal into the multifractal dimension domain, through the computation of the variance fractal dimension trajectory (VFDT). Features can then be extracted from the VFDT using a Kohonen self-organizing feature map. The second stage involves the use of a complex domain neural network and a probabilistic neural network to determine the class of a signal based on these extracted features. The results of this paper show that these techniques can be successful in creating a classification system which can obtain correct classification rates of about 87% when…

Complexity and its measures in cognitive and other complex systems

Witold Kinsner

Computational Theory and Mathematics · · cited 30× · DOI ↗ · more like this ·

The last few decades of physics, chemistry, biology, computer science, engineering, and social sciences have been marked by major developments of views on cognitive systems, dynamical systems, complex systems, complexity, self-organization, and emergent phenomena that originate from the interactions among the constituent components (agents) and with the environment, without any central authority. How can measures of complexity capture the intuitive sense of pattern, order, structure, regularity, evolution of features, memory, and correlation? This paper describes several key ideas, including dynamical systems, complex systems, complexity, and quantification of complexity. As there is no single definition of a complex system, its complexity and complexity measures too have many definitions. This papers also addresses some practical aspects of acquiring the observables.

Towards cognitive security systems

Witold Kinsner

Artificial Intelligence · · cited 27× · DOI ↗ · more like this ·

This talk addresses the changing world of security systems, and a possible approach to their improvement. Since the scientific, technical, industrial, business, and social worlds have changed from physically isolated systems to electronically interconnected system-of-systems (SoS), the functioning of such a SoS depends critically on its operational robustness and security. In the previous physically-isolated world, robust static security for selected matched problems was often sufficient. Today, we need a new approach to providing security, because even adaptive security is insufficient. This new approach is termed here a cognitive security system. The talk will cover three major issues. First, the talk starts from a review of the existing security systems, with their problems and required solutions, as well as their vulnerabilities, attacks, and defences. Second, it provides a review…