arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Junling Fu

4 papers · 2022–2024

2022: 12023: 12024: 2
2022peak 2 in 20242024

Frequent co-authors

Papers

showing 1–4 of 4 RSS

Recent Advancements in Augmented Reality for Robotic Applications: A Survey

Junling Fu, Alberto Rota, Shufei Li +5 more

Computer Vision and Pattern Recognition · Actuators · · cited 50× · DOI ↗ · more like this ·

Robots are expanding from industrial applications to daily life, in areas such as medical robotics, rehabilitative robotics, social robotics, and mobile/aerial robotics systems. In recent years, augmented reality (AR) has been integrated into many robotic applications, including medical, industrial, human–robot interactions, and collaboration scenarios. In this work, AR for both medical and industrial robot applications is reviewed and summarized. For medical robot applications, we investigated the integration of AR in (1) preoperative and surgical task planning; (2) image-guided robotic surgery; (3) surgical training and simulation; and (4) telesurgery. AR for industrial scenarios is reviewed in (1) human–robot interactions and collaborations; (2) path planning and task allocation; (3) training and simulation; and (4) teleoperation control/assistance. In addition, the limitations and…

Augmented Reality and Human-Robot Collaboration Framework for Percutaneous Nephrolithotomy: System Design, Implementation, and Performance Metrics

Junling Fu, Matteo Pecorella, Elisa Iovene +5 more

cs.RO · · cited 15× · arXiv ↗ · more like this ·

During Percutaneous Nephrolithotomy (PCNL) operations, the surgeon is required to define the incision point on the patient's back, align the needle to a pre-planned path, and perform puncture operations afterward. The procedure is currently performed manually using ultrasound or fluoroscopy imaging for needle orientation, which, however, implies limited accuracy and low reproducibility. This work incorporates Augmented Reality (AR) visualization with an optical see-through head-mounted display (OST-HMD) and Human-Robot Collaboration (HRC) framework to empower the surgeon's task completion performance. In detail, Eye-to-Hand calibration, system registration, and hologram model registration are performed to realize visual guidance. A Cartesian impedance controller is used to guide the operator during the needle puncture task execution. Experiments are conducted to verify the system…

Hybrid Tracking Module for Real-Time Tool Tracking for an Autonomous Exoscope

Elisa Iovene, D. Cattaneo, Junling Fu +2 more

Computer Vision and Pattern Recognition · IEEE Robotics and Automation Letters · · cited 6× · DOI ↗ · more like this ·

Exoscopes have emerged as a promising visual solution within the field of microneurosurgery. However, manual repositioning poses a challenge causing interruptions that disrupt the surgical flow. Thus, the need for hands-free exoscope control arises. This paper introduces a position-based visual-servoing control approach, comprising a detection module, a hybrid tracking module, and a control module that adjusts a robotic camera holder to follow a surgical tool. The hybrid module was integrated to track and predict the surgical tool's future position to minimize system latency. The proposed system is composed of a 7 Degree-of-Freedom robotic manipulator with an eye-in-hand stereo camera. A comparative analysis with three alternative approaches (Convolutional Neural Network - CNN, Particle Filter - PF, Optical Flow - OF) was assessed using Tracking Error and Center Error metrics. Results…

Envisioning Robotic Exoscope: Concept and Preliminary Results

Alice Valeria Iordache, Alessandro Casella, Elisa Iovene +6 more

Computer Vision and Pattern Recognition · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · · cited 1× · DOI ↗ · more like this ·

The introduction of a surgical microscope in neurosurgery increased the spectrum and safety of interventions. The surgeon operates with both hands on the patient while also controlling the visualization system to provide the proper view. Despite the benefits of the microscope, low ergonomics may lead to long-term effects on the muscu- loskeletal system. The bulky binocular system may limit the setup’s flexibility, hindering robotics integration into the operating theatre. Recently, the introduction of the exoscopes overcame those limitations by enabling a flexible and ergonomic working environment, combined with improved image quality. The exoscope is fixed on the surgical field through pneumatic arm holders that the surgeon can move manually or through foot control. Although providing the surgeon with enhanced vision, the complexity of its use has emerged as a limiting factor [1]. The…