Publications
219 results found
Cui Z, Cartucho J, Giannarou S, et al., 2023, Caveats on the First-Generation da Vinci Research Kit: Latent Technical Constraints and Essential Calibrations, IEEE ROBOTICS & AUTOMATION MAGAZINE, ISSN: 1070-9932
Hu ZJ, Wang Z, Huang Y, et al., 2023, Towards Human-Robot Collaborative Surgery: Trajectory and Strategy Learning in Bimanual Peg Transfer, IEEE ROBOTICS AND AUTOMATION LETTERS, Vol: 8, Pages: 4553-4560, ISSN: 2377-3766
Souipas S, Nguyen A, Laws SG, et al., 2023, SimPS-Net: Simultaneous Pose and Segmentation Network of Surgical Tools, IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, Vol: 5, Pages: 614-622
Aktas A, Demircali AA, Secoli R, et al., 2023, Towards a procedure-optimised steerable catheter for deep-seated neurosurgery, Biomedicines, Vol: 11, Pages: 1-17, ISSN: 2227-9059
In recent years, steerable needles have attracted significant interest in relation to minimally invasive surgery (MIS). Specifically, the flexible, programmable bevel-tip needle (PBN) concept was successfully demonstrated in vivo in an evaluation of the feasibility of convection-enhanced delivery (CED) for chemotherapeutics within the ovine model with a 2.5 mm PBN prototype. However, further size reductions are necessary for other diagnostic and therapeutic procedures and drug delivery operations involving deep-seated tissue structures. Since PBNs have a complex cross-section geometry, standard production methods, such as extrusion, fail, as the outer diameter is reduced further. This paper presents our first attempt to demonstrate a new manufacturing method for PBNs that employs thermal drawing technology. Experimental characterisation tests were performed for the 2.5 mm PBN and the new 1.3 mm thermally drawn (TD) PBN prototype described here. The results show that thermal drawing presents a significant advantage in miniaturising complex needle structures. However, the steering behaviour was affected due to the choice of material in this first attempt, a limitation which will be addressed in future work.
Virdyawan V, Ayatullah T, Sugiharto A, et al., 2023, Design and manufacturing of an affordable soft robotic manipulator for minimally invasive diagnosis, International Conference on Robotics and Automation Engineering (ICRAE), Publisher: IEEE
Soft robotic manipulators are inherently compliant thus they are ideally suited for minimally invasive diagnosis and intervention. In addition, soft robotics allows for affordable manufacturing, thus it could be adopted in low and middle-income countries where conventional robotics is prohibitively expensive. In this work, the design, manufacturing, and actuation strategy of an affordable soft robotic manipulator is presented. The manufacturing process does not rely on sophisticated technologies, and the pneumatic actuation does not require digital pressure regulators. Instead, a low-cost solution consisting of a needle valve operated by a servo motor is employed. The prototype is assessed with experiments that demonstrate its functionality.
Donder A, Rodriguez y Baena F, 2023, 3-D path-following control for steerable needles with fiber Bragg gratings in multi-core fibers, IEEE Transactions on Biomedical Engineering, Vol: 70, Pages: 1072-1085, ISSN: 0018-9294
Steerable needles have the potential for accurateneedle tip placement even when the optimal path to a target tissueis curvilinear, thanks to their ability to steer, which is an essen-tial function to avoid piercing through vital anatomical features.Autonomous path-following controllers for steerable needles havealready been studied, however they remain challenging, especiallybecause of the complexities associated to needle localization. Inthis context, the advent of fiber Bragg Grating (FBG)-inscribedmulti-core fibers (MCFs) holds promise to overcome these diffi-culties. Objective: In this study, a closed-loop, 3-D path-followingcontroller for steerable needles is presented. Methods: The controlloop is closed via the feedback from FBG-inscribed MCFs embed-ded within the needle. The nonlinear guidance law, which is a well-known approach for path-following control of aerial vehicles, isused as the basis for the guidance method. To handle needle-tissueinteractions, we propose using Active Disturbance Rejection Con-trol (ADRC) because of its robustness within hard-to-model en-vironments. We investigate both linear and nonlinear ADRC, andvalidate the approach with a Programmable Bevel-tip SteerableNeedle (PBN) in both phantom tissue and ex vivo brain, with someof the experiments involving moving targets. Results: The mean,standard deviation, and maximum absolute position errors areobserved to be 1.79 mm, 1.04 mm, and 5.84 mm, respectively, for3-D, 120 mm deep, path-following experiments. Conclusion: MCFswith FBGs are a promising technology for autonomous steerableneedle navigation, as demonstrated here on PBNs. Significance:FBGs in MCFs can be used to provide effective feedback in path-following controllers for steerable needles
Alian A, Zari E, Wang Z, et al., 2023, Current engineering developments for robotic systems in flexible endoscopy, Techniques and Innovations in Gastrointestinal Endoscopy, Vol: 25, Pages: 67-81, ISSN: 2590-0307
The past four decades have seen an increase in the incidence of early-onset gastrointestinal cancer. Because early-stage cancer detection is vital to reduce mortality rate, mass screening colonoscopy provides the most effective prevention strategy. However, conventional endoscopy is a painful and technically challenging procedure that requires sedation and experienced endoscopists to be performed. To overcome the current limitations, technological innovation is needed in colonoscopy. In recent years, researchers worldwide have worked to enhance the diagnostic and therapeutic capabilities of endoscopes. The new frontier of endoscopic interventions is represented by robotic flexible endoscopy. Among all options, self-propelling soft endoscopes are particularly promising thanks to their dexterity and adaptability to the curvilinear gastrointestinal anatomy. For these devices to replace the standard endoscopes, integration with embedded sensors and advanced surgical navigation technologies must be investigated. In this review, the progress in robotic endoscopy was divided into the fundamental areas of design, sensing, and imaging. The article offers an overview of the most promising advancements on these three topics since 2018. Continuum endoscopes, capsule endoscopes, and add-on endoscopic devices were included, with a focus on fluid-driven, tendon-driven, and magnetic actuation. Sensing methods employed for the shape and force estimation of flexible endoscopes were classified into model- and sensor-based approaches. Finally, some key contributions in molecular imaging technologies, artificial neural networks, and software algorithms are described. Open challenges are discussed to outline a path toward clinical practice for the next generation of endoscopic devices.
Treratanakulchai S, Franco E, Garriga Casanovas A, et al., 2022, Development of a 6 DOF soft robotic manipulator with integrated sensing Skin, International Conference on Intelligent Robots and Systems (IROS 2022), Publisher: IEEE, Pages: 6944-6951
This paper presents a new 6 DOF soft roboticmanipulator intended for colorectal surgery. The manipulator,based on a novel design that employs an inextensible tube tolimit axial extension, is shown to maximize the force exertedat its tip and the bending angle, the latter being measuredwith a soft sensing skin. Manufacturing of the prototypeis achieved with a lost-wax silicone-casting technique. Thekinematic model of the manipulator, its workspace, and itsmanipulability are discussed. The prototype is evaluated withextensive experiments, including pressure-deflection measure-ment with and without tip load, and lateral force measurementswith and without the soft sensing skin to assess hysteresis. Theexperimental results indicate that the prototype fulfils the keydesign requirements for colorectal surgery: (i) it can generatesufficient force to perform a range of laparoscopic tasks; (ii) theworkspace is commensurate with the dimensions of the largeintestine; (iii) the soft sensing skin only results in a marginalreduction of the maximum tip rotation within the range ofpressures and external loads relevant for the chosen application.
Lima MR, Wairagkar M, Gupta M, et al., 2022, Conversational affective social robots for ageing and dementia support, IEEE Transactions on Cognitive and Developmental Systems, Vol: 14, Pages: 1378-1397, ISSN: 2379-8920
Socially assistive robots (SAR) hold significant potential to assist older adults and people with dementia in human engagement and clinical contexts by supporting mental health and independence at home. While SAR research has recently experienced prolific growth, long-term trust, clinical translation and patient benefit remain immature. Affective human-robot interactions are unresolved and the deployment of robots with conversational abilities is fundamental for robustness and humanrobot engagement. In this paper, we review the state of the art within the past two decades, design trends, and current applications of conversational affective SAR for ageing and dementia support. A horizon scanning of AI voice technology for healthcare, including ubiquitous smart speakers, is further introduced to address current gaps inhibiting home use. We discuss the role of user-centred approaches in the design of voice systems, including the capacity to handle communication breakdowns for effective use by target populations. We summarise the state of development in interactions using speech and natural language processing, which forms a baseline for longitudinal health monitoring and cognitive assessment. Drawing from this foundation, we identify open challenges and propose future directions to advance conversational affective social robots for: 1) user engagement, 2) deployment in real-world settings, and 3) clinical translation.
Secoli R, Matheson E, Pinzi M, et al., 2022, Modular robotic platform for precision neurosurgery with a bio-inspired needle: system overview and first in-vivo deployment, PLoS One, ISSN: 1932-6203
Bernardini A, Trovatelli M, Klosowski M, et al., 2022, Reconstruction of ovine axonal cytoarchitecture enables more accurate models of brain biomechanics, Communications Biology, Vol: 5, ISSN: 2399-3642
There is an increased need and focus to understand how local brain microstructure affects the transport of drug molecules directly administered to the brain tissue, for example in convection-enhanced delivery procedures. This study reports a systematic attempt to characterize the cytoarchitecture of commissural, long association and projection fibres, namely the corpus callosum, the fornix and the corona radiata, with the specific aim to map different regions of the tissue and provide essential information for the development of accurate models of brain biomechanics. Ovine samples are imaged using scanning electron microscopy combined with focused ion beam milling to generate 3D volume reconstructions of the tissue at subcellular spatial resolution. Focus is placed on the characteristic cytological feature of the white matter: the axons and their alignment in the tissue. For each tract, a 3D reconstruction of relatively large volumes, including a significant number of axons, is performed and outer axonal ellipticity, outer axonal cross-sectional area and their relative perimeter are measured. The study of well-resolved microstructural features provides useful insight into the fibrous organization of the tissue, whose micromechanical behaviour is that of a composite material presenting elliptical tortuous tubular axonal structures embedded in the extra-cellular matrix. Drug flow can be captured through microstructurally-based models using 3D volumes, either reconstructed directly from images or generated in silico using parameters extracted from the database of images, leading to a workflow to enable physically-accurate simulations of drug delivery to the targeted tissue.
Donder A, Rodriguez y Baena F, 2022, Kalman filter-based, dynamic 3-D shape reconstruction for steerable needles with fiber bragg gratings in multi-core fibers, IEEE Transactions on Robotics, Vol: 38, Pages: 2262-2275, ISSN: 1552-3098
Steerable needles are a promising technology toprovide safe deployment of tools through complex anatomy inminimally invasive surgery, including tumor-related diagnosesand therapies. For the 3-D localization of these instruments in softtissue, fiber Bragg gratings (FBGs)-based reconstruction methodshave gained in popularity because of the inherent advantages ofoptical fibers in a clinical setting, such as flexibility, immunity toelectromagnetic interference, non-toxicity, the absence of line ofsight issues. However, methods proposed thus far focus on shapereconstruction of the steerable needle itself, where accuracy issusceptible to errors in interpolation and curve fitting methodsused to estimate the curvature vectors along the needle. In thisstudy, we propose reconstructing the shape of the path createdby the steerable needle tip based on the follow-the-leader natureof many of its variants. By assuming that the path made by thetip is equivalent to the shape of the needle, this novel approachpaves the way for shape reconstruction through a single set ofFBGs at the needle tip, which provides curvature informationabout every section of the path during navigation. We proposea Kalman Filter-based sensor fusion method to update thecurvature information about the sections as they are continuallyestimated during the insertion process. The proposed methodis validated through simulation, in vitro and ex vivo experimentsemploying a programmable bevel-tip steerable needle (PBN). Theresults show clinically acceptable accuracy, with 2.87 mm meanPBN tip position error, and a standard deviation of 1.63 mm fora 120 mm 3-D insertion.
Jamal A, Yuan T, Galvan S, et al., 2022, Insights into infusion-based targeted drug delivery in brain: perspectives, challenges and opportunities, International Journal of Molecular Sciences, Vol: 23, Pages: 3139-3139, ISSN: 1422-0067
Targeted drug delivery in the brain is instrumental in the treatment of lethal brain diseases, such as glioblastoma multiforme, the most aggressive primary central nervous system tumour in adults. Infusion-based drug delivery techniques, which directly administer to the tissue for local treatment, as in convection-enhanced delivery (CED), provide an important opportunity; however, poor understanding of the pressure-driven drug transport mechanisms in the brain has hindered its ultimate success in clinical applications. In this review, we focus on the biomechanical and biochemical aspects of infusion-based targeted drug delivery in the brain and look into the underlying molecular level mechanisms. We discuss recent advances and challenges in the complementary field of medical robotics and its use in targeted drug delivery in the brain. A critical overview of current research in these areas and their clinical implications is provided. This review delivers new ideas and perspectives for further studies of targeted drug delivery in the brain.
Darwood A, Hurst SA, Villatte G, et al., 2022, Novel robotic technology for the rapid intraoperative manufacture of patient-specific instrumentation allowing for improved glenoid component accuracy in shoulder arthroplasty: a cadaveric study, JOURNAL OF SHOULDER AND ELBOW SURGERY, Vol: 31, Pages: 561-570, ISSN: 1058-2746
- Author Web Link
- Cite
- Citations: 3
Franco E, Garriga Casanovas A, Tang J, et al., 2022, Adaptive energy shaping control of a class of nonlinear soft continuum manipulators, IEEE-ASME Transactions on Mechatronics, Vol: 27, Pages: 280-291, ISSN: 1083-4435
Soft continuum manipulators are characterized by low stiffness which allows safe operation in unstructured environments but introduces under-actuation. In addition, soft materials such as silicone rubber, which are commonly used for soft manipulators, are characterized by nonlinear stiffness, while pneumatic actuation can result in nonlinear damping. Consequently, achieving accurate control of these systems in the presence of disturbances is a challenging task. This paper investigates the model-based adaptive control for soft continuum manipulators that have nonlinear uniform stiffness and nonlinear damping, that bend under the effect of internal pressure, and that are subject to time-varying disturbances. A rigid-link model with virtual elastic joints is employed for control purposes within the port-Hamiltonian framework. The effects of disturbances and of model uncertainties are estimated adaptively. A nonlinear controller that regulates the tip orientation of the manipulator and that compensates the effects of disturbances and of model uncertainties is then constructed by using an energy shaping passivity-based approach. Stability conditions are discussed highlighting the beneficial role of nonlinear damping. The effectiveness of the controller is assessed with simulations and with experiments on a soft continuum manipulator prototype.
Hu X, Rodriguez y Baena F, Cutolo F, 2022, Head-Mounted Augmented Reality Platform for Markerless Orthopaedic Navigation, IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, Vol: 26, Pages: 910-921, ISSN: 2168-2194
- Author Web Link
- Cite
- Citations: 10
Bautista-Salinas D, Abdelaziz MEMK, Temelkuran B, et al., 2022, Towards a Functional Atraumatic Self-Shaping Cochlear Implant, MACROMOLECULAR MATERIALS AND ENGINEERING, Vol: 307, ISSN: 1438-7492
Iqbal H, Rodriguez y Baena F, 2022, Semi-Automatic Infrared Calibration for Augmented Reality Systems in Surgerye, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Publisher: IEEE, Pages: 4957-4964, ISSN: 2153-0858
Hu X, Anh N, Rodriguez y Baena F, 2022, Occlusion-Robust Visual Markerless Bone Tracking for Computer-Assisted Orthopedic Surgery, IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, Vol: 71, ISSN: 0018-9456
- Author Web Link
- Cite
- Citations: 2
Cao MY, Laws S, Baena FRY, 2021, Six-Axis Force/Torque Sensors for Robotics Applications: A Review, IEEE SENSORS JOURNAL, Vol: 21, Pages: 27238-27251, ISSN: 1530-437X
- Author Web Link
- Cite
- Citations: 15
D'Ettorre C, Mariani A, Stilli A, et al., 2021, Accelerating Surgical Robotics Research: A Review of 10 Years With the da Vinci Research Kit, IEEE ROBOTICS & AUTOMATION MAGAZINE, Vol: 28, Pages: 56-78, ISSN: 1070-9932
- Author Web Link
- Cite
- Citations: 32
Treratanakulchai S, Rodriguez y Baena F, 2021, A passive decoupling mechanism for misalignment compensation in master-slave teleoperation, IEEE Transactions on Medical Robotics and Bionics, Vol: 3, Pages: C2-C2, ISSN: 2576-3202
Pinzi M, Vakharia VN, Hwang BY, et al., 2021, Computer Assisted Planning for Curved Laser Interstitial Thermal Therapy, IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, Vol: 68, Pages: 2957-2964, ISSN: 0018-9294
- Author Web Link
- Cite
- Citations: 2
Schlueter-Brust K, Henckel J, Katinakis F, et al., 2021, Augmented-reality-assisted K-wire placement for glenoid component positioning in reversed shoulder arthroplasty: a proof-of-concept study, Journal of Personalized Medicine, Vol: 11, Pages: 1-8, ISSN: 2075-4426
The accuracy of the implant’s post-operative position and orientation in reverse shoulder arthroplasty is known to play a significant role in both clinical and functional outcomes. Whilst technologies such as navigation and robotics have demonstrated superior radiological outcomes in many fields of surgery, the impact of augmented reality (AR) assistance in the operating room is still unknown. Malposition of the glenoid component in shoulder arthroplasty is known to result in implant failure and early revision surgery. The use of AR has many promising advantages, including allowing the detailed study of patient-specific anatomy without the need for invasive procedures such as arthroscopy to interrogate the joint’s articular surface. In addition, this technology has the potential to assist surgeons intraoperatively in aiding the guidance of surgical tools. It offers the prospect of increased component placement accuracy, reduced surgical procedure time, and improved radiological and functional outcomes, without recourse to the use of large navigation or robotic instruments, with their associated high overhead costs. This feasibility study describes the surgical workflow from a standardised CT protocol, via 3D reconstruction, 3D planning, and use of a commercial AR headset, to AR-assisted k-wire placement. Post-operative outcome was measured using a high-resolution laser scanner on the patient-specific 3D printed bone. In this proof-of-concept study, the discrepancy between the planned and the achieved glenoid entry point and guide-wire orientation was approximately 3 mm with a mean angulation error of 5°.
Iqbal H, Tatti F, Baena FRY, 2021, Augmented reality in robotic assisted orthopaedic surgery: A pilot study, JOURNAL OF BIOMEDICAL INFORMATICS, Vol: 120, ISSN: 1532-0464
- Author Web Link
- Cite
- Citations: 11
Trovatelli M, Brizzola S, Zani DD, et al., 2021, Development and in vivo assessment of a novel MRI-compatible headframe system for the ovine animal model, INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, Vol: 17, ISSN: 1478-5951
- Author Web Link
- Cite
- Citations: 1
Franco E, Garriga Casanovas A, Tang J, et al., 2021, Position regulation in Cartesian space of a class of inextensible soft continuum manipulators with pneumatic actuation, Mechatronics, Vol: 76, Pages: 1-21, ISSN: 0957-4158
This work investigates the position regulation in Cartesian space of a class of inextensible soft continuum manipulators with pneumatic actuation subject to model uncertainties and to unknown external disturbances that act on the tip. Soft continuum manipulators are characterised by high structural compliance which results in a large number of degrees-of-freedom, only a subset of which can be actuated independently or instrumented with sensors. External disturbances, which are common in many applications, result in uncertain dynamics and in uncertain kinematics thus making the control problem particularly challenging. We have investigated the use of integral action to model the uncertain kinematics of the manipulators, and we have designed a new control law to achieve position regulation in Cartesian space by employing a port-Hamiltonian formulation and a passivity-based approach. In addition, we have compared two adaptive laws that compensate the effects of the external disturbances on the system dynamics. Local stability conditions are discussed with a Lyapunov approach and are related to the controller parameters. The performance of the controller is demonstrated by means of simulations and experiments with two different prototypes.
Giles JW, Broden C, Tempelaere C, et al., 2021, Development and <i>ex-vivo</i> assessment of a novel patient specific guide and instrumentation system for minimally invasive total shoulder arthroplasty, PLOS ONE, Vol: 16, ISSN: 1932-6203
Pinzi M, Watts T, Secoli R, et al., 2021, Path replanning for orientation-constrained needle steering, IEEE Transactions on Biomedical Engineering, Vol: 68, Pages: 1459-1466, ISSN: 0018-9294
Introduction: Needle-based neurosurgical procedures require high accuracy in catheter positioning to achieve high clinical efficacy. Significant challenges for achieving accurate targeting are (i) tissue deformation (ii) clinical obstacles along the insertion path (iii) catheter control. Objective: We propose a novel path-replanner able to generate an obstacle-free and curvature bounded three-dimensional (3D) path at each time step during insertion, accounting for a constrained target pose and intraoperative anatomical deformation. Additionally, our solution is sufficiently fast to be used in a closed-loop system: needle tip tracking via electromagnetic sensors is used by the path-replanner to automatically guide the programmable bevel-tip needle (PBN) while surgical constraints on sensitive structures avoidance are met. Methods: The generated path is achieved by combining the ”Bubble Bending” method for online path deformation and a 3D extension of a convex optimisation method for path smoothing. Results: Simulation results performed on a realistic dataset show that our replanning method can guide a PBN with bounded curvature to a predefined target pose with an average targeting error of 0.65 ± 0.46 mm in position and 3.25 ± 5.23 degrees in orientation under a deformable simulated environment. The proposed algorithm was also assessed in-vitro on a brain-like gelatin phantom, achieving a target error of 1.81 ± 0.51 mm in position and 5.9 ± 1.42 degrees in orientation. Conclusion: The presented work assessed the performance of a new online steerable needle path-planner able to avoid anatomical obstacles while optimizing surgical criteria. Significance: This method is particularly suited for surgical procedures demanding high accuracy on the desired goal pose under tissue deformations and real-world inaccuracies.
Hu X, Liu H, Rodriguez y Baena FM, 2021, Markerless navigation system for orthopaedic knee surgery: a proof of concept study, IEEE Access, Vol: 9, Pages: 64708-64718, ISSN: 2169-3536
Current computer-assisted surgical navigation systems mainly rely on optical markers screwed into the bone for anatomy tracking. The insertion of these percutaneous markers increases operating complexity and causes additional harm to the patient. A markerless tracking and registration algorithm has recently been proposed to avoid anatomical markers for knee surgery. The femur points were directly segmented from the recorded RGBD scene by a neural network and then registered to a pre-scanned femur model for the real-time pose. However, in a practical setup such a method can produce unreliable registration results, especially in rotation. Furthermore, its potential application in surgical navigation has not been demonstrated. In this paper, we first improved markerless registration accuracy by adopting a bounded-ICP (BICP) technique, where an estimate of the remote hip centre, acquired also in a markerless way, was employed to constrain distal femur alignment. Then, a proof-of-concept markerless navigation system was proposed to assist in typical knee drilling tasks. Two example setups for global anchoring were proposed and tested on a phantom leg. Our BICP-based markerless tracking and registration method has better angular accuracy and stability than the original method, bringing our straightforward, less invasive markerless navigation approach one step closer to clinical application. According to user tests, our proposed optically anchored navigation system achieves comparable accuracy with the state-of-the-art (3.64± 1.49 mm in position and 2.13±0.81° in orientation). Conversely, our visually anchored, optical tracker-free setup has a lower accuracy (5.86± 1.63 mm in position and 4.18±1.44° in orientation), but is more cost-effective and flexible in the operating room.
This data is extracted from the Web of Science and reproduced under a licence from Thomson Reuters. You may not copy or re-distribute this data in whole or in part without the written consent of the Science business of Thomson Reuters.