Luping Fn,Peng Go,Boling Zho,Yu Sun,Xioxio Xin,Ying Hu,*, Shoubin Liu,Jinwei Zhng
aShenzhen Graduate School,Harbin Institute of Technology,Shenzhen,China
bShenzhen Institutes of Advanced Technology,Chinese Academy of Sciences,Shenzhen,China
cCAS Key Laboratory of Human-Machine Intelligence-Synergy Systems,Shenzhen Institutes of Advanced Technology,Shenzhen,China
dUniversity of Hamburg,Hamburg,Germany
Available online 5 November 2016
Safety control strategy for vertebral lamina milling task
Luping Fana,b,c,Peng Gaob,c,Baoliang Zhaob,c,Yu Suna,b,c,Xiaoxiao Xina,b,c,Ying Hub,c,*, Shoubin Liua,Jianwei Zhangd
aShenzhen Graduate School,Harbin Institute of Technology,Shenzhen,China
bShenzhen Institutes of Advanced Technology,Chinese Academy of Sciences,Shenzhen,China
cCAS Key Laboratory of Human-Machine Intelligence-Synergy Systems,Shenzhen Institutes of Advanced Technology,Shenzhen,China
dUniversity of Hamburg,Hamburg,Germany
Available online 5 November 2016
Vertebral lamina milling task is one of the high-risk operations in spinal surgeries.The operation is to remove part of vertebral lamina and release the pressure on the spinal nerve.Because many important vessels and nerves are under the vertebral lamina,any incorrect operation may cause irreparable damage to patients.To improve the safety of lamina milling task,a fuzzy force control strategy is proposed in this paper. Primary experiments have been conducted on bone samples from different animals.The results show that,with the fuzzy force control strategy, the bone milling system can recognize all surgery states and halt the tool at the proper location,achieving satisfactory surgery performance. Copyright?2016,Chongqing University of Technology.Production and hosting by Elsevier B.V.This is an open access article under the CC BY-NC-ND license(http://creativecommons.org/licenses/by-nc-nd/4.0/).
Safety control;Force feedback;Fuzzy logic control;Vertebral lamina milling;Spinal surgery
Advances in science and technology have led to the use of various robots in the field of medical application.In recent years,surgical robots have been widely applied in different types of orthopedic surgery,such as laminectomy,total knee arthroplasty,artificial disc replacement[1-3],etc.Spinal surgery is believed to be high-risk since any damage to the spinal cord may cause paralysis or even death to the patients. Traditionally,the spinal surgery is performed manually,and the long duration time will cause surgeons'fatigue,reducing the surgery quality.
Laminectomy is to restore the function of the compressed spinal nerve by expanding the spinal canal space.The vertebral lamina milling operation is regarded as one of the most critical and risky operations.In the surgery,the surgeon needs to hold the high-speed-rotating bone drill to mill the vertebral lamina from the surface to the inner cortical bone, removing the spike process part and releasing the pressure on the spinal nerve[4,5](Fig.1).
Laminectomy has been widely used to treat patients with lumbarspinalstenosis[7,8],toreleasetheoppressedspinalnerve andrecoverthefunctionofspinalcord.Thekeytothesuccessof Laminectomyistoensuretheproperamountoflaminaremained. Too small amount of residual volume may cause harm to the spinal canal and spinal nerve,and too large amount cannot achieve the effect of spinal nerve decompression[9].
Researchers have tried using robots to assist surgeons to improve the surgery accuracy and efficiency.An Israel company has marketed a parallel robot to help surgeons to guide the tools and implants(Renaissance Guidance System,Mazor Robotics?,Caesarea,Israel)[10];Ortmaier has designed a robot for accurate placement of pedicle screws with the help of an optical navigation system[11];Chung has designed a robot to insert pedicle screws in the spinal fusion procedure[12];Huhas developed a spinal surgical robot and successfully recognized the different states during the pedicle screw insertion process with a real-time force sensing algorithm[13].For the vertebral lamina milling task,some safety control strategies have been studied.Wang et al.[14,15]milled the vertebral layer by layer from the outer cortical bone to the inner cortical bone at a constant depth.Based on the analysis of typical characteristic parameters of the force profiles,the crosscorrelation to the standard profiles are adopted to judge the milling status.Because this method was unable to adapt to the complex surfaces of the vertebrae,the profile pattern is in close relation to the three-layer structure,which is to the disadvantage of milling status distinguishment.Zhang et al. [16]proposed a fuzzy logic control method for bone drilling operation to treat laminectomy.Based on surgeons'experience,the database of fuzzy rules was established.The pressure on the drill and the thickness of the bone are set as input, the drilling depth and drilling velocity are set as output.The fuzzy logic control system was simulated with MATLAB and SIMULINK,and the result showed its feasibility.Deng et al. [17]designed a fuzzy force controller for vertebral lamina milling operation.The force control was implemented to adjust the milling parameters to adjust for the complex anatomical structure of the vertebral lamina.For safety purposes,a state detection method based on energy consumption was also proposed.The results of contrast experiments showed that the milling operation under fuzzy force control took shorter time and was with more stable longitudinal contact force.The state detection method could detect the three milling states successfully,resulting in an acceptable vertebral lamina residue.
Fig.1.The laminectomy operation[6].
In this paper,we firstly describe the anatomical structure of the vertebral lamina and the milling procedure.Then,the fuzzy force control theory is introduced.The milling force in the horizontal direction is controlled constant,and the milling force in the vertical direction is used to distinguish the structure of the bone layer.The principle of milling state distinguishment is established through six groups of vertebral lamina milling experiments.Then,twelve groups of experiments are conducted to validate the robustness of the safety control strategy based on this principle.
The paper is organized as follows.The fuzzy force control strategy is proposed in Section 2 and 3.The principle of milling state distinguishment is established and validated in Section 4 and 5.The conclusions are presented in Section 6.
In laminectomy,vertebral lamina milling is the key and most difficult procedure.Orthopedists must handle the tool to mill vertebral lamina very carefully to ensure that the pressure on the spinal nerve is relieved but the spinal nerve and its surrounding vessels are not damaged.During the vertebral lamina milling operation,the bone drill needs to drill through the outer cortical bone,cancellous bone,and the inner cortical bone(Fig.2).During the actual operation,if not controlled well,the bone drill may drill through the inner cortical bone and seriously damage the spinal cord and nerves,this will cause paralysis or even death of the patients(Fig.3).Therefore,it is very important to detect the milling state and ensure the safety in a robot-assisted surgery.
Fig.2.Physiological structure of lamina.
The interacting force between the bone drill and vertebral lamina is affected by manyfactorsduring the milling operation. It mainly includes:bone density,rotating speed,milling speed andmillingdepth.Inourcase,themillingspeedandtherotating speed of bone drill are both set to a constant value.With the bone drill mills different layers and the milling depth changes, the interacting force between the vertebrae lamina and bone drill will change.During the milling operation,the bone drill needs to work on three bone layers including outer cortical bone,cancellousboneandinnercorticalbone.Thebonedensity of the cortical bone is larger than that of the cancellous bone [18,19].With the same milling depth,the interacting force between bone drill and cortical bone is larger than that of the cancellous bone.The interacting force between the bone drill and vertebral lamina is analyzed to recognize the milling state.
During the milling operation,the bone drill mills along the surface of the vertebral lamina,and the milling force can be decomposedintotwocomponents:axialforceFyandtangential force Fz(Fig.4).To ensure the safety of the surgery,a safety controlstrategybasedonfuzzylogicisproposed(Fig.5).Atthe beginning of milling operation,an initial milling depth is given, and the tangential force with this milling depth is set to be the reference value.The real-time tangential force signal is introduced into the fuzzy logic controller.By adjusting the milling depth of the bone drill,the tangential force is kept in a constant range.At the same time,the axial force signal generated in milling operation is used to estimate the state of the vertebral lamina milling;if the bone drill is milling in the outer cortical bone layer and cancellous bone layer,the milling operation continues;if the bone drill is milling in the inner cortical bone layer,the milling operation stops.
Fuzzy control system is a closed loop control system based on fuzzy language representation and logic inference.Its core component is fuzzy logic controller(FLC)[20].It transforms the measured values by various sensors into the fuzzy quantities suitable for the fuzzy operation.Then fuzzy rules are constructed to infer the output result.In the end,the fuzzy quantity in the operation result is converted to the exact quantity,in order to carry out the specific operation of the actuator control(Fig.6).Since the control output of the fuzzy logic control system is calculated from the fuzzy inference,it does not need the system mathematical model.The parameters of the membership functions and fuzzy rules need to be planned by the expert or based on experience[21].
Fig.3.Dangerous operation[4].
Fig.4.Analysis of the milling force.
Fig.5.Safety control strategy.
In order to test the safety control strategy presented in this paper,the milling experiments have been conducted with the three-axis robot system.The experiment setup is shown in Fig.7.The bone mill is with diameter of?4 mm and its rotating speed can be regulated from 0 r/min to 80000 r/min. The interacting force between the bone dill and bone sample is measured by the force/torque sensor with sampling frequency of 1000 Hz.The milling speed is 1.5 mm/s,the initial milling depth is 0.5 mm.
The original force signal is noisy,caused by motor vibration,so the collected force signal needs to be filtered before subsequent processing.In this study,recursion averagefiltering is used to process the original force signal.Fig.8 shows the filtering result of the original force signal.
The force controller is based on admittance control,constructed with milling depth?d,horizontal milling force FZand reference milling force Fref,as shown in Eqs.(1)and(2).
Fig.6.The structure of fuzzy logic controller.
Fig.7.Milling experiments.
Where Geis the contact admittance between the ends of the bone drill and the lamina,y and yrefare the actual space coordinate and the reference space coordinate of the bone drill in the direction of milling depth for the bone drill.
We define linguistic variables“E”in the domain of system error e.We define the linguistic variable“Ec”in the domain of the error changing rate ec.We define the linguistic variable“U”in the domain of control u,as shown in Eqs.(3)-(5).
Fuzzification is the first step of fuzzy combiner,which transforms the input and output variables into the fuzzy quantity.In the discrete domain,the input and output variables are denoted as{-6,-5,-4,-3,-2,-1,0,1,2,3,4,5,6}, respectively.Their corresponding fuzzy quantities are defined for the rule base as{NB(negative big),NM(negative middle), NS(negative small),ZO(zero),PS(positive small),PM (positive middle),PB(positive big)}[19].
The values of the e and u are scaled to the interval of[-0.5, 0.5]and the interval of[-0.09,0.09]for the ec,as shown in Eqs.(6)-(11).
Fig.8.Original force signal and its short-time recursion average.
where keand kecdenote the quantization factors of input,and kudenote the scaling factor of output.
After fuzzification,fuzzy inference is used to establish the fuzzy rules.In this study,the triangular membership function is used for all variables,as shown in Fig.9.
The fuzzy rules are constructed using if-then statements, and 49 rules are defined to form the fuzzy rule base for the fuzzy combiner,as shown in Table 1.
FLC is developed using the Fuzzy Logic Toolbox for MATLAB and Simulink.Surface viewer is utilized for the determination of the characteristics of the proposed fuzzy controller,as shown in Fig.10.
In order to show the advantages of fuzzy force control strategy,twogroupsofexperimentshavebeenconductedonthesame bone sample,which is a vertebra bone of pig with thickness of 57 mm.The rotating speed of the bone drill is set to be 15000 r/ min.In the first experiment,the milling depth remains constant; the bone drill mills down 0.5 mm layer by layer,until the inner cortical bone.In the second experiment,the milling depth is adjustedwith the tangential millingforcebasedonfuzzycontrol strategy,keeping the tangential force a constant value.
Themillingforcesignalsofthetwoexperimentsareshownin Figs.11 and 12.There are 10 layers in Figs.11 and 7 layers in Fig.12 in the milling process until milling to the inner cortical bone.Comparing the two figures,it is noticed that the experiment with fuzzy force control has less milling layers(meaning less time used)and obtains a more regulated drill-bone interacting force,which will benefit the milling operation[22].
To ensure the safety of milling operation,the bone drill needs to stop when it gets to the inner cortical bone.To obtain the relationship between the axial force and the state recognition,the experiment below has been conducted.Three kinds of bone samples including vertebra of pig,vertebra of sheep and vertebra of cattle are used in the experiment,with bone drill rotating speed of 15000 r/min and 20000 r/min separately. The initial milling depth is set to be 0.5 mm,and the tangential force during the milling operation is controlled to be constant with the fuzzy logic.The mean value of the axial force isrecorded for each layer,until the bone drill gets to the inner cortical bone.Table 2 shows that the axial milling forces are different on different bone samples and the force value is also affected by drilling speed.
Fig.9.Membership functions of the input and output variables.
Table 1 The rule base for FLC.
Fig.10.Surface viewer.
Fig.11.Result of the first experiment.
Fig.12.Result of the second experiment.
To prove that the surgical system can detect the milling states for all the cases,the data is normalized.By using the normalized mean feature,the characteristic parameter range of the axial force is mapped to the[0,1],as shown in Fig.13.
After normalizing the data of these 6 groups,we found that the axial force of the cancellous layer are always in the range of(0.4,0.5)and the axial force of the cortical layer are always greater than 0.9.
With the above experimental results,we has obtained the relationship between the axial force and milling state,and the control program is written,as shown in Fig.14.Firstly parameters are initialized,then the system starts milling operation.In the initial milling stage,S=1,the bone drill is located in the outer cortical bone.The average milling force of the first two layers is used to determine the maximum milling force Fo.
Table 2 Axial milling force(unit:Newton).
Fig.13.Normalized axial force.
Fig.14.Program control flow chart.
Table 4 Experimental result.
Fig.15.Normalized force features in different milling situations.
When the average milling force of the i-th layer is less than Fo/2,S=2.Bone drill is located in the cancellous bone,the milling operation continues.When the milling force is larger than 0.9*Fo,S=3.The bone drill is located in the inner cortical bone,the milling operation stops immediately.
According to the surgeons'experience,the vertebra lamina residue with thickness of 1-2 mm can meet the safety requirement of the operation,and the surgeons can easily open the spinal canal wall.
In order to verify the effectiveness of the safety control strategy in the lamina milling operation,we conducted 6 groups of experiments,2 times in each group,with parameters shown in Table 4.
The experimental method is based on the three-axis robot system,usingthevertebraofpig,vertebraofsheep,andvertebra of cattle for the milling experiment.We check the state of the milling process and measure the residual lamina thickness.
Table 3 shown the data collected with the 6 groups of experiments.In Fig.15,the test data are normalized,and it is clearly shown that the normalized force feature of 0.4-0.5 for the milling in cancellous bone,and the normalized force feature higher than 0.9 for the milling in cortical bone.The data trend in Fig.15 is similar to that in Fig.13.
TheexperimentalresultisshowninTable4.Bymeasuringthe thickness of the residual lamina,we found that the experimental resultsofthe6groupsarealllocatedbetween1and2mm,which guarantees the safety of the vertebral lamina milling operation.
In this study,a safety control strategy based on fuzzy force control is proposed for vertebral lamina milling task.The anatomical structure of the vertebral lamina is described and the interacting force between the bone drill and the lamina is analyzed.The milling force in the horizontal direction is controlled constant with fuzzy force control logic,and the milling force in the vertical direction is used to distinguish the structure of the bone layer.Through several experiments on different bone samples,the milling state distinguishment principle is recognized,and by data normalization,a safety control strategy is designed and validated.The experiment results shows that,with the control strategy proposed in this paper,the system can obtain a regulated bone-tool interacting force and take less milling time.The state detection method can protect the vertebral lamina from being milled through and ensure an acceptable thickness of vertebral lamina residue.
Acknowledgements
This research is supported by the National Nature Science Foundation of China(No.61573336,61473278),National High-tech R&D Program of China(No.2015AA043201),Key Fundamental Research Program of Shenzhen (No. JCYJ20150529143500954).
[1]S.Wang,P.Gao,L.Fan,et al.,J.Med.Devices 10(3)(2016)030924.
[2]C.Plaskos,P.Cinquin,S.Lavallee,et al.,Int.J.Med.Robotics Comput. Assisted Surg.1(4)(2005)67-79.
[3]H.Tian,D.Wu,Z.Du,et al.,Design and analysis of a 6-DOF parallel robot used in artificial cervical disc replacement surgery,in:IEEE International Conference on Information and Automation,2010.
[4]M.S.Patel,M.Newey,P.Sell,Bone Jt.J.97-B(3)(2015)366-371.
[5]E.Y.L.Teo,B.S.Kelley,I.H.Black,J.Clin.Anesth.26(8)(2014) 606-610.
[6]T.Osa,C.F.Abawi,N.Sugita,et al.,IEEE/ASME Trans.Mechatron.20 (6)(2015)3018-3027.
[7]Z.Ghogawala,J.Dziura,W.E.Butler,et al.,N.Engl.J.Med.374(15) (2016)1424-1434.
[8]G.M.Overdevest,W.Jacobs,C.Vleggeert-Lankamp,Cochrane Database Syst.Rev.24(10)(2015)2244-2263.
[9]J.Chen,N.J.Shen,M.X.Lin,et al.,Orthop.J.China 16(19)(2008) 1510-1511.
[10]http://www.mazorrobotics.com/surgeons/how-it-works/,visited on 11/6/ 2015.
[11]T.Ortmaier,H.Weiss,U.Hagn,et al.,A hands-on-robot for accurate placement of pedicle screws,in:IEEE International Conference on Robotics and Automation,2006.
[12]G.B.Chung,S.Kim,S.G.Lee,et al.,Int.J.Control Automation Syst.4 (1)(2006)30-41.
[13]Y.Hu,H.Jin,L.Zhang,et al.,IEEE-ASME Trans.Mechatron.19(1) (2014)357-365.
[14]T.M.Wang,S.Luan,L.Hu,et al.,Med.Robot.Comput.Assist.Surg.6 (2)(2010)178-185.
[15]T.M.Wang,J.L.Zhang,Z.J.Liu,et al.,Robot 29(5)(2007)463-468.
[16]J.L.Zhang,T.M.Wang,S.Luan,et al.,Mater.Sci.Technol.14(2006) 77-82.
[17]Z.Deng,H.Y.Jin,Y.Hu,et al.,Mechatronics 35(2016)1-10.
[18]D.T.Reilly,A.H.Burstein,J.Bone Jt.Surg.(1974)1001-1022.
[19]X.Banse,T.J.Sims,A.J.Bailey,J.Bone Mineral Res.17(9)(2002) 1621-1628.
[20]C.C.Lee,IEEE Trans.Syst.Man.Cybern.20(Apr.1990)404-418.
[21]P.J.King,E.H.Mamdani,Automatica 13(3)(1977)235-242.
[22]H.C.Shin,Y.S.Yoon,J.Biomech.39(1)(2006)33-39.
LupingFan was born in Hebei,China.He received the B.S.degree in mechanical engineering from Hunan University of Technology,Zhuzhou,Hunan, China,in 2013and he is currently pursuing the M.S. degree in mechanical engineering from Harbin Institute of Technology,Shenzhen,China.He is currently a guest student in Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences(Shenzhen,Guangdong,China).His research interest is surgical robots.
Peng Gao received the Bachelor's and Master's degrees from the hebei university of engineering,Handan,China,in 2010 and 2013,respectively.He is currently a engineer in the Center for Cognitive Technology,Shenzhen Institute of Advanced Technology,Chinese Academy of Sciences,Shenzhen.His research interest include surgical robot,parallel robot and optimal design of robot.
Baoliang Zhao was born in Hebei,China.He received the B.S.degree in mechanical engineering from Yanshan University,Qinhuangdao,Hebei, China,in 2008 and M.S.degree in mechanical engineering from Tongji University,Shanghai,China, in 2011.He completed the Ph.D.degree in mechanical engineering and applied mechanics at the University of Nebraska-Lincoln,Lincoln,NE,USA in 2015.He is currently a postdoctor in Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences(Shenzhen,Guangdong,China). His research interests include haptics,teleoperation,surgical robots and rehabilitation robots.
Yu Sun received the Bachelor's and Master's degrees from Harbin Institute of Technology,China,in 2012 and 2015,respectively.He is the Ph.D student in Harbin Institute of Technology Shenzhen Graduate School,China,from 2015.He is currently a guest Ph.D student in Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences(Guangdong,China).His research interests include surgical robots,image navigation,control and signal processing and analysis.
Xiaoxiao Xin was born in Henan,China.She received the B.S.degree in mechanical engineering from North China University of Water Resources and Electric Power,zhengzhou,China.She is currently studying in Harbin Institute of Technology.Shenzhen, China.She is currently a guest student in the Center for Cognitive Technology,Shenzhen Institute of Advanced Technology,Chinese Academy of Sciences,Shenzhen.Her research interests is surgical robots.
Ying Hu(M'11)received the B.S.degree from Shanghai Jiaotong University,Shanghai,China,in 1991,and the M.S.and Ph.D.degrees in mechanical engineering from Harbin Institute of Technology, Shenzhen,China,in1998and2007,respectively.Sheis currently a Professor in the Center for Cognitive Technology,Shenzhen Institute of Advanced Technology,Chinese Academy of Sciences,Shenzhen.She is the author or coauthor of more than 60 scientific papers published in refereed journals and conference proceedings.Her research interests include parallel robots,medical assistant robots,and mobile robots.
Shoubin Liu received the Bachelor's and Master's degrees from Shandong University China,in 1985 and 1990 respectively,and the Ph.D.degree from City University of Hong Kong.He is currently a associate Professor in Harbin Institute of Technology Shenzhen,China.
Jianwei Zhang(M'91)received the Bachelor's and Master's degrees from the Department of Computer Science,Tsinghua University,Beijing,China,in 1986 and 1989 respectively,and the Ph.D.degree from the Department of Computer Science,Institute of Real-Time Computer Systems and Robotics,University of Karlsruhe,Karlsruhe,Germany,in1994.Heiscurrently aProfessorandHeadoftheTAMSGroup,Universityof Hamburg,Hamburg,Germany.His research interests includemultimodalperception,robotlearning,andmobileservicerobots.Intheseareashehaspublishedmore than200journalandconferencepapers,technicalreports,fourbookchapters,and two research monographs.Dr.Zhang has received several awards,including the IEEE ROMAN and IEEE AIM Best Paper Awards.
*Corresponding author.Xueyuan Avenue 1068,Shenzhen 518055, Guangdong,China.
E-mail addresses:lp.fan@siat.ac.cn(L.Fan),peng.gao@siat.ac.cn(P. Gao),bl.zhao@siat.ac.cn(B.Zhao),yu.sun@siat.ac.cn(Y.Sun),xx.xin@ siat.ac.cn(X.Xin),ying.hu@siat.ac.cn(Y.Hu),mesbliu@hitsz.edu.cn(S. Liu),zhang@informatik.uni-hamburg.de(J.Zhang).
Peer review under responsibility of Chongqing University of Technology.
http://dx.doi.org/10.1016/j.trit.2016.10.005
2468-2322/Copyright?2016,Chongqing University of Technology.Production and hosting by Elsevier B.V.This is an open access article under the CC BY-NCND license(http://creativecommons.org/licenses/by-nc-nd/4.0/).
CAAI Transactions on Intelligence Technology2016年3期