張軍國,馮文釗,胡春鶴,駱有慶
(1. 北京林業(yè)大學(xué)工學(xué)院,北京 100083;2. 北京林業(yè)大學(xué)林學(xué)院,北京 100083)
·農(nóng)業(yè)航空工程·
無人機(jī)航拍林業(yè)蟲害圖像分割復(fù)合梯度分水嶺算法
張軍國1,馮文釗1,胡春鶴1,駱有慶2※
(1. 北京林業(yè)大學(xué)工學(xué)院,北京 100083;2. 北京林業(yè)大學(xué)林學(xué)院,北京 100083)
針對林業(yè)信息監(jiān)測方式實(shí)時性差、監(jiān)測范圍有限等問題,為更加實(shí)時、準(zhǔn)確地對林業(yè)蟲害信息進(jìn)行監(jiān)測并計(jì)算監(jiān)測樣地中蟲害區(qū)域比例,該文在搭建面向林區(qū)蟲害監(jiān)測的多旋翼無人飛行器航拍監(jiān)測系統(tǒng)基礎(chǔ)上,提出了一種基于復(fù)合梯度分水嶺算法的圖像分割方法。該方法引入全局直方圖均衡化消除了圖像暗紋理的影響,并采用形態(tài)學(xué)混合開閉重構(gòu)濾波完成了圖像樣本的去噪處理。計(jì)算灰度圖像各像素點(diǎn)的復(fù)合梯度實(shí)現(xiàn)了非相關(guān)區(qū)域(道路及裸地)的提取,最終利用分水嶺算法實(shí)現(xiàn)了監(jiān)測圖像蟲害區(qū)域的分割提取。利用該文所提算法對8幅蟲害侵蝕程度不同的監(jiān)測圖像進(jìn)行分割,并與傳統(tǒng)分水嶺算法、K-means聚類算法進(jìn)行對比試驗(yàn)。試驗(yàn)結(jié)果表明,該文算法蟲害區(qū)域提取的平均相對誤差率分別降低 6.56%、3.17%,平均相對極限測量精度分別改善 7.19%、2.41%,能夠相對準(zhǔn)確地將蟲害區(qū)域從監(jiān)測圖像中分割出來,可為后續(xù)林業(yè)蟲害監(jiān)測與防護(hù)提供參考。
無人機(jī);算法;監(jiān)測;圖像分割;復(fù)合梯度
森林作為陸地生態(tài)系統(tǒng)的主體,是人類賴以生存及社會發(fā)展不可或缺的資源[1]。而林業(yè)蟲害對森林資源的危害非常嚴(yán)重,根據(jù)調(diào)查結(jié)果表明,平均每年發(fā)生林業(yè)蟲害面積有1 333萬hm2左右,約占中國林地總面積的6%[2]。因此林業(yè)蟲害防治形勢十分嚴(yán)峻,而科學(xué)有效地對林業(yè)蟲害信息進(jìn)行監(jiān)測則是解決這一問題的重要前提。目前,常用的林業(yè)蟲害監(jiān)測方法主要為人工直接測量法[3]、引誘劑誘集法[4]、衛(wèi)星遙感測量法[5]以及無線傳感器網(wǎng)絡(luò)監(jiān)測法[6-7]。然而,現(xiàn)有監(jiān)測方法仍存在一定的缺陷,人工直接測量法監(jiān)測效率低、實(shí)時性差且存在安全隱患;引誘劑的誘集效果會受誘捕器懸掛高度和生態(tài)環(huán)境類型的影響;衛(wèi)星遙感測量法不能精確測量局部微觀信息;無線傳感器網(wǎng)絡(luò)監(jiān)測法只能進(jìn)行地面監(jiān)測,監(jiān)測范圍有限。為了避免上述問題,利用小型化無人機(jī)作為監(jiān)測載體的方法逐漸取得了學(xué)者們的廣泛關(guān)注[8-9]。其中,多旋翼無人飛行器作為一種低空遙感平臺,具有結(jié)構(gòu)簡單、制造維護(hù)成本低、便于攜帶和易于操作等特點(diǎn)[10],可以實(shí)時、高效地低空采集林區(qū)植被圖像信息。
如何從圖像中有效地提取出健康林區(qū)與蟲害區(qū)域則是研究的關(guān)鍵[11]。目前圖像分割方法在林業(yè)蟲害監(jiān)測領(lǐng)域的應(yīng)用越來越廣[12],已有國內(nèi)外學(xué)者提出了應(yīng)用于林業(yè)蟲害監(jiān)測領(lǐng)域的圖像分割方法。例如邊緣檢測[13-15]、聚類法[16-18]、基于分?jǐn)?shù)演算的分水嶺算法[19]和基于顯著和模糊檢測的圖像分割方法[20]等。但是,由于蟲害監(jiān)測圖像中非相關(guān)區(qū)域與病蟲害區(qū)域顏色相近,而目前現(xiàn)有的算法并沒有針對蟲害區(qū)域分割提取過程中圖像非相關(guān)區(qū)域的影響問題進(jìn)行深入研究,同時大部分算法只針對地面圖像進(jìn)行分析,不適用于多旋翼無人飛行器航拍圖像[21]。
基于以上情況,本文以遼寧省建平縣遭受油松毛蟲侵蝕的油松林為研究對象,搭建了面向林業(yè)蟲害監(jiān)測的多旋翼無人飛行器圖像采集平臺,提出了一種基于復(fù)合梯度分水嶺算法的圖像分割方法,實(shí)現(xiàn)了林業(yè)蟲害監(jiān)測圖像進(jìn)行有效提取,解決了非相關(guān)區(qū)域?qū)οx害區(qū)域分割提取的影響問題以及圖像分割中存在的過分割現(xiàn)象。
本文采用自主設(shè)計(jì)的八旋翼飛行器執(zhí)行林區(qū)蟲害監(jiān)測圖像的監(jiān)測任務(wù)。八旋翼飛行器采用 8個獨(dú)立電機(jī)驅(qū)動,相鄰電機(jī)旋轉(zhuǎn)方向相反,相對電機(jī)旋轉(zhuǎn)方向相同。由于電機(jī)旋轉(zhuǎn)導(dǎo)致的扭矩相互抵消,保證了飛行器扭矩平衡不會產(chǎn)生自旋[22]。飛行器通過控制 8個旋翼的轉(zhuǎn)速變化實(shí)現(xiàn)對飛行器6個自由度的控制。
1.1 坐標(biāo)系定義
采用大地平面假設(shè),建立相對于地球靜止的慣性坐標(biāo)系和相對于飛行器本體的機(jī)體坐標(biāo)系[23],具體如圖 1所示。其中機(jī)體坐標(biāo)系X軸為飛行器前進(jìn)與后退方向,軸向與電機(jī)M4和M8所在軸重合;Y與Z軸垂直;Z軸為垂直機(jī)體本身方向。采用歐拉角(俯仰角、橫滾角、偏航角)對飛行器姿態(tài)進(jìn)行描述[24]。
圖1 八旋翼飛行器系統(tǒng)坐標(biāo)系Fig.1 Eight rotor aircraft coordinate system
1.2 機(jī)載航電系統(tǒng)設(shè)計(jì)
本文設(shè)計(jì)的八旋翼飛行器機(jī)載航電系統(tǒng)包括如下 6個部分,即飛行控制器、慣性導(dǎo)航系統(tǒng)、數(shù)據(jù)傳輸系統(tǒng)、無刷電機(jī)調(diào)速器、供電系統(tǒng)以及信息采集系統(tǒng),結(jié)構(gòu)框圖及其實(shí)物圖如圖2、圖3所示。其中飛控計(jì)算機(jī)微處理器采用意法半導(dǎo)體公司 STM32F103RCT6芯片,具有精度高、速度快、硬件性能強(qiáng)以及接口資源豐富等優(yōu)點(diǎn)。慣性導(dǎo)航系統(tǒng)采用 9軸數(shù)字運(yùn)動處理器(digital motion processor,DMP)[25]MPU6050,相較于多組件方案,DMP免除了組合陀螺儀和加速器時之軸間差的問題。光學(xué)圖像采集設(shè)備使用松下GH3單反相機(jī),其搭載在八旋翼飛行器的三軸云臺上,可以采集高清、穩(wěn)定的林區(qū)低空航拍圖像。
圖2 機(jī)載航電系統(tǒng)結(jié)構(gòu)框圖Fig.2 Structure block diagram of airborne avionics system
圖3 八旋翼飛行器監(jiān)測平臺實(shí)物圖Fig.3 Practicality image of eight rotor aircraft monitoring platform
1.3 姿態(tài)控制系統(tǒng)設(shè)計(jì)
飛行器采用串級PID(proportion integration differentiation)控制算法設(shè)計(jì)飛行器控制系統(tǒng),實(shí)現(xiàn)姿態(tài)跟蹤控制??刂破魍猸h(huán)為角度環(huán),內(nèi)環(huán)為角速度環(huán)。外環(huán)輸入量為飛行器歐拉角,給定角度由遙控器或串口控制終端設(shè)定,通過 PID控制器得到輸出量角速度,作為指令輸入到內(nèi)環(huán)。內(nèi)環(huán)根據(jù)輸入,利用PID控制器輸出電機(jī)控制信號,通過PWM信號發(fā)生器控制槳葉電機(jī)轉(zhuǎn)速,進(jìn)而控制飛行器飛行姿態(tài)。系統(tǒng)控制結(jié)構(gòu)如圖4所示。
圖4 串級PID控制框圖Fig.4 Diagram of cascade PID control
1.4 監(jiān)測圖像采集
本文利用八旋翼飛行器針對遼寧省試驗(yàn)林區(qū)進(jìn)行實(shí)地圖像采集,該試驗(yàn)林區(qū)主要受到松毛蟲和木蠹蛾的侵蝕,侵蝕后樹木表現(xiàn)為枯死現(xiàn)象,采集圖像及受災(zāi)現(xiàn)象如圖 5所示。通過對采集圖像質(zhì)量的綜合考慮,選取陰天多云天氣采集圖像。飛行器在監(jiān)測區(qū)域中心起飛,垂直上升過程中飛行器每隔5 m懸停5 s采集圖像。圖像依靠機(jī)載單反相機(jī)(分辨率為4 608×2 592像素)以正攝圖像[25]采集方式得到,共采集30~100 m圖像451張(其中油松林167張、沙棘地148張、紅松72張、白樺64張),數(shù)據(jù)存儲大小為 2.58 G。綜合考慮圖像分割對采集圖像的像素要求,選取拍攝高度約為50 m的8張監(jiān)測圖像。
圖5 遼寧省建平縣監(jiān)測圖像效果圖Fig.5 Monitoring images effect in Jianping country,Liaoning province
傳統(tǒng)的分水嶺圖像分割算法對噪聲比較敏感[26],在圖像受到復(fù)雜噪聲干擾及暗紋理影響時,分割結(jié)果無法滿足需求,甚至?xí)a(chǎn)生嚴(yán)重的過分割現(xiàn)象。此外,蟲害區(qū)域的分割圖像中往往還存在大量的非相關(guān)區(qū)域,而傳統(tǒng)分水嶺算法對此缺乏處理能力。針對以上問題,本文提出一種基于復(fù)合梯度的分水嶺圖像分割算法對蟲害監(jiān)測圖像進(jìn)行處理。
算法關(guān)鍵步驟如下:1)對輸入圖像進(jìn)行全局直方圖均衡化圖像增強(qiáng)處理并對其進(jìn)行形態(tài)學(xué)混合開閉重構(gòu)濾波;2)計(jì)算預(yù)處理后的灰度圖像的復(fù)合梯度提取梯度圖像;3)利用分水嶺變換對梯度圖像進(jìn)行分割,對非林區(qū)區(qū)域進(jìn)行提?。?)在原始圖像的基礎(chǔ)上去除非林區(qū)區(qū)域,進(jìn)行灰度變換,計(jì)算灰度圖像的復(fù)合梯度提取梯度圖像;5)利用分水嶺變換對梯度圖像進(jìn)行分割提取蟲害區(qū)域并進(jìn)行區(qū)域合并。
2.1 圖像預(yù)處理
為了有效降低噪聲與暗紋理對分割圖像的影響,針對圖像噪聲,本文采用形態(tài)學(xué)混合開閉重構(gòu)濾波[27-28],對圖像樣本進(jìn)行處理。形態(tài)學(xué)混合開閉重構(gòu)濾波在降低噪聲干擾的同時還可以保持圖像中剩余連續(xù)區(qū)域的邊緣,在后續(xù)分割時不會產(chǎn)生新的輪廓邊緣[29]。
針對圖像暗紋理,本文采用全局直方圖均衡化對圖像進(jìn)行增強(qiáng)處理。具體處理過程如下:假設(shè)將圖像gzh(x,y)的灰度級r歸一化到區(qū)間[0,1],r=0時為黑色,r=1時為白色。gzh(x,y)灰度級范圍為[0,L-1],像素的總數(shù)為n,則有灰度級為rk的像素個數(shù)為nk。其全局直方圖均衡化對應(yīng)的變換如式(1)所示。
式中Pr(rj)為gzh(x,y)的概率分布函數(shù),Sk即為圖像gzh(x,y)的灰度級k從0取至(L-1)時,對圖像gzh(x,y)概率分布函數(shù)Pr(rj)求和,L為圖像灰度級總數(shù)。
對經(jīng)過圖像增強(qiáng)的彩色圖像進(jìn)一步進(jìn)行灰度變換得到灰度圖像并對其進(jìn)行開運(yùn)算并對其結(jié)果進(jìn)行閉運(yùn)算(灰度圖像6a為參考圖像,結(jié)構(gòu)元素選為正方形,尺寸為3×3像素),即可利用開閉重構(gòu)得出濾波后的圖像。輸入圖像的灰度圖像、開操作圖像、閉操作圖像如圖6a、6b、6c所示。
圖6 濾波過程效果圖Fig.6 Result of filtering process
2.2 非相關(guān)區(qū)域提取
圖像中非相關(guān)區(qū)域(道路及裸地)的分割結(jié)果會對蟲害區(qū)域分割結(jié)果的提取產(chǎn)生干擾,使得分割結(jié)果不準(zhǔn)確。為解決上述問題,本文先提取出非相關(guān)區(qū)域,再對蟲害區(qū)域進(jìn)行分割處理。
首先對預(yù)處理后的灰度圖像進(jìn)行復(fù)合梯度的求解。通過計(jì)算灰度圖像各像素點(diǎn)的復(fù)合梯度[30]得到梯度圖像,各像素點(diǎn)的復(fù)合梯度Cg的計(jì)算如式(2)所示。
式中水平復(fù)合梯度Hg和垂直復(fù)合梯度Vg分別通過微分模板計(jì)算即可得到,如矩陣(3)所示。
水平/垂直微分模板代表相對于像素點(diǎn)水平/垂直方向 0o與 180o、45o與 135o、-45o與-135o的鄰域像素點(diǎn)灰度值差值相加后取平均值。
統(tǒng)計(jì)各梯度層頻率,根據(jù)當(dāng)前像素點(diǎn)的梯度信息將其放入排序數(shù)組中的合適位置,梯度值越低的像素點(diǎn)存放的位置越靠前,相同梯度值的點(diǎn)為一個梯度層。然后尋找圖像的極小區(qū)域 (此區(qū)域通過閾值判定) 并對其進(jìn)行標(biāo)記,區(qū)域的面積為區(qū)域中像素點(diǎn)的個數(shù),本文選取的閾值為整幅圖像面積的1%。若同一梯度層相鄰像素點(diǎn)均已標(biāo)記且標(biāo)記相同,將 2個區(qū)域合并。去除所有小于特定像素?cái)?shù)H(此處H設(shè)為20)的斑點(diǎn)污漬。最后進(jìn)行分水嶺變換,提取出非相關(guān)區(qū)域圖像。
2.3 蟲害區(qū)域分割提取
由于非相關(guān)區(qū)域?qū)οx害區(qū)域提取的影響,本文采用在輸入圖像的基礎(chǔ)上去除非相關(guān)區(qū)域,所的圖像作為蟲害區(qū)域分割提取的輸入圖像。通過對三原色 RGB(red,green, blue)、色彩模型Lab(L代表亮度Luminosity, 通道a正值為紅色,負(fù)值為綠色;通道b正值為黃色,負(fù)值為藍(lán)色)、顏色模型HSL(hue, saturation, lightness)和灰度圖像顏色空間效果的比較,采用更能直接反映圖像特征的L變量(亮度信息),也就是灰度圖像作為顏色轉(zhuǎn)換空間。通過計(jì)算灰度圖像的各像素點(diǎn)的復(fù)合梯度,進(jìn)而提取梯度圖像。采用分水嶺變換對梯度圖像進(jìn)行分割,實(shí)現(xiàn)蟲害區(qū)域的分割提取。
2.4 區(qū)域合并
基于復(fù)合梯度的分水嶺變換所得的蟲害提取圖像可能仍存在過分割現(xiàn)象,本文采用對分割后的圖像進(jìn)行區(qū)域合并。
首先定義區(qū)域Ci和Cj的綜合距離度量ijD如公式(4)所示。
式中ui為區(qū)域Ci的顏色均值向量,uj為區(qū)域Cj的顏色均值向量,σi為區(qū)域Ci內(nèi) 3個通道顏色均方差的均值,σj為區(qū)域Cj內(nèi) 3個通道顏色均方差的均值,Eij為區(qū)域Ci和Cj公共邊緣歸一化均值,E為所有邊緣歸一化均值。其中若Ci和Cj存在鄰接關(guān)系,且Ci和Cj的綜合距離度量Dij小于閾值參數(shù)T,則合并Ci和Cj;若所有存在鄰接關(guān)系的區(qū)域綜合距離度量均大于T,則合并結(jié)束。
2.5 蟲害監(jiān)測圖像分割效果
以油松林為例,利用本文方法對監(jiān)測圖像進(jìn)行蟲害區(qū)域分割提取的效果圖如圖7所示,其中對輸入圖像7a進(jìn)行圖像預(yù)處理,得到濾波圖像7b和增強(qiáng)圖像7c;基于復(fù)合梯度實(shí)現(xiàn)非相關(guān)區(qū)域圖像7d的提取,如圖中白色區(qū)域所示;在圖像7a的基礎(chǔ)上去除非相關(guān)區(qū)域圖像7d并將其轉(zhuǎn)化為灰度圖像 7e,初步顯現(xiàn)出蟲害區(qū)域范圍;計(jì)算灰度圖像7e的復(fù)合梯度得到梯度圖像7f,使得蟲害區(qū)域更加明顯;利用分水嶺變換對圖像7f進(jìn)行分割得到蟲害區(qū)域,如圖7g所示;最后將非相關(guān)區(qū)域圖像7d與蟲害區(qū)域提取圖像7g進(jìn)行區(qū)域合并得到最終分割效果,如圖7h所示。
圖7 蟲害監(jiān)測圖像分割效果圖Fig.7 Segmentation effect of pest monitoring image
3.1 不同算法對蟲害監(jiān)測圖像分割效果
本文選取蟲害侵蝕程度不同的監(jiān)測圖像作為測試樣本,侵蝕程度如圖 8中不同圖像樹木枯死面積所示。將本文提出的復(fù)合梯度分水嶺算法與傳統(tǒng)分水嶺算法、K-means聚類分割算法的蟲害區(qū)域分割的提取效果進(jìn)行了比較,結(jié)果如圖 8所示。其中傳統(tǒng)分水嶺算法在分水嶺變換的基礎(chǔ)上采用形態(tài)學(xué)混合開閉重構(gòu)濾波對分割圖像進(jìn)行去噪;聚類分割算法采用K-means聚類算法,參數(shù)K設(shè)定為20。本文借助圖像拆分器通過手動操作方法標(biāo)注出蟲害位置,計(jì)算蟲害區(qū)域比例作為參照真值。
上述 8組試驗(yàn)結(jié)果表明,傳統(tǒng)分水嶺算法得到的蟲害區(qū)域明顯大于真實(shí)情況,錯誤率較高,同時K-means聚類分割算法能夠有效提取出蟲害區(qū)域,但會摻雜非相關(guān)區(qū)域造成誤報(bào)。而本文算法得到的結(jié)果與人工篩選結(jié)果近似,能夠有效地提取出蟲害區(qū)域與非林區(qū)區(qū)域,從而計(jì)算出健康區(qū)域、蟲害區(qū)域、非相關(guān)區(qū)域在整幅圖像中的占比。
3.2 算法性能評價與分析
為了驗(yàn)證本文算法的有效性,采用相對誤差率和相對極限測量精度等作為評價指標(biāo)[31]。相對誤差率ξ用于描述分割目標(biāo)和背景之間的誤分辨率。
式中Ni為分割處理后區(qū)域i的實(shí)際像素點(diǎn)數(shù);Ni*為區(qū)域i實(shí)際目標(biāo)像素點(diǎn)數(shù);N為一幅圖像實(shí)際像素點(diǎn)數(shù);c為區(qū)域分割所得的總區(qū)域數(shù)。相對誤差率的高低可以表征分割結(jié)果的好壞。
圖8 蟲害監(jiān)測圖像分割效果對比圖Fig.8 Segmentation effect comparison of pest monitoring image
相對極限測量精度σ用于表示目標(biāo)區(qū)域相對參照真值的偏離程度,表征圖像分割性能。
式中w為原圖像中待分割區(qū)域?qū)嶋H像素點(diǎn)數(shù),即為參照真值;wm為采用分割算法分割后所得目標(biāo)區(qū)域像素點(diǎn)數(shù)。σ的值越小,分割性能越好。
針對前面所述的 8幅蟲害監(jiān)測圖像樣本,參照真值采用借助圖像拆分器人工標(biāo)注所計(jì)算出的蟲害比例。本文算法與傳統(tǒng)分水嶺算法、K-means聚類算法分割結(jié)果的相對誤差率及相對測量精度結(jié)果如表1所示。
表1 相對誤差率與相對極限測量精度測試結(jié)果Table 1 Results of relative error rate and relative ultimate measurement accuracy%
通過對以上試驗(yàn)數(shù)據(jù)的分析,采用傳統(tǒng)分水嶺算法的平均相對誤差率為 8.19%,平均相對極限測量精度為8.50%;K-means聚類算法的平均相對誤差率為4.80%,平均相對測量精度為3.72%。而采用本文算法的平均相對誤差率為1.63%,平均相對測量精度為1.31%。試驗(yàn)結(jié)果表明,本文算法對監(jiān)測圖像蟲害區(qū)域分割提取結(jié)果優(yōu)于傳統(tǒng)分水嶺算法、K-means聚類分割算法,其中相對誤差率平均降低 6.56%和 3.17%,相對極限測量精度平均改善7.19%和2.41%。
本文在搭建面向林區(qū)蟲害監(jiān)測的多旋翼無人飛行器航拍監(jiān)測系統(tǒng)的基礎(chǔ)上,實(shí)現(xiàn)了對林區(qū)蟲害信息實(shí)時、高效采集。針對林業(yè)航拍監(jiān)測圖像,提出了一種基于復(fù)合梯度分水嶺算法的多旋翼無人飛行器林業(yè)蟲害監(jiān)測圖像的分割方法。利用本文所提算法對遼寧省試驗(yàn)林區(qū)實(shí)地采集到的蟲害監(jiān)測圖像進(jìn)行處理,并從分割效果、相對誤差率及相對極限測量精度 3個方面與傳統(tǒng)分水嶺算法、K-means聚類算法進(jìn)行比較。試驗(yàn)結(jié)果表明,本文算法對監(jiān)測圖像蟲害區(qū)域分割提取結(jié)果優(yōu)于傳統(tǒng)分水嶺算法、K-means聚類分割算法,其中相對誤差率平均降低6.56%和3.17%,相對極限測量精度平均改善7.19%和2.41%。
[1] 趙鐵良,董振輝,于治軍,等. 中國森林病蟲指數(shù)的研究[J]. 林業(yè)科學(xué),2003,39(3):172-176.Zhao Tieliang, Dong Zhenhui, Yu Zhijun.Study on establishment of forest pest indexes[J]. Scientia Silvae Sinicae, 2003,39(3):172-176. (in Chinese with English abstract)
[2] 凌天淅,侯輝,周桃龍. 淅川森林病蟲害防治[J]. 中國林業(yè),2010,19:49-49.Ling Tianxi, Hou Hui, Zhou Taolong. Prevention and control of forest diseases and pests in Xi Chuan[J]. Forestry of China,2010, 19: 49-49. (in Chinese with English abstract)
[3] 新疆維吾爾自治區(qū)林業(yè)有害生物防治檢疫局. 林業(yè)有害生物防治[M]. 北京:中國林業(yè)出版社,2010:23-76.
[4] 袁菲,駱有慶,石娟,等. 不同含量引誘劑對落葉松八齒小蠹及其天敵紅胸郭公蟲的引誘[J]. 林業(yè)科學(xué),2012,48(6):89-94.Yuan Fei, Luo Youqing, Shi Juan, et al. Different attractive effects and eag responses of ips subelongatus(coleoptera,scolytidae) and its predator thanasimus substriatus (coleoptera:cleridae) to ipslures[J]. Scientia Silvae Sinicae, 2012, 48(6):89-94. (in English with Chinese abstract)
[5] Leila G, Pir B M, Jamil A, et al. Monitoring infestations of oak forests by tortrix viridana (Lepidoptera: Tortricidae)using remote sensing[J]. Plant Protection Science, 2016,52(4): 270-276. (in Chinese with English abstract)
[6] 齊建東,蔣禧,趙燕東. 基于無線多媒體傳感器網(wǎng)絡(luò)的森林病蟲害監(jiān)測系統(tǒng)[J]. 北京林業(yè)大學(xué)學(xué)報(bào),2010,32(4):186-190.Qi Jiandong, Jiang Xi, Zhao Yandong. A forest pest and disease monitoring system based on wireless multimedia sensor network[J]. Journal of Beijing Forestry University,2010, 32(4): 186-190. (in Chinese with English abstract)
[7] 王艷. 基于物聯(lián)網(wǎng)的森林病蟲害防治智能傳感系統(tǒng)研究[D]. 南京:南京林業(yè)大學(xué),2012.Wang Yan. Research of Intelligent Sensor System for Forest Pest Control based on the Internet of Things[D]. Nanjing:Nanjing Forestry University, 2012. (in Chinese with English abstract)
[8] 費(fèi)運(yùn)巧,劉文萍,駱有慶,等. 森林病蟲害監(jiān)測中的無人機(jī)圖像分割算法比較[J]. 計(jì)算機(jī)工程與應(yīng)用,2017,53(8):216-223.Fei Yunqiao, Liu Wenping, Luo Youqing, et al. Comparison of algorithms for unmanned aerial vehicle image segmentation in monitoring forest diseases and insect pests[J]. Computer Engineering and Applications, 2017, 53(8): 216-223. (in Chinese with English abstract)
[9] Sankarasrinivasan S, Balasubramanian E, Karthik K, et al.Health monitoring of civil structures with integrated UAV and image processing system[J]. Procedia Computer Science,2015, 54: 508-515.
[10] Luck B. Unmanned aerial vehicles (UAVs) in pest management:Progress in the development of a UAV-deployed mating disruption system for Wisconsin cranberries[J]. Nucleosides Nucleotides & Nucleic Acids, 2008, 27(5): 449-459.
[11] 刁智華,王歡,宋寅卯,等. 復(fù)雜背景下棉花病葉害螨圖像分割方法[J]. 農(nóng)業(yè)工程學(xué)報(bào),2013,29(5):147-152.Diao Zhihua, Wang Huan, Song Yinmao, et al. Segmentation method for cotton mite disease image under complex background[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2013,29(5): 147-152. (in Chinese with English abstract)
[12] Liu C, Liu W, Xing W. An improved edge-based level set method combining local regional fitting information for noisy image segmentation[J]. Signal Processing, 2017, 130: 12-21.
[13] 張靜,王雙喜. 溫室植物病害圖像處理技術(shù)中圖像分割方法的研究[J]. 內(nèi)蒙古農(nóng)業(yè)大學(xué)學(xué)報(bào),2007,28(3):19-22.Zhang Jing, Wang Shuangxi. A study on the segmentation method in image processing for plant disease of green house[J]. Journal of Inner Mongolia Agricultural University,2007, 28(3): 19-22. (in Chinese with English abstract)
[14] 姜濱,曹軍,崔莉. 基于小波多尺度的林業(yè)害蟲圖像邊緣檢測[J]. 森林工程,2013,29(4):14-17.Jiang Bin, Cao Jun, Cui Li. Image edge detection for forest pests based on wavelet milti-scale transform[J]. Forest Engineering, 2013, 29(4): 14-17. (in Chinese with English abstract)
[15] 宋蟄存,周秀明. 微分算子在蟲害楊樹葉片邊緣檢測的應(yīng)用[J]. 林業(yè)機(jī)械與木工設(shè)備,2007,35(2):47-49.Song Zhecun, Zhou Xiuming. Application of different operators in edge detection of pest poplar blades[J]. Forestry Machinery and Woodworking Equipment, 2007, 35(2): 47-49. (in Chinese with English abstract)
[16] 李冠林,馬占鴻,黃沖,等. 基于K-means硬聚類算法的葡萄病害彩色圖像分割方法[J]. 農(nóng)業(yè)工程學(xué)報(bào),2010,26(14):32-37.Li Guanlin, Ma Zhanhong, Huang Chong, et al. Segmentation of color images of grape diseases usingK-means clustering algorithm[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2010, 26(14): 32-37. (in Chinese with English abstract)
[17] Faithpraise F, Birch P, Young R, et al. Automatic plant pest detection and recognition using k-means clustering algorithm and correspondence filters[J]. International Journal of Advanced Biotechnology & Research, 2013, 4(2): 189-199.
[18] Bouyer A, Jalali M, Bouyer A, et al. Developing a rule-based data clustering algorithm for diagnosing of wheat pest[J].Global Journal on Technology, 2013, 3: 1549-1555.
[19] Liu W. A marker-based watershed algorithm using fractional calculus for unmanned aerial vehicle image segmentation[J].Journal of Information & Computational Science, 2015,12(14): 5327-5338.
[20] 陳雷,袁媛,吳娜,等. 基于顯著和模糊檢測的淺景深作物病害圖像分割[J]. 農(nóng)業(yè)工程學(xué)報(bào),2015,31(增刊 2):145-151.Chen Lei, Yuan Yuan, Wu Na, et al. Segmentation for low depth of field crop disease images based on saliency and blurred detection[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2015,31(Supp.2): 145-151. (in Chinese with English abstract)
[21] Merabet Y, Meurie C, Ruichek Y, et al. Building roof segmentation from aerial images using a lineand region-based watershed segmentation technique[J]. Sensors, 2015, 15(2):3172-3203.
[22] Salazar S, Romero H, Lozano R, et al. Modeling and realtime stabilization of an aircraft having eight rotors[J]. Journal of Intelligent & Robotic Systems, 2009, 54(1): 455-470.
[23] 趙世榮,孫運(yùn)強(qiáng),石喜玲. 基于信息融合的八旋翼飛行器狀態(tài)解算[J]. 彈箭與制導(dǎo)學(xué)報(bào),2016,36(2):167-170.Zhao Shirong, Sun Yunqiang, Shi Xiling. Attitude estimation of octorotor aircraft based on information fusion[J]. Journal of Projectiles, Rockets, Missiles and Guidance, 2016, 36(2):167-170. (in Chinese with English abstract)
[24] 常彥春. 多旋翼無人飛行器自主飛行控制系統(tǒng)設(shè)計(jì)研究[D]. 北京:北京理工大學(xué),2016.Chang Yanchun. Research on the Autonomous Flight Control System of Muti-rotor Aricraft[D]. Beijing: Beijing Institute of Technology, 2016. (in Chinese with English abstract)
[25] Michael N, Mellinger D, Lindsey Q, et al. The grasp multiple micro-uav testbed[J]. Robotics & Automation Magazine,IEEE, 2010, 17(3): 56-65.
[26] Franchi G, Angulo J. Bagging stochastic watershed on natural color image segmentation[J]. Lecture Notes in Computer Science, 2015, 9082: 422-433.
[27] 江怡,梅小明,鄧敏,等. 一種結(jié)合形態(tài)濾波和標(biāo)記分水嶺變換的遙感圖像分割方法[J]. 地理與地理信息科學(xué),2013,29(2):17-21.Jiang Yi, Mei Xiaoming, Deng Min, et al. Segmentation of remote sensing imagery combined with morphological filtering and marked watershed transformation[J]. Geography and Geo-Information Science, 2013, 29(2): 17-21. (in Chinese with English abstract)
[28] 夏平,劉馨瓊,向?qū)W軍,等. 復(fù)合形態(tài)濾波和改進(jìn)型分水嶺算法的圖像分割[J]. 三峽大學(xué)學(xué)報(bào)自然科學(xué)版,2008,30(5):60-63.Xia Ping, Liu Xinqiong, Xiang Xuejun, et al. Image segmentation based on compound morphology filter and modiffied watershed algorithm[J]. Journal of China Three Gorges University: Natural Sciences, 2008, 30(5): 60-63. (in Chinese with English abstract)
[29] 楊信廷,孫文娟,李明,等. 基于K均值聚類和開閉交替濾波的黃瓜葉片水滴熒光圖像分割[J]. 農(nóng)業(yè)工程學(xué)報(bào),2016,32(17):136-143.Yang Xinting, Sun Wenjuan, Li Ming, et al. Water droplets fluorescence image segmentation of cucumber leaves based onK-means clustering with opening and closing alternately filtering[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2016, 32(17): 136-143. (in Chinese with English abstract)
[30] 江霞. 基于復(fù)合梯度分水嶺算法的彩色白血細(xì)胞分割[D].長沙:中南林業(yè)科技大學(xué),2012.Jiang Xia. Color Leukocyte Image Segmentation based on Composite Gradient Watershed Algorithm[D]. Changsha:Central South University of Forestry and Technology, 2012.(in Chinese with English abstract)
[31] Mesascarrascosa F J, Rumbao I C, Berrocal J A, et al.Positional quality assessment of orthophotos obtained from sensors onboard multi-rotor UAV platforms[J]. Sensors, 2014,14(12): 22394-22407.
Image segmentation method for forestry unmanned aerial vehicle pest monitoring based on composite gradient watershed algorithm
Zhang Junguo1, Feng Wenzhao1, Hu Chunhe1, Luo Youqing2※
(1. School of Technology, Beijing Forestry University, Beijing100083,China;2.School of Forestry, Beijing Forestry University, Beijing100083,China)
The application of multi-rotor unmanned aerial vehicle monitoring system for forest pest information collecting has many advantages, such as low running cost, operating flexibility, easy access to data, high image resolution etc. It has been regarded as a quick access to forest insect pest information collecting. By use of unmanned aerial vehicle system, valid segmentation and extraction of pest images acquired with the help of multi-rotor unmanned aerial vehicle can be used to calculate the insect pest proportion in monitored sample field. It can provide forest conservation experts with evidence for assessing the insect pest damage. To conduct forest monitoring work and calculate the proportion of pest infested area in monitored sample field with more preciseness and fast turnaround, in this paper, we aimed to solve poor time response circle and limited monitoring range problems that exist in current forestry information monitoring method. Firstly, in this paper, we built both hardware and software systems of multi-rotor unmanned aerial vehicle. Aerial vehicle equipped with image collecting devices was used to monitor in forestry pest insect infested area and collect data in the Liaoning testing forest. In order to obtain proper resolution images, aerial vehicle took off the center of the chosen monitoring area vertically to collect photo resources. By considering needed resolution requirements on image segmentation comprehensively, the height of about 50 m was chosen for image acquisition. On the analytical basis of monitoring images, an image segmentation method based on composite gradient watershed algorithm was proposed. This method introduced global histogram equalization to eliminate the influence of dark texture and adopted the morphological hybrid open-closing reconstruction filter to complete the denoising work of the image samples, eliminate the image interference to the segmentation effect, and suppress the over-segmentation phenomenon in image segmentation process. The gray-scale image was obtained by gray-scale transformation of the pre-processed image. The non-correlation regions (road and bare ground) were extracted by calculating the composite gradient of each pixel point in the gray image. Interference to the segmentation result may arise in segmenting process due to the similar color of non-correlation region and pest insect infested area. In this paper, the mentioned region was removed from the original image, which greatly avoided the interference of the non-related region to the pest area and ensured the accuracy of the result. Finally, the watershed algorithm was applied to realize the segmentation and extraction of insect pest area in images. In order to verify the effectiveness of the proposed method, the traditional watershed algorithm and K-means clustering algorithm were used for comparing experiment methods in the segmentation of eight images with different levels of insect pest. With the help of mage segmentation device, the accurate pest insect infested area was labeled manually, and it was taken as reference value in pest insect proportion calculating step. The experiment result showed that the segmentation effect was much more similar to the manual operation result. Specifically, the relative error rate decreased by 6.56% and 3.17% and the relative limit measuring accuracy was improved by 7.19% and 2.41% in this proposed method when traditional watershed algorithm was compared withK-means cluster algorithm. Our result showed that multi-rotor unmanned aerial vehicle was helpful in real time and effective monitoring of forest pest insect. The algorithm proposed in this paper was able to accurately segment and extract pest insect area in monitoring images and the proportion of pest area in whole sample fields was acquired, thus providing valid data support for forest pest monitoring and preventing work in the future.
unmanned aerial vehicles; algorithms; monitoring; image segmentation; composite gradient
10.11975/j.issn.1002-6819.2017.14.013
TP391.4; S126
A
1002-6819(2017)-14-0093-07
張軍國,馮文釗,胡春鶴,駱有慶. 無人機(jī)航拍林業(yè)蟲害圖像分割復(fù)合梯度分水嶺算法[J]. 農(nóng)業(yè)工程學(xué)報(bào),2017,33(14):93-99.
10.11975/j.issn.1002-6819.2017.14.013 http://www.tcsae.org
Zhang Junguo, Feng Wenzhao, Hu Chunhe, Luo Youqing. Image segmentation method for forestry unmanned aerial vehicle pest monitoring based on composite gradient watershed algorithm[J]. Transactions of the Chinese Society of Agricultural Engineering(Transactions of the CSAE), 2017, 33(14): 93-99. (in Chinese with English abstract)
doi:10.11975/j.issn.1002-6819.2017.14.013 http://www.tcsae.org
2017-03-12
2017-05-15
林業(yè)公益性行業(yè)科研專項(xiàng)資助(201404401);國家自然科學(xué)基金項(xiàng)目資助(31670553);中央高校基本科研業(yè)務(wù)費(fèi)專項(xiàng)資金資助(2016ZCQ08)
張軍國,教授,博士生導(dǎo)師,主要從事圖像處理與人工智能研究。北京 北京林業(yè)大學(xué)工學(xué)院,100083。Email:zhangjunguo@bjfu.edu.cn
※通信作者:駱有慶,教授,博士生導(dǎo)師,主要從事森林有害生物可持續(xù)控制研究。北京 北京林業(yè)大學(xué)林學(xué)院,100083。Email:yqluo@bjfu.edu.cn