'LDJQRVLVRI'LDEHWLF5HWLQRSDWK\E\%ORRG
9HVVHO6HJPHQWDWLRQDQG([XGDWH'HWHFWLRQ
/HNVKPL6K\DP
Dept. of Electronics and Communication, SCT College Of Engineering, Pappanamcode,
Thiruvananthapuram-18
.XPDU*6
Assistant Professor,
Dept. of Electronics and Communication, SCT College of Engineering, Pappanamcode,
Thiruvananthapuram-18
$EVWUDFW%OLQGQHVVLVDJURZLQJSUREOHPDOORYHUWKHZRUOG7KHPDMRUGLVHDVHVWKDWOHDGWREOLQGQHVVDUHJODXFRPDDQG GLDEHWLFUHWLQRSDWK\(YHQWKRXJKWKHVHGLVHDVHVOHDGWRLUUHYHUVLEOHEOLQGQHVVLWFDQEHFRQWUROOHGWRFHUWDLQH[WHQWLI GHWHFWHGHDUOLHU'LDEHWLF5HWLQRSDWK\FDQEHGHWHFWHGE\WKHSUHVHQFHRIH[XGDWHV7KHSDSHUSURSRVHV DPHWKRGIRU YHVVHO VHJPHQWDWLRQ EDVHG RQ KLJK SDVV ILOWHULQJ DQG PRUSKRORJLFDO UHFRQVWUXFWLRQ PHWKRGV 7KH EORRG YHVVHO VHJPHQWDWLRQLVDQLPSRUWDQWWDVNLQ'LDEHWLF5HWLQRSDWK\GHWHFWLRQ2SWLFGLVFLQWKHIXQGXVLPDJHLVGHWHFWHGE\+RXJK WUDQVIRUP$IWHUWKHVHJPHQWDWLRQWKHYHVVHOVDQGRSWLFGLVFDUHUHPRYHGIURPWKHRULJLQDOLPDJH'LDEHWLF5HWLQRSDWK\LV FKDUDFWHUL]HGE\WKHSUHVHQFHRIH[XGDWHV7KHH[XGDWHVDUHGHWHFWHGE\PHDQVRILPWRRORSHUDWRULQWKHPDWODE7KH VLPXODWLRQVDUHSHUIRUPHGRQPDWODEDQGWKHGDWDDUHFROOHFWHGIURP',$5(7'%DQG+5)GDWDEDVHV .H\ZRUGV([XGDWHV+LJKSDVVILOWHULQJ0RUSKRORJLFDOUHFRQVWUXFWLRQ+RXJK7UDQVIRUP,PWRRORSHUDWRU ,,1752'8&7,21 %OLQGQHVVLVDJURZLQJSUREOHPDOORYHUWKHZRUOG7KHPDLQFDXVHVRIEOLQGQHVVDUHWKHGLVHDVHV*ODXFRPDDQG 'LDEHWLF 5HWLQRSDWK\ *ODXFRPD LV FDXVHG GXH WR DQ LQFUHDVH LQ WKH LQWUDRFXODU SUHVVXUH 'LDEHWLF 5HWLQRSDWK\ RFFXUVGXHWRWKHFRPSOH[LW\RI'LDEHWHV,QGLDEHWLFUHWLQRSDWK\IOXLGIURPWKHEORRGOHDNVDQGJHWVGHSRVLWHGLQ WKH UHWLQDO UHJLRQV 7KHVH RFFXU LQ WKH IRUP RI \HOORZ VSRWV FDOOHG H[XGDWHV 7KXV 'LDEHWLF 5HWLQRSDWK\ FDQ EH GHWHFWHG E\ WKH SUHVHQFH RI H[XGDWHV )RU HIIHFWLYH WUHDWPHQW WKH GLVHDVH KDV WR EH GHWHFWHG HDUOLHU 'LDEHWLF 5HWLQRSDWK\OHDGVWRGDPDJHWRWKHEORRGYHVVHOVDQGDOVRIRUPDWLRQRIOHVLRQV$QRWKHUFRPSOH[LW\RIWKHGLVHDVHLV WKDWQHZDEQRUPDOEORRGYHVVHOVJURZLQWKHUHWLQDNQRZQDVUHYDVFXODUL]DWLRQ7KHVHDEQRUPDOLWLHVOHDGWRVHYHUH YLVXDOSUREOHPV,IWKHH[XGDWHVH[WHQGWRWKHPDFXODUUHJLRQLWZLOOOHDGWRVHYHUHYLVLRQORVV)RUWKHGHWHFWLRQRI H[XGDWHVILUVWWKHEORRGYHVVHOVLQWKHUHWLQDOUHJLRQVDUHWREHVHJPHQWHG$IWHUWKHVHJPHQWDWLRQRIEORRGYHVVHOV RSWLF GLVF LV WR EH VHJPHQWHG 7KH EORRG YHVVHOV DUH WR EH UHPRYHG WR GHWHFW WKH SUHVHQFH RI H[XGDWHV 7KH VHJPHQWDWLRQRIEORRGYHVVHOVLVFDUULHGRXWRQIXQGXVLPDJHV7KHIXQGXVLPDJHVDUH
FDSWXUHGE\PHDQVRID
IXQGXVFDPHUD
$IXQGXVFDPHUDLVDVSHFLDOL]HGORZSRZHUPLFURVFRSHZLWKDQDWWDFKHGFDPHUD7KHSURSRVHG PHWKRGHPSOR\HHVKLJKSDVVILOWHULQJDQGPRUSKRORJLFDOUHFRQVWUXFWLRQIRUEORRGYHVVHOVHJPHQWDWLRQ7KHRSWLF GLVFGHWHFWLRQLVSHUIRUPHGE\+RXJKWUDQVIRUPPDNHVXVHRIIHDWXUHVOLNHEORRGYHVVHOVKDHPPRUDJKHVRI13'5LPDJHDQGH[XGDWHVRI3'5LPDJH'HWHFWLRQRI H[XGDWHVDQGQRQH[XGDWHGHWHFWLRQLVSHUIRUPHGE\PHDQVRI%31PRGHODWSL[HOOHYHO>@'HFLVLRQWUHHDQG*$ &)6PHWKRGDUHXVHGDVLQSXWWRWKH%31PRGHO%ORRGYHVVHOVDUHGHWHFWHGE\WKUHVKROGLQJPHWKRGVDQGRSWLFGLVF LVGHWHFWHGE\+RXJKWUDQVIRUP>@7KHSDSHUSURSRVHVRQWKHGHWHFWLRQRIKDUGH[XGDWHV7KHDGYDQWDJHRIWKH PHWKRGLVWKDWLWZRUNVZHOOLQORZTXDOLW\LPDJHVDOVR*DXVVLDQVPRRWKHQLQJDQGFRQWUDVWHQKDQFHPHQWFDQEH XVHGDVSUHSURFHVVLQJVWHSV>@)HDWXUHH[WUDFWLRQEDVHGRQORFDWLRQRIRSWLFGLVFVKDSHLQGH[DQGDUHDLVFDUULHG RXWIRUH[XGDWHVGHWHFWLRQ:DYHOHWVXEEDQGVFDQDOVREHXWLOL]HGIRUGHWHFWLQJWKHSUHVHQFHRIH[XGDWHV>@7KH HQHUJ\ GLVWULEXWLRQV RYHU WKH ZDYHOHW VXE EDQGV FDQ EH DQDO\]HG IRU H[XGDWHV GHWHFWLRQ 7KH H[XGDWHV DUH DOVR GHWHFWHG HIIHFWLYHO\ IURP WKH UHWLQD IXQGXV LPDJH XVLQJ VHJPHQWDWLRQ DOJRULWKPV >@7KH SDSHU LV RUJDQL]HG DV IROORZV6HFWLRQ,,FRYHUVWKHSURSRVHGPHWKRG6HFWLRQ,,,GLVFXVVHVWKHUHVXOWVREWDLQHG)LQDOO\VHFWLRQ,9GHDOV ZLWKWKHFRQFOXVLRQ
,,0(7+2'2/2*<
7KHIORZFKDUWRIWKHSURSRVHGPHWKRGLVDVIROORZV,PDJHLVWDNHQIURP',$5(7'%GDWDEDVH7KHLQLWLDO VWHSLVWKHEORRGYHVVHOVHJPHQWDWLRQ7KHYHVVHOUHJLRQVDUHWKHLQWHUVHFWLQJUHJLRQVEHWZHHQWKHKLJKSDVVILOWHUHG LPDJHDQGWKHWRSKDWUHFRQVWUXFWHGLPDJH7KHRSWLFGLVFLVGHWHFWHGE\XVLQJWKHFLUFXODU+RXJKWUDQVIRUP$IWHU WKHGHWHFWLRQRIEORRGYHVVHOVDQGRSWLFGLVFWKHVHDUHUHPRYHG7KHUHIRUHLIWKHUHLVDQ\SUHVHQFHRIH[XGDWHVLQWKH UHWLQD WKHVH FDQEH HDVLO\ LGHQWLILHG([XGDWHV DUH WKH OHDNDJHV IURP WKH EORRG WKDW JHWVGHSRVLWHG LQ WKHUHWLQDO DUHDV7KHH[XGDWHVDUHGHWHFWHGE\WKHLPWRROLQWKHPDWODE
)LJ)ORZFKDUWRIWKHSURSRVHGPHWKRG
A. Blood vessel segmentation
&RQWUDVWHQKDQFHPHQWLVSHUIRUPHGWRLQFUHDVHWKHYLVLELOLW\RIWKHYHVVHOUHJLRQV&RQWUDVWLVWKHGLIIHUHQFHEHWZHHQ WKHPD[LPXPDQGPLQLPXPSL[HOLQWHQVLWLHV&RQWUDVWHQKDQFHPHQWLVGRQHE\KLVWRJUDPHTXDOL]DWLRQ7RPDNHWKH YHVVHOUHJLRQVGDUNHUYHVVHOHQKDQFHPHQWLVSHUIRUPHG9HVVHOHQKDQFHPHQWLQYROYHVVTXDULQJWKHSL[HOYDOXHVDQG QRUPDOL]LQJLQWKHUDQJH>@$ORZSDVVILOWHULVLPSOHPHQWHGE\PHDQVRIPHGLDQILOWHULQJ0HGLDQILOWHULQJLV SUHIHUUHG VLQFH LW UHGXFHV LPSXOVLYH QRLVHV DQG SUHVHUYHV VKDUS HGJHV 7KH YHVVHO UHJLRQV FRUUHVSRQG WR KLJK IUHTXHQFLHVLQWKHLPDJHV7KXVKLJKSDVVILOWHUHGYHUVLRQRIWKHLPDJHLVREWDLQHGE\VXEWUDFWLQJWKHORZSDVVLPDJH IURPWKHHQKDQFHGLPDJH7KLV\LHOGVWKHILUVWSUHSURFHVVHGLPDJH7KHUHGUHJLRQVLQWKHJUHHQSODQHLPDJHDUH H[WUDFWHGE\WDNLQJWKHQHJDWLYHRIWKHJUHHQSODQHLPDJH1H[WWRSKDWUHFRQVWUXFWLRQLVSHUIRUPHGRQWKHQHJDWLYH LPDJH7RSKDWUHFRQVWUXFWLRQLVDPRUSKRORJLFDOUHFRQVWUXFWLRQPHWKRGWKDWLVGHILQHGDVWKHGLIIHUHQFHEHWZHHQWKH LQSXWLPDJHDQGLWVRSHQLQJE\VRPHVWUXFWXULQJHOHPHQW7KLVLVWKHVHFRQGSUHSURFHVVHGLPDJH7KHYHVVHOUHJLRQV DUHWKHLQWHUVHFWHGUHJLRQVEHWZHHQWKHWZRSUHSURFHVVHGLPDJHV
B. Optic disc detection
2SWLFGLVFGHWHFWLRQLVSHUIRUPHG
E\+RXJKWUDQVIRUP+RXJKWUDQVIRUPLVXVHGWRGHWHFWREMHFWVLQDQLPDJH &LUFXODU+RXJKWUDQVIRUPLVDQH[WHQVLRQRI+RXJKOLQHWUDQVIRUP,WLVDIHDWXUHH[WUDFWLRQWHFKQLTXHIRUGHWHFWLQJ FLUFOHV$FLUFOHLVUHSUHVHQWHGE\
[D\E U
[\LVWKHFHQWHUFRRUGLQDWHDQGULVWKHUDGLXV7KHFXUYHREWDLQHGLQWKH+RXJK7UDQVIRUPVSDFHIRUHDFKHGJH SRLQWZLOOEHDULJKWFLUFXODUFRQH3RLQWRILQWHUVHFWLRQRIWKHFRQHVJLYHVWKHSDUDPHWHUVDEU,IWKHSRLQW[\LV IL[HGWKHQWKHSDUDPHWHUVFDQEHIRXQGDFFRUGLQJWR,IWKHUDGLXVLVIL[HGWKHSDUDPHWHUVSDFHZLOOFRUUHVSRQG WREH'7KHPDLQDGYDQWDJHRIXVLQJ+RXJKWUDQVIRUPLVWKDWLWLVOHVVDIIHFWHGE\QRLVH
C.Blood vessel and optic disc removal
7KH EORRG YHVVHOV DUH GHWHFWHG E\ WKH LQWHUVHFWLQJ UHJLRQV EHWZHHQ WKH KLJK SDVV ILOWHUHG LPDJH DQG WRSKDW UHFRQVWUXFWHGLPDJH7KHRSWLFGLVFLVGHWHFWHGE\FLUFXODU+RXJKWUDQVIRUP$IWHUWKHGHWHFWLRQRIWKHVHWKHEORRG YHVVHOVDQGRSWLFGLVFDUHVXEWUDFWHGIURPWKHRULJLQDOLPDJH,IWKHUHLVWKHSUHVHQFHRIH[XGDWHVWKHQWKHVHDUH LGHQWLILHGHDVLO\
D. Exudate detection.
$IWHUWKHUHPRYDORIEORRGYHVVHOVDQGRSWLFGLVFWKHH[XGDWHVFDQEHGHWHFWHGIURPWKHLPDJHE\LPWRROLQWKH PDWODE7KHLPWRROIDFLOLWDWHVWKHFDOFXODWLRQRIWKHSL[HOLQIRUPDWLRQ%DVHGRQWKHSL[HOLQIRUPDWLRQWKHH[XGDWHV DUHLGHQWLILHG ,,,5(68/76$1'',6&866,21
7KHLQLWLDOVWHSLQWKH'LDEHWLF5HWLQRSDWK\GHWHFWLRQLVWKHEORRGYHVVHOVHJPHQWDWLRQ7KHYHVVHOUHJLRQVDUH WKHLQWHUVHFWLRQUHJLRQVEHWZHHQWZRSUHSURFHVVHGLPDJHV7KHILUVWSUHSURFHVVHGLPDJHLVWKHKLJKSDVVILOWHUHG LPDJHDQGWKHVHFRQGLPDJHLVWKHWRSKDWUHFRQVWUXFWHGLPDJH+LJKSDVVILOWHULQJLVSHUIRUPHGRQWKHJUHHQFKDQQHO DQG WRSKDW UHFRQVWUXFWLRQ LV SHUIRUPHG RQ WKH UHG UHJLRQV LQ WKH JUHHQ FKDQQHO 7KH UHVXOWV RI EORRG YHVVHO VHJPHQWDWLRQDUHJLYHQEHORZD E
F G H IJ
)LJ5HVXOWVRIEORRGYHVVHOVHJPHQWDWLRQD,QSXWLPDJHE*UHHQSODQHLPDJHF&RQWUDVWHQKDQFHGLPDJHG9HVVHOHQKDQFHGLPDJHH +LJKSDVVILOWHUHGLPDJHI7RSKDWUHFRQVWUXFWHGLPDJHJ)LQDOYHVVHOVHJPHQWHGLPDJH
$IWHUWKHEORRGYHVVHOVDUHVHJPHQWHGIURPWKHIXQGXVLPDJHVWKHRSWLFGLVFLVWREHGHWHFWHG&LUFXODUKRXJK WUDQVIRUPKHOSVWRGHWHFWFLUFXODUREMHFWVLQWKHLPDJH7KHUHVXOWVRIRSWLFGLVFGHWHFWLRQDUHJLYHQEHORZ
DE
)LJ2SWLFGLVFVHJPHQWDWLRQUHVXOWD,QSXWLPDJHE2SWLFGLVFVHJPHQWHGLPDJH
2QFHWKHEORRGYHVVHOVDQGRSWLFGLVFDUHGHWHFWHGWKHVHDUHVXEWUDFWHGIURPWKHLQSXWLPDJH7KHUHVXOWVRIEORRG YHVVHODQGRSWLFGLVFUHPRYDODUHJLYHQEHORZ
)LJ5HVXOWVRIEORRGYHVVHODQGRSWLFGLVFUHPRYDO
)LJ5HVXOWVRIH[XGDWHVGHWHFWLRQ
,9&21&/86,21
7KHH[DPLQDWLRQRIEORRGYHVVHOVSOD\VDPDMRUUROHLQWKHPHGLFDOILHOG6HYHUDODSSURDFKHVDUHDYDLODEOHIRUWKH VHJPHQWDWLRQRIEORRGYHVVHOVIURPWKHIXQGXVLPDJHV7KHSDSHUSURSRVHVDPHWKRGWKDWLGHQWLILHVYHVVHOUHJLRQDV WKHLQWHUVHFWHGUHJLRQEHWZHHQWKHKLJKSDVVILOWHUHGLPDJHDQGWRSKDWUHFRQVWUXFWHGLPDJH'LDEHWLF5HWLQRSDWK\LV DFRPSOLFDWHG GLVHDVHWKDWLVFDXVHGE\GLDEHWHV7KHPDLQV\PSWRPRI'LDEHWLF5HWLQRSDWK\LVWKHSUHVHQFHRI H[XGDWHV 7KH PHWKRG LQ WKLV SDSHU PDNHV XVH RI WKH LGHQWLILFDWLRQ RI H[XGDWHV DIWHU WKH VHJPHQWDWLRQ RI EORRG YHVVHOVDQGRSWLFGLVF7KHH[XGDWHVDUHGHWHFWHGE\LPWRRORSHUDWRU7KHVHPHWKRGVSURYLGHDPHDQVWRLGHQWLI\ 'LDEHWLF5HWLQRSDWK\WRDFHUWDLQH[WHQW
5()(5(1&(6
>@ '-H\DVKUHH*6KDUPLODDQG.5DPDVDP\ ³&RPELQHG $SSURDFK RQ $QDO\VLV RI 5HWLQDO %ORRG 9HVVHO 6HJPHQWDWLRQ IRU 'LDEHWLF 5HWLQRSDWK\DQG*ODXFRPD'LDJQRVLV´,QWHUQDWLRQDO-RXUQDORI6FLHQWLILF (QJLQHHULQJ5HVHDUFK9ROXPH,VVXH0D\ >@ 53UL\DDQG3$UXQD³'LDJQRVLVRIGLDEHWLFUHWLQRSDWK\XVLQJPDFKLQHOHDUQLQJWHFKQLTXHV´,&7$&7-RXUQDORQ6RIW&RPSXWLQJ9ROXPH
,VVXH-XO\
>@ $VKD*RZGD.DUHJRZGD$VIL\D1DVLKD0$-D\DUDPDQG$60DQMXQDWK³([XGDWHGHWHFWLRQLQUHWLQDOLPDJHVXVLQJEDFNSURSDJDWLRQ QHXUDOQHWZRUN´,QWHUQDWLRQDO-RXUQDORI&RPSXWHU$SSOLFDWLRQV9ROXPH±1R-XO\
>@ -5DP\D66RXQGDU\D$1DJRRUPHHUDO5DKPDWKQLVKDQG(5HYDWKL³'HWHFWLRQRIH[XGDWHVLQFRORUIXQGXVLPDJHV´,QWHUQDWLRQDO-RXUQDO RI,QQRYDWLYH5HVHDUFKLQ6FLHQFH(QJLQHHULQJDQG7HFKQRORJ\9RO,VVXH0DUFK
>@ 6KUDGGKD7ULSDWKL.ULVKQD.DQW6LQJK%.6LQJKDQG$NDQVKD0HKURWUD³'HWHFWLRQ$XWRPDWLF'HWHFWLRQRI([XGDWHVLQ5HWLQDO)XQGXV ,PDJHVXVLQJ'LIIHUHQWLDO0RUSKRORJLFDO3URILOH´,QWHUQDWLRQDO-RXUQDORI(QJLQHHULQJDQG7HFKQRORJ\9RO1R-XQ-XO
>@ .XOOD\DPPDDQG30DGKDYHH/DWKD³5HWLQDO,PDJH$QDO\VLVIRU([XGDWHV'HWHFWLRQ´,QWHUQDWLRQDO-RXUQDORI(QJLQHHULQJ5HVHDUFKDQG $SSOLFDWLRQV9RO,VVXH-DQXDU\)HEUXDU\SS