|
1.IntroductionOne of the most common mechanisms in the development of foot ulcerations involves the cumulative effect of unrecognized repetitive trauma over the course of several days at pressure points on the sole of the foot.1, 2, 3 Areas that are likely to ulcerate are those associated with increased local skin temperatures due to inflammation and enzymatic autolysis of tissue.4, 5, 6 Such inflammation is characterized by five signs: redness, heat, swelling, pain, and loss of function. Some signs are difficult for clinicians to assess objectively; however, temperature measurements can provide quantitative data shown to be predictive of impending ulceration.4, 7, 8, 9, 10 Conventional noninvasive methods used to assess foot skin integrity, including inspection and palpation, may be valuable diagnostic tools, but they usually do not detect changes in skin integrity until skin breakdown has already occurred. Additionally, manual infrared thermometers used in clinics can only provide a mean value over a large area of the foot. In this research study, thermal imaging is used to monitor the temperature distribution on the skin. However, there is no standard distribution for skin-surface temperature of a healthy foot because that skin temperature can be affected by many factors, such as ambient and internal thermal conditions, age, sex, weight, etc. One way to eliminate this variability is to compare the thermal skin distributions of two feet for the same subject.11, 12 This comparison, called asymmetry analysis, is then combined with a segmentation technique that is based on a genetic algorithm to achieve higher efficiency in the detection of inflammation and, hence, better prediction of ulcers before they develop. This proposed methodology involves three steps: segmentation, geometric transformation, and asymmetry analysis. 2.MethodologyIn this research, a thermal camera, FLIR A320 (0–350°C, ±2%), was used to record foot skin temperature distributions after patients removed their socks and shoes. The resulting thermal images were then analyzed, as illustrated in Fig. 1. This approach, implemented using MATLAB as a platform, involves three steps:
2.1.Automatic ThresholdingIn this proposed methodology, automatic thresholding of the thermal images is an important step to minimize noise and decrease detection of false inflammation. This step presents certain challenges, however. First, some patients have feet that present areas with low temperatures, which are also close to the temperatures of the image background levels. Second, the heat transfer from the legs and other body parts increases the temperature between the feet, resulting in high nonuniform background levels. Figures 2, 2, 2 show three examples of thermal images that present nonuniform background levels due to the transfer of heat from the legs and other body parts to the air. Fig. 2Example of thermal images corresponding to (a) healthy feet with cold temperatures areas, (b) healthy feet with nonuniform background due to the heat transfer around the feet, and (c) foot with an abnormal area. ![]() To extract the feet from the background image and remove as much noise as possible, a genetic algorithm is used. Genetic algorithms are optimization algorithms based on biological mechanics of natural selection through certain operations, such as chromosome, population size, cross rate, mutation rate, and maximum generation.12, 13 Fitness is then evaluated by applying the following equation: Eq. 1[TeX:] \documentclass[12pt]{minimal}\begin{document}\begin{equation} {\rm Fitness}\left(x \right) = N_{\rm f} N_{\rm b} \left({M_{\rm f} - M_{\rm b} } \right)^2, \end{equation}\end{document}[TeX:] $M_{\rm f}$ , the mean intensity of foreground pixels, is given by Eq. 2[TeX:] \documentclass[12pt]{minimal}\begin{document}\begin{equation} M_{\rm f} = \frac{{I_{\rm f} }}{{N_{\rm f} }}, \end{equation}\end{document}[TeX:] $M_{\rm b}$ is the mean intensity of background pixels given by Eq. 3[TeX:] \documentclass[12pt]{minimal}\begin{document}\begin{equation} M_{\rm b} = \frac{{I_{\rm b} }}{{N_{\rm b} }}, \end{equation}\end{document}The best threshold is determined by applying the following equation: Eq. 4[TeX:] \documentclass[12pt]{minimal}\begin{document}\begin{equation} {\rm Fitness}({x^ * }) = \max \left\{ {{\rm Fitness}(x)} \right\}, \end{equation}\end{document}The main steps of the proposed genetic algorithm are summarized as follows:
2.2.Geometry TransformationThe ultimate goal of this research paper is to compare the thermal distributions of a healthy foot to those of an abnormal foot with abnormal areas. For the most accurate comparison, the feet must be arranged symmetrically in relation to each other. However, in practice, feet in an image are rarely in symmetric positions. Therefore, a geometric transformation is needed to adjust their positions. Assuming that the feet in the image are the same size, a simple translation and rotation around two feature points can achieve this goal. The centroid and the farthest point from the centroid to the heel edge serve as reference points for the adjustment of each foot. On the basis of these two feature points, the relative position and angle differences between the two feet are then calculated. Then, a rotation and a translation are performed to set each foot in the middle of the image with the characteristic line in a vertical direction. The geometric transformation procedure is described as follows:
2.3.Asymmetry AnalysisIn this step, the potential ulcerous areas are identified by analyzing the asymmetry between the adjusted foot images. Once the feet are adjusted in symmetric positions using the geometric transformation algorithm, the left-foot pixel intensities are subtracted from the corresponding right-foot pixel intensities. If the difference exceeds a specific threshold, then the intensity is shown as an abnormality in image difference. 3.ResultsTo assess the effectiveness of this developed technique, we accessed over 100 thermal images, corresponding to patients’ feet with and without inflammation. Examples of these thermal images are presented in Figs. 2, 2, 2. Figures 2 and 2 show examples of thermal images of healthy feet, whereas Fig. 2 shows an example of a thermal image in which the right foot contains a high-temperature area, indicating the presence of inflammation. As seen in these images, the heat transfer from the legs in the thermal images generates a nonuniform background. An example of results when applying the genetic algorithm is shown in Fig. 3. These results are compared to those of other existing techniques that were also implemented, including Otsu's technique,14 Ridler and Calvard's technique,15 Kapur, 16 and Tsai's technique.17 The results of applying these techniques are shown in Figs. 3, 3, 3, 3. A comparison of all these results is done through use of four criteria as well as their combination. These four criteria are misclassification error (ME), edge mismatch (EMM), relative foreground area error (RAE), and region nonuniformity (NU). The descriptions of the criteria can be found in Refs. 18, 19, 20, 21. Fig. 3Some results of the thresholding techniques: (a) Gray-scale image corresponding to the thermal image of Fig. 2(b), (b) output image after applying moment preserving method, (c) output image after applying maximum entropy method, (d) output image after applying Otsu's method, and (e) output image after applying the genetic algorithm. ![]() Examples of results of this assessment are given in Table 1, offering the quantification results of the above criteria for the five implemented techniques as applied to the image of Fig. 2. From Table 1 one can quantitatively see that the genetic algorithm has a relatively smaller overall combination value than do the other techniques, even though it does not give the best value for every criterion. Similar results are found for the set of thresholded images, which indicate that the genetic algorithm provides better thresholding results than do the other implemented techniques. Table 1Evaluation of different thresholding techniques.
Although the genetic algorithm does give better results, it does not completely remove the noise between the feet. One solution to increase this efficiency is separating the feet from the other parts of the body by using a lightweight metallically painted shield. An example of these results is shown in Fig. 4. As observed, the quality of the thresholded image greatly improves and the noise around the feet is completely removed. Figure 5 represents output images with adjusted feet after applying the geometric transformation to the thresholded image of Fig. 4. Figure 6 shows the gray-scale image that represents the result of the asymmetry analysis. In this image, the white spot represents the location of the abnormal area. Figure 7 shows the results of the asymmetry analysis (output images after overlapping and subtracting) for different inflammation diameters, measured using a ruler and ranging from 1 to 0.2381 cm. As can be seen, inflammation with a diameter as small as 2 mm can be detected. Furthermore, Figs. 8 and 9 illustrate the accuracy of the technique by showing the linear relationships between the inflammation areas and their corresponding spot areas in those images resulting from the asymmetry analyses. This relationship will allow clinicians to accurately estimate the area of the inflammation and take corrective actions before an ulcer develops. The assessment of the efficiency of the proposed system is based on the number of images that show hot spots (feet with or without abnormal areas), the number of images with missing spots (feet with abnormal areas that were not detected), and the number of images with false spots (feet that do not contain abnormal areas). Table 2 offers a summary of such assessment based on these parameters. As one can see, 45 images contained hot spots after analysis with the proposed system; however, 10 of these images were false spots. These false spots were identified as a result of the differences between the shapes and sizes of the left and right feet in the images. Such differences are mainly due to the fact that the patients moved their feet in all directions, and thus, the projections of their feet were not the same in some images. Table 2Results of the assessment.
4.ConclusionWe developed a technique to use for investigating the thermal distributions of feet in order to detect inflammation and hence predict foot ulcers. The experimental results indeed show that this technique can be used to identify inflammation and therefore predict potential ulceration. However, the developed technique assumes that the two feet are on the same plane in an image and have the same shape and size. In the future, our research objectives will include (i) developing a technique that scans and compares symmetric pixels, no matter the shape, size, and position of the feet and (ii) studying the decay rates of temperature distributions over time for successive images that correspond to the same feet. AcknowledgmentThis work was supported by the ND EPSCoR project through National Science Foundation Grant No. UND0012168. ReferencesL. A. Lavery,
D. G. Armstrong,
S. Vela, and
J. G. Fleishli,
“Practical criteria to screen patients at risk for diabetic foot ulceration,”
Arch. Int. Med., 158 157
–162
(1998). https://doi.org/10.1001/archinte.158.2.157 Google Scholar
G. E. Reiber,
L. Vileikyte,
E. J. Boyko,
M. del Aguila,
D. G. Smith,
L. A. Lavery, and
A. J. Boulton,
“Causal pathways for incident lower extremity ulcers in patients with diabetes from two settings,”
Diabetes Care, 22 157
–162
(1999). https://doi.org/10.2337/diacare.22.1.157 Google Scholar
R. G. Frykberg,
L. A. Lavery,
H. Pham,
C. Harvey,
L. Harkless, and
A. Veves,
“Role of neuropathy and high foot pressures in diabetic foot ulceration,”
Diabetes Care, 21 1714
–1719
(1998). https://doi.org/10.2337/diacare.21.10.1714 Google Scholar
D. G. Armstrong,
L. A. Lavery,
P. J. Liswood,
W. F. Todd, and
J. Tredwell,
“Infrared dermal thermometry of the high-risk diabetic foot,”
Phys Ther, 77 169
–177
(1997). Google Scholar
P. W. Brand,
“The insensitive foot (including leprosy),”
Disorders of the Foot and Ankle, 2173
–2175 1991). Google Scholar
R. P. Clark,
M. R. Goff,
J. Hughes, and
L. Klenerman,
“Thermography and pedobarography in the assessment of tissue damage in neuropathic and atherosclerotic feet,”
Thermology, 3 15
–20
(1988). Google Scholar
G. E. Reiber,
L. Vileikyte,
E. J. Boyko,
M. del Aguila, D. G. Smith,
L. A. Lavery, and
A. J. Boulton,
“Home monitoring of foot skin temperatures to prevent ulceration,”
Diabetes Care, 27 2642
–2647
(2004). https://doi.org/10.2337/diacare.27.11.2642 Google Scholar
V. Schubert and
B. Fagrell,
“Local skin pressure and its effect on skin microcirculation as evaluated by laser Doppler fluxmetry,”
Clin. Physiol., 9 535
–545
(1989). https://doi.org/10.1111/j.1475-097X.1989.tb01007.x Google Scholar
V. Schubert and
B. Fagrell,
“Evaluation of the dynamic cutaneous post ischaemichyperaemia and thermal response in elderly subjects and in an area at risk for pressure sores,”
Clin. Physiol., 11 169
–182
(1991). https://doi.org/10.1111/j.1475-097X.1991.tb00110.x Google Scholar
D. G. Armstrong and
L. A. Lavery,
“Predicting neuropathic ulceration with infrared dermal thermometry,”
J. Am. Podiatr. Med. Assoc., 87 336
–337
(1997). Google Scholar
N. Kaabouch,
Y. Chen,
W. C. Hu,
J. Anderson,
F. Ames, and
R. Paulson,
“Early detection of foot ulcers through asymmetry analysis,”
Proc. SPIE, 7243 72621L
(2009). Google Scholar
N. Kaabouch,
Y. Chen,
J. Anderson,
F. Ames, and
R. Paulson,
“Asymmetry analysis based on Genetic Algorithms for the Prediction of Foot Ulcers,”
(2009). Google Scholar
D. E. Goldber,
“Genetic algorithms in search, optimization and machine learning,”
Addison-Wesley,1989.). Google Scholar
N. Otsu,
“A threshold selection method from gray level histograms,”
62
–66
(1979). Google Scholar
T. W. Ridler and
S. Calvard,
“Picture thresholding using an iterative selection method,”
630
–632
(1978). Google Scholar
J. N. Kapur,
P. K. Sahoo, and
A. K. C. Wong,
“A new method for gray-level picture thresholding using the entropy of the histogram,”
Graph. Models Image Process., 29 273
–285
(1985). https://doi.org/10.1016/0734-189X(85)90125-2 Google Scholar
W. H. Tsai,
“Moment-preserving thresholding: a new approach,”
Graph. Models Image Process., 19 377
–393
(1985). Google Scholar
M. Sezgin and
B. Sankur,
“Survey over image thresholding techniques and quantitative performance evaluatio,”
J. Electronique Imaging, 13
(1), 146
–165
(2004). https://doi.org/10.1117/1.1631315 Google Scholar
Y. J. Zhang,
“A survey on evaluation methods for image segmentation,”
Pattern Recogn., 29 1335
–1346
(1996). https://doi.org/10.1016/0031-3203(95)00169-7 Google Scholar
W. A. Yasnoff,
J. K. Mui, and
J. W. Bacus,
“Error measures for scene segmentation,”
Pattern Recogn., 9 217
–231
(1977). https://doi.org/10.1016/0031-3203(77)90006-1 Google Scholar
M. D. Levine and
A. M. Nazif,
“Dynamic measurement of computer generated image segmentations,”
IEEE Trans. Patt. Anal. Mach. Intel., 7
(2), 155
–164
(1985). https://doi.org/10.1109/TPAMI.1985.4767640 Google Scholar
|