Effect of zooming on texture features of ultrasonic images

Abstract

Background

Unstable carotid plaques on subjective, visual, assessment using B-mode ultrasound scanning appear as echolucent and heterogeneous. Although previous studies on computer assisted plaque characterisation have standardised B-mode images for brightness, improving the objective assessment of echolucency, little progress has been made towards standardisation of texture analysis methods, which assess plaque heterogeneity. The aim of the present study was to investigate the influence of image zooming during ultrasound scanning on textural features and to test whether or not resolution standardisation decreases the variability introduced.

Methods

Eighteen still B-mode images of carotid plaques were zoomed during carotid scanning (zoom factor 1.3) and both images were transferred to a PC and normalised. Using bilinear and bicubic interpolation, the original images were interpolated in a process of simulating off-line zoom using the same interpolation factor. With the aid of the colour-coded image, carotid plaques of the original, zoomed and two resampled images for each case were outlined and histogram, first order and second order statistics were subsequently calculated.

Results

Most second order statistics (21/25, 84%) were significantly (p < 0.05) sensitive to image zooming during scanning, in contrast to histogram and first order statistics (4/25, 16%, p < 0.001, Fisher's exact test). Median (interquartile range) change of those features sensitive to zooming was 18.14% (4.94–28.43). Image interpolation restored these changes, the bicubic interpolation being superior compared to bilinear interpolation (p = 0.036).

Conclusion

Texture analysis of ultrasonic plaques should be performed under standardised resolution settings; otherwise a resolution normalisation algorithm should be applied.

Background

Cross-sectional studies have shown that echolucent and heterogeneous internal carotid artery plaques on B-mode ultrasound scanning are associated with neurological symptoms [1–3]; similarly prospective studies have confirmed that these subjective plaque characteristics predict future neurological symptoms [4, 5]. Our group has investigated objective, computer-assisted methods, which involved standardisation of ultrasonic images (normalisation) and echogenicity measurements [6, 7]. We have also, like other groups, investigated objective methods of accessing plaque heterogeneity, known also as texture analysis, and found these helpful in separating symptomatic from asymptomatic plaques [8–12].

Image resolution has a significant effect on texture analysis results; this has been shown by studies on remote sensing [13–15], and ultrasound [16]. Images obtained during ultrasound scanning can have variable resolution due to different zooming (resampling) factors during the actual scanning procedure and digitisation settings during image downloading. Kuo, in an effort to solve this problem, proposed an algorithm, which ignores the extra pixels of those images with increased resolution [17]. The aim of the present study was to investigate the influence of image zooming during ultrasound scanning on the value of histogram analysis and textural features and to test whether or not resolution standardisation by applying image resampling decreases the variability introduced by the different image resolution.

Methods

Eighteen images of carotid plaques producing stenosis greater than 50% were included in this study. These were obtained from consecutive asymptomatic patients, participants of the Asymptomatic Carotid Stenosis and Risk of Stroke (ACSRS) multicenter natural history study [18]. Stenosis severity was estimated with velocity ratios (European Carotid Surgery Trial – ECST – method), as previously described [19], using an ATL HDI 3000 scanner (Philips Medical Systems, Bothell, WA, USA). A linear post-processing curve was used during carotid scanning, B-mode and colour-coded still images (Figures 1 and 2) were stored on magneto-optical disks as Tagged Image File Format (TIFF) files [resolution of 576 pixels (height) × 768 pixels (width)]; the same still (frozen) B-mode images were zoomed off-line using the zoom feature of the scanner (zoom factor of 1.3, default of the ultrasound scanner) and also stored on the magneto-optical disk. B-mode images were 8-bit i.e. they had 256 (range 0–255) shades of grey. All digital (unzoomed and zoomed) images were recorded using a standardised protocol [7, 10] and subsequently transferred to a PC and normalised for brightness, using blood and arterial adventitia as reference points, as previously described [7], using commercially available software (Adobe ^® Photoshop version 5.5, Adobe Systems Inc., Palo Alto, CA, USA). Normalisation (linear scaling) of the image was performed with the "curves" option of the software so that in the secondary image the grey scale median (GSM) of blood is 0 to 5 and that of the adventitia is 185 to 195. To reduce variability, a single GSM measurement of reference points (adventitia and blood) was used for the process of normalisation of both the unzoomed and zoomed images. Subsequently, the normalised resolution, i.e. the number of pixels per cm of image depth (using the image depth scale) was calculated. Although in some of the images, due to deeply situated carotid arteries, image depth was increased and therefore normalised resolution decreased, it was realised that the zoomed image had invariably increased resolution, 1.3 times more than the unzoomed image. The original B-mode images were subsequently interpolated (resampled) to increase their pixel resolution 1.3 times, to match the zoom factor of the scanner and therefore simulate the zoom process of the scanner. This resolution standardisation was achieved by using the image size (resampling) feature of the Adobe ^® Photoshop software (version 5.5). The bilinear and bicubic interpolation methods (Appendix I) were used to resample the images. With the aid of the colour-coded image, the region of interest (carotid plaques) of the original, the zoomed and two resampled images (all grey-scale or B-mode) for each case were outlined and texture features were calculated. Texture analysis of the plaque outlines was performed with a custom-made computer program (Figure 3) and a MATLAB platform (The MathWorks, Inc, Natick, Mass, USA); the program also counts the number of pixels included in the plaque outline. Results were saved by downloading them to a text file, which can be imported by most statistical packages. Textural features calculated included:

Figure 1

This figure shows an unzoomed B-mode still image obtained during carotid scanning.

Figure 2

This figure shows the unzoomed colour-coded still image, corresponding to Figure 1. Image was used to facilitate the outline of the original gray scale plaque shown in Figure 1, during image analysis.

Figure 3

Histogram and statistical features of the carotid plaque outline (top left), were automatically extracted by the computer program module, shown in this figure. The contoured image (10 contours of the 0–255 grey level spectrum) is shown below.

A. Histogram measures

Percentage of pixels below grey level 30 (PP < 30) and 50 (PP <50).

Percentage of pixels of each of the 10 contours of the 0–255 grey level spectrum (PPC1-PPC10), the first 2 contours (grey level 0–51) analysed further into 5 sub-contours (PPCS1-PPCS5). These are novel features described by the authors. PPC1 is the percentage of image pixels having a grey level between 0–26, PPCS1 is the percentage of image pixels having a grey level between 0–10, ect.

B. First order grey level parameters [20, 21]

Mean grey level, variance, median (GSM), mode, kurtosis, skewness, energy, entropy.

C. Second order (texture) statistics

1. The Spatial Gray Level Dependence Matrices (SGLDM) algorithm, known also as co-occurrence matrix method [22]. We used an interpixel distance (d) of 1 and an average angle measure calculated by averaging the values from the measures calculated at angles 0, 45, 90 and 135, as previously described [12, 23, 24]. The following features were calculated: angular second moment (ASM), contrast, correlation, variance (sum of squares), inverse difference moment (IDM), sum average, sum variance, sum entropy, entropy, difference variance, difference entropy, information measures of correlation-1 and -2 (InM1 and InM2).

2. Gray level difference statistics (GLDS) [25]: Entropy, contrast, mean, angular second moment – Homogeneity, energy.

3. Gray level run length statistics [26]: Short run emphasis (SRE), grey level distribution (GLD), run length distribution (RLD), long run emphasis (LRE), run percentage (RP).

4. Radial and angular sum of the Fourier power spectrum (FPS) were calculated [25].

Statistics

Because of the small sample size (<50), the Shapiro-Wilk test was used to test the results for normal distribution; because some of them were not normally distributed, the Wilcoxon signed ranks test was used to test the difference between unzoomed and zoomed images.

The results were expressed as median and interquartile range (IQR). SPSS for Windows, version 11.5 (SPSS Inc., Chicago, IL, USA), was the statistical package used for statistical analysis. P values of 0.05 or less were considered statistically significant.

Results

Image zooming increased both plaque total pixel number and image resolution. Median (IQR) pixel count of unzoomed images was 9,629 (7,203–14,299). This was increased by 54.3% (~1.3² times) to 14,861 (11,595–22,673) with image zooming (p < 0.001). Median resolution of the original images used in the current study was 15.8 pixels/mm, which increased up to 20.55 pixels/mm with zooming (~1.3 times).

The results of texture analysis of the original, zoomed and resampled images are shown in Table 1, 2, 3, 4, 5, 6, 7. Twenty-five features (50%) were sensitive to zooming, and in five of them (10%), the magnitude of change was over 50%. Median (IQR) change of those features sensitive to zooming was 18.14% (4.94–28.43). Histogram features (Tables 1 and 2) and first order statistics (Table 3) were generally not sensitive to resolution changes, with only four of them being significantly (p < 0.05) sensitive (4/25, 16%).

Table 1 Table showing the difference of texture features (contour analysis) in zoomed images and those without zoom. The latter were subsequently resampled to equalise their resolution (pixels/mm) with the corresponding zoomed ones, by using bilinear (BLI) or bicubic (BCI) interpolation. Percent difference with zoomed image are also shown. Statistically significant differences are highlighted.

Table 2 Table showing the difference of histogram features (subcontour analysis), PP < 30 and PP < 50 in zoomed images and those without zoom. The latter were subsequently resampled to equalise their resolution (pixels/mm) with the corresponding zoomed ones, by using bilinear (BLI) or bicubic (BCI) interpolation. Percent difference with zoomed image are also shown. Statistically significant differences are highlighted.

Table 3 Table showing the difference of first order statistics in zoomed images and those without zoom. The latter were subsequently resampled to equalise their resolution (pixels/mm) with the corresponding zoomed ones, by using bilinear (BLI) or bicubic (BCI) interpolation. Percent difference with zoomed image are also shown. Statistically significant differences are highlighted.

Table 4 Table showing the difference of SGLDM features in zoomed images and those without zoom. The latter were subsequently resampled to equalise their resolution (pixels/cm) with the corresponding zoomed ones, by using bilinear (BLI) or bicubic (BCI) interpolation. Percent difference with zoomed image are also shown. Statistically significant differences are highlighted.

Table 5 Table showing the difference of GLDS features in zoomed images and those without zoom. The latter were subsequently resampled to equalise their resolution (pixels/mm) with the corresponding zoomed ones, by using bilinear (BLI) or bicubic (BCI) interpolation. Percent difference with zoomed image are also shown. Statistically significant differences are highlighted.

Table 6 Table showing the difference of Fourier features in zoomed images and those without zoom. The latter were subsequently resampled to equalise their resolution (pixels/cm) with the corresponding zoomed ones, by using bilinear (BLI) or bicubic (BCI) interpolation. Percent difference with zoomed image are also shown. Statistically significant differences are highlighted.

Table 7 Table showing the difference of Runlength features in zoomed images and those without zoom. The latter were subsequently resampled to equalise their resolution (pixels/cm) with the corresponding zoomed ones, by using bilinear (BLI) or bicubic (BCI) interpolation. Percent difference with zoomed image are also shown. Statistically significant differences are highlighted.

On the other hand, most second order features (21/25, 84%) were significantly (p < 0.05) sensitive to the relatively small zoom factor of 1.3 (Table 4, 5, 6, 7). Compared with histogram features and first order statistics combined, second order statistics were significantly more often sensitive to zooming (p < 0.001, Fisher's exact test).

Resolution standardisation, indeed, decreased significantly these differences. This was more evident when the features, which were resolution sensitive, were considered separately (Table 8). The bicubic interpolation method was statistically significantly better than the bilinear interpolation method; this was more evident in the subgroup of features that are resolution dependent (Table 8), where the magnitude of change is on average 43% less for the 25 sensitive features (2.79% vs 4.88%).

Table 8 Image resampling reduces significantly the variability due to different image resolution. Bicubic interpolation (BCI) was better than bilinear interpolation (BLI), p = 0.036. This was remarkable for those 25 features shown on Wilcoxon analysis to be significantly different, when zoomed and un-zoomed images were compared. Results are shown as median and interquartile range.

Discussion

Our study showed that most second order textural features are particularly sensitive to the interpolation process during image zooming. Chan and McCarty reported that magnification affects runlength SRE, LRE and RP, but gave no further details [16]. This might be the result of increased pixel number. In contrast, most histogram features and first order statistics were relatively insensitive; actually these features are not texture algorithms.

A small zoom factor (the default by the ultrasound scanner was 1.3) is more likely to be applied in real circumstances, but under some circumstances this might be higher; the effect of a series of tests with progressively increased magnification could investigate if the association between zoom factor and change is linear, exponential, etc. It is expected that bigger zoom factors result in greater differences and further research is necessary to prove that this standardisation process eliminates any differences.

The implications of these results are that second order statistics should be used under standardised resolution settings, which means that these factors should be kept steady during the scanning process or a method of standardisation needs to be applied. In everyday practice, plaque resolution can vary up to 3 times, between 10–30 pixels/mm; this depends on the depth and zoom of the scanner. The former can vary from 2–5 cm. The combination of variable depth of carotid arteries and various zoom factors results in images of substantially different pixel number and therefore resolution (pixels/mm) of the region of interest (carotid plaque). This "normalised" resolution of the region of interest should not be confused with the image resolution, determined during the initial process of digitisation, for example all original images used in the current study hadresolution of 576 pixels (height) × 768 pixels (width). Increased depth results in reduced plaque resolution and although this can be controlled by zooming, so that resolution will remain the same, this is not possible in lengthy carotid plaques.

In the present study, two well-known interpolation methods were used to standardise resolution and it was found that the bicubic method is superior. This was expected, since the bicubic method is superior in terms of image quality, in comparison with the bilinear method [27, 28]. The more complex algorithms, including bicubic interpolation, had the disadvantage of running slowly by the low-memory computers used in the 70^s and 80^s, but modern technology has solved this problem. New algorithms, like the spline interpolation algorithm could be tested by future studies [29].

Conclusion

Second order statistics, unlike most first order statistics and histogram features, are sensitive to image interpolation, commonly used during scanning with image zoom. A process of standardisation like the one used in this study should be applied when these features are used in images with variable resolution of the region of interest.

Appendix I

Bilinear interpolation algorithm

Bilinear interpolation determines the value of new pixels by calculating the weighted average of the values of the four surrounding pixels that is above, below, right, and left of the point where the new pixel is to be created (a 2 × 2 array).

Bicubic interpolation algorithm

Bicubic interpolation determines the values of new pixels by calculating the weighted average of the closest 16 pixels (a 4 × 4 array) based on distance. Although bicubic interpolation is slower and therefore requires more computational time, it produces a much smoother image than the bilinear technique and therefore it is considered superior; for this reason it is the default image-enlargement technique in the vast majority of image processing software.