HIERARCHICAL CLASSIFICATION OF SAR DATA USING
A MARKOV RANDOM FIELD MODEL


Melba M. Crawford and Michael R. Ricard
Center for Space Research, University of Texas at Austin
3925 W. Braker Ln., Suite 200, Austin, TX 78759-5321
Ph: (512) 471-5573 Fax: (512) 471-3570 E-mail: crawford@csr.utexas.edu


ABSTRACT

A general framework is presented for classifying coastal environments using synthetic aperture radar (SAR) data. This framework addresses two main issues associated with the accurate classification of SAR data: 1) the variability in radar backscatter of a given pixel caused by the presence of speckle in the imagery and 2) the characteristic decrease in intensity as a function of incidence angle. To combat the effect of speckle on a given pixel's backscatter, a Markov Random Field (MRF) model is used to incorporate contextual information from the imagery by considering neighbor pixel statistics in the classification process. To address the class-specific decrease in backscatter as a function of angle, a hierarchical two-level classifier is considered to compensate for the highly variable water class and the less influenced land classes. Preliminary results are shown from the hierarchical MRF-based classifier and are compared to single level MRF and radial basis function (RBF) classifiers. For the test site presented, classification accuracy only improves slightly in using the hierarchical architecture, but does show the potential for application to coastal areas with larger percentages of upland and urban land cover types.
I. INTRODUCTION


Classification of land cover is one of the primary objectives in the analysis of remotely sensed data. In synthetic aperture radar (SAR) data, speckle and variation in scattering coefficient with incidence angle both affect the accuracy of pixel-based classifiers. By compensating for these sources of variation in backscatter statistics, a more accurate land cover map can be created.

Single channel filtering is commonly employed for the reduction of speckle in SAR imagery. While these filters improve the appearance of the image for visual interpretation and result in smoother classification maps, statistical variability in measured backscatter caused by speckle still remains at the pixel level. Thus, in order to compensate for this variability, neighborhood, or contextual, information is often incorporated into the classifier methodology. Markov Random Fields (MRF) are frequently employed to model neighborhood and class label structure for the classification of remotely sensed data. In particular, [3] and [4] have used MRF models in the classification of SAR data and obtained better results than classification methods which do not utilize contextual information.

In analysis of SAR data from coastal environments, variation due to changes in angle of incidence [5] may cause otherwise separable classes, namely water and land, to overlap statistically. In order to compensate for this variation in measured backscatter, a hierarchical classifier is proposed. At each level of the classifier, the data can be class-corrected using models for the variation in backscatter with angle given in [5]. By employing a hierarchical structure, conflicts in class separability can potentially be alleviated.

The following sections contain descriptions of the classification of a coastal environment using polarimetric airborne SAR data acquired by the NASA JPL AIRSAR system. Results are shown for both the MRF-based classifier and a non-contextual classifier utilizing a radial basis function (RBF) neural network. Finally, a hierarchical architecture is presented, and the results of the three classifiers are compared.


II. SAR CLASSIFICATION


This section contains a description of the test site, the SAR data which were acquired, and results obtained initially by a pixel-based RBF classifier. The MRF-based classifier is then outlined and shown to yield superior results to the non-contextual RBF classifier for this data set.

A. Test Site Description
Bolivar Peninsula is part of the low relief barrier islands of the Texas coast located at the mouth of Galveston Bay. The test site chosen for this study consists of a salt marsh located at a washover fan on southern Bolivar Peninsula, shown in Figure 1. This salt marsh is adjacent to uplands, agricultural, and urban areas. For classification purposes, the marsh area is further characterized in terms of sub-environments defined by wetland maps [6]. The land cover types which occur in these environments include low and high proximal marsh, high distal marsh, and spoil/barren flats, as well as areas consisting of water and isolated trees.


Figure 1. Test Site on Bolivar Peninsula, TX.


B. Data Description
For the purpose of mapping wetland vegetation, NASA/JPL airborne SAR (AIRSAR) data were collected on June 28, 1996 over Bolivar Peninsula on the Texas coast. The 40 MHz AIRSAR data has a spatial resolution of 4m is acquired at three frequencies (C-Band, L-band, and P-band) of fully polarimetric radar data (HH, VV, and HV linear polarizations). C and L-band data were analyzed in this study, Prior to input to the classifier, the AIRSAR data were speckle filtered using a 5x5 enhanced Lee filter. A 500x500 pixel subset of the imagery was selected as the test site, and each channel of data was normalized (mean zero, standard deviation one) for equal classifier weighting. An example image depicting the AIRSAR data collected is shown in Figure 2.

The effects of speckle in the imagery are still readily visible in the grainy texture of Figure 2. In addition, brightness is reduced in the range direction (horizontal direction; near range at left), which is most apparent over the water. The influence of both of these factors can be shown in the classification results.


Figure 2. Measured AIRSAR Data.


C. RBF Classification
The test site data were classified previously using a RBF neural network [2]. The corresponding labeled land cover map and classification accuracy are reproduced in Figure 3 and Table 1, respectively. As evidenced in the classified image, the effect of speckle is quite noticeable, despite the application of a speckle filter. Note, classes are scaled linearly in grayscale: Water (1), Low Proximal Marsh (2), High Proximal Marsh (3), High Distal Marsh (4), Barren Flats (5), and Trees (6).


Figure 3. RBF Classified Map.

D. MRF Classification
To ameliorate the effect of speckle on the pixel-based RBF classifier, a MRF model was investigated in conjunction with a maximum likelihood (ML) estimator in a maximum a posteriori (MAP) classifier setting [3]. The resulting MAP estimate is given by

(1)
where s is a given pixel, Xs is the measured data vector for that pixel, Ls is its label, Nso is the neighborhood surrounding, but not including, the pixel. The energy function U1s corresponds to the ML estimate

(2)
while the energy function U2s corresponds to the MRF model
(3)
where the parameter [beta] governs the degree neighboring pixels influence the pixel's label.


Figure 4. MRF Classified Map.


The MRF-based classifier was applied to the test site data, using the same inputs, outputs, and training sites as the RBF classifier. The input vector consisted of six channels of AIRSAR data. The six output classes were chosen to be water, low proximal marsh, high proximal marsh, high distal marsh, barren flats, and trees. This supervised classification method used 11960, 9692, 3611, 1561, 2323, and 801 training samples for classes 1-6, respectively.

For the resulting classified image shown in Figure 4, the MRF model was defined over a 3x3 neighborhood. The iterative conditional modes (ICM) algorithm was used to minimize the MAP estimate; five iterations were required using a [beta]=1.4. The accuracy of the MRF-based classifier is shown in Table 1. In comparison to the RBF classifier from [2], the MRF model produces a higher rate of correct classification and less "noisy" land cover map. As such, it handles the effects of speckle on backscatter statistics better than the non-contextual classifier.


III. HIERARCHICAL CLASSIFICATION


Classifiers utilizing hierarchical, or sequential, architectures generally perform well for remote sensing applications. Typically, when discriminating land cover types, there is a benefit to separating the data into general groupings rather than specific classes, as well as to removing those classes which are easily separable from the rest. This multiscale framework in terms of class separability reduces the complexity of the classifier, both in terms of training and decision making. This is because the classifier does not need to distinguish between all classes, just one class (or a few) from the rest.

By employing a hierarchical classifier, different inputs can be used at each level of the overall classification process depending on the classes to be discriminated. This then allows for a possible reduction in the number of inputs, or for the use of class specific data such as topography, at a given level. The described benefits of a hierarchical architecture generally lead to an increase in classification accuracy. An example of a successful hierarchical classifier in remote sensing, based on knowledge-based sequential decision rules, can be found in [1].

A hierarchical version of the above MRF-based classifier was developed to account for the class dependent variation in backscatter associated with changes in incidence angle. A methodology for "correcting" SAR data according to class-specific models is described and is then presented as the first level in the architecture of the hierarchical classifier.


A. Water Correction
To account for the variation in radar backscatter due to changes in angle of incidence of SAR data for a given land cover class, a hierarchical classifier is developed. Because this variation is known to be different for each land cover class, frequency, and polarizations [5], at each level of the classifier, the input vector can be "corrected" using a class-specific model applied to the original SAR data. This will compensate for the variation in backscatter statistics for the given class and produce ideally constant data for that class.

The particular model chosen to account for this variation is taken from [5] and given by
(4)

where is the scattering coefficient, is the maximum value for the scattering coefficient (usually measured at vertical incidence), is the angle of incidence, and is a constant dependent on terrain type, frequency, and polarization.
When the backscatter is analyzed in units of dB, the model simplifies to a linear equation given by
(4)
Thus, a linear correction is applied at each frequency and polarization to generate uniform backscatter statistics for a given class.


Figure 5. "Water-Corrected" AIRSAR Data.

In the SAR data collected over the coastal test site, the greatest variation occurs over the open water, as can be seen in Figure 2. To correct for this variation, water pixels were isolated in a supervised manner, and linear fits were calculated for each of the six bands. An example image depicting the "water-corrected" AIRSAR data is shown in Figure 5.

Now, while the "corrected" class would be easily identifiable as an individual class, the other land cover classes would have had their statistics altered (incorrectly) and would not be reliably separable from one another. This leads directly to the proposed the hierarchical structure whereby the classification process is broken into simpler tasks based upon ease of class separability.

B. Hierarchical Classifier Architecture
For this test site, the two level hierarchical classifier shown in Figure 6 was used. The Level-1 classifier is designed to separate the image into water and land by using the "water-corrected" data as the input, while the Level-2 classifier then discriminates between the land classes consisting of wetlands and uplands using the original SAR data as the input.


Figure 6. Example Two Level Classifier Architecture.

At each level, the MRF model is utilized to account for the presence of speckle in the imagery. By incorporating a MRF model in the hierarchical architecture, improved classification accuracy should be obtained.


IV. CLASSIFICATION RESULTS


This section contains results from the hierarchical classification of SAR data using a MRF model, First, the two level classifier shown in Figure 6 was utilized. A smooth water class was then added to Level-2 (rough water in Level-1), and the results are shown.

A. Hierarchical MRF
The MRF-based classifier from Section II.D, along with the two-level hierarchical architecture shown in Figure 6 were used jointly to classify the test site on Bolivar Peninsula. As before, all six channels of AIRSAR data were used as inputs. The same training sites were used, yielding the same six output classes.

For the resulting classified image shown in Figure 7, the MRF model was again defined over a 3x3 neighborhood. At each level of the classifier, the iterative conditional modes (ICM) algorithm was used to minimize the MAP estimate; five iterations were required using a [beta] of 1.9. The accuracy of the hierarchical MRF-based classifier is shown in Table 1.


Figure 7. Hierarchical MRF Classified Map.


Slight overall improvement (~1%) was obtained for the test data in comparison with the single-level MRF-based classifier. The improvement in classification accuracy was mostly due to the early removal of the easily separable water class from the "water-corrected" AIRSAR data, resulting in a less complex classification process at Level-2.

B. Hierarchical MRF - Rough/Smooth Water
Some misclassification was attributed to differing backscatter from rough and smooth water, so the water class was divided into "rough water" and "smooth water". The classification process was identical to that in Part A, except that "water" was replaced by "rough water" in Level-1 and "smooth water" was added to Level-2. (The model for water-correction used to generate Figure 5 was actually applied only to "rough water".) After performing the hierarchical MRF-based classification, the two water classes were recombined. The resulting classified image is shown in Figure 8, and the classification accuracy is shown in Table 1.


Figure 8. Hierarchical MRF Classified Map.
(Rough and Smooth Water)


Only minor improvements (~0.5%) were shown for the test data. However, in examining the classified images and comparing them to the AIRSAR data in Figures 2 and 5, much improved results can be seen in the classification of water and low proximal marsh, giving credence to the use of both the hierarchical classifier and the splitting of the water class.


V. CONCLUSION


In this paper, two SAR data issues which influence the classification process of coastal environments, the presence of speckle and variation in backscatter with angle of incidence, were studied. Results from a RBF classifier applied to SAR data collected over a coastal test site were compared to output of a MRF-based classifier, which was better able to cope with the speckled imagery. In addition, a hierarchical classifier architecture based on class-specific model corrections at each classifier level was presented to account for the variation in backscatter statistics. Finally, a two-level hierarchical MRF-based classifier was applied to the same test site, and results indicated slight improvement over the single-level MRF-based classifier.

While the hierarchical classifier yielded only slight improvements in classification accuracy, the technique does show promise. In particular, significant improvements would be expected if the test site were chose to include more classes with high returns such as upland and urban classes. The distributions of backscatter for these classes tend to overlap with the near-range returns for the water class, thereby obtaining more benefit from using the "water-correction" model in Level-1. In addition, a hierarchical classifier architecture would be useful in situations where different inputs or data sets were used to discriminate classes at different levels. For example, multisensor classification of this coastal environment using both polarimetric and interferometric SAR data should be investigated. In this case, the bulk of the classification would be performed using polarimetric SAR data, while the terrain would be introduced at Level-2 to separate the land classes into environmental groupings that are affected by elevation.


REFERENCES

  1. M.C. Dobson, L.E. Pierce, and F.T. Ulaby, "Knowledge-Based Land-Cover Classification Using ERS-1/JERS-1 SAR Composites", IEEE Transactions on Geoscience and Remote Sensing, vol. 34, no. 1, pp. 83-99, January 1996.
  2. M.R. Ricard, A.L. Neuenschwander, M.M. Crawford, and J.C. Gibeaut, "Multisensor Classification of Wetland Environments Using Airborne Multispectral and SAR Data", In Proceedings of International Geoscience and Remote Sensing Symposium, vol. II, pp. 667-669, August 1997.
  3. E. Rignot and R. Chellappa, "Segmentation of Polarimetric Synthetic Aperture Radar Data", IEEE Transactions on Image Processing, vol. 1, no. 3, pp. 281-300, July 1992.
  4. A.H. Schistad Solberg, T. Taxt, and A.K. Jain, "A Markov Random Field Model for Classification of Multisource Satellite Imagery", IEEE Transactions on Geoscience and Remote Sensing, vol. 34, no. 1, pp. 100-113, January 1996.
  5. F.T. Ulaby, R.K. Moore, and A.K. Fung, Microwave Remote Sensing: Active and Passive, Volume II: Radar Remote Sensing and Surface Scattering and Emission Theory, Boston: Artech House, 1982.
  6. W.A. White, T.R. Calnan, R.A. Morton, R.S. Kimble, T.G. Littleton, J.H. McGowen, H.S. Nance, and K.E. Schmedes, Submerged Lands of Texas, Galveston-Houston Area, Bureau of Economic Geology, University of Texas at Austin, 1985.

Table 1. Classification Accuracy for Test Sets.


Probability of Correct Classification


Class


Classifier

1

2

3

4

5

6

Overall

RBF

94.0

72.7

68.9

72.3

53.9

82.0

74.1

MRF

96.4

79.0

84.4

86.1

59.8

89.9

82.6

Hierarchical MRF

97.3

78.1

86.5

87.0

61.8

91.3

83.7

Hierarchical MRF (Rough/Smooth Water)

99.5

77.9

86.5

87.0

62.4

91.3

84.1