Next Article in Journal
Aboveground-Biomass Estimation of a Complex Tropical Forest in India Using Lidar
Previous Article in Journal
Building Façade Recognition Using Oblique Aerial Images
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of Land Cover Maps in China Using a Sampling-Based Labeling Approach

1
State Key Laboratory of Resources and Environmental Information System, Institute of Geographical Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, China
2
Global Land Cover Facility, Department of Geographical Sciences, University of Maryland, College Park, MD 20742, USA
3
Guangdong Open Laboratory of Geospatial Information Technology and Application, Guangzhou Institute of Geography, Guangzhou 510070, China
4
Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application, Nanjing 210023, China
5
General Staff Information Center of Surveying and Mapping, Beijing 100088, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2015, 7(8), 10589-10606; https://doi.org/10.3390/rs70810589
Submission received: 17 July 2015 / Revised: 30 July 2015 / Accepted: 12 August 2015 / Published: 18 August 2015

Abstract

:
This paper presents a rigorous validation of five widely used global land cover products, i.e., GLCC (Global Land Cover Characterization), UMd (University of Maryland land cover product), GLC2000 (Global Land Cover 2000 project data), MODIS LC (Moderate Resolution Imaging Spectro-radiometer Land Cover product) and GlobCover (GLOBCOVER land cover product), and a national land cover map GLCD-2005 (Geodata Land Cover Dataset for year 2005) against an independent reference data set over China. The land cover reference data sets in three epochs (1990, 2000, and 2005) were collected on a web-based prototype system using a sampling-based labeling approach. Results show that, in China, the highest overall accuracy is observed in GLCD-2005 (72.3%), followed by MODIS LC (68.9%), GLC2000 (65.2%), GlobCover (57.7%) and GLCC (57.2%), while UMd has the lowest accuracy (48.6%); all of the products performed best in representing “Trees” and “Others”, well with “Grassland” and “Cropland”, but problematic with “Water” and “Urban” across China in general. Moreover, in respect of GLCD-2005, there are significant accuracy differences across seven geographical locations of China, ranging from 46.3% in the Southwest, 77.5% in the South, 79.2% in the Northwest, 80.8% in the North, 81.8% in the Northeast, 82.6% in the Central, to 89.0% in the East. This study indicates that a regionally focused land cover map would in fact be more accurate than extracting the same region from a globally produced map.

Graphical Abstract

1. Introduction

Land cover is a crucial parameter of the needed ecosystem-based information within the global change framework, which has been placed at the top of international scientific and political agendas by an increasing number of multilateral environmental agreements [1,2,3]. Vegetative covers are required as a boundary layer in a number of general circulation and carbon exchange models [4]. Accurate land cover information is therefore essential. Conventional approaches like field surveys are not effective to describe the features on the earth’s surface due to their potential limitations, e.g., time consuming, too expensive, or date-lagged [5]. Remote sensing offers a practical and economical means to acquire land cover information over large areas on account of its capacity for systematic observations at various scales [6]; consequently, it has been identified as one of the major data sources for the generation of land cover products.
The general approach of land cover mapping is to produce temporal, usually monthly composites from daily or weekly mosaics to minimize cloud cover and data noise [7]. In conjunction with other ancillary data sets, monthly composites are then used to produce land cover categories according to a defined classification scheme at a regional, continental or global scale. The first global land cover map was produced using the satellite observations from the Advanced Very High Resolution Radiometer (AVHRR) [8,9,10]. As more advanced, moderate resolution satellite sensors have emerged, i.e., Systeme Probatoire d’Observation de la Terre (SPOT), Moderate Resolution Imaging Spectro-radiometer (MODIS), and Medium Resolution Imaging Spectrometer (MERIS), the scientific community has witnessed the significant increase of available data sources for land cover mapping [11]. In the last two decades, land cover products at various scales have been generated to provide primary terrestrial baseline data sets for numerous applications [12,13,14,15,16,17,18,19,20,21]. However, significant disagreements have been found between distinct products across several land cover categories, especially forest and cropland related classes [1,22].
Various assessments on the global land cover data sets have been carried out globally or regionally [11,23,24,25,26,27]. Focusing on China, a region that presents many challenges for monitoring land cover and its dynamics, attempts at rigorous validation of global land cover products for this region have been very limited. Ran et al. [27] evaluated four 1 km global land cover products with the 1:100,000 land cover map of China as a reference data. Wu et al. [28] validated four 1 km global land cover products across China but limited to cropland. We have assessed the five global land cover data sets over China in terms of thematic comparison and consistency analysis [29]. In this paper, we will further identify the accuracies of the five widely used global land cover products and a national land cover map of China by validating against independent land cover samples, which are collected using a sampling-based land cover labeling approach for efficiently producing high accuracy reference data over large areas.

2. Data and Method

2.1. Land Cover Maps

Five global land cover maps and a national land cover map of China are assessed here:
(1)
GLCC (Global Land Cover Characterization) land cover map with 1 km spatial resolution from the IGBP (International Geosphere-Biosphere Programme) [9].
(2)
UMd land cover map with 1 km spatial resolution from the University of Maryland [15].
(3)
GLC2000 land cover map with 1 km spatial resolution from the European Commission’s Joint Research Center [13].
(4)
MODIS land cover map (MODIS LC, hereafter) with 500 m spatial resolution (V005) from NASA (National Aeronautics and Space Administration) [14,30].
(5)
GlobCover land cover map with 300 m spatial resolution from the ESA (European Space Agency) [31].
(6)
GLCD-2005 (Geodata Land Cover Dataset for year 2005) land cover map of China at a scale of 1 to 250,000 produced by the Data Sharing Infrastructure of Earth System Science [32].
The general characteristics of the six land cover maps are: (i) they were derived from different sensors, such as AVHRR, SPOT-4, MODIS, and MERIS; (ii) they were characterized by a varying number of land cover classes [17,25]; and (iii) they represented the land cover at different points in time, i.e., GLCC and UMd are in 1992–1993, GLC2000 and MODIS LC are in 2000 and 2001, and GlobCover and GLCD-2005 are in 2005.
In the validation initiatives for these maps, GLCD-2005 was assessed using field survey data [32], MODIS LC was based on a cross-validation using several subsets of the training data that had not been used for the training process as reference information [30], while the other four maps used design based sampling schemes for collecting samples interpreted from high resolution images [19,33,34,35], such as Landsat TM (Thematic Mapper), SPOT, and Google Earth. Since different approaches and reference data were used in the validation of these land cover maps, the reported accuracy measures are not comparable [7].

2.2. Data Pre-Processing

To allow comparative analysis of the above six land cover maps, two issues are addressed in the pre-processing: projection/spatial resolution unification and classification harmonization, which have been illustrated in our earlier work [29] in detail, such as Sinusoidal projection at a spatial resolution of 1 km was chosen as the common reference projection. Besides, we reclassified the six maps again into the data sets with seven land cover types on occurrence of major life forms (Table 1) here; that is, the five forest related classes and “Shrubland” were aggregated into “Trees” only and left the other classes intact.
Table 1. Aggregation of land cover classes according to major life forms (refer to [29]).
Table 1. Aggregation of land cover classes according to major life forms (refer to [29]).
Harmonized LegendLife Forms
Evergreen needleleaf forestTrees
Evergreen broadleaf forest
Deciduous needleleaf forest
Deciduous broadleaf forest
Mixed forest
Shrubland
GrasslandGrassland
CroplandCropland
WetlandWetland
WaterWater
UrbanUrban
OthersOthers

2.3. Accuracy Validation

Validation of land cover product provides indications of confidence that a pixel or segment has been correctly assigned to a thematic class [36]. Generally, four approaches are used to quantify the accuracy of land cover classifications [7]: (i) confidence values of the classifier, (ii) cross-validation with training data sets, (iii) comparison with other reference data, and (iv) sampling and acquisition of ground information, which is regarded as most reliable. Popular measures for mapping accuracy in remote sensing are based on the error matrix [37,38], which is a square array of numbers that presents summary information on units classified as map land cover class and reference class [39,40]. Three widely used parameters derived from error matrix describing the map and class specific accuracies are overall, user’s and producer’s accuracy [41]. Overall accuracy is simply the percentage of correctly classified pixels, commonly calculated as area-weighted estimates for the different classes; the user’s accuracy of a class is defined as the percentage of map area classified correctly, while the producer’s accuracy of a class relates to the percentage of validation sites classified correctly [42].
Validation of the six land cover maps across China was done in the following three major steps: sampling design, sample labeling, and accuracy estimation.

2.3.1. Sampling Design

Like accuracy assessments of all other large scale land cover maps, the constraints such as time, cost and workload lead to the fact that it is impossible to collect ground truth information through direct investigations in the vast area of China. An alternative approach for collecting land cover samples inspired by a number of earlier studies [31,43,44,45,46,47] is given in this study, i.e., a stratified random sampling based on high resolution satellite images, supplemented by ancillary data sets.
(1) Sampling strategy
Strata, known as the division of a population into smaller groups in sampling, are formed based on members’ shared attributes or characteristics in stratified random sampling [48]. Here, we defined the land cover strata based on two maps:
(i)
The per-pixel comparison result (agreement map) of the five global land cover maps (GLCC, UMd, GLC2000, MODIS LC, and GlobCover) in China, which was assigned with five levels of agreement ranging from “No agreement” to “Full agreement” (identified as 1 to 5 accordingly) (see [29]). Here, we reclassified this agreement again into two categories: “high agreement” (pixel value > 3) and “low agreement” (pixel value ≤ 3) (Figure 1).
Figure 1. Reclassified agreement map in China.
Figure 1. Reclassified agreement map in China.
Remotesensing 07 10589 g001
(ii)
The synthetical land cover map Geodata LC, which was synthesized from the five global land cover maps by voting according to the majority criteria in terms of life forms in Table 1. If the accumulated number of votes for a pixel is more than three among the five global land cover maps, then the final type of this pixel in Geodata LC is the majority class of the corresponding pixel in the five maps. Supposing that the total number of voting is less than three on a pixel among the compared maps, the land cover type of this pixel in Geodata LC is set to be the corresponding class in MODIS LC.
The reclassified agreement map and Geodata LC were then overlaid to produce the land cover strata for sampling, and finally 14 strata were generated (two agreement levels × seven land cover classes).
Within land cover strata, samples were selected using following criteria:
(a)
Sample size depends on the area of the strata, in that larger sample sizes are allocated to larger strata.
(b)
To increase the sample size in the “low agreement” strata, the sampling probability of “low agreement” is set to be ten times that of the “high agreement”.
(c)
Sample size of each land cover class was controlled under Geodata LC, avoiding the case that the sample size of one class is too excessive while another class is too little.
The sample units were 1 km, and samples were interpreted based on the maximum area rule in each sample unit.
(2) Calculating weight
The inclusion probability of the samples in each stratum was different due to the above criteria. Although it ensures enough samples were collected to represent each stratum, it would lead to bias when validating a land cover data with samples collected from different strata. Weight is calculated for each sample to correct the sampling bias (Equation (1)).
W s = ( 1 / N t ) × ( N s , t / N p )
Where Ws is the weight for sample s, Nt is the number of samples in strata t, Ns,t is the total pixels of strata t that sample s located, and Np is the total sampling pixels (here is the total number of pixels in the area of China).

2.3.2. Sample Labeling

In our study, we utilized the method of interpreting land cover types at samples (Figure 2), which is mainly based on high resolution images, aided by other auxiliary information like pictures, charts, and records, etc.
Figure 2. Interpreting land cover types at samples collected in a given area [49].
Figure 2. Interpreting land cover types at samples collected in a given area [49].
Remotesensing 07 10589 g002
The interpretation process of land cover types at samples collected in a given area was performed using following reference data sources:
(i)
Landsat images from the three epochs (1990, 2000, and 2005) provided by the Global Land Survey (GLS) [50,51,52,53,54],
(ii)
Yearly NDVI (Normalized Difference Vegetation Index) variation profile derived from the eight-day composited MODIS Surface Reflectance products (MOD09A1) after cloud and shadow masking, and
(iii)
Google Maps, and photos collected by Panoramio [55].
Collecting data was done by 21 image analysts who have experience in remote sensing image interpretation. Initially, 18 of the 21 analysts performed the interpretation, and the results were passed to another interpreter for cross-checking. Then, cross-checked interpretation results were submitted to one of the three quality controllers, who are familiar with land cover types of China, for final checking.

2.3.3. Accuracy Estimation

Land cover samples collected on the online system were applied to the accuracy validation of the five global and a national land cover maps in China, and error matrixes were calculated with the weighted samples. The detailed information of measurements retrieved from error matrix, including overall accuracy (OA), user’s accuracy (UA), and producer’s accuracy (PA), is available in [56].

3. Results

Figure 3 presents the distribution of land cover samples in China. A total of 9000 samples were collected, 3000 samples in each individual year (1990, 2000, and 2005). Subsequently, GLCC and UMd pair, GLC2000 and MODIS LC pair, and GlobCover and GLCD-2005 pair were evaluated using 3000 samples in 1990, 2000, and 2005 separately.
Figure 3. The distribution of land cover samples collected in China.
Figure 3. The distribution of land cover samples collected in China.
Remotesensing 07 10589 g003

3.1. Validation of Six Land Cover Maps in China

A summary of error matrixes between each map pair and land cover samples is given in Table 2, Table 3 and Table 4 separately. Overall accuracies of the six land cover maps across China are GLCD-2005 (72.3%), MODIS LC (68.9%), GLC2000 (65.2%), GlobCover (57.7%), GLCC (57.2%), and UMd (48.6%) in the descending order. Both user’s and producer’s accuracies of life forms vary considerably. It should be known that accuracy of ‘Wetland’ is not considered here.
Table 2. Summary of error matrixes for GLCC (Global Land Cover Characterization), UMd (University of Maryland land cover product) in China.
Table 2. Summary of error matrixes for GLCC (Global Land Cover Characterization), UMd (University of Maryland land cover product) in China.
YearLife FormsNumberGLCCUMd
UA (%)PA (%)UA (%)PA (%)
1990Trees128774.848.180.453.4
Grassland65473.067.248.752.7
Cropland28151.972.156.351.7
Water3239.738.145.941.4
Urban16Nodata0Nodata0
Others73098.449.794.642.0
OA (%)57.248.6
Table 3. Summary of error matrixes for GLC2000 (Global Land Cover 2000 project data), MODIS LC (Moderate Resolution Imaging Spectro-radiometer Land Cover product) in China.
Table 3. Summary of error matrixes for GLC2000 (Global Land Cover 2000 project data), MODIS LC (Moderate Resolution Imaging Spectro-radiometer Land Cover product) in China.
YearLife FormsNumberGLC2000MODIS LC
UA (%)PA (%)UA (%)PA (%)
2000Trees129380.269.283.772.9
Grassland65451.558.471.362.2
Cropland27061.964.166.669.3
Water3247.437.952.143.7
Urban210048.641.2
Others73083.472.192.473.3
OA (%)65.268.9
Table 4. Summary of error matrixes for GlobCover (GLOBCOVER land cover product), and a national land cover map GLCD-2005 (Geodata Land Cover Dataset for year 2005) in China.
Table 4. Summary of error matrixes for GlobCover (GLOBCOVER land cover product), and a national land cover map GLCD-2005 (Geodata Land Cover Dataset for year 2005) in China.
YearLife FormsNumberGlobCoverGLCD-2005
UA (%)PA (%)UA (%)PA (%)
2005Trees129382.855.690.070.9
Grassland65545.033.359.278.0
Cropland26938.770.090.080.8
Water3252.646.746.656.9
Urban2372.915.588.876.4
Others72883.174.690.964.1
OA (%)57.772.3
From the user’s point of view, life form classes with accuracy of more than 50% are (Figure 4):
(i)
“Trees” and “Others” in all of the six land cover maps,
(ii)
“Grassland” in GLCC, GLC2000, MODIS LC and GLCD-2005,
(iii)
“Cropland” in the all of the six maps except GlobCover,
(iv)
“Water” in MODIS LC and GlobCover, and
(v)
“Urban” in GlobCover and GLCD-2005.
From the producer’s aspect, life form classes with accuracy of more than 50% are (Figure 5):
(i)
“Trees” in all of the six land cover maps except GLCC,
(ii)
“Grassland” in all of the six maps except GlobCover,
(iii)
“Cropland” in all of the six maps,
(iv)
“Water” and “Urban” only in GLCD-2005, and
(v)
“Others” in all of the six maps except GLCC and UMd.
Figure 4. User’s accuracy of the six land cover maps with life forms in China.
Figure 4. User’s accuracy of the six land cover maps with life forms in China.
Remotesensing 07 10589 g004
Figure 5. Producer’s accuracy of the six land cover maps with life forms in China.
Figure 5. Producer’s accuracy of the six land cover maps with life forms in China.
Remotesensing 07 10589 g005
In general, the validation results indicate that the six land cover maps performed best in representing “Trees” and “Others”, well with “Grassland” and “Cropland”, whereas problematic with “Water” and “Urban” particularly over China.

3.2. Validation of GLCD-2005 in Geographical Regions of China

To understand the accuracy discrepancies of GLCD-2005 in different regions, we further assessed its accuracy across seven geographical locations of China (Figure 6), including:
(a)
East: Shanghai, Jiangsu, Zhejiang, Anhui, Fujian, Jiangxi, Shandong, and Taiwan.
(b)
Central: Henan, Hubei, and Hunan.
(c)
Northeast: Heilongjiang, Jilin, and Liaoning.
(d)
North: Beijing, Tianjin, Hebei, Shanxi, and Inner Mongolia.
(e)
Northwest: Shannxi, Gansu, Qinghai, Ningxia, and Xinjiang.
(f)
South: Guangdong, Guangxi, Hainan, Hongkong, and Macau.
(g)
Southwest: Chongqing, Guizhou, Sichuan, Yunnan, and Tibet.
Figure 6. Geographical locations of regions and provinces in China.
Figure 6. Geographical locations of regions and provinces in China.
Remotesensing 07 10589 g006
The detailed information for land cover types of samples in each region are shown in Table 5, and the validation results are presented in Figure 7, Figure 8 and Figure 9. At the regional scale, the highest overall accuracy of GLCD-2005 is observed in East of China (89.0%), followed by Central (82.6%), Northeast (81.8%), North (80.8%), Northwest (79.2%) and South of China (77.5%); while GLCD-2005 in the Southwest of China gets the lowest overall accuracy (46.3%), which is expected as this region is mainly geomorphologically mountainous terrains with much more complex landscapes and dominated by highly fragmented land cover types. Besides, in terms of each land cover class, both “Trees” and “Cropland” in the GLCD-2005 are presented quite well in the seven geographical locations; whereas “Water” is problematic particularly in the Northwest of China, although the sampling data is not strictly thorough enough to take equal consideration for every land cover type in each region.
Table 5. Land cover types of sample distributed in each region (“Y” means “type-included”, “N” means “not type-included”). The number in brackets refers to the sum of samples in each region.
Table 5. Land cover types of sample distributed in each region (“Y” means “type-included”, “N” means “not type-included”). The number in brackets refers to the sum of samples in each region.
Life FormsEast (263)Central (132)Northeast (328)North (454)Northwest (686)South (202)Southwest (935)
TreesYYYYYYY
GrasslandYYYYYYY
CroplandYYYYYYY
UrbanYYYYNYN
Wetland/WaterYYYYYNY
BarrenNNYYYNY
Figure 7. Overall accuracy for GLCD-2005 over seven geographical regions of China.
Figure 7. Overall accuracy for GLCD-2005 over seven geographical regions of China.
Remotesensing 07 10589 g007
Figure 8. User’s accuracy for GLCD-2005 over seven geographical regions of China.
Figure 8. User’s accuracy for GLCD-2005 over seven geographical regions of China.
Remotesensing 07 10589 g008
Figure 9. Producer’s accuracy for GLCD-2005 over seven geographical regions of China.
Figure 9. Producer’s accuracy for GLCD-2005 over seven geographical regions of China.
Remotesensing 07 10589 g009

4. Discussion

This study reveals that there were significant accuracy differences among the one national and five global land cover maps when compared in China. Moreover, for the five global land cover maps, the validation results show relatively lower overall accuracies in China than those in the globe. Many factors could potentially affect the final validation results.
Factors embedded in each land cover map from the very beginning of its generation should firstly be paid attention to, mainly referred to remote sensors, and classification methods. Time acquisition cannot be the primary factor since we assessed the accuracy of land cover map pair against with samples collected in the same year. There were substantial accuracy differences between GLCC and UMd, as well as GlobCover and GLCD-2005. GLC2000 and MODIS LC got the higher accuracy compared with GlobCover, although significant improvements in sensor and data processing approach had been used. In addition, GLCD-2005 has the highest accuracy among the compared maps in this study; it was mainly due to the classification method and high accuracy reference data sets adopted at China regional scale.
Furthermore, accuracy assessment of land cover maps has always been tightly tied with reference data, i.e., “true” land cover type [57], and the quality and availability of adequate validation data sets have been known as the most limited factors for land cover evaluation. In this study, it is not thorough enough to take equal consideration for each land cover type, although a collection of 3000 validation sites per year was applied to assess the maps. Besides, it is necessary to mention that the validation sites collected with a stratified random sampling were exclusively designed for this study, in that the reclassified agreement map and Geodata LC were based on.

5. Conclusions

Accuracy assessment has always been emphasized by researchers for its importance to scientific investigations and policy makings based on land cover information [58]. Our study used a sampling-based labeling approach to assess the accuracies of the five global and a national land cover maps (i.e., GLCC, UMd, GLC2000, MODIS LC, GlobCover, and GLCD-2005) in China, all of which were created for providing the needed ecosystem information of global change research but were based on different remotely sensed data and classification methods.
The rigorous validation for the six land cover maps over China suggests that a regionally focused land cover map would in fact be more accurate than extracting the same region from a globally produced map, which is proved strongly by the result that the overall accuracies among the six maps vary from 48.6% to 72.3%; they were UMd, GLCC, GlobCover, GLC2000, MODIS LC, and GLCD-2005 in ascending order. The differences in user’s and producer’s accuracies for each life form class among the six maps were substantial. However, all of the six land cover maps performed best in representing “Trees” and “Others”, well with “Grassland” and “Cropland”, but problematic with “Water” and “Urban” over China in general. For GLCD-2005, there are significant differences between the accuracies of the maps across different regions, ranging from 46.3% in the Southwest (lowest) to 89.0% in the East (highest) of China; “Trees” and “Cropland" in the maps are presented quite well in all seven geographical locations compared with the other five classes.
The approach of interpreting land cover types at samples presented here can be used for identifying land cover types at a sample of locations distributed across a given area efficiently, and the accuracy of the interpreted land cover data is maximized by associating the sample locations with multiple sources of input, such as Landsat images acquired in different seasons and epochs, high-resolution images from Google Maps, and in situ ground photos from web sources [49]. The approach can also be adopted for continental and global land cover research activities. In the next work, we would use this sampling-based labeling approach to investigate the accuracy of land cover maps produced recently and (or) with high resolution, like GLCNMO (Global Land Cover by National Mapping Organizations) [59], FROM-GLC (Finer Resolution Observation and Monitoring of Global Land Cover) [44], and GlobeLand30 (Global land cover dataset with 30 m spatial resolution) [60].

Acknowledgments

This work was funded by the China Postdoctoral Science Foundation (No. 2014M550816), and the Earth System Science Data Sharing Infrastructure of National Science and Technology Infrastructure (NSTI) of China (No. 2005DKA32300). We thank the Global Land Cover Facility (GLCF) (http://www.landcover.org/) for the Landsat data, and thank the National Data Sharing Infrastructure of Earth System Science for providing GLCD-2005 (http://www2.geodata.cn/).

Author Contributions

Yan Bai drafted the manuscript and was responsible for the data processing and results analysis. Min Feng reviewed the manuscript and was responsible for the research design and technical support. Hao Jiang and Yingzhen Liu supported sample collection. Juanle Wang provided useful suggestions on research design and accuracy validation. All of the authors contributed to editing and reviewing the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. McCallum, I.; Obersteiner, M.; Nilsson, S.; Shvidenko, A. A spatial comparison of four satellite derived 1km global land cover datasets. Int. J. Appl. Earth Observ. Geoinf. 2006, 8, 246–255. [Google Scholar] [CrossRef]
  2. Mitchell, R.B. International environmental agreements: A survey of their features, formation, and effects. Annu. Rev. Env. Resour. 2003, 28, 429–461. [Google Scholar] [CrossRef]
  3. Earth Observation for Biodiversity Monitoring: A Review of Current Approaches and Future Opportunities for Tracking Progress towards the Aichi Biodiversity Targets. Available online: http://www.eubon.eu/news/10842_Earth%20Observation%20for%20Biodiversity%20Monitoring:%20A%20review%20of%20current%20approaches%20and%20future%20opportunities%20for%20tracking%20progress%20towards%20the%20Aichi%20Biodiversity%20Targets (accessed on 24 March 2014).
  4. Sellers, P.J.; Dickinson, R.E.; Randall, D.A.; Betts, A.K.; Hall, F.G.; Berry, J.A.; Collatz, G.J.; Denning, A.S.; Mooney, H.A.; Nobre, C.A.; et al. Modeling the exchanges of energy, water, and carbon between continents and the atmosphere. Science 1997, 275, 502–509. [Google Scholar] [CrossRef] [PubMed]
  5. Townshend, J.; Justice, C.; Li, W.; Gurney, C.; McManus, J. Global land cover classification by remote sensing: Present capabilities and future possibilities. Remote Sens. Environ. 1991, 35, 243–255. [Google Scholar] [CrossRef]
  6. Xie, Y.; Sha, Z.; Yu, M. Remote sensing imagery in vegetation mapping: A review. J. Plant. Ecol. 2008, 1, 9–23. [Google Scholar] [CrossRef]
  7. Jung, M.; Henkel, K.; Herold, M.; Churkina, G. Exploiting synergies of global land cover products for carbon cycle modeling. Remote Sens. Environ. 2006, 101, 534–553. [Google Scholar] [CrossRef]
  8. Loveland, T.R.; Belward, A.S. The international geosphere biosphere programme data and information system global land cover data set (discover). Acta Astronaut. 1997, 41, 681–689. [Google Scholar] [CrossRef]
  9. Loveland, T.R.; Reed, B.C.; Brown, J.F.; Ohlen, D.O.; Zhu, Z.; Yang, L. Development of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data. Int. J. Remote Sens. 2000, 21, 1303–1330. [Google Scholar] [CrossRef]
  10. Loveland, T.R.; Belward, A.S. The IGBP-DIS global 1km land cover data set, DISCover: First results. Int. J. Remote Sens. 1997, 18, 3289–3295. [Google Scholar] [CrossRef]
  11. Tchuenté, A.T.K.; Roujean, J.L.; De Jong, S.M. Comparison and relative quality assessment of the GLC2000, GLOBCOVER, MODIS and ECOCLIMAP land cover data sets at the African continental scale. Int. J. Appl. Earth Observ. Geoinf. 2011, 13, 207–219. [Google Scholar] [CrossRef]
  12. Arino, O.; Gross, D.; Ranera, F.; Bourg, L.; Leroy, M.; Bicheron, P.; Latham, J.; di Gregorio, A.; Brockman, C.; Witt, R.; et al. GlobCover: ESA service for Global Land Cover from MERIS. In Proceedings of the 2007 International Geoscience and Remote Sensing Symposium, Barcelona, Spain, 23–28 July 2007; pp. 2412–2415.
  13. Bartholome, E.; Belward, A. GLC2000: A new approach to global land cover mapping from Earth observation data. Int. J. Remote Sens. 2005, 26, 1959–1977. [Google Scholar] [CrossRef]
  14. Friedl, M.A.; Mclver, D.K.; Hodges, J.C.; Zhang, X.Y.; Muchoney, D.; Strahler, A.H.; Woodcock, C.E.; Gopal, S.; Schneider, A.; Cooper, A.; et al. Global land cover mapping from MODIS: algorithms and early results. Remote Sens. Environ. 2002, 83, 287–302. [Google Scholar] [CrossRef]
  15. Hansen, M.C.; Defries, R.S.; Townshend, J.R.G.; Sohlberg, R. Global land cover classification at 1 km spatial resolution using a classification tree approach. Int. J. Remote Sens. 2000, 21, 1331–1364. [Google Scholar] [CrossRef]
  16. Liu, J.; Zhuang, D.; Zhang, Z.; Gao, Z.; Deng, X. The establishment of land-use spatial-temporal database and its relative studies in China. Geoinf. Sci. 2002, 4, 3–7. [Google Scholar]
  17. Lu, L.; Kuenzer, C.; Guo, H.; Li, Q.; Long, T.; Li, X. A novel land cover classification map based on a modis time-series in Xinjiang, China. Remote Sens. 2014, 6, 3387–3408. [Google Scholar] [CrossRef]
  18. Mayaux, P.; Bartholomé, E.; Fritz, S.; Belward, A. A new land-cover map of Africa for the year 2000. J. Biogeogr. 2004, 31, 861–877. [Google Scholar] [CrossRef]
  19. Mayaux, P.; Strahler, A.; Eva, H.; Herold, M.; Shefali, A.; Naumov, S. Validation of the global land cover 2000 map. IEEE Trans. Geosci. Remote Sens. 2006, 44, 1728–1739. [Google Scholar] [CrossRef]
  20. Nowak, D.; Greenfield, E. Evaluating the national land cover database tree canopy and impervious cover estimates across the conterminous United States: A comparison with photo-interpreted estimates. J.Environ. Manage. 2010, 46, 378–390. [Google Scholar] [CrossRef] [PubMed]
  21. Zhao, Y.S.; Liao, A.P.; Chen, L.J. The creation of national land cover database in china. Sci. Surv. Map. 2007, 32, 138–140. [Google Scholar]
  22. Fritz, S.; See, L. Identifying and quantifying uncertainty and spatial disagreement in the comparison of global land cover for different applications. Glob. Chang. Biol. 2008, 14, 1057–1075. [Google Scholar] [CrossRef]
  23. Comparison and Validation of Five Land Cover Products over the African Continent. Available online: http://www.natgeo.lu.se/ex-jobb/exj_195.pdf (accessed on 18 July 2015).
  24. Fritz, S.; See, L.; Rembold, F. Comparison of global and regional land cover maps with statistical information for the agricultural domain in Africa. Int. J. Remote Sens. 2010, 31, 2237–2256. [Google Scholar] [CrossRef]
  25. Kuenzer, C.; Leinenkugel, P.; Vollmuth, M.; Dech, S. Comparing global land-cover products—Implications for geoscience applications: An investigation for the trans-boundary mekong basin. Int. J. Remote Sens. 2014, 35, 2752–2779. [Google Scholar] [CrossRef]
  26. Latifovic, R.; Olthof, I. Accuracy assessment using sub-pixel fractional error matrices of global land cover products derived from satellite data. Remote Sens. Environ. 2004, 90, 153–165. [Google Scholar] [CrossRef]
  27. Ran, Y.; Li, X.; Lu, L. Evaluation of four remote sensing based land cover products over China. Int. J. Remote Sens. 2010, 31, 391–401. [Google Scholar] [CrossRef]
  28. Wu, W.; Shibasaki, R.; Yang, P.; Ongaro, L.; Zhou, Q.; Tang, H. Validation and comparison of 1 km global land cover products in China. Int. J. Remote Sens. 2008, 29, 3769–3785. [Google Scholar] [CrossRef]
  29. Bai, Y.; Feng, M.; Jiang, H.; Wang, J.; Zhu, Y.; Liu, Y. Assessing consistency of five global land cover data sets in China. Remote Sens. 2014, 6, 8739–8759. [Google Scholar] [CrossRef]
  30. Friedl, M.A.; Sulla-Menashe, D.; Tan, B.; Schneider, A.; Ramankutty, N.; Sibley, A.; Huang, X. Modis collection 5 global land cover: Algorithm refinements and characterization of new datasets. Remote Sens. Environ. 2010, 114, 168–182. [Google Scholar] [CrossRef]
  31. Bicheron, P.; Defourny, P.; Brockman, C.; Schouten, L.; Vancutsem, C.; Huc, M.; Bontemps, S.; Leroy, A.; Achard, F.; Herold, M.; et al. Globcover: Product Description and Validation Report. Available online: http://publications.jrc.ec.europa.eu/repository/handle/JRC49240 (accessed on 18 July 2015).
  32. Zhang, Z.; Wang, X.; Wang, C.; Zuo, L.; Wen, Q.; Dong, T.; Zhao, X.; Liu, B.; Yi, L. National land cover mapping by remote sensing under the control of interpreted data. J. Geoinf. Sci. 2009, 11, 216–224. [Google Scholar] [CrossRef]
  33. Defries, R.S.; Hansen, M.; Townshend, J.R.G.; Sohlberg, R. Global land cover classifications at 8 km spatial resolution: The use of training data derived from Landsat imagery in decision tree classifiers. Int. J. Remote Sens. 1998, 19, 3141–3168. [Google Scholar] [CrossRef]
  34. Scepan, J. Thematic validation of high-resolution global land-cover data sets. Photogramm. Eng. Rem. Sens. 1999, 65, 1051–1060. [Google Scholar]
  35. Strahler, A.; Boschetti, L.; Foody, G.; Friedl, M.; Hansen, M.; Herold, M.; Mayaux, P.; Morisette, J.; Stehman, S.; Woodcock, C. Global Land Cover Validation: Recommendations for Evaluation And Accuracy Assessment of Global Land Cover Maps. Available online: http://159.226.251.230/videoplayer/GlobalLandCoverValidation.pdf?ich_u_r_i=d828839f030b9388e43469edb5cb240c&ich_s_t_a_r_t=0&ich_e_n_d=0&ich_k_e_y=1545088906750763552478&ich_t_y_p_e=1&ich_d_i_s_k_i_d=3&ich_u_n_i_t=1 (accessed on 18 July 2015).
  36. Scepan, J.; Estes, J.E.; Starmer, W.J. Accuracy analysis and validation of global 1 km land cover data sets. In Proceedings of the Geoscience and Remote Sensing Symposium, Lincoln, NE, USA, 27–31 May 1996; pp. 198–200.
  37. Lillesand, M.T.; Kiefer, W.R.; Chipman, W.J. Digital image processing. In Remote Sensing and Image Interpretation; John Wiley & Sons: New Jersey, NJ, USA, 2004; pp. 586–593. [Google Scholar]
  38. Stehman, S.V. Sampling designs for accuracy assessment of land cover. Int. J. Remote Sens. 2009, 30, 5243–5272. [Google Scholar] [CrossRef]
  39. Lewis, H.G.; Brown, M. A generalized confusion matrix for assessing area estimates from remotely sensed data. Int. J. Remote Sens. 2001, 22, 3223–3235. [Google Scholar] [CrossRef]
  40. Stehman, S.V.; Arora, M.K.; Kasetkasem, T.; Varshney, P.K. Estimation of fuzzy matrix accuracy measures under stratified random sampling. Photogramm. Eng. Remote Sens. 2007, 73, 165–173. [Google Scholar] [CrossRef]
  41. Foody, G.M. Status of land cover classification accuracy assessment. Remote Sens. Environ. 2002, 80, 185–201. [Google Scholar] [CrossRef]
  42. Bo, Y.; Wang, J. Assessment on uncertainty in remotely sensed data classification: Progresses, problems and prospects. Adv. Earth Sci. 2005, 20, 1218–1225. [Google Scholar]
  43. Gong, P. Accuracies of global land cover maps checked against fluxnet sites. Sci. Found. China 2008, 16, 31–35. [Google Scholar] [CrossRef]
  44. Gong, P.; Wang, J.; Yu, L.; Zhao, Y.; Zhao, Y.; Liang, L.; Niu, Z.; Huang, X.; Fu, H.; Liu, S.; et al. Finer resolution observation and monitoring of global land cover: First mapping results with Landsat TM and ETM+ data. Int. J. Remote Sens. 2013, 34, 2607–2654. [Google Scholar] [CrossRef]
  45. Iwao, K.; Nishida, K.; Kinoshita, T.; Yamagata, Y. Validating land cover maps with degree confluence project information. Geophys. Res. Lett. 2006, 33. [Google Scholar] [CrossRef]
  46. Kloditz, C.; Van Boxtel, A.; Carfagna, E.; Van Deursen, W. Estimating the accuracy of coarse scale classifications using high scale information. Photogramm. Eng. Remote Sens. 1998, 62, 127–133. [Google Scholar]
  47. Ning, J.; Zhang, S.; Cai, H.; Bu, K. A comparative analysis of the modis land cover data sets and globcover land cover data sets in Heilongjiang Basin. J. Geoinf. Sci. 2012, 14, 240–249. [Google Scholar] [CrossRef]
  48. Yates, F. Sampling Methods for Censuses and Surveys; Macmillan: London, UK, 1981. [Google Scholar]
  49. Feng, M.; Huang, C.; Sexton, J.O.; Channan, S.; Narasimhan, R.; Townshend, J.R. An approach for quickly labeling land cover types for multiple epochs at globally selected locations. In Proceedings of the Geoscience and Remote Sensing Symposium, Munich, Germany, 22–27 July 2012; pp. 6203–6206.
  50. Feng, M.; Huang, C.; Channan, S.; Vermote, E.F.; Masek, J.G.; Townshend, J.R. Quality assessment of Landsat surface reflectance products using MODIS data. Comput. Geosci. 2012, 38, 9–22. [Google Scholar] [CrossRef]
  51. Feng, M.; Sexton, J.O.; Huang, C.; Masek, J.G.; Vermote, E.F.; Gao, F.; Narasimhan, R.; Channan, S.; Wolfe, R.E.; Townshend, J.R. Global surface reflectance products from Landsat: Assessment using coincident modis observations. Remote Sens. Environ. 2013, 134, 276–293. [Google Scholar] [CrossRef]
  52. Franks, S.; Masek, J.; Headley, R.; Gasch, J.; Covington, S.; Arvidson, T. Large area scene selection interface (LASSI): Methodology of selecting Landsat imagery for the global land survey 2005. Photogramm. Eng. Remote Sens. 2009, 75, 1287–1296. [Google Scholar] [CrossRef]
  53. Gutman, G.; Byrnes, R.; Masek, J. Towards monitoring land-cover and land-use changes at a global scale: The global land survey 2005. Photogramm. Eng. Remote Sens. 2008, 74, 6–10. [Google Scholar]
  54. Gutman, G.; Huang, C.; Chander, G.; Noojipady, P.; Masek, J.G. Assessment of the NASA–USGS global land survey (GLS) datasets. Remote Sens. Environ. 2013, 134, 249–265. [Google Scholar] [CrossRef]
  55. Google Maps. Available online: http://www.panoramio.com/ (accessed on 18 July 2015).
  56. Stehman, S.V. Estimating area and map accuracy for stratified random sampling when the strata are different from the map classes. Int. J. Remote Sens. 2014, 35, 4923–4939. [Google Scholar] [CrossRef]
  57. Muchoney, D.M.; Borak, J.; Strahler, A. Global Land Cover Classification Training and Validation Issues and Requirements. Available online: http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=516301&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D516301 (accessed on 18 July 2015).
  58. Stehman, S.V.; Czaplewski, R.L. Design and analysis for thematic map accuracy assessment: Fundamental principles. Remote Sens. Environ. 1998, 64, 331–344. [Google Scholar] [CrossRef]
  59. Tateishi, R.; Uriyangqai, B.; Al-Bilbisi, H.; Ghar, M.A.; Tsend-Ayush, J.; Kobayashi, T.; Kasimu, A.; Hoan, N.T.; Shalaby, A.; Alsaaideh, B.; et al. Production of global land cover data—GLCNMO. Int. J. Digit. Earth 2010, 4, 22–49. [Google Scholar] [CrossRef]
  60. Chen, J.; Chen, J.; Liao, A.; Cao, X.; Chen, L.; Chen, X.; He, C.; Han, G.; Peng, S.; Lu, M.; et al. Global land cover mapping at 30 m resolution: A pok-based operational approach. ISPRS J. Photogramm. Remote Sens. 2015, 103, 7–27. [Google Scholar] [CrossRef]

Share and Cite

MDPI and ACS Style

Bai, Y.; Feng, M.; Jiang, H.; Wang, J.; Liu, Y. Validation of Land Cover Maps in China Using a Sampling-Based Labeling Approach. Remote Sens. 2015, 7, 10589-10606. https://doi.org/10.3390/rs70810589

AMA Style

Bai Y, Feng M, Jiang H, Wang J, Liu Y. Validation of Land Cover Maps in China Using a Sampling-Based Labeling Approach. Remote Sensing. 2015; 7(8):10589-10606. https://doi.org/10.3390/rs70810589

Chicago/Turabian Style

Bai, Yan, Min Feng, Hao Jiang, Juanle Wang, and Yingzhen Liu. 2015. "Validation of Land Cover Maps in China Using a Sampling-Based Labeling Approach" Remote Sensing 7, no. 8: 10589-10606. https://doi.org/10.3390/rs70810589

APA Style

Bai, Y., Feng, M., Jiang, H., Wang, J., & Liu, Y. (2015). Validation of Land Cover Maps in China Using a Sampling-Based Labeling Approach. Remote Sensing, 7(8), 10589-10606. https://doi.org/10.3390/rs70810589

Article Metrics

Back to TopTop