Journal topic
The Cryosphere, 13, 511–519, 2019
https://doi.org/10.5194/tc-13-511-2019
The Cryosphere, 13, 511–519, 2019
https://doi.org/10.5194/tc-13-511-2019

Brief communication 12 Feb 2019

Brief communication | 12 Feb 2019

# Brief communication: Evaluation and inter-comparisons of Qinghai–Tibet Plateau permafrost maps based on a new inventory of field evidence

Brief communication: Evaluation and inter-comparisons of Qinghai–Tibet Plateau permafrost maps based on a new inventory of field evidence
Bin Cao1,2, Tingjun Zhang1, Qingbai Wu3, Yu Sheng3, Lin Zhao4, and Defu Zou5 Bin Cao et al.
• 1Key Laboratory of Western China's Environmental Systems (Ministry of Education), College of Earth and Environmental Sciences, Lanzhou University, Lanzhou 730000, China
• 2Department of Geography & Environmental Studies, Carleton University, Ottawa K1S 5B6, Canada
• 3State Key Laboratory of Frozen Soil Engineering, Cold and Arid Regions Environmental and Engineering Research Institute, Chinese Academy of Sciences, Lanzhou 730000, China
• 4School of Geographical Sciences, Nanjing University of Information Science and Technology, Nanjing 210044, China
• 5Cryosphere Research Station on the Qinghai–Tibet Plateau, State Key Laboratory of Cryospheric Science, Cold and Arid Regions Environmental and Engineering Research Institute, Chinese Academy of Sciences, Lanzhou 730000, China

Correspondence: Tingjun Zhang (tjzhang@lzu.edu.cn)

Abstract

Many maps have been produced to estimate permafrost distribution over the Qinghai–Tibet Plateau (QTP), but the errors and biases among them are poorly understood due to limited field evidence. Here we evaluate and inter-compare the results of six different QTP permafrost maps with a new inventory of permafrost presence or absence comprising 1475 field sites compiled from various sources. Based on the in situ measurements, our evaluation results showed a wide range of map performance, with Cohen's kappa coefficient from 0.21 to 0.58 and an overall accuracy between about 55 % and 83 %. The low agreement in areas near the boundary between permafrost and non-permafrost and in spatially highly variable landscapes highlights the need for improved mapping methods that consider more controlling factors at both medium–large and local scales.

1 Introduction

Permafrost is one of the major components of the cryosphere due to its large spatial extent. The Qinghai–Tibet Plateau (QTP), also known as the Third Pole, has the largest extent of permafrost in the low–middle latitudes. Permafrost over the QTP was reported to be sensitive to climate change mainly due to high ground temperature ($>-\mathrm{2}$C) , and its distribution has strong influences on hydrological processes (e.g. ), biogeochemical processes (e.g. ), and human systems (e.g. ).

Many approaches have been used to produce permafrost distribution and ground ice condition maps at different scales over the QTP . Typically, these maps classify frozen ground into permafrost and seasonally frozen ground, and information on the extent, such as the areal abundance, of permafrost is available for some of them . These maps significantly improved the understanding of permafrost distribution over the QTP. However, limited in situ measurements and the different classification systems and compilation approaches used make it challenging to compare maps directly. With the availability of high-resolution spatial datasets (e.g. surface air temperature and land surface temperature), several empirical and (semi-)physical models have been applied in permafrost distribution simulations at fine scales (e.g. ). The QTP has also been included in hemispheric or global maps including the Circum-Arctic Map of Permafrost and Ground-Ice Conditions produced by the International Permafrost Association (denoted as the IPA map) and the global permafrost zonation index (PZI) map (denoted as the PZIglobal map) derived by .

Despite the increasing efforts in mapping QTP permafrost, the maps have not been evaluated and inter-compared with the large amount of evidence of permafrost presence or absence. These data have been collected since the 2000s and represent a number of different field techniques including ground temperature measurements, soil pits, and geophysics. A new inventory of this field evidence provides an opportunity to improve the evaluation of the existing permafrost maps. This is an important step in describing the current body of knowledge on permafrost mapping performance as well as identifying any possible bias. It is also critical for identifying priorities when updating these maps in the future. Additionally, an improved evaluation is a useful guide to selecting a map to use for permafrost and related studies, such as setting boundary conditions for eco-hydrological model simulations. Climate change and increasing infrastructure construction on permafrost add both environmental and engineering relevance to investigating permafrost distribution and increase the importance of evaluating and comparing existing permafrost maps.

In this study, we aim to

1. provide the first inventory of evidence of permafrost presence or absence for the QTP; and

2. use the inventory to evaluate and inter-compare existing permafrost maps of the QTP.

2 Data and methods

## 2.1 Inventory of permafrost presence or absence evidence

Four methods were used to acquire evidence of permafrost presence or absence: borehole temperature (BH), soil pit (SP), ground surface temperature (GST), and ground-penetrating radar (GPR) surveys (Fig. 1, Table 1). In this study, we used the mean ground temperatures (MGTs) measured from the boreholes, the depths of which vary from a few metres to about 20 m depending on the depth of zero annual amplitude and borehole depth, to identify permafrost presence or absence. At SP sites, the presence of ground ice was used to indicate permafrost presence. However, due to the prevalence of coarse soil, there are only six SP sites and the depths range from less than 1 to about 2.5 m. Thermal offset, here defined as the mean annual temperature at the top of permafrost (TTOP) minus the mean annual ground surface temperature (MAGST) at a depth of 0.05 or 0.1 m, was used to estimate permafrost presence or absence for sites with only GST available. Although it is spatially variable depending on soil and temperature conditions, the magnitude of the thermal offset is small on the QTP compared with northern, high-latitude environments due to the prevalent coarse soil and low soil moisture content. The maximum thermal offset under natural conditions reported for the QTP is 0.79 C (denoted as the maximum thermal offset, TOmax) . In this study, sites with $\mathrm{MAGST}+{\mathrm{TO}}_{max}$ 0 C are considered to be permafrost sites. The reversed thermal offset reported on the QTP was not considered here because thermal offset measurements are not available for all sites, and the influence of the reversed thermal offset is expected to be minimal due to its small magnitude (the value was reported as −0.07C by ). GPR data are from and were measured in 2014 between late September and November using 100 and 200 MHz antennas. The GPR survey depth is from about 0.8 to nearly 5 m depending on the active layer thickness. The data were carefully processed by removing opaque reflections and evaluated using direct measurements. The ability of GPR data to detect permafrost relies on the strong dielectric contrast between liquid water and ice . Consequently, it is more difficult to discern the presence of permafrost in areas with low soil moisture content because it weakens this contrast . For this reason, the GPR data were only considered to indicate the presence of permafrost if an active layer thickness could be established.

Figure 1(a) The location of the QTP, and the distribution of evidence of in situ permafrost presence (PF) or absence (NPF) over the QTP, superimposed on the background of the digital elevation model (DEM) with a spatial resolution of 30 arcsec. (b) Number of field evidence located in NPF and PF regions. SP means soil pit, GPR refers to ground-penetrating radar, BH stands field evidence measured by borehole drilling, and MAGST is the mean annual ground surface temperature. (c) Distribution of field evidence in terms of elevation (radius), slope (coloured), and aspect (0∕360 represents north). Distributions of (d) mean annual air temperature (MAAT), (e) scaled mean annual snow cover days (MASCD), and (f) annual maximum NDVI (NDVImax) for field evidence (red line) compared to the entire QTP (black line). Numbers in (d), (e), and (f) are mean values. Only the sites with MAAT < 0 C, which is the precondition for permafrost presence, are present in (d).

Table 1Classification algorithm of evidence of in situ permafrost presence or absence from various methods.

BH is the borehole temperature, SP is the soil pit, GST is the ground surface temperature, GPR is the ground-penetrating radar, MGT is the mean ground temperature, and MAGST is the mean annual ground surface temperature. TOmax, the maximum thermal offset under natural conditions reported for the QTP, is 0.79 C. “Ambiguous” means the data are not sufficient to determine permafrost conditions and are not included in the inventory.

In order to apply the permafrost presence or absence inventory more broadly, the degree of confidence in the data is estimated and provided in the inventory and in Table 1, although it is not used in this study. BH and SP provide direct evidence of permafrost presence or absence based on MGT and/or ground ice observations, and hence have high confidence . The data confidence derived from MAGST is classified based on temperature and the length of the observation period. The evaluated GPR survey result was considered to have medium confidence.

## 2.2 Topographical and climatological properties of the inventory sites

The slope and aspect for the inventory sites were derived from a digital elevation model (DEM) with 3 arcsec spatial resolution, which is aggregated from the Global Digital Elevation Model Version 2 (GDEM2) by averaging to avoid the noise in the original dataset . The thermal state and spatial distribution of permafrost result from the long-term interaction of the climate and subsurface. Additionally, vegetation and snow cover play important roles in permafrost distribution by influencing the energy exchange between the atmosphere and the ground surface . In this study, three climate variables were selected to test the representativeness of the inventory for permafrost map evaluation: mean annual air temperature (MAAT), mean annual snow cover days (MASCD), and the annual maximum normalized difference vegetation index (NDVImax). The MAAT was obtained from . It has a spatial resolution of 1 km and represents the reference period spanning 1961–1990. The MASCD, with a spatial resolution of about 500 m, was derived from a daily snow cover product developed by based on MODIS products (MOD10A1 and MYD10A1). To improve the comparison of MASCD, it was scaled to values between 0 and 1 by dividing the total days of a given year, and the mean MASCD during 2003–2010 was produced as a predictor. The annual maximum NDVI is from the MODIS/Terra 16-day Vegetation Index product (MOD13Q1, v006) which has a spatial resolution of 250 m. It was computed for each year between 2001 and 2017 to represent the approximate amount of vegetation and then aggregated to a median value for the entire period to avoid sensitivity to extreme values. These climate variables were extracted for field site locations based on nearest-neighbour interpolation. The outline of the QTP is from ; glacier outlines are from , representing conditions in 2010; and lake data are provided by the Third Pole Environment Database.

## 2.3 Existing maps over the QTP

Table 2 gives a summary of the most widely used and recently developed permafrost maps over the QTP. In general, permafrost maps over the QTP could be classified as (i) categorical, using categorical classification with different permafrost categories (e.g. continuous, discontinuous, sporadic, and island permafrost) or (ii) continuous, using a continuous probability or index with a range of [0.01–1] to represent the proportion of an area that is underlain by permafrost. The IPA map, which may be the most widely used categorical map, was compiled by assembling all readily available data on the characteristics and distribution of permafrost . The IPA map uses the “permafrost zone” to describe spatial patterns of permafrost, and the areas are divided into five categories based on the proportion of the ground underlain by permafrost: continuous (>90 %), discontinuous (50 %–90 %), sporadic (10 %–50 %), island (0 %–10 %), and absent (0 %). The most recent efforts were made by using the TTOP model (denoted as the QTPTTOP map) forced by a calibrated (using station data) land surface temperature (or freezing and thawing indices) considering soil properties and by based on the Noah land surface model (denoted as the QTPNoah map) as well as gridded meteorological datasets, including surface air temperature, radiation, and precipitation. Although these two categorical maps are expected to be superior because they use the latest measurements and advanced methods, they were evaluated using limited and narrow distributed data (∼200 sites for the QTPTTOP map and 56 sites for the QTPNoah map). The PZIglobal map, which gives a continuous index value for permafrost distribution, is derived through a heuristic–empirical relationship with mean annual air temperature (MAAT) based on generalized linear models (Gruber2012). The model parameters are established largely based on the boundaries of continuous (PZI = 0.9 for MAAT =−8.0C) and island (PZI = 0.1 for MAAT =−1.5C) permafrost in the IPA map and do not use field observations. introduced two end-member cases for either cold (conservative or more permafrost) or warm (non-conservative or less permafrost) conditions, into the PZIglobal map to allow the propagation of uncertainty caused by input datasets and model suitability. The three cases or maps, denoted as the PZInorm, PZIwarm, and PZIcold maps, differ in the parameters used. Compared to the normal case, the cold and warm variants are derived by shifting PZI and MAAT at the respective limit by ±5 % and ±0.5C, respectively. The PZIglobal map was partly evaluated for the QTP using rock glaciers, considered as indicators of permafrost conditions, based on remote sensing imagery . However, rock glaciers are absent in much of the QTP due to very low precipitation .

Table 2Summary and evaluation of existing permafrost maps over the Qinghai–Tibet Plateau.

Evaluations are conducted using 1475 in situ measurements of permafrost presence or absence. GLM is the generalized linear model, and PF is permafrost. Norm (normal), warm, and cold mean different cases and assumptions of parameters for permafrost distribution simulations in the PZIglobal map; details are given in Table 1 of . The continuous classification criteria mean the permafrost spatial patterns are compiled or present as a continuous value with a range of [0.01–1], e.g. the permafrost zonation index in the PZI maps.

## 2.4 Statistics and evaluation of permafrost distribution maps

In order to compare maps, it is important to understand the difference between the extent of permafrost regions and the permafrost area. The permafrost area refers to the quantified extent of the area within a domain that is completely underlain by permafrost, whereas permafrost regions are categorical areas within a domain that are defined by the percent of land area underlain by permafrost. For example, extensive discontinuous permafrost is a region where, by definition, 50 % to 90 % of the land area is underlain by permafrost. In this discontinuous permafrost region of a known area, the area actually underlain by permafrost is the permafrost area .

To conduct the map evaluations compared to measurements with binary information (presence or absence), it was necessary to develop classification aggregations for the existing maps. We argue that although the aggregation presented here simplifies the information available in these maps and may introduce uncertainty for further analyses, it is necessary in order to conduct inter-comparisons among them. For the IPA map, we consider the continuous and discontinuous permafrost zones to correspond to permafrost presence and the other zones (sporadic permafrost, island permafrost, and non-permafrost) to correspond to permafrost absence by using the proportion of ground underlain by permafrost of 50 % as a threshold. This is consistent with the threshold of the PZI map described below. For the QTPTTOP and QTPNoah maps, the permafrost distribution was derived using simulated mean annual ground temperature (thermally defined). In these maps, areas are classified into three types: permafrost, seasonally frozen ground, and unfrozen ground. Here, we merge the areas of seasonally frozen ground and unfrozen ground to yield areas of permafrost absence. For the PZI maps, specified thresholds are required for both the extent of permafrost region and permafrost area. Following , only the areas with PZI≥0.01 were selected for further analysis, permafrost regions were defined as regions where PZI≥0.1, and permafrost area was calculated as PZI multiplied by the pixel area. A value of 0.5 was used as the threshold of permafrost presence and absence .

Maps were evaluated based on field evidence to produce accuracy measurements as follows :

$\begin{array}{}\text{(1)}& & {\mathrm{PCC}}_{\mathrm{PF}}=\frac{{\mathrm{PF}}_{\mathrm{T}}}{{\mathrm{PF}}_{\mathrm{T}}+{\mathrm{PF}}_{\mathrm{F}}}×\mathrm{100}\phantom{\rule{0.125em}{0ex}}\mathit{%}\text{(2)}& & {\mathrm{PCC}}_{\mathrm{NPF}}=\frac{{\mathrm{NPF}}_{\mathrm{T}}}{{\mathrm{NPF}}_{\mathrm{T}}+{\mathrm{NPF}}_{\mathrm{F}}}×\mathrm{100}\phantom{\rule{0.125em}{0ex}}\mathit{%}\text{(3)}& & {\mathrm{PCC}}_{\mathrm{tol}}=\frac{{\mathrm{PF}}_{\mathrm{T}}+{\mathrm{NPF}}_{\mathrm{T}}}{{\mathrm{PF}}_{\mathrm{T}}+{\mathrm{PF}}_{\mathrm{F}}+{\mathrm{NPF}}_{\mathrm{T}}+{\mathrm{NPF}}_{\mathrm{F}}}×\mathrm{100}\phantom{\rule{0.125em}{0ex}}\mathit{%},\end{array}$

where PFT is the number of permafrost sites correctly classified as permafrost, and PFF is the number of permafrost sites incorrectly classified as non-permafrost. Similarly, NPFT is the number of permafrost-absent sites correctly classified as non-permafrost, and NPFF is the number of incorrectly classified non-permafrost sites. PCC is the percentage of sites correctly classified, and the subscripts PF, NPF, and tol indicate permafrost, non-permafrost, and total sites, respectively. To avoid the impact of unequal sample sizes in each of the two categories (presence and absence), Cohen's kappa coefficient (κ), which measures inter-rater agreement for categorical items , was used for map evaluation:

$\begin{array}{}\text{(4)}& \mathit{\kappa }=\frac{{p}_{\mathrm{o}}-{p}_{\mathrm{e}}}{\mathrm{1}-{p}_{\mathrm{e}}},\end{array}$

where pe and po are the probability of random agreement and disagreement, respectively, and can be calculated as

$\begin{array}{}\text{(5)}& & {p}_{\mathrm{e}}=\frac{\left({\mathrm{PF}}_{\mathrm{T}}+{\mathrm{PF}}_{\mathrm{F}}\right)×\left({\mathrm{PF}}_{\mathrm{T}}+{\mathrm{NPF}}_{\mathrm{F}}\right)}{\left({\mathrm{PF}}_{\mathrm{T}}+{\mathrm{PF}}_{\mathrm{F}}+{\mathrm{NPF}}_{\mathrm{F}}+{\mathrm{NPF}}_{\mathrm{T}}{\right)}^{\mathrm{2}}}\text{(6)}& & {p}_{\mathrm{o}}=\frac{\left({\mathrm{NPF}}_{\mathrm{F}}+{\mathrm{NPF}}_{\mathrm{T}}\right)×\left({\mathrm{PF}}_{\mathrm{F}}+{\mathrm{NPF}}_{\mathrm{T}}\right)}{\left({\mathrm{PF}}_{\mathrm{T}}+{\mathrm{PF}}_{\mathrm{F}}+{\mathrm{NPF}}_{\mathrm{F}}+{\mathrm{NPF}}_{\mathrm{T}}{\right)}^{\mathrm{2}}}.\end{array}$

Cohen's kappa coefficient results are interpreted to mean excellent agreement for κ 0.8, substantial agreement for 0.6 κ<0.8, moderate agreement for 0.4 κ<0.6, slight agreement for 0.2 κ<0.4, and poor agreement for κ<0.2.

3 Results and discussion

## 3.1 Evidence of permafrost presence or absence

There are a total of 1475 sites of permafrost presence or absence contained in the inventory acquired using BH, SP, GST, and GPR methods (Fig. 1). Among these, 1141 (77.4 %) sites were measured by BH, 184 (12.5 %) sites by GST, 144 (9.8 %) sites by GPR, and 6 (0.4 %) sites by SP (Fig. 1b). There are 1012 (68.6 %) sites of permafrost presence and 463 (31.4 %) sites of permafrost absence. The data cover a large area of the QTP (latitude: 27.73–38.96 N, longitude: 75.06–103.57 E) and a wide elevation range from about 1600 to above 5200 m. However, the majority of sites (93.2 %) are located between 3500 and 5000 m. The inventory has an even distribution of aspects, with 27.3 % on the east slope, 27.9 % on the south slope, 22.0 % on the west slope, and 22.6 % on the north slope. Most of the sites (96.1 %) have slope angles less than 20 (Fig. 1c).

Figure 1d, e, and f compare the distribution of three climate variables between the field sites and the entire QTP. The 1475 field sites have a narrower MAAT range (−10.5 to 15.7 C, with 25th percentile =−6.0C and 75th percentile =−3.8C) compared to the entire QTP, which has a MAAT between −25.6 and 22.1 C (25th percentile =−6.6C and 75th percentile =−0.41C), and only 1.5 % sites located in the area with MAAT <−8C. However, the data (88.2 %) were mostly found in the most sensitive MAAT range (from −8 to −2C) for permafrost presence or absence . There is a slight bias in the scaled MASCD coverage. Few measurements (7.5 %) were located in areas of high scaled MASCD (>0.20) due to the associated harsh climate and inconvenient access. The NDVImax at field evidence sites has a wide coverage for the QTP, with a range of 0.05–0.88. The higher mean NDVImax for field sites (0.44 at the sample sites and 0.37 for the QTP) is due to the fact that measurements were normally collected in flat areas with relatively dense vegetation cover. These results suggest that the evaluation presented in this study is representative of most of the QTP but may have more uncertainty in steep and regularly snow-covered regions.

## 3.2 Evaluation and comparison of existing maps

The new inventory was used to evaluate existing permafrost maps derived with different methods (Table 2). In general, these permafrost maps showed different performances, including slight agreement for the IPA map, fair agreement for the PZIwarm map, and moderate agreement for the QTPNoah, PZInorm, PZIcold, and QTPTTOP maps, with a wide spread of κ from 0.21 to 0.58. The high PCCPF together with low PCCNPF for the QTPNoah, PZIcold, and QTPTTOP maps indicate permafrost is overestimated by them, while the IPA, PZIwarm, and PZInorm maps underestimated the permafrost over the QTP. Despite the small permafrost area bias for the QTPTTOP and QTPNoah maps caused by different QTP boundaries, lake, and glacier datasets used, the range of the estimated permafrost region (1.42–1.84 × 106 km2, or 30 % difference) and area (0.76–1.25 × 106 km2, or 64.4 % difference) is extremely large (Fig. 2).

Figure 2The permafrost classification results at in situ evidence sites shown on the (a) IPA, (b) QTPTTOP, (c) QTPNoah, (d) PZInorm, (e) PZIwarm, and (f) PZIcold maps. Cohen's kappa coefficient (κ) was derived from the selected spatially highly variable landscapes (marked by black box) with 106 evidence sites. All the maps are resampled to the unprojected grid of the SRTM30 DEM with a spatial resolution of 30 arcsec (∼1 km) to avoid map bias caused by different resolutions, geographic projection, and format. The boundary of QTP used in this study is marked by the black line. Categorical classification is used for the QTPTTOP, QTPNoah, and IPA maps, while the continuous PZI was present for the PZInorm, PZIwarm, and PZIcold maps. The blank parts in the PZI maps are areas with PZI < 0.01.

Among the categorical maps, the QTPTTOP map achieved the best performance for permafrost distribution over the QTP, with the highest κ (0.58, moderate agreement) and PCCtol (82.8 %); however, caution should be taken when interpolating the map. The QTPTTOP map was derived based on MODIS land surface temperature with temporal coverage of 2000–2012 . Though the MODIS land surface temperature time-series gaps caused mainly by clouds were filled using the Harmonic Analysis of Time Series (HANTS) algorithm , the surface conditions, especially vegetation and snow cover, were ignored. In this case, land surface temperature is underestimated in high or dense vegetation areas because it comes from the top of the vegetation canopy, and it is overestimated in snow-covered areas where the cooling effects of snow are not considered. As a consequence, permafrost is likely overestimated in areas of high or dense vegetation and underestimated in regularly snow-covered areas. While the QTPNoah map performed slightly better (2.5 % higher) for permafrost area than the QTPTTOP map, it suffered from considerable underestimation of the non-permafrost area (12.7 % lower for PCCNPF). Although the QTPNoah map was derived using a coupled land surface model (Noah), the poorer performance, especially for the non-permafrost area (PCCNPF=49.5 %), is likely caused by the coarse-scale forcing dataset (0.1 resolution or ∼10 km) and by the uncertainty in the soil texture dataset . It is not surprising that the IPA map has slight agreement (κ=0.21) because fewer observations were compiled and the methods used were more suitable for high latitudes .

For the PZI map, the PZInorm and PZIcold maps were found to be in moderate agreement (κ=0.56 for the PZInorm map and 0.55 for the PZIcold map) with in situ measurements, and they performed slightly worse than the QTPTTOP map. The poor performance of the PZIwarm map and underestimation of the PZInorm map indicated that permafrost over the QTP is more prevalent than most of the other regions, even though the climate conditions, especially the MAAT, are similar. This is likely because of the high soil thermal conductivity due to coarse soil and the cooling effects of minimal snow (Zhang2005). Large differences of the permafrost region (0.42×106 km2, or 25 % of the normal case) and area (0.49×106 km2, or 49 % of the normal case) were found for the three cases of the PZIglobal map, though the upper and lower bounds only changed about 5 % for the PZI and ±0.5C for the MAAT. The MAAT used in the PZIglobal map was statistically downscaled from reanalysis based on the lapse rate derived from NCEP upper-air (pressure level) temperatures. The land surface influences on surface air temperature, such as cold air pooling, were ignored . This is important as winter inversions are expected to be common due to the prevalent mountains over the QTP. In other words, permafrost may be underestimated in valleys due to the overestimated MAAT.

Spatially, the non-permafrost areas of the southeastern QTP are well represented in all maps, while misclassification is prevalent in areas near the boundary between permafrost and non-permafrost and in spatially highly variable landscapes such as the sources of the Yellow River (Fig. 2). This is because the permafrost spatial patterns in these areas are not only controlled by medium- to large-scale climate conditions (e.g. MAAT), which are described by the models used, but are also strongly influenced by various local factors such as peat layers, thermokarst, soil moisture, and hydrological processes. The IPA and PZIwarm maps showed a fit that is only good in some areas (e.g. relatively colder areas for the IPA map and southeastern area for the PZIwarm map) based on the in situ measurements and may not represent the permafrost distribution patterns well for the other areas beyond the measurements.

4 Conclusions

We compiled an inventory of evidence of permafrost presence or absence using 1475 field sites obtained based on diverse methods over the QTP. With a wide coverage of topography (e.g. elevation and slope aspect) and climate conditions (e.g. surface air temperature and snow cover), the inventory gives a representative baseline for site-specific permafrost occurrence.

The existing permafrost maps over the QTP were evaluated and inter-compared using the inventory of ground-based evidence, and they showed a wide range of performance, with κ from 0.21 to 0.58 and an overall classification accuracy of about 55 %–83 %. The misclassification is prevalent in areas near the boundary between permafrost and non-permafrost and in spatially highly variable landscapes. This highlights the need for improved mapping methods that consider more controlling factors at both medium–large and local scales. The QTPTTOP map is recommended for representing permafrost distribution over the QTP based on our evaluation. Additionally, the PZInorm and PZIcold maps are similar to one another and are valuable alternatives for describing a permafrost zonation index over the QTP. The inadequate sampling in steep and regularly snow-covered areas is expected to result in higher uncertainty for map evaluation and requires further investigation using systematic samples.

Data availability
Data availability.

The inventory of permafrost presence or absence is partly available as a supplement, and the other evidence sites not listed are available from the authors upon request.

Supplement
Supplement.

Author contributions
Author contributions.

BC carried out this study by organizing the inventory of evidence of permafrost presence or absence, analysing data, performing the simulations, and structuring as well as writing the paper. TZ guided the research. QW, YS, LZ, and DZ contributed to the organization of the dataset of permafrost presence or absence.

Competing interests
Competing interests.

The authors declare that they have no conflict of interest.

Acknowledgements
Acknowledgements.

The authors would like to thank the editor, Peter Morse, two anonymous reviewers, Stephan Gruber, and Kang Wang for their constructive suggestions. We thank Nicholas Brown for improving the writing of an earlier version of the manuscript. We thank Zhuotong Nan and Xiaobo Wu for providing the QTPNoah map. This study was supported by the Strategic Priority Research Program of Chinese Academy of Sciences (XDA20100103, XDA20100313), the National Natural Science Foundation of China (41871050, 41801028), and partly by the Fundamental Research Funds for the Central Universities (lzujbky_2016_281, 862863). We thank CMA (http://data.cma.cn/; last access: 6 February 2019) for providing the surface air and ground surface temperatures. The GDEM2 dataset can be downloaded from the United States Geological Survey (http://gdex.cr.usgs.gov/gdex/; last access: 6 February 2019). The NDVI datasets are derived and processed in the Google Earth Engine. The glacier inventory is provided by the Environmental and Ecological Science Data Center for West China (http://westdc.westgis.ac.cn/; last access: 6 February 2019), and the lake inventory is from the Third Pole Environment Database (http://www.tpedatabase.cn; last access: 6 February 2019).

Edited by: Peter Morse
Reviewed by: two anonymous referees

References

Azócar, G. F., Brenning, A., and Bodin, X.: Permafrost distribution modelling in the semi-arid Chilean Andes, The Cryosphere, 11, 877–890, https://doi.org/10.5194/tc-11-877-2017, 2017. a

Boeckli, L., Brenning, A., Gruber, S., and Noetzli, J.: Permafrost distribution in the European Alps: calculation and evaluation of an index map and summary statistics, The Cryosphere, 6, 807–820, https://doi.org/10.5194/tc-6-807-2012, 2012. a

Brown, J., Ferrians Jr., O. J., Heginbottom, J. A., and Melnikov, E. S.: Circum-Arctic Map of Permafrost and Ground-ice Conditions, 1997. a, b

Cao, B., Gruber, S., and Zhang, T.: REDCAPP (v1.0): parameterizing valley inversions in air temperature data downscaled from reanalyses, Geosci. Model Dev., 10, 2905–2923, https://doi.org/10.5194/gmd-10-2905-2017, 2017a. a, b

Cao, B., Gruber, S., Zhang, T., Li, L., Peng, X., Wang, K., Zheng, L., Shao, W., and Guo, H.: Spatial variability of active layer thickness detected by ground-penetrating radar in the Qilian Mountains, Western China, J. Geophys. Res.-Earth, 122, 574–591, https://doi.org/10.1002/2016JF004018, 2017b. a, b

Cao, B., Zhang, T., Peng, X., Mu, C., Wang, Q., Zheng, L., Wang, K., and Zhong, X.: Thermal Characteristics and Recent Changes of Permafrost in the Upper Reaches of the Heihe River Basin, Western China, J. Geophys. Res.-Atmos., 123, 7935–7949, https://doi.org/10.1029/2018JD028442, 2018. a

Chen, Y., Yang, K., He, J., Qin, J., Shi, J., Du, J., and He, Q.: Improving land surface temperature modeling for dry land of China, J. Geophys. Res.-Atmos., 116, D20104, https://doi.org/10.1029/2011JD015921, 2011. a

Cheng, G. and Jin, H.: Permafrost and groundwater on the Qinghai-Tibet Plateau and in northeast China, Hydrogeol. J., 21, 5–23, https://doi.org/10.1007/s10040-012-0927-2, 2013. a

Cremonese, E., Gruber, S., Phillips, M., Pogliotti, P., Boeckli, L., Noetzli, J., Suter, C., Bodin, X., Crepaz, A., Kellerer-Pirklbauer, A., Lang, K., Letey, S., Mair, V., Morra di Cella, U., Ravanel, L., Scapozza, C., Seppi, R., and Zischg, A.: Brief Communication: “An inventory of permafrost evidence for the European Alps”, The Cryosphere, 5, 651–657, https://doi.org/10.5194/tc-5-651-2011, 2011. a

Gruber, S.: Derivation and analysis of a high-resolution estimate of global permafrost zonation, The Cryosphere, 6, 221–233, https://doi.org/10.5194/tc-6-221-2012, 2012. a, b, c, d, e, f, g, h, i, j

Gruber, S., Fleiner, R., Guegan, E., Panday, P., Schmid, M.-O., Stumm, D., Wester, P., Zhang, Y., and Zhao, L.: Review article: Inferring permafrost and permafrost thaw in the mountains of the Hindu Kush Himalaya region, The Cryosphere, 11, 81–99, https://doi.org/10.5194/tc-11-81-2017, 2017. a

Landis, J. R. and Koch, G. G.: The Measurement of Observer Agreement for Categorical Data, Biometrics, 33, 159–174, 1977. a

Lin, Z., Burn, C. R., Niu, F., Luo, J., Liu, M., and Yin, G.: The Thermal Regime, including a Reversed Thermal Offset, of Arid Permafrost Sites with Variations in Vegetation Cover Density, Wudaoliang Basin, Qinghai-Tibet Plateau, Permafrost Periglac., 26, 142–159, https://doi.org/10.1002/ppp.1840, 2015. a, b

Liu, S., Yao, X., Guo, W., Xu, J., Shangguan, D., Wei, J., Bao, W., and Wu, L.: The contemporary glaciers in China based on the Second Chinese Glacier Inventory, Acta Geographica Sinica, 70, 3–16, 2015 (in Chinese with English abstract). a

Moorman, B. J., Robinson, S. D., and Burgess, M. M.: Imaging periglacial conditions with ground-penetrating radar, Permafrost Periglac., 14, 319–329, https://doi.org/10.1002/ppp.463, 2003. a

Mu, C., Zhang, T., Zhao, Q., Su, H., Wang, S., Cao, B., Peng, X., Wu, Q., and Wu, X.: Permafrost affects carbon exchange and its response to experimental warming on the northern Qinghai-Tibetan Plateau, Agr. Forest Meteorol., 247, 252–259, https://doi.org/10.1016/j.agrformet.2017.08.009, 2017. a

Nan, Z., Huang, P., and Zhao, L.: Permafrost distribution modeling and depth estimation in the Western Qinghai-Tibet Plateau, Acta Geographica Sinica, 68, 318, https://doi.org/10.11821/xb201303003, 2013 (in Chinese with English abstract). a

Norman, J., Kustas, W., and Humes, K.: Source approach for estimating soil and vegetation energy fluxes in observations of directional radiometric surface temperature, Agr. Forest Meteorol., 77, 263–293, 1995. a

Prince, S., Goetz, S., Dubayah, R., Czajkowski, K., and Thawley, M.: Inference of surface and air temperature, atmospheric precipitable water and vapor pressure deficit using Advanced Very High-Resolution Radiometer satellite observations: comparison with field observations, J. Hydrol., 212–213, 230–249, https://doi.org/10.1016/S0022-1694(98)00210-8, 1998. a

Ran, Y., Li, X., Cheng, G., Zhang, T., Wu, Q., Jin, H., and Jin, R.: Distribution of Permafrost in China: An Overview of Existing Permafrost Maps, Permafrost Periglac., 23, 322–333, https://doi.org/10.1002/ppp.1756, 2012. a, b, c, d

Schmid, M.-O., Baral, P., Gruber, S., Shahi, S., Shrestha, T., Stumm, D., and Wester, P.: Assessment of permafrost distribution maps in the Hindu Kush Himalayan region using rock glaciers mapped in Google Earth, The Cryosphere, 9, 2089–2099, https://doi.org/10.5194/tc-9-2089-2015, 2015. a

Wang, W., Huang, X., Deng, J., Xie, H., and Liang, T.: Spatio-Temporal Change of Snow Cover and Its Response to Climate over the Tibetan Plateau Based on an Improved Daily Cloud-Free Snow Cover Product, Remote Sensing, 7, 169–194, https://doi.org/10.3390/rs70100169, 2015. a, b

Wu, J., Sheng, Y., Wu, Q., and Wen, Z.: Processes and modes of permafrost degradation on the Qinghai-Tibet Plateau, Sci. China Ser. D, 53, 150–158, https://doi.org/10.1007/s11430-009-0198-5, 2010. a

Wu, Q. and Zhang, T.: Recent permafrost warming on the Qinghai-Tibetan Plateau, J. Geophys. Res.-Atmos., 113, d13108, https://doi.org/10.1029/2007JD009539, 2008. a

Wu, Q., Zhu, Y., and Liu, Y.: Application of the Permafrost Table Temperature and Thermal Offset Forecast Model in the Tibetan Plateau, Journal of Glaciology and Geocryology, 24, 614–617, 2002 (in Chinese with English abstract). a

Wu, Q., Zhang, Z., Gao, S., and Ma, W.: Thermal impacts of engineering activities and vegetation layer on permafrost in different alpine ecosystems of the Qinghai–Tibet Plateau, China, The Cryosphere, 10, 1695–1706, https://doi.org/10.5194/tc-10-1695-2016, 2016.  a

Wu, X., Nan, Z., Zhao, S., Zhao, L., and Cheng, G.: Spatial modeling of permafrost distribution and properties on the Qinghai – Tibet Plateau, Permafrost Periglac., 29, 86–99, https://doi.org/10.1002/ppp.1971, 2018. a, b, c

Yang, K., He, J., Tang, W., Qin, J., and Cheng, C. C.: On downward shortwave and longwave radiations over high altitude regions: Observation and modeling in the Tibetan Plateau, Agr. Forest Meteorol., 150, 38–46, https://doi.org/10.1016/j.agrformet.2009.08.004, 2010. a

Zhang, T.: Influence of the seasonal snow cover on the ground thermal regime: An overview, Rev. Geophys., 43, RG4002, https://doi.org/10.1029/2004RG000157, 2005. a, b

Zhang, T., Heginbottom, J. A., Barry, R. G., and Brown, J.: Further statistics on the distribution of permafrost and ground ice in the Northern Hemisphere, Polar Geography, 24, 126–131, https://doi.org/10.1080/10889370009377692, 2000. a

Zhang, Y., Li, B., and Zheng, D.: A discussion on the boundary and area of the Tibetan Plateau in China, Geogr. Res., 21, 1–8, 2002 (Chinese with English abstract). a

Zhang, Y. L., Li, X., Cheng, G. D., Jin, H. J., Yang, D. W., Flerchinger, G. N., Chang, X. L., Wang, X., and Liang, J.: Influences of Topographic Shadows on the Thermal and Hydrological Processes in a Cold Region Mountainous Watershed in Northwest China, J. Adv. Model. Earth Sy., 10, 1439–1457, https://doi.org/10.1029/2017MS001264, 2018. a

Zhao, S., Nan, Z., Huang, Y., and Zhao, L.: The Application and Evaluation of Simple Permafrost Distribution Models on the Qinghai–Tibet Plateau, Permafrost Periglac., 28, 391–404, https://doi.org/10.1002/ppp.1939, 2017. a

Zou, D., Zhao, L., Sheng, Y., Chen, J., Hu, G., Wu, T., Wu, J., Xie, C., Wu, X., Pang, Q., Wang, W., Du, E., Li, W., Liu, G., Li, J., Qin, Y., Qiao, Y., Wang, Z., Shi, J., and Cheng, G.: A new map of permafrost distribution on the Tibetan Plateau, The Cryosphere, 11, 2527–2542, https://doi.org/10.5194/tc-11-2527-2017, 2017. a, b, c, d