Articles | Volume 5, issue 2
https://doi.org/10.5194/gi-5-473-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gi-5-473-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Expanding HadISD: quality-controlled, sub-daily station data from 1931
Robert J. H. Dunn
CORRESPONDING AUTHOR
Met Office Hadley Centre, FitzRoy Road, Exeter, EX1 3PB, UK
Kate M. Willett
Met Office Hadley Centre, FitzRoy Road, Exeter, EX1 3PB, UK
David E. Parker
Met Office Hadley Centre, FitzRoy Road, Exeter, EX1 3PB, UK
Lorna Mitchell
Met Office Hadley Centre, FitzRoy Road, Exeter, EX1 3PB, UK
Related authors
Kate M. Willett, Robert J. H. Dunn, John J. Kennedy, and David I. Berry
Earth Syst. Sci. Data, 12, 2853–2880, https://doi.org/10.5194/essd-12-2853-2020, https://doi.org/10.5194/essd-12-2853-2020, 2020
Short summary
Short summary
We describe the development and validation of a new near-global gridded marine humidity monitoring product, HadISDH.marine, from air temperature and dew point temperature reported by ships. Erroneous data, biases, and inhomogeneities have been removed where possible through checks for outliers, supersaturated values, repeated values, and adjustments for known biases in non-aspirated instruments and ship heights. We have also estimated uncertainty in the data at the grid box and regional level.
Robert J. H. Dunn, Kate M. Willett, and David E. Parker
Earth Syst. Dynam., 10, 765–788, https://doi.org/10.5194/esd-10-765-2019, https://doi.org/10.5194/esd-10-765-2019, 2019
Short summary
Short summary
Using a sub-daily dataset of in situ observations, we have performed a study to see how the distributions of temperatures and wind speeds have changed over the last 45 years. Changes in the location or shape of these distributions show how extreme temperatures or wind speeds have changed. Our results show that cool extremes are warming more rapidly than warm ones in high latitudes but that in other parts of the world the opposite is true.
Stephen Blenkinsop, Hayley J. Fowler, Renaud Barbero, Steven C. Chan, Selma B. Guerreiro, Elizabeth Kendon, Geert Lenderink, Elizabeth Lewis, Xiao-Feng Li, Seth Westra, Lisa Alexander, Richard P. Allan, Peter Berg, Robert J. H. Dunn, Marie Ekström, Jason P. Evans, Greg Holland, Richard Jones, Erik Kjellström, Albert Klein-Tank, Dennis Lettenmaier, Vimal Mishra, Andreas F. Prein, Justin Sheffield, and Mari R. Tye
Adv. Sci. Res., 15, 117–126, https://doi.org/10.5194/asr-15-117-2018, https://doi.org/10.5194/asr-15-117-2018, 2018
Short summary
Short summary
Measurements of sub-daily (e.g. hourly) rainfall totals are essential if we are to understand short, intense bursts of rainfall that cause flash floods. We might expect the intensity of such events to increase in a warming climate but these are poorly realised in projections of future climate change. The INTENSE project is collating a global dataset of hourly rainfall measurements and linking with new developments in climate models to understand the characteristics and causes of these events.
Robert J. H. Dunn, Kate M. Willett, Andrew Ciavarella, and Peter A. Stott
Earth Syst. Dynam., 8, 719–747, https://doi.org/10.5194/esd-8-719-2017, https://doi.org/10.5194/esd-8-719-2017, 2017
Short summary
Short summary
We compare the latest observations of relative and specific humidity with those from climate models. The climate models do not accurately reproduce the observed humidity behaviour for the last 15–20 years. We use the temporal, spatial and trend information to contrast the patterns exhibited by the observations and models. The temporal behaviour of the observations has previously been documented and is consistent with faster warming rates over land compared to oceans.
R. J. H. Dunn, M. G. Donat, and L. V. Alexander
Clim. Past, 10, 2171–2199, https://doi.org/10.5194/cp-10-2171-2014, https://doi.org/10.5194/cp-10-2171-2014, 2014
Short summary
Short summary
Observational data sets contain uncertainties, e.g. from the instrument accuracy, as well as from the fact that usually only a single method is used in processing. We have performed an assessment of the size of the uncertainties associated with choices in the method used. The largest effects come from changes which affect the station network or the gridding method used. However, for the temperature indices in places with many stations, these changes have little effect on the long-term behaviour.
K. M. Willett, R. J. H. Dunn, P. W. Thorne, S. Bell, M. de Podesta, D. E. Parker, P. D. Jones, and C. N. Williams Jr.
Clim. Past, 10, 1983–2006, https://doi.org/10.5194/cp-10-1983-2014, https://doi.org/10.5194/cp-10-1983-2014, 2014
Short summary
Short summary
We have developed HadISDH, a new gridded global land monthly mean climate montitoring product for humidity and temperature from 1973 to then end of 2013 (updated annually) based entirely on in situ observations. Uncertainty estimates are provided. Over the period of record significant warming and increases in water vapour have taken place. The specific humidity trends have slowed since a peak in 1998 concurrent with decreasing relative humidity from 2000 onwards.
R. J. H. Dunn, K. M. Willett, C. P. Morice, and D. E. Parker
Clim. Past, 10, 1501–1522, https://doi.org/10.5194/cp-10-1501-2014, https://doi.org/10.5194/cp-10-1501-2014, 2014
K. M. Willett, C. N. Williams Jr., R. J. H. Dunn, P. W. Thorne, S. Bell, M. de Podesta, P. D. Jones, and D. E. Parker
Clim. Past, 9, 657–677, https://doi.org/10.5194/cp-9-657-2013, https://doi.org/10.5194/cp-9-657-2013, 2013
Kate M. Willett, Robert J. H. Dunn, John J. Kennedy, and David I. Berry
Earth Syst. Sci. Data, 12, 2853–2880, https://doi.org/10.5194/essd-12-2853-2020, https://doi.org/10.5194/essd-12-2853-2020, 2020
Short summary
Short summary
We describe the development and validation of a new near-global gridded marine humidity monitoring product, HadISDH.marine, from air temperature and dew point temperature reported by ships. Erroneous data, biases, and inhomogeneities have been removed where possible through checks for outliers, supersaturated values, repeated values, and adjustments for known biases in non-aspirated instruments and ship heights. We have also estimated uncertainty in the data at the grid box and regional level.
Robert J. H. Dunn, Kate M. Willett, and David E. Parker
Earth Syst. Dynam., 10, 765–788, https://doi.org/10.5194/esd-10-765-2019, https://doi.org/10.5194/esd-10-765-2019, 2019
Short summary
Short summary
Using a sub-daily dataset of in situ observations, we have performed a study to see how the distributions of temperatures and wind speeds have changed over the last 45 years. Changes in the location or shape of these distributions show how extreme temperatures or wind speeds have changed. Our results show that cool extremes are warming more rapidly than warm ones in high latitudes but that in other parts of the world the opposite is true.
Stephen Blenkinsop, Hayley J. Fowler, Renaud Barbero, Steven C. Chan, Selma B. Guerreiro, Elizabeth Kendon, Geert Lenderink, Elizabeth Lewis, Xiao-Feng Li, Seth Westra, Lisa Alexander, Richard P. Allan, Peter Berg, Robert J. H. Dunn, Marie Ekström, Jason P. Evans, Greg Holland, Richard Jones, Erik Kjellström, Albert Klein-Tank, Dennis Lettenmaier, Vimal Mishra, Andreas F. Prein, Justin Sheffield, and Mari R. Tye
Adv. Sci. Res., 15, 117–126, https://doi.org/10.5194/asr-15-117-2018, https://doi.org/10.5194/asr-15-117-2018, 2018
Short summary
Short summary
Measurements of sub-daily (e.g. hourly) rainfall totals are essential if we are to understand short, intense bursts of rainfall that cause flash floods. We might expect the intensity of such events to increase in a warming climate but these are poorly realised in projections of future climate change. The INTENSE project is collating a global dataset of hourly rainfall measurements and linking with new developments in climate models to understand the characteristics and causes of these events.
Robert J. H. Dunn, Kate M. Willett, Andrew Ciavarella, and Peter A. Stott
Earth Syst. Dynam., 8, 719–747, https://doi.org/10.5194/esd-8-719-2017, https://doi.org/10.5194/esd-8-719-2017, 2017
Short summary
Short summary
We compare the latest observations of relative and specific humidity with those from climate models. The climate models do not accurately reproduce the observed humidity behaviour for the last 15–20 years. We use the temporal, spatial and trend information to contrast the patterns exhibited by the observations and models. The temporal behaviour of the observations has previously been documented and is consistent with faster warming rates over land compared to oceans.
R. J. H. Dunn, K. M. Willett, D. E. Parker, and L. Mitchell
Clim. Past Discuss., https://doi.org/10.5194/cpd-11-4569-2015, https://doi.org/10.5194/cpd-11-4569-2015, 2015
Manuscript not accepted for further review
Short summary
Short summary
We present an updated to a quality-controlled hourly dataset (HadISD) of a range of weather observations, including temperature, pressure and wind measured at over 8000 stations across the world. In this update we have extended the time coverage back to 1931 and increased the number of stations included in HadISD. We will release annual updates of HadISD version 2, keeping the dataset up to date, and allowing the study of more recent climate events in high detail.
R. J. H. Dunn, M. G. Donat, and L. V. Alexander
Clim. Past, 10, 2171–2199, https://doi.org/10.5194/cp-10-2171-2014, https://doi.org/10.5194/cp-10-2171-2014, 2014
Short summary
Short summary
Observational data sets contain uncertainties, e.g. from the instrument accuracy, as well as from the fact that usually only a single method is used in processing. We have performed an assessment of the size of the uncertainties associated with choices in the method used. The largest effects come from changes which affect the station network or the gridding method used. However, for the temperature indices in places with many stations, these changes have little effect on the long-term behaviour.
K. M. Willett, R. J. H. Dunn, P. W. Thorne, S. Bell, M. de Podesta, D. E. Parker, P. D. Jones, and C. N. Williams Jr.
Clim. Past, 10, 1983–2006, https://doi.org/10.5194/cp-10-1983-2014, https://doi.org/10.5194/cp-10-1983-2014, 2014
Short summary
Short summary
We have developed HadISDH, a new gridded global land monthly mean climate montitoring product for humidity and temperature from 1973 to then end of 2013 (updated annually) based entirely on in situ observations. Uncertainty estimates are provided. Over the period of record significant warming and increases in water vapour have taken place. The specific humidity trends have slowed since a peak in 1998 concurrent with decreasing relative humidity from 2000 onwards.
K. Willett, C. Williams, I. T. Jolliffe, R. Lund, L. V. Alexander, S. Brönnimann, L. A. Vincent, S. Easterbrook, V. K. C. Venema, D. Berry, R. E. Warren, G. Lopardo, R. Auchmann, E. Aguilar, M. J. Menne, C. Gallagher, Z. Hausfather, T. Thorarinsdottir, and P. W. Thorne
Geosci. Instrum. Method. Data Syst., 3, 187–200, https://doi.org/10.5194/gi-3-187-2014, https://doi.org/10.5194/gi-3-187-2014, 2014
R. J. H. Dunn, K. M. Willett, C. P. Morice, and D. E. Parker
Clim. Past, 10, 1501–1522, https://doi.org/10.5194/cp-10-1501-2014, https://doi.org/10.5194/cp-10-1501-2014, 2014
V. O. John, D. E. Parker, S. A. Buehler, J. Price, and R. W. Saunders
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acpd-13-10547-2013, https://doi.org/10.5194/acpd-13-10547-2013, 2013
Revised manuscript has not been submitted
K. M. Willett, C. N. Williams Jr., R. J. H. Dunn, P. W. Thorne, S. Bell, M. de Podesta, P. D. Jones, and D. E. Parker
Clim. Past, 9, 657–677, https://doi.org/10.5194/cp-9-657-2013, https://doi.org/10.5194/cp-9-657-2013, 2013
Related subject area
Data base
Making geoscientific lab data FAIR: a conceptual model for a geophysical laboratory database
A universal and multi-dimensional model for analytical data on geological samples
Sodankylä ionospheric tomography data set 2003–2014
A 7-year dataset for driving and evaluating snow models at an Arctic site (Sodankylä, Finland)
The abandoned surface mining sites in the Czech Republic: mapping and creating a database with a GIS web application
Determining the focal mechanisms of the events in the Carpathian region of Ukraine
Sven Nordsiek and Matthias Halisch
Geosci. Instrum. Method. Data Syst., 13, 63–73, https://doi.org/10.5194/gi-13-63-2024, https://doi.org/10.5194/gi-13-63-2024, 2024
Short summary
Short summary
Research data resulting from geoscientific laboratory methods comprise multiple types and formats. A diversity of Earth system science fuels are needed to make research data available to scientists beyond a particular discipline. Global working groups define standards and create tools to improve research data handling in general. Adaption of these solutions to the needs of the geoscientific disciplines is vital to enable the development of a widely applicable geoscientific laboratory database.
Yutong He, Di Tian, Hongxia Wang, Li Yao, Miao Yu, and Pengfei Chen
Geosci. Instrum. Method. Data Syst., 8, 277–284, https://doi.org/10.5194/gi-8-277-2019, https://doi.org/10.5194/gi-8-277-2019, 2019
Short summary
Short summary
A universal data model is a core to converge big geoanalytical data. We studied geoanalytical instruments, geological samples, and geoanalytical results and give a summarization of comprehensive geoanalytical data. We abstracted the data contents and designed the data model. It can be used for the construction of any geoanalytical data management system, data sharing system, or database by professional or amateur developers. Morever, we highly improved the efficiency of the data model.
Johannes Norberg, Lassi Roininen, Antti Kero, Tero Raita, Thomas Ulich, Markku Markkanen, Liisa Juusola, and Kirsti Kauristie
Geosci. Instrum. Method. Data Syst., 5, 263–270, https://doi.org/10.5194/gi-5-263-2016, https://doi.org/10.5194/gi-5-263-2016, 2016
Short summary
Short summary
The Sodankylä Geophysical Observatory has been producing ionospheric tomography data since 2003. Based on these data, one solar cycle of ionospheric vertical total electron content (VTEC) estimates is constructed. The measurements are compared against the IRI-2012 model, F10.7 solar flux index and sunspot number data. Qualitatively the tomographic VTEC estimate corresponds to reference data very well, but the IRI-2012 model are on average 40 % higher of that of the tomographic results.
Richard Essery, Anna Kontu, Juha Lemmetyinen, Marie Dumont, and Cécile B. Ménard
Geosci. Instrum. Method. Data Syst., 5, 219–227, https://doi.org/10.5194/gi-5-219-2016, https://doi.org/10.5194/gi-5-219-2016, 2016
Short summary
Short summary
Physically based models that predict the properties of snow on the ground are used in many applications, but meteorological input data required by these models are hard to obtain in cold regions. Monitoring at the Sodankyla research station allows construction of model input and evaluation datasets covering several years for the first time in the Arctic. The data are used to show that a sophisticated snow model developed for warmer and wetter sites can perform well in very different conditions.
Richard Pokorný and Marie Tereza Peterková
Geosci. Instrum. Method. Data Syst., 5, 143–149, https://doi.org/10.5194/gi-5-143-2016, https://doi.org/10.5194/gi-5-143-2016, 2016
Short summary
Short summary
The paper is aimed at the evidence of old quarries and other open mining sites in former Czechoslovakia. It is the result of several years of research. In the manuscript is described a very interesting history of the mapping in our country and especially the digital database and the web map building process. We register 10 000 historical mining sites that were active in the first half of the 20th century. The web map is designated for geologist, historians, landscape ecologists, biologists, etc.
A. Pavlova, O. Hrytsai, and D. Malytskyy
Geosci. Instrum. Method. Data Syst., 3, 229–239, https://doi.org/10.5194/gi-3-229-2014, https://doi.org/10.5194/gi-3-229-2014, 2014
Short summary
Short summary
The paper is devoted to mathematical modelling of propagation of seismic waves in inhomogeneous media. The trial and error method for determining the angles of orientation of fault plane and earthquake mechanism has been proposed. The graphic and trial and error approaches have been applied for determining the source parameters of earthquakes in the seismically active region of eastern Carpathian.
Cited articles
ACSM: Prevention of thermal injuries during distance running, Med. Sci. Sports Exerc., 16, iv–xiv, 1984.
Buck, A. L.: New equations for computing vapor pressure and enhancement factor, J. Appl. Meteorol., 20, 1527–1532, 1981.
Compo, G. P., Whitaker, J. S., Sardeshmukh, P. D., Matsui, N., Allan, R. J., Yin, X., Gleason, B. E., Vose, R., Rutledge, G., Bessemoulin, P., Brönnimann, S., Brunet, M., Crouthamel, R. I., Grant, A. N., Groisman, P. Y., Jones, P. D., Kruk, M. C., Kruger, A. C., Marshall, G. J., Maugeri, M., Mok, H. Y., Nordli, Ø., Ross, T. F., Trigo, R. M., Wang, X. L., Woodruff, S. D., and Worley, S. J.: The twentieth century reanalysis project, Q. J. Roy. Meteorol. Soc., 137, 1–28, 2011.
DeGaetano, A. T.: A quality-control routine for hourly wind observations, J. Atmos. Ocean. Tech., 14, 308–317, 1997.
Dikmen, S. and Hansen, P.: Is the temperature-humidity index the best indicator of heat stress in lactating dairy cows in a subtropical environment?, J. Dairy Sci., 92, 109–116, 2009.
Dunn, R. J. H., Willett, K. M., Thorne, P. W., Woolley, E. V., Durre, I., Dai, A., Parker, D. E., and Vose, R. S.: HadISD: a quality-controlled global synoptic report database for selected variables at long-term stations from 1973–2011, Clim. Past, 8, 1649–1679, https://doi.org/10.5194/cp-8-1649-2012, 2012.
Dunn, R. J. H., Willett, K. M., Morice, C. P., and Parker, D. E.: Pairwise homogeneity assessment of HadISD, Clim. Past, 10, 1501–1522, https://doi.org/10.5194/cp-10-1501-2014, 2014.
El Fadli, K. I., Cerveny, R. S., Burt, C. C., Eden, P., Parker, D., Brunet, M., Peterson, T. C., Mordacchini, G., Pelino, V., Bessemoulin, P., and Stella, J. L.: World Meteorological organization assessment of the Purported World record 58 °C temperature extreme at el azizia, libya (13 September 1922), B. Am. Meteorol. Soc., 94, 199–204, 2013.
Jaccard, P.: Étude comparative de la distribution florale dans une portion des Alpes et des Jura, Bulletin de la Société Vaudoise des Sciences Naturelle, 37, 547–579, 1901.
Jensen, M. E., Burman, R. D., and Allen, R. G.: Evapotranspiration and irrigation water requirements, American Society of Civil Engineers, New York, NY, 1990.
List, R. J.: Smithsonian Meteorological Tables, in: Vol. 114, 6th Edn., Smithsonian Institution, Washington, D.C., 268 pp., https://doi.org/10.1002/qj.49707833627, 1963.
Lott, J. N.: The quality control of the integrated surface hourly database, American Meteorological Society Paper 71929, 14th Conference on Applied Climatology, Seattle, WA, available at: https://ams.confex.com/ams/84Annual/webprogram/Paper71929.html (last access: September 2016), 2004.
Lucio-Eceiza, E. E., González-Rouco, J. F., Navarro, J., Beltrami, H., Hidalgo, A., and Conte, J.: Quality Control of surface wind observations in North Eastern North America. Part II: Measurement Errors, J. Atmos. Ocean. Tech., submitted, 2015.
Masterton, J. and Richardson, F.: Humidex: a method of quantifying human discomfort due to excessive heat and humidity, Downsview, Ont., Atmos. Environ., Environment Canada, 1979.
Menne, M. J. and Williams Jr., C. N.: Homogenization of temperature series via pairwise comparisons, J. Climate, 22, 1700–1717, 2009.
Peixoto, J. and Oort, A. H.: The climatology of relative humidity in the atmosphere, J. Climate, 9, 3443–3463, 1996.
Rennie, J., Lawrimore, J., Gleason, B., Thorne, P., Morice, C., Menne, M., Williams, C., Almeida, W. G., Christy, J., Flannery, M., Ishihara, M., Kamiguchi, K., Klein-Tank, A. M. G., Mhanda, A., Lister, D. H., Razuvaev, V., Renom, M., Rusticucci, M., Tandy, J., Worley, S. J., Venema, V., Angel, W., Brunet, M., Dattore, B., Diamond, H., Lazzara, M. A., Le Blancq, F., Luterbacher, J., Mächel, H., Revadekar, J., Vose, R. S., and Yin, X.: The international surface temperature initiative global land surface databank: monthly temperature data release description and methods, Geosci. Data J., 1, 75–102, https://doi.org/10.1002/gdj3.8, 2014.
Rothfusz, L. P.: The heat index equation (or, more than you ever wanted to know about heat index), National Oceanic and Atmospheric Administration, National Weather Service, Office of Meteorology, Fort Worth, Texas, 90–23, 1990.
Smith, A., Lott, N., and Vose, R.: The integrated surface database: Recent developments and partnerships, B. Am. Meteorol. Soc., 92, 704–708, 2011.
Steadman, R. G.: Norms of apparent temperature in Australia, Aust. Met. Mag., 43, 1–16, 1994.
Willett, K. M., Dunn, R. J. H., Thorne, P. W., Bell, S., de Podesta, M., Parker, D. E., Jones, P. D., and Williams Jr., C. N.: HadISDH land surface multi-variable humidity and temperature record for climate monitoring, Clim. Past, 10, 1983–2006, https://doi.org/10.5194/cp-10-1983-2014, 2014.
Short summary
We have extended the sub-daily, integrated HadISD back to 1931 to double the time coverage of the dataset. We have updated and improved the station selection and merging procedure, which will be rerun on an annual basis to prevent it becoming out of date. The quality-control code has been rewritten from IDL to Python2.7 to make it clearer and more accessible. We have also calculated humidity and heat-stress variables in HadISD.2.0.0. This increases the value and applicability of this dataset.
We have extended the sub-daily, integrated HadISD back to 1931 to double the time coverage of...