Articles | Volume 9, issue 2
https://doi.org/10.5194/gi-9-267-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gi-9-267-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Auroral classification ergonomics and the implications for machine learning
Derek McKay
CORRESPONDING AUTHOR
NORCE Norwegian Research Centre AS, Tromsø, Norway
Andreas Kvammen
Department of Physics and Technology, UiT – The Arctic University of Norway, Tromsø, Norway
Related authors
Fasil Tesema, Noora Partamies, Hilde Nesse Tyssøy, and Derek McKay
Ann. Geophys., 38, 1191–1202, https://doi.org/10.5194/angeo-38-1191-2020, https://doi.org/10.5194/angeo-38-1191-2020, 2020
Short summary
Short summary
In this study, we present the ionization level from EISCAT radar experiments and cosmic noise absorption level
from KAIRA riometer observations during pulsating auroras. We found thick layers of ionization that reach down
to 70 km (harder precipitation) and higher cosmic noise absorption during patchy pulsating aurora than
during amorphous pulsating and patchy auroras.
Devin Huyghebaert, Björn Gustavsson, Juha Vierinen, Andreas Kvammen, Matthew Zettergren, John Swoboda, Ilkka Virtanen, Spencer M. Hatch, and Karl M. Laundal
Ann. Geophys., 43, 99–113, https://doi.org/10.5194/angeo-43-99-2025, https://doi.org/10.5194/angeo-43-99-2025, 2025
Short summary
Short summary
The EISCAT_3D radar is a new ionospheric radar under construction in the Fennoscandia region. The radar will make measurements of plasma characteristics at altitudes above approximately 60 km. The capability of the system to make these measurements at spatial scales of less than 100 m using multiple digitised signals from each of the radar antenna panels is highlighted. There are many ionospheric small-scale processes that will be further resolved using the techniques discussed here.
Samuel Kočiščák, Andreas Kvammen, Ingrid Mann, Nicole Meyer-Vernet, David Píša, Jan Souček, Audun Theodorsen, Jakub Vaverka, and Arnaud Zaslavsky
Ann. Geophys., 42, 191–212, https://doi.org/10.5194/angeo-42-191-2024, https://doi.org/10.5194/angeo-42-191-2024, 2024
Short summary
Short summary
In situ observations are crucial for understanding interplanetary dust, yet not every spacecraft has a dedicated dust detector. Dust encounters happen at great speeds, leading to high energy density at impact, which leads to ionization and charge release, which is detected with electrical antennas. Our work looks at how the transient charge plume interacts with Solar Orbiter spacecraft. Our findings are relevant for the design of future experiments and the understanding of present data.
Theresa Rexer, Björn Gustavsson, Juha Vierinen, Andres Spicher, Devin Ray Huyghebaert, Andreas Kvammen, Robert Gillies, and Asti Bhatt
Geosci. Instrum. Method. Data Syst. Discuss., https://doi.org/10.5194/gi-2023-18, https://doi.org/10.5194/gi-2023-18, 2024
Preprint under review for GI
Short summary
Short summary
We present a second-level calibration method for electron density measurements from multi-beam incoherent scatter radars. It is based on the well-known Flat field correction method used in imaging and photography. The methods improve data quality and useability as they account for unaccounted, and unpredictable variations in the radar system. This is valuable for studies where inter-beam calibration is important such as studies of polar cap patches, plasma irregularities and turbulence.
Andreas Kvammen, Kristoffer Wickstrøm, Samuel Kociscak, Jakub Vaverka, Libor Nouzak, Arnaud Zaslavsky, Kristina Rackovic Babic, Amalie Gjelsvik, David Pisa, Jan Soucek, and Ingrid Mann
Ann. Geophys., 41, 69–86, https://doi.org/10.5194/angeo-41-69-2023, https://doi.org/10.5194/angeo-41-69-2023, 2023
Short summary
Short summary
Collisional fragmentation of asteroids, comets and meteoroids is the main source of dust in the solar system. The dust distribution is however uncharted and the role of dust in the solar system is largely unknown. At present, the interplanetary medium is explored by the Solar Orbiter spacecraft. We present a novel method, based on artificial intelligence, that can be used for detecting dust impacts in Solar Orbiter observations with high accuracy, advancing the study of dust in the solar system.
Fasil Tesema, Noora Partamies, Hilde Nesse Tyssøy, and Derek McKay
Ann. Geophys., 38, 1191–1202, https://doi.org/10.5194/angeo-38-1191-2020, https://doi.org/10.5194/angeo-38-1191-2020, 2020
Short summary
Short summary
In this study, we present the ionization level from EISCAT radar experiments and cosmic noise absorption level
from KAIRA riometer observations during pulsating auroras. We found thick layers of ionization that reach down
to 70 km (harder precipitation) and higher cosmic noise absorption during patchy pulsating aurora than
during amorphous pulsating and patchy auroras.
Related subject area
Data quality
Airborne electromagnetic data levelling based on the structured variational method
Crack damage stress in fully saturated, permeable rocks: A new detection procedure
Upgrade of LSA-SAF Meteosat Second Generation daily surface albedo (MDAL) retrieval algorithm incorporating aerosol correction and other improvements
Swarm Langmuir probes' data quality validation and future improvements
Evaluating methods for reconstructing large gaps in historic snow depth time series
Production of definitive data from Indonesian geomagnetic observatories
Artifacts from manganese reduction in rock samples prepared by focused ion beam (FIB) slicing for X-ray microspectroscopy
The influence of sample geometry on the permeability of a porous sandstone
The operator difference in absolute geomagnetic measurements
One second vector and scalar magnetic measurements at the low-latitude Choutuppal (CPL) magnetic observatory
Data quality control and tools in passive seismic experiments exemplified on the Czech broadband seismic pool MOBNET in the AlpArray collaborative project
Time-stamp correction of magnetic observatory data acquired during unavailability of time-synchronization services
Stability analysis of geomagnetic baseline data obtained at Cheongyang observatory in Korea
European UV DataBase (EUVDB) as a repository and quality analyser for solar spectral UV irradiance monitored in Sodankylä
Bed conduction impact on fiber optic distributed temperature sensing water temperature measurements
A framework for benchmarking of homogenisation algorithm performance on the global scale
New analysis software for Viking Lander meteorological data
Innovations and applications of the VERA quality control
Qiong Zhang, Xin Chen, Zhonghang Ji, Fei Yan, Zhengkun Jin, and Yunqing Liu
Geosci. Instrum. Method. Data Syst., 13, 193–203, https://doi.org/10.5194/gi-13-193-2024, https://doi.org/10.5194/gi-13-193-2024, 2024
Short summary
Short summary
In an airborne survey, dynamic flight conditions cause unequal data levels, which have a serious impact on airborne geophysical data analysis and interpretation. A new technique is proposed to level geophysical data, and we confirm the reliability of the method by applying it to magnetic data and apparent conductivity data. The method can automatically extract the levelling errors without the participation of staff members or tie line control.
Sandra Schumacher and Werner Gräsle
EGUsphere, https://doi.org/10.5194/egusphere-2024-1074, https://doi.org/10.5194/egusphere-2024-1074, 2024
Short summary
Short summary
Under German law, the crack damage stress must not be reached at any time during the operation or post-closure phase of a nuclear waste repository. This legal requirement can only be fulfilled if the parameter can be measured precisely. We have thus developed a new measurement technique, which overcomes the limitations of the conventional method. In combination, old and new method offer an easy procedure to detect the crack damage stress in fully saturated rocks in a fast and robust manner.
Daniel Juncu, Xavier Ceamanos, Isabel F. Trigo, Sandra Gomes, and Sandra C. Freitas
Geosci. Instrum. Method. Data Syst., 11, 389–412, https://doi.org/10.5194/gi-11-389-2022, https://doi.org/10.5194/gi-11-389-2022, 2022
Short summary
Short summary
MDAL is a near real-time, satellite-based surface albedo product based on the geostationary Meteosat Second Generation mission. We propose an update to the processing algorithm that generates MDAL and evaluate the results of these changes through comparison with the pre-update, currently operational MDAL product as well as reference data using different satellite-based albedo products and in situ measurements. We find that the update provides a valuable improvement.
Filomena Catapano, Stephan Buchert, Enkelejda Qamili, Thomas Nilsson, Jerome Bouffard, Christian Siemes, Igino Coco, Raffaella D'Amicis, Lars Tøffner-Clausen, Lorenzo Trenchi, Poul Erik Holmdahl Olsen, and Anja Stromme
Geosci. Instrum. Method. Data Syst., 11, 149–162, https://doi.org/10.5194/gi-11-149-2022, https://doi.org/10.5194/gi-11-149-2022, 2022
Short summary
Short summary
The quality control and validation activities performed by the Swarm data quality team reveal the good-quality LPs. The analysis demonstrated that the current baseline plasma data products are improved with respect to previous baseline. The LPs have captured the ionospheric plasma variability over more than half of a solar cycle, revealing the data quality dependence on the solar activity. The quality of the LP data will further improve promotion of their application to a broad range of studies.
Johannes Aschauer and Christoph Marty
Geosci. Instrum. Method. Data Syst., 10, 297–312, https://doi.org/10.5194/gi-10-297-2021, https://doi.org/10.5194/gi-10-297-2021, 2021
Short summary
Short summary
Methods for reconstruction of winter long data gaps in snow depth time series are compared. The methods use snow depth data from neighboring stations or calculate snow depth from temperature and precipitation data. All methods except one are able to reproduce the average snow depth and maximum snow depth in a winter reasonably well. For reconstructing the number of snow days with snow depth ≥ 1 cm, results suggest using a snow model instead of relying on data from neighboring stations.
Relly Margiono, Christopher W. Turbitt, Ciarán D. Beggan, and Kathryn A. Whaler
Geosci. Instrum. Method. Data Syst., 10, 169–182, https://doi.org/10.5194/gi-10-169-2021, https://doi.org/10.5194/gi-10-169-2021, 2021
Short summary
Short summary
We have produced a standardised high-quality set of measurements to create definitive data for four Indonesian Geomagnetic Observatories for 2010–2018. We explain the steps taken to update the existing data collection and processing protocols and suggest improvements to further enhance the quality of the magnetic time series at each observatory. The new data will fill the gap in the western Pacific region and provide input into geomagnetic field modeling and secular variation studies.
Dorothea S. Macholdt, Jan-David Förster, Maren Müller, Bettina Weber, Michael Kappl, A. L. David Kilcoyne, Markus Weigand, Jan Leitner, Klaus Peter Jochum, Christopher Pöhlker, and Meinrat O. Andreae
Geosci. Instrum. Method. Data Syst., 8, 97–111, https://doi.org/10.5194/gi-8-97-2019, https://doi.org/10.5194/gi-8-97-2019, 2019
Short summary
Short summary
Focused ion beam (FIB) slicing is a widely used technique to prepare ultrathin slices for the microanalysis of geological and environmental samples. During our investigations of the manganese oxidation states in rock varnish slices, we found an FIB-related reduction of manganese(IV) to manganese(II) at the samples’ surfaces. This study characterizes the observed reduction artifacts and emphasizes that caution is needed in the analysis of transition metal oxidation states upon FIB preparation.
Michael J. Heap
Geosci. Instrum. Method. Data Syst., 8, 55–61, https://doi.org/10.5194/gi-8-55-2019, https://doi.org/10.5194/gi-8-55-2019, 2019
Short summary
Short summary
To better understand the influence of sample geometry on laboratory measurements of permeability, the permeabilities of sandstone samples with different lengths and diameters were measured. Despite the large range in length, aspect ratio, and volume, the permeabilities of the samples are near identical. This is due to a homogeneous porosity structure and the small grain/pore size with respect to the minimum tested diameter and length. More tests are now needed to help develop such guidelines.
Yufei He, Xudong Zhao, Jianjun Wang, Fuxi Yang, Xijing Li, Changjiang Xin, Wansheng Yan, and Wentong Tian
Geosci. Instrum. Method. Data Syst., 8, 21–27, https://doi.org/10.5194/gi-8-21-2019, https://doi.org/10.5194/gi-8-21-2019, 2019
Nelapatla Phani Chandrasekhar, Sai Vijay Kumar Potharaju, Kusumita Arora, Chandra Shakar Rao Kasuba, Leonid Rakhlin, Sergey Tymoshyn, Laszlo Merenyi, Anusha Chilukuri, Jayashree Bulusu, and Sergey Khomutov
Geosci. Instrum. Method. Data Syst., 6, 547–560, https://doi.org/10.5194/gi-6-547-2017, https://doi.org/10.5194/gi-6-547-2017, 2017
Short summary
Short summary
This work presents the progressive steps which led to the successful setup of such measurements at the new magnetic observatory in Choutuppal (CPL) of CSIR-NGRI, Hyderabad, India. Iterative tuning of the setup led to the generation of good quality data from 2016 onward. The processes of commissioning this setup in low-latitude conditions, with the aim of producing 1 s definitive data, and the characteristics of the data from this new instrument are presented here.
Luděk Vecsey, Jaroslava Plomerová, Petr Jedlička, Helena Munzarová, Vladislav Babuška, and the AlpArray working group
Geosci. Instrum. Method. Data Syst., 6, 505–521, https://doi.org/10.5194/gi-6-505-2017, https://doi.org/10.5194/gi-6-505-2017, 2017
Short summary
Short summary
This paper focuses on major issues related to data reliability and MOBNET network performance in the AlpArray seismic experiments. We present both new hardware and software tools that help to assure the high-quality standard of broadband seismic data. Special attention is paid to issues like a detection of sensor misorientation, timing problems, exchange of record components and/or their polarity reversal, sensor mass centring, or anomalous channel amplitudes due to imperfect gain.
Pierdavide Coïsson, Kader Telali, Benoit Heumez, Vincent Lesur, Xavier Lalanne, and Chang Jiang Xin
Geosci. Instrum. Method. Data Syst., 6, 311–317, https://doi.org/10.5194/gi-6-311-2017, https://doi.org/10.5194/gi-6-311-2017, 2017
Short summary
Short summary
Data loggers of magnetic observatories use GPS receivers to provide accurate time stamping of recorded data. Typical sampling rate is 1 s. A failure of the GPS receiver can result in erroneous time stamps. The observatory of Lanzhou, China, accumulated a lag of 28 s over 1 year. Using magnetic data recorded at other locations in a radius of 3000 km it was possible to estimate the diurnal lag and correct the time tamps to produce reliable 1 min averages of magnetic data.
Shakirah M. Amran, Wan-Seop Kim, Heh Ree Cho, and Po Gyu Park
Geosci. Instrum. Method. Data Syst., 6, 231–238, https://doi.org/10.5194/gi-6-231-2017, https://doi.org/10.5194/gi-6-231-2017, 2017
Short summary
Short summary
In this work, we analysed the Cheongyang geomagnetic baseline data from 2014 to 2016. We observed a step of more than 5 nT in the H and Z baseline in 2014 and 2015 due to artificial magnetic noise in the absolute hut. The baseline also shows a periodic modulation due to temperature variations in the fluxgate magnetometer hut. The quality of the baselines was improved by correcting the discontinuity in the H and Z baselines.
Anu Heikkilä, Jussi Kaurola, Kaisa Lakkala, Juha Matti Karhu, Esko Kyrö, Tapani Koskela, Ola Engelsen, Harry Slaper, and Gunther Seckmeyer
Geosci. Instrum. Method. Data Syst., 5, 333–345, https://doi.org/10.5194/gi-5-333-2016, https://doi.org/10.5194/gi-5-333-2016, 2016
Short summary
Short summary
Solar spectral UV irradiance data measured by the Brewer #037 spectroradiometer in Sodankylä, Finland, in 1990–2014 were examined for their quality flags given by the quality assurance (QA) tools of the European UV DataBase (EUVDB). Statistical analysis on the flags was performed, and five cases were investigated in detail. The results can be used in further development of the quality control/QA tools and selection of cases of exceptional atmospheric conditions for process studies.
T. O'Donnell Meininger and J. S. Selker
Geosci. Instrum. Method. Data Syst., 4, 19–22, https://doi.org/10.5194/gi-4-19-2015, https://doi.org/10.5194/gi-4-19-2015, 2015
K. Willett, C. Williams, I. T. Jolliffe, R. Lund, L. V. Alexander, S. Brönnimann, L. A. Vincent, S. Easterbrook, V. K. C. Venema, D. Berry, R. E. Warren, G. Lopardo, R. Auchmann, E. Aguilar, M. J. Menne, C. Gallagher, Z. Hausfather, T. Thorarinsdottir, and P. W. Thorne
Geosci. Instrum. Method. Data Syst., 3, 187–200, https://doi.org/10.5194/gi-3-187-2014, https://doi.org/10.5194/gi-3-187-2014, 2014
O. Kemppinen, J. E. Tillman, W. Schmidt, and A.-M. Harri
Geosci. Instrum. Method. Data Syst., 2, 61–69, https://doi.org/10.5194/gi-2-61-2013, https://doi.org/10.5194/gi-2-61-2013, 2013
D. Mayer, A. Steiner, and R. Steinacker
Geosci. Instrum. Method. Data Syst., 1, 135–149, https://doi.org/10.5194/gi-1-135-2012, https://doi.org/10.5194/gi-1-135-2012, 2012
Cited articles
Brändström, U.: Kiruna All-Sky Camera, Swedish Institute of Space Physics, available at: http://www2.irf.se/allsky/data.html, last access: 7 July 2020. a
Culverhouse, P. F.: Human and machine factors in algae monitoring performance,
Ecol. Inform., 2, 361–366,
https://doi.org/10.1016/j.ecoinf.2007.07.001, 2007. a, b, c
Culverhouse, P. F., Williams, R., Reguera, B., Herry, V., and González-Gil,
S.: Do experts make mistakes? A comparison of human and machine
indentification of dinoflagellates, Mar. Ecol.-Prog. Ser., 247,
17–25, https://doi.org/10.3354/meps247017, 2003. a
Domingos, P.: A unified bias-variance decomposition, in: ICML '00: Proceedings
of the Seventeenth International Conference on Machine Learning, edited by:
Langley, P., Morgan Kaufmann Publishers Inc., San Francisco,
CA, USA, 231–238, 2000. a
Kvammen, A., Wickstrøm, K., McKay, D., and Partamies, N.: Auroral Image
Classification with Deep Neural Networks, https://doi.org/10.1002/essoar.10501968.1 online first, 2020a. a, b, c, d
Kvammen, A., Wickstrøm, K., McKay, D., and Partamies, N.: Replication Data for: Auroral Image Classification with Deep Neural Networks, DataverseNO, https://doi.org/10.18710/SSA38J, 2020b. a
Syrjäsuo, M., Donovan, E., Qin, X., and Yang, Y.: Automatic classification
of auroral images in substorm studies, in: 8th International Conference on
Substorms (ICS8), 309–313, available at: http://aurora.phys.ucalgary.ca/donovan/pdfs/syrjaesuo_ics8.pdf (last access: 7 July 2020),
2007. a
Yang, B., Spanswick, E., Liang, J., Grono, E., and Donovan, E.: Responses of
Different Types of Pulsating Aurora in Cosmic Noise Absorption, Geophys.
Res. Lett., 46, 5717–5724, https://doi.org/10.1029/2019GL083289,
2019. a
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., and Xiao, J.: LSUN:
Construction of a Large-scale Image Dataset using Deep Learning with Humans
in the Loop, available at: https://arxiv.org/pdf/1506.03365.pdf (last access: 7 July 2020),
2015. a
Zhu, T., Johnson, A. E. W., Behar, J., and Clifford, G. D.: Crowd-Sourced
Annotation of ECG Signals Using Contextual Information, Ann. Biomed.
Eng., 42, 871–884, https://doi.org/10.1007/s10439-013-0964-6, 2014. a
Short summary
Researchers are making increasing use of machine learning to improve accuracy, efficiency and consistency. During such a study of the aurora, it was noted that biases or distortions had crept into the data because of the conditions (or ergonomics) of the human trainers. As using machine-learning techniques in auroral research is relatively new, it is critical that such biases are brought to the attention of the academic and citizen science communities.
Researchers are making increasing use of machine learning to improve accuracy, efficiency and...