NARA Discovery
Article Details
← Back to Search Results
Journal Article

Relationship of flagging frequency to confidence intervals in the statistical regression approach for automated quality control of T max and T min

Jinsheng You; Kenneth G. Hubbard
International Journal of Climatology · Vol. 27, Issue 9 · pp. 1257-1263 · 2007

Abstract

With the widespread use of electronic interfaces in data collection, many networks have increased, or will increase, the sampling rate and add more sensors. The associated increase in data volume will naturally lead to an increased reliance on automatic quality assurance (QA) procedures. The number of data entries flagged for further manual validation can be affected by the choice of confidence intervals in statistically based QA procedures, which in turn affects the number of bad entries classified as good measurements. At any given station, a number of confidence intervals for the Spatial Regression Test (SRT) were specified and tested in this study, using historical data for both the daily minimum ( T min ) and maximum ( T max ), to determine how the frequency of flagging is related to the choice of confidence interval. An assessment of the general relationship of the number of data flagged to the specified confidence interval over a set of widely dispersed stations in the High Plains was undertaken to determine whether a single confidence factor would suffice, at all stations, to identify a moderate number of flags. This study suggests that using a confidence factor ‘ f ’ larger than 2.5 to specify the confidence interval will flag a reasonable number of measurements (

Bibliographic Information

JournalInternational Journal of Climatology
PublisherWiley
Publication Date2007-07-01
Publication Year2007
Volume27
Issue9
Pages1257-1263
Document TypeJournal Article
Print ISSN0899-8418
eISSN1097-0088
DOI10.1002/joc.1484
SubjectAtmospheric Sciences

Access Information

NARA Access Coverage1996-01-01~Current
Journal Homepagehttps://rmets.onlinelibrary.wiley.com/loi/10970088
Publisher PageOpen Publisher Page
Full-text access depends on NARA's subscribed coverage and institutional access.