Sentences with phrase «data provenance»
Data provenance refers to the origin and history of data. It describes where the data came from, how it was created or obtained, and any changes made to it along the way. It helps in understanding the reliability, trustworthiness, and quality of the data. Full definition
There's a major difference in data provenance in 2006: GISS only uses USHCN data up to March 2006 in their US numbers; they have a population of non-USHCN sites: primarily airports (which dominate the current data in all the indices).
climateaudit.org
If you're talking about climate science, I agree that the lack of documentation of data provenance, be it in Nature, Science, GRL, is shameful and I've done what I can to draw attention to the problem.
A source hierarchy has been established which prioritizes datasets that have better data provenance, extensive metadata, and long, consistent periods of record.
In addition, data provenance flags are added to every observation to provide a history of that particular observation.
The possibility of this kind of thing, and retaining control of data provenance and the sequence of transactions done to data is a reason why different flavors of trusted timestamping might be a good idea for all these sources, including blockchain techniques.
Some methodological issues addressed by this project include: data provenance; quality control in data collection and analysis; representativeness of the collected data; and potential data gaps due to factors such as gender and access to technology.
In this talk I will provide an overview of the data provenance problem and illustrate some emerging solutions.