A description of both the DESRAD concept and the Diurnal Test Facility is presented here along with examples of
the model verification data and a brief measurement uncertainty analysis.
Not exact matches
As to validated, I was speaking in terms of
model validation —
verification of trends in the
model against
data, etc..
He is expert in application of the mesoscale
modelling output (numerical wind atlas
data) in microscale
models (including WAsP) for site specific
verification and feasibility studies.
But since my experience (always risky when thinking about statistics which so often has provable results that seem counter to intuition) tells me that one should be really excited to have a
model that shows more skill in
verification than over the
data against which it was calibrated, I have to wonder why discard those cases at all?
As I said on another blog, what would be an interesting comparison would be a comparison of
data to output from (e.g.) unmodified AR4 codes run further forward to 2013 (or as recent as is practicable) using the actual forcings, starting with the exact run states of the
models at the end of the
verification period for AR4 (that is the end - point where «known» forcings were used, rather than scenarios).
All of the
models are verified against observational
data, but in a
model with 10 ** 9 degrees of freedom, it is not always clear how to interpret these
verifications, and what elements of the solution are actually important in terms of the objectives of the simulation.
The recommendations for validation made by Sargent (the author) are: 1) assessing the conceptual validity of the
model 2) computer
model verification 3) necessary
data is available for building the
model
Recommendations for
verification are: 1) comparison to other
models 2) degenerate tests 3) event validity 4) extreme event validity 5) extreme condition tests 6) «face» validity tests 7) fixed value tests 8) historical
data validation 9) internal validity (stochastic runs) 10) multistage validation 11) parameter variability - sensitivity analysis 12) predictive validation 13) traces 14) turing tests (i didn't know what this is so googled ECWMF turing test, and i got 150 hits)
It was a striking
verification, with entirely independent methods and
data, of what computer
models had been predicting for the planetâ??