VerificationIssuesatNCEP.pptVIP

Verification Issues at NCEP Zoltan Toth and Yuejian Zhu Environmental Modeling Center NOAA/NWS/NCEP Acknowledgements: Geoff DiMego, Mark Iredell and Stephen Lord EMC Contents Design Principles: Modularity, Flexibility, Portability An EMC-wide verification system is not worth doing unless it is modular, flexible, and portable. Most people will want to use such a system, and many will be able to contribute to its development. Verification Statistics: Types, scope and etc.. Required diagnostic/verification scores Deterministic, probabilistic … Sample Modularity Design General scripts - inputs Components Required Display Capabilities Design Principles Modularity. The verification system should be broken into modules with pre-defined interfaces so that different users can work on different parts of the code without affecting each other. This common shared stream of modules would be unified and much of the code would be shared across EMC. The design of the verification system would be bought into by all EMC groups. User groups can make necessary changes for their special applications. The VSDB format is an example of this kind of interface, but the statistic generating codes and the display codes could be more modular. Flexibility. New kinds of verification scores need to be easily added to the verification system without having to ask an expert. We cannot readily anticipate ahead of time what these new kinds of scores are. Modularity would allow users to modify specific parts without detailed knowledge about the rest of the software. The system should be adaptable to other modeling systems: ocean, land, cryosphere, space, single column, osses, etc. Portability. All codes should be able to run efficiently on the CCS or on the EMC workstations. GUI menu driven software should be able to reach all the way back into the robotic tape archives if necessary. Verification Statistics Major types of statistics Diagnostics (depends on forecast only) Verificat