C1 Infrastructure: Multi-Sensor Compositing for Hydrometeor Classification, High-Impact Weather, Nowcasting and Data Assimilation


Joint project between University of Bonn and Free University of Berlin

University of Bonn, Institute for Geoscience, section Meteorology: Dr. Silke Trömel (PI), Prof. Dr. Clemens Simmer (PI),
Mahfuja Akter (research scientist)
Free University of Berlin: Dr. René Preusker (PI), Prof. Dr. Jürgen Fischer (PI)
Dr. Cintia Carbajal Henken (research scientist)

RealPEP follows the hypothesis, that Quantitative Precipitation Estimation (QPE), Quantitative Precipitation Nowcasting (QPN) and Quantitative Precipitation Forecasting (QPF) by Numerical Weather Prediction (NWP) can be significantly improved by exploiting the full observational state evolution information of the precipitation-generating atmosphere, which will be provided by this central service project. Besides polarimetric radar observations of the DWD network and NWP analyses and predictions, C1 will integrate satellite-based near- and thermal infrared observations, GNSS-derived total column water vapor fields and lightning data. In cooperation with P2, advection and convergence of total water vapor fields will enrich observation-based nowcasting with indications of convection initiation and intensifying precipitation.

The data collection and exploitation platform will employ the DWD C++ processing platform POLARA, which includes already several standard radar processing and analysis tools suitable for creating initial data for P1 to P4, and which will be expanded during the course of RealPEP. C1 will initiate and guide the updating of POLARA with developments by RealPEP and from other sources, and its integration into the RealPEP process chain from QPE to flood prediction.

Contribution of University of Bonn

Figure C1-1: Flowchart for Benchmark generation with 4 months data set, RealPEP-meeting 5-6 Dec'2022.

At University of Bonn a first installation of the POLARA C++ processing framework has been set up on a dedicated server. After joining a POLARA workshop, the project scientist dives into the overall structure of the complex framework and into the details of a first set of routines for data quality, data processing (e.g. for the processing of differential phase shift DP), and compositing. Figure C1-1 shows examples of two compositing algorithms.

In May 2022, a new project scientist took over the position at Uni Bonn and installed an updated version of the POLARA C++ processing framework. The project scientist dived into the overall structure of the POLARA framework and the so-called POLARA-RECALC system. The latter allows parallel processing of multiple jobs by splitting the time period and processes and archives the output data. The POLARA-RECALC system is configured to process multiple days/months of data and can utilize generated output data files from one job into another job during runtime.

In a joint effort, the RealPEP research group aims at a benchmark data set for in-depth evaluation of RealPEP developments along the process chain from QPE to flash flood prediction based on a 4 months data set. Thus, algorithms inherent in POLARA have been extended and also complemented by algorithms developed in projects P1 and P2 (see Fig. C1-1). However, POLARA's Quality Assurance (QA) job is not completely suitable for the Quantitative Precipitation Estimation (QPE) algorithm to be implemented. Therefore, the QA job has been extended for the vertical channels (e.g. attenuation correction of vertical reflectivity ZV) and the processing of several intermediate products/ variables like reflectivity ZH/ZV, differential reflectivity ZDR and corrected differential phase ΦDP from the QA job (see Fig. C1-2) is now fed into the RealPEP job to implement the new QPE algorithm using specific differential phase KDP and specific attenuation A,R(KDP)/R(A), developed in P1. E.g., a different method to estimate the attenuation parameter α is applied. Also, the corrected ΦDP from QA job is further processed in RealPEP job (e.g. including the removal of isolated points, subtracting the system ΦDP, smoothening, and interpolation), KDP is then calculated from interpolated ΦDP (utilizing the POLARA algorithm), and the noise correction for the correlation coefficient ρHV is implemented. The hotspot detection following Gu et al. (2011) is implemented and also different formulations for (differential) attenuation correction below, within, and above the melting layer are applied. Next steps include the implementation of a ΦDP bump correction (backscatter differential phase δ), replacement of POLARAs spline interpolation for KDP calculation, and additional local KDP smoothening, as suggested in the P1-QPE algorithm. Additionally, the POLARA-RECALC system is now able to run the nowcasting (QPN) algorithm (e.g. STEPS or SPROG-LOC) scripts provided by P2 on a specific parameterized setup that aligns with the system (see again Fig. C1-1).


Figure C1-2: Data flow of POLARA QA and RealPEP jobs.





References

Chen, J.-Y., S. Trömel, A. Ryzhkov, C. Simmer, 2021: Assessing the benefits of specific attenuation for quantitative precipitation estimation with a C-band radar network, Journal of Hydrometeorology, 22(10), 2617–2631, https://doi.org/10.1175/JHM-D-20-0299.1.

Gu, J., A. V. Ryzhkov, P. Zhang, P. Neilley, M. Knight, B. Wolf, and D. Lee, 2011: Polarimetric attenuation correction in heavy rain at C Band. J. Appl. Meteor. Climatol., 50, 39-58, https://doi.org/10.1175/2010JAMC2258.1.

Reinoso-Rondinel R., M. Rempel, M. Schultze, S. Trömel, 2022: Nationwide Radar-Based Precipitation Nowcasting – A Localization Filtering Approach and its Application for Germany. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, 1670–1691, doi: 10.1109/JSTARS.2022.3144342, https://ieeexplore.ieee.org/document/9689956.


Contribution of University of Bonn
At Uni Bonn a first installation of the POLARA C++ processing framework has been set up on a dedicated server. After joining a POLARA workshop, the project scientist dives into the overall structure of the complex framework and into the details of a first set of routines for data quality, data processing (e.g. for the processing of differential phase shift DP), and compositing. Figure C1-1 shows examples of two compositing algorithms.



Figure C1-1: Example of composites of horizontal reflectivities ZH measured with the DWD C-band radar network at 16:55 UTC on 25 July 2017. Maximum algorithm (left panel) retrieves composite values w.r.t. the maximum value within the column, while MinMSL algorithm (right panel) uses the values monitored at the minimum height above mean sea level.

Contribution Free University of Berlin
The aim is to support and improve quantitative precipitation estimation and nowcasting by exploiting satellite data. The predictive potential of organized structures and/or variability metrics in spatially (later also temporal) high resolution clear-sky water vapor fields regarding convective initiation is investigated. A set of satellite retrieved cloud properties at high temporal resolution contribute to information on cloud evolution and possibly on-going precipitation generation. Additionally, satellite data will be prepared for digestion by POLARA.

At the moment the project scientists works on both on the development of both the OLCI-Sentinel-3 integrated water vapour retrieval and SEVIRI-MSG integrated water vapour retrieval. The OLCI retrieval provides high spatial resolution and precision water vapour fields about twice a day, while the MSG retrieval provides high temporal water vapour fields at lower spatial resolution and precision. For OLCI about 1,5 years of data has been processed (see Figure C1-2 as an example) and first evaluation studies using GPS observations and model data are performed. MSG cloud products are collected and temporally and spatially matched with processed OLCI data as well as GPS data. These match-up datasets will be extended with the newly developed MSG retrievals and used in convective initiation studies.

Figure C1-2: Example of OLCI-retrieved integrated water vapor for 9:15 UTC on 16 June 2016.