Supplement to "Discriminating non-stationary flood hazard effects via probabilistic estimation of sparse residuals from rescued and rated stage–discharge data"

This supplement contains the data and script associated with “Sparse hydrometric data rescue for exploratory analyses of conveyance-driven flood hazard trends and controls,” which has been submitted to a journal for consideration. This supplement is deposited on Zenodo.

Code, Data, and Attribute Descriptions

Uploaded are five directories (indicated in bold font, with their contents detailed below) containing input data and various outputs of the analyses performed for our case study on the Pulangi River at Lumayong (Philippines). Please consider this description equivalent to an omnibus README file for the deposited files. Note that we collected and rescued the hydrometric data herein from the archives of the Water Projects Division (WPD) of the Philippine Department of Public Works and Highways (DPWH).

●      Pln_R_code contains (1) Pln_RC.R, the R script file, and (2) 240601_Pln_RC.RData, which stores objects generated from the script based on the last execution (on 1 June 2024). The script consists of admittedly too many lines of code (e.g., for data wrangling, formal analyses, and producing figures used in the manuscript) that should have been split into multiple .R files. Apologies. Please be guided by the outline and the comments and kindly reach out lest issues with the code arise.

●      Pln_GH_PDFs contains the scanned gaugekeeper’s reports of gauge heights (“stages”).   

○      The name of each file varies. For example, Pln-GH-1100.pdf contains daily stage readings for all months in the year 2011. But, if the last two digits are not zeroes, as in Pln-GH-1204.pdf, they refer to the month of that year; in this case, for example, the PDF file contains stage data for the month of April in the year 2012.

○      Each scanned sheet contains sub-daily (with readings at “AM,” “NOON,” and “PM”) and mean daily stages for a given month.

○      Also indicated are the gaugekeeper’s remarks on the daily weather (e.g., “fair,” “cloudy”). Under inclement weather, the gaugekeeper would note the duration of rainfall and its intensity and might, at times, record extra stage readings.

●      Pln_DM_PDFs contains the following PDF files and a sub-directory:

○      Pln-DM-.pdf contains the scanned log for each direct stage—discharge measurement, otherwise known as “gaugings.” Each file is named according to the date of gauging (YYMMDD). For example, the log for the gauging performed on 24 February 2011 can be found in the file Pln-DM-110224.pdf. Data from these gaugings are summarized in Pln-DM-filtered.csv in the Pln_In_CSVs directory.

■      The readability of each file varies based on the original quality of the original paper-format data.

■      The first page in each file contains, on the left side, a summary of the gauging data and metadata (e.g., date of measurement, number of gauging verticals or “sections” used, method of crossing or measuring the cross-section), and on the right side, the velocity—area readings at each gauging vertical.

■      The second page in each file contains the plotted cross-section of the channel at the time of measurement.

○      Pln-RC.pdf contains various other paper-format data and some annotations relevant to the historical rating at the station.

■      P. 1: The hydrographic engineer’s comment (dated 19 January 2012) on the evaluation of the discharge data, specifically detailing the periods of validity of the rating curves developed for different sub-periods of monitoring.

■      PP. 2—3: A summary table of all the gaugings performed from 1983 to 2010 whose logs were no longer retrievable (and hence not included as a DM-PDF file in this directory).

■      PP. 4—5: Plots of the official stage—discharge rating curves developed by DPWH hydrographers.

■      PP. 6—8: Rating tables used to convert daily mean stages to deterministic discharge estimates. Two of these rating tables were digitized and can be found in the Pln_RatingTables sub-directory in Pln_In_CSVs.

■      PP. 9—22: Daily stage (m) and its corresponding daily discharge (L/s) for the 2004—2010 sub-period. The stages were digitized and included in Pln-H_arch.csv in the Pln_In_CSVs directory.

○      Pln_DM_unused contains the PDF files of logs (including data and metadata) corresponding to the gaugings that were excluded from our analysis following our filtering step for gauging location consistency.

●      Pln_In_CSVs contains the following CSV files and two sub-directories; these files were used as inputs to the R script for formal analyses:

○      Pln-H_arch.csv contains the mean daily stage values [“H_bar_arch”] (m) for every day in the 2004—2020 sub-period [“Date”] (YYYY-MM-DD). The stages in this file are already corrected for gross errors.

○      Pln-DM-filtered.csv contains the following information on the gaugings performed on the Pulangi at Lumayong (1983—2020): (i) date [“Date”] (YYYY-MM-DD); (ii) stage [“H”] (m); (iii) discharge in L/s [“Q_lps”] and m3/s [“Q_cms”]; (iv) wetted area [“A_sqm”] (m2); (v) mean flow velocity [“Vel_mps”] (m/s); (vi) channel width [“W_m”] (m); (vii) mean flow depth [“D_ave_m”] (m); (viii) location of the measurement cross-section with respect to the staff gauge, with negative values meaning downstream of the gauge and positive values meaning upstream of the gauge [“XS_loc_wrt_gage”]; (ix) maximum flow depth [“Max_Depth_m”] (m); and (x) minimum streambed elevation [“MINSBE”] (m). Note that this file includes only gaugings that passed our filtering step for measurement location consistency.

○      Pln-DM_oview.csv contains information on the temporal coverage (bounded by “Start_date” and “End_date”) of the available hydrometric data from the station archives.

○      Pln-H_sample_GrossE_corr.csv contains a sample sub-period (2017-06-15 through 2017-11-30) and the corresponding values of stages (m), uncorrected [“H_uncorrected”] and corrected for gross errors [“H_corrected”]. This CSV file was used as an input to the R script to produce one of the figures in the manuscript. 

○      Pln-XS-csv.csv contains data on the gauging transects: gauging ID [“GaugingID”]; date [“Date”] (YYYY-MM-DD); lateral distance from a fixed initial point [“Lat_distance”] (m); width of the gauging vertical [“Width_vert..m.”] (m); depth relative to the water surface [“Depth..m.”] (m); stage at the gauging vertical [“H_m_vert..m.”] (m); and elevation with respect to a fixed arbitrary datum at the station [“Elev..m.”] (m).

○      Pln_Rating_Tables contains two rating tables, Pln-DM - RatingTable_A.csv and Pln-DM - RatingTable_B.csv, prepared and used by DPWH hydrographers for converting stage values to deterministic discharge estimates for the Pulangi River at Lumayong for the 1980s—early 2000s sub-period. Each rating table contains columns for stage [“H”], discharge in L/s [“Q_lps”], and discharge in m3/s [“Q_cms”].

○      Pln_Q_rated contains two CSV files: Pulangi.csv has the columns “YEAR”, “DAY”, and every month of the year [“JAN” through “DEC”] for the 1983—2003 sub-period, with the values under each month column indicating the deterministic discharge estimates in L/s; Pulangi_trunc.csv contains similarly formatted data, but for the 2009—2010 sub-period.

●      Pln_Out_CSVs contains two CSV files, the primary outputs of the hydrometric data rescue effort.

○      Pln_Q_recon.csv contains the reconstructed discharge time series (1983—2020) and its associated uncertainties at the 95% credibility interval. It has the following columns: date [“Date”] (YYYY-MM-DD); daily stage [“H”] (m); lower bound of the discharge estimate [“Q_lwr”] (m3/s); median discharge estimate [“Q_med”] (m3/s); and the upper bound of the discharge estimate [“Q_upr”] (m3/s).

Pln_H_recon.csv contains the reconstructed and quality-controlled stage time series (1983—2020). It has the following columns: date [“Date”] (YYYY-MM-DD); mean daily stage that has been corrected for gross errors, but not yet filtered through other quality checks [“H_bar_arch”] (m); quality check for low outliers [“Low_Outlier”] (TRUE/FALSE); quality check for flatliners [“Flatliner”] (TRUE/FALSE); difference between the stage values on day i and day i-1 [“Daily_Step”] (m); quality check for large steps [“Large_Step”] (TRUE/FALSE); and the corrected and quality-controlled mean daily stage values [“H”] (m).