# # # Distribution Statement A. Approved for public release. Distribution unlimited.# # ## # # Author:# # # Naval Research Laboratory, Marine Meteorology Division# # ## # # This program is free software: you can redistribute it and/or modify it under# # # the terms of the NRLMMD License included with this program. This program is# # # distributed WITHOUT ANY WARRANTY; without even the implied warranty of# # # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the included license# # # for more details. If you did not receive the license, for more information see:
Version 1.4.2 (2022-02-05)#
v1.4.2: 2022-02-05, finalizing procflows to allow unprojected outputs, updating test outputs for consistent shapefiles
Test Repo Updates#
Updated to Natural Earth Vector v5.0.0 shapefiles
AMSR2 TC image - very slightly modified political boundaries
AHI global image - very slightly modified political boundaries
Major New Functionality#
SAR Incident Angle Product
Added “incident_angle” variable to SAR xarray output
Added “incident-angle” product to “sar-spd” product_inputs
Added “incident-angle” YAML product_params, and test script
ASCAT UHR windbarbs test script
“unprojected_image” output_format module
Plots the data with no resampling - no area_def required
- Call signature: xarray_obj, product_name, output_fnames, product_name_title=None, mpl_colors_info=None
x_size=None, y_size=None
“unprojected” outputter_type
Call signature: xarray_obj, product_name, output_fnames, product_name_title=None, mpl_colors_info=None
Support <DATASET>:<VARNAME> variable requests in product_inputs YAML config files
Update VIIRS Night-Visible to use DNB:SunZenith
Update VIIRS Visible to use MOD:Sunzenith
Update AHI Visible to use MED:Sunzenith
Added noaa-20 platform to amsub_mirs reader
Filter “poor” quality data within SMOS reader
previously was saving poor, fair, and good
Improvements#
Installation Improvements
Allow skipping installation steps, rather than just continuing or quitting altogether
Separate steps for downloading cartopy map data and linking to ~/.local
Separate rclone, seviri, and vim8 installation steps (to allow skipping one or more if not needed)
Updated command line arguments
sectored_read / resampled_read - specifications for primary dataset
Determines whether to read data initially or within area_def loop
self_register_dataset, self_register_source, and self_register_platform
Explicitly request using specific dataset lat/lons as the area_def target for resampling
Add self_register area_def specification in get_area_defs_from_commandline_args
fuse_sectored_read / fuse_resampled_read - specifications for additional datasets
fuse_self_register_dataset, fuse_self_register_source, fuse_self_register_platform
Updated procflow ordering
Tunable data read order within procflows (based on data read requirements)
- For self_register or reader_defined area_defs - must read data prior to calling
get_area_defs_from_commandline_args (so area information is available within the xarray dataset when identifying area_defs)
- For externally specified area_defs, read data after calling get_area_defs_from_commandline_args,
to reduce processing time if there is no coverage
For sectored_read / resampled_read data types, do not read data until we are within the area_defs loop
Tunable algorithm order within procflows (based on alg_type specified in dev/alg.py)
- Support alg_cmap and alg_interp_cmap algorithm types (previously only interp_alg_cmap supported -
allow calling algorithm prior to data interpolation)
Tunable sectoring order within procflows (based on data read requirements)
Do not sector reader_defined or self_register sector types - must use full dataset, no padding available
Tunable outputter_types within procflows (variable call signatures)
xarray_data
image
image_overlay
unprojected_image
Add mem_usg and process_times output to procflows for monitoring
Bug fixes#
Update pmw_37 and windbarbs algorithms to only include mandatory “arrays” argument, make output_data_range optional
If None, output_data_range will default to 230 to 280 for 37pct, and data min/max for windbarbs.
Update single_source procflow to ensure “resampled_read” is passed to get_alg_xarray
to allow using the resampled dataset for retrieving the requested variables
- if <DATASET_NAME>:<VARIABLE_NAME> construct used in product_inputs YAML configs,
we must assure resampled data is not limited to the native datasets, since they will no longer exist