# # # Distribution Statement A. Approved for public release. Distribution unlimited.
# # #
# # # Author:
# # # Naval Research Laboratory, Marine Meteorology Division
# # #
# # # This program is free software: you can redistribute it and/or modify it under
# # # the terms of the NRLMMD License included with this program. This program is
# # # distributed WITHOUT ANY WARRANTY; without even the implied warranty of
# # # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the included license
# # # for more details. If you did not receive the license, for more information see:

Version 1.4.2 (2022-02-05)#

v1.4.2: 2022-02-05, finalizing procflows to allow unprojected outputs, updating test outputs for consistent shapefiles

Test Repo Updates#

  • Updated to Natural Earth Vector v5.0.0 shapefiles

    • AMSR2 TC image - very slightly modified political boundaries

    • AHI global image - very slightly modified political boundaries

Major New Functionality#

  • SAR Incident Angle Product

    • Added “incident_angle” variable to SAR xarray output

    • Added “incident-angle” product to “sar-spd” product_inputs

    • Added “incident-angle” YAML product_params, and test script

  • ASCAT UHR windbarbs test script

  • “unprojected_image” output_format module

    • Plots the data with no resampling - no area_def required

    • Call signature: xarray_obj, product_name, output_fnames, product_name_title=None, mpl_colors_info=None

      x_size=None, y_size=None

  • “unprojected” outputter_type

    • Call signature: xarray_obj, product_name, output_fnames, product_name_title=None, mpl_colors_info=None

  • Support <DATASET>:<VARNAME> variable requests in product_inputs YAML config files

    • Update VIIRS Night-Visible to use DNB:SunZenith

    • Update VIIRS Visible to use MOD:Sunzenith

    • Update AHI Visible to use MED:Sunzenith

  • Added noaa-20 platform to amsub_mirs reader

  • Filter “poor” quality data within SMOS reader

    • previously was saving poor, fair, and good

Improvements#

  • Installation Improvements

    • Allow skipping installation steps, rather than just continuing or quitting altogether

    • Separate steps for downloading cartopy map data and linking to ~/.local

    • Separate rclone, seviri, and vim8 installation steps (to allow skipping one or more if not needed)

  • Updated command line arguments

    • sectored_read / resampled_read - specifications for primary dataset

      • Determines whether to read data initially or within area_def loop

    • self_register_dataset, self_register_source, and self_register_platform

      • Explicitly request using specific dataset lat/lons as the area_def target for resampling

      • Add self_register area_def specification in get_area_defs_from_commandline_args

    • fuse_sectored_read / fuse_resampled_read - specifications for additional datasets

    • fuse_self_register_dataset, fuse_self_register_source, fuse_self_register_platform

  • Updated procflow ordering

    • Tunable data read order within procflows (based on data read requirements)

      • For self_register or reader_defined area_defs - must read data prior to calling

        get_area_defs_from_commandline_args (so area information is available within the xarray dataset when identifying area_defs)

      • For externally specified area_defs, read data after calling get_area_defs_from_commandline_args,

        to reduce processing time if there is no coverage

      • For sectored_read / resampled_read data types, do not read data until we are within the area_defs loop

    • Tunable algorithm order within procflows (based on alg_type specified in dev/alg.py)

      • Support alg_cmap and alg_interp_cmap algorithm types (previously only interp_alg_cmap supported -

        allow calling algorithm prior to data interpolation)

    • Tunable sectoring order within procflows (based on data read requirements)

      • Do not sector reader_defined or self_register sector types - must use full dataset, no padding available

    • Tunable outputter_types within procflows (variable call signatures)

      • xarray_data

      • image

      • image_overlay

      • unprojected_image

  • Add mem_usg and process_times output to procflows for monitoring

Bug fixes#

  • Update pmw_37 and windbarbs algorithms to only include mandatory “arrays” argument, make output_data_range optional

    • If None, output_data_range will default to 230 to 280 for 37pct, and data min/max for windbarbs.

  • Update single_source procflow to ensure “resampled_read” is passed to get_alg_xarray

    • to allow using the resampled dataset for retrieving the requested variables

    • if <DATASET_NAME>:<VARIABLE_NAME> construct used in product_inputs YAML configs,

      we must assure resampled data is not limited to the native datasets, since they will no longer exist