Distribution Statement

# # # This source code is subject to the license referenced at

# # # NRLMMD-GEOIPS.

Version 1.4.2 (2022-02-05)

v1.4.2: 2022-02-05, finalizing procflows to allow unprojected outputs, updating test outputs for consistent shapefiles

Test Repo Updates

• Updated to Natural Earth Vector v5.0.0 shapefiles

  • AMSR2 TC image - very slightly modified political boundaries

  • AHI global image - very slightly modified political boundaries

Major New Functionality

• SAR Incident Angle Product

  • Added “incident_angle” variable to SAR xarray output

  • Added “incident-angle” product to “sar-spd” product_inputs

  • Added “incident-angle” YAML product_params, and test script

• ASCAT UHR windbarbs test script

• “unprojected_image” output_format module

  • Plots the data with no resampling - no area_def required

  • Call signature: xarray_obj, product_name, output_fnames, product_name_title=None, mpl_colors_info=None

    x_size=None, y_size=None

• “unprojected” outputter_type

  • Call signature: xarray_obj, product_name, output_fnames, product_name_title=None, mpl_colors_info=None

• Support <DATASET>:<VARNAME> variable requests in product_inputs YAML config files

  • Update VIIRS Night-Visible to use DNB:SunZenith

  • Update VIIRS Visible to use MOD:Sunzenith

  • Update AHI Visible to use MED:Sunzenith

• Added noaa-20 platform to amsub_mirs reader

• Filter “poor” quality data within SMOS reader

  • previously was saving poor, fair, and good

Improvements

• Installation Improvements

  • Allow skipping installation steps, rather than just continuing or quitting altogether

  • Separate steps for downloading cartopy map data and linking to ~/.local

  • Separate rclone, seviri, and vim8 installation steps (to allow skipping one or more if not needed)

• Updated command line arguments

  • sectored_read / resampled_read - specifications for primary dataset

    • Determines whether to read data initially or within area_def loop

  • self_register_dataset, self_register_source, and self_register_platform

    • Explicitly request using specific dataset lat/lons as the area_def target for resampling

    • Add self_register area_def specification in get_area_defs_from_commandline_args

  • fuse_sectored_read / fuse_resampled_read - specifications for additional datasets

  • fuse_self_register_dataset, fuse_self_register_source, fuse_self_register_platform

• Updated procflow ordering

  • Tunable data read order within procflows (based on data read requirements)

    • For self_register or reader_defined area_defs - must read data prior to calling

      get_area_defs_from_commandline_args (so area information is available within the xarray dataset when identifying area_defs)

    • For externally specified area_defs, read data after calling get_area_defs_from_commandline_args,

      to reduce processing time if there is no coverage

    • For sectored_read / resampled_read data types, do not read data until we are within the area_defs loop

  • Tunable algorithm order within procflows (based on alg_type specified in dev/alg.py)

    • Support alg_cmap and alg_interp_cmap algorithm types (previously only interp_alg_cmap supported -

      allow calling algorithm prior to data interpolation)

  • Tunable sectoring order within procflows (based on data read requirements)

    • Do not sector reader_defined or self_register sector types - must use full dataset, no padding available

  • Tunable outputter_types within procflows (variable call signatures)

    • xarray_data

    • image

    • image_overlay

    • unprojected_image

• Add mem_usg and process_times output to procflows for monitoring

Bug fixes

• Update pmw_37 and windbarbs algorithms to only include mandatory “arrays” argument, make output_data_range optional

  • If None, output_data_range will default to 230 to 280 for 37pct, and data min/max for windbarbs.

• Update single_source procflow to ensure “resampled_read” is passed to get_alg_xarray

  • to allow using the resampled dataset for retrieving the requested variables

  • if <DATASET_NAME>:<VARIABLE_NAME> construct used in product_inputs YAML configs,

    we must assure resampled data is not limited to the native datasets, since they will no longer exist