Recent Releases of NCO
NCO - Sea Shanty
Version 5.3.3 adds IEEE floating-point exception testing to ncks. All operators include corner-case quantization fixes for strange numbers (-0.0, NaN) that are also now in the netCDF-C Library. ncclimo now only tries to create regional timeseries statistics on variables that are single-level horizontal lat/lon/ncol fields. ncremap supports interpolation of pure-pressure to hybrid sigma-pressure coordinates with distinct source and destination surface pressure fields. And ncrename adds some words of caution. Skip this release if these changes do not interest you.
Did you realize that the first public release of ncks was May 2, 1995?
https://www.unidata.ucar.edu/mailing_lists/archives/netcdfgroup/1995/msg00069.html
Happy 30th birthday ncks!!!
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 1 month ago

NCO - Prime Rib
Version 5.3.2 mainly adds features and fixes to ncremap and quantization. Support for vertical interpolation of ECMWF IFS, and CAMS-format hybrid sigma-pressure vertical coordinate datasets has been improved. And the output is more CF-compliant. All arithmetic operators are once again able to use NCO quantization algorithms on variables in non-root groups. Skip this release if these changes do not interest you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 3 months ago

NCO - Dark Sunset (Palisades Lost)
Version 5.3.1 adds features and fixes to ncremap and ncclimo. The new autoconversion feature allows these scripts to automagically convert netCDF4 string variables to netCDF3 character arrays. The improved treatment of fixed time dimensions allows ncclimo to work with raw MERRA2 files. Together these improvements make possible regridding and vertical interpolation of the new formatting of Copernicus Data Store (CDS) files used for, e.g., ERA5. Skip this release if these changes do not interest you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 4 months ago

NCO - Awkward Self-Haircut
Version 5.3.0 significantly improves the unpacking of ELM/CLM/CTSM history and restart datasets, and seems complete in this regard. ncrcat has more friendly behavior when appending, and ncclimo now outputs more metrics (such as valid area per gridcell) when in regional statistics mode. This release many be skipped if these changes do not interest you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 4 months ago

NCO - Empathy Card
Version 5.2.9 significantly improves the unpacking of ELM/CLM/CTSM history and restart datasets. ncclimo and ncremap benefit from a few updates and fixes. This release many be skipped if these changes do not interest you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 7 months ago

NCO - Sitton Peak
Version 5.2.8 mostly contains features and fixes for regridding and climatology generation. Climatologies now allow the choice between two statistics (sums and means) to output as regional/global timeseries. The regridder fixes corner case behavior when the sub-gridscale (SGS) fraction is a missing value (as in ELM/CLM). Many improvements to the robustness and helpfulness of WARNINGs and ERRORs are included. Upgrades are encouraged for everyone who uses the regridder on ELM/CLM/CTSM datasets.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 8 months ago

NCO - Kealakekua
Version 5.2.7 contains updates to quantization metadata, enhanced grid area diagnostics for check_map, and bug-fixes for ncremap.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 9 months ago

NCO - Solstice
Version 5.2.6 contains a one-line bugfix to ncremap in 5.2.5. Unfortunately that horse had already escaped the barn. There is nothing else new in 5.2.6, so the release notes below repeat those for 5.2.5 so people can get a quick summary of new features since the previous widely distributed version, 5.2.4.
Version 5.2.6 fully implements the draft CF lossy metadata convention for all NCO internal quantization algorithms. It also improves ncclimo diagnostics and adds a new invocation synonym (--qnt) for quantization, and outputs a maximum_relative_error statistic where possible. ncclimo/ncremap add support for MPAS-Atmosphere datasets, and ncclimo supports excluding variable lists in timeseries mode. Skip this release if these changes are not important to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 11 months ago

NCO - Freight Train
Version 5.2.5 fully implements the draft CF lossy metadata convention for all NCO internal quantization algorithms. It also improves ncclimo diagnostics and adds a new invocation synonym (--qnt) for quantization, and outputs a maximum_relative_error statisticwhere possible. ncclimo/ncremap add support for MPAS-Atmosphere datasets, and ncclimo supports excluding variable lists in timeseries mode. Skip this release if these changes are not important to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender 11 months ago

NCO - Kamehameha I
Version 5.2.4 fully implements the CF lossy metadata convention for all NCO internal quantization algorithms. It also improves ncclimo diagnostics and adds a new invocation synonym (--qnt) for quantization. No major new features are implemented. Skip this release if these changes are not important to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 1 year ago

NCO - Cowboy Carter
ncclimo
now automates the correct options for regional averages of timeseries of subgridscale fields (useful for ELM/CLM).) Other fixes to ncclimo
splitter behavior are included. No major new features are implemented. Skip this release if these changes are not important to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 1 year ago

NCO - Bambino
Version 5.2.2 introduces a new operator, ncchecker, that checks dataset compliance with a small yet growing number of recommendations. ncclimo no longer omits time_bounds from ELM/CLM regional averages. No new features are implemented. Skip this release if these changes are not important to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 1 year ago

NCO - Shabu Shabu
Version 5.2.1 fixes an issue with ncremap and ncclimo in MPI mode. Another small fix to enables GCC compilation in pedantic mode. No new features are implemented, but it was too late to recall 5.2.0. My apologies and thanks to the package maintainers.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 1 year ago

NCO - Fast Car
Version 5.2.0 includes four major new features and various fixes. The features: 1) All operators append draft CF Convention behavior for metadata to encode lossy compression. 2) ncclimo timeseries mode now supports all input methods (including automatic filename generation) long-supported by climo mode. 3) ncremap Make-Weight-File (MWF) mode has been revamped and now support specifiable lists of algorithms. Last but not least, 4) ncks --s1d now converts CLM/ELM restart files from their native, inscrutable sparse 1-D (S1D) format to normal-looking files, without loss of information.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 1 year ago

NCO - Likanne o ka Moana
Version 5.1.9 updates ncremap to employ new TempestRemap weight-generation algorithms (bilinear and integrated bilinear), updates ncremap to recognize new names for existing algorithms, changes ncremap's default treatment of filling empty areas with missing values, and fixes a long-standing bug with ncra and ncrcat subcycle and interleave options. A notable fix for MS Windows OS is included as are a few other miscellaneous features described in the ANNOUNCE.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 1 year ago

NCO - Cafe Pasqual's
Version 5.1.8 recognizes NC_STRING as valid alternatives to NC_CHAR attributes (consistent with CF Conventions), infers MPAS grids stored in radians when units attributes are not present, and support checks for adherence to NASA DIWG (and CF) recommendations for valid identiers, and for the missing_value attribute. Skip this release if these issues are of no import to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 1 year ago

NCO - Barbenheimer
Version 5.1.7 simplifies netCDF codec invocation in ncremap/ncclimo, and fixes two issues with Intel compilers. Skip this release if these issues are of no import to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 2 years ago

NCO - Crossroads
Version 5.1.6 further polishes vertical interpolation, further improves NCZarr safety, and fixes minor ncremap issues, improves EAMxx support, adds basic support for regridding Coupler history files, and employs CF Conventions, where possible, on all input files regardless of whether they claim to be CF-compliant. This release can be skipped if you would not use the NCZarr and regridder improvements.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 2 years ago

NCO - Rhubarb Pi
Version 5.1.5 polishes the new vertical interpolation capabilities introduced in 5.1.3 and 5.1.4, improves the safety NCZarr operations, and fixes minor ncremap bugs. This release can be skipped if these regridding and NCZarr features are not useful to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 2 years ago

NCO - Bakhmut
Version 5.1.4 introduces vertical interpolation for datasets stored on depth/height grids, such as ocean data. The interpolation works on all datasets tested with vertical levels that are either horizontally varying (e.g., MPAS-Ocean, POP, MOM) or uniform (many observational datasets including ARGO, SOSE, WOA18). The algorithms play well with horizontally varying bathymetry. This release also fixes a vexing issue that can occur with certain compilers on AMD hardware. This release can be skipped if these regridding features are not useful to you.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 2 years ago

NCO - Mauna Loa
Version 5.1.3 improves the speed of vertical interpolation for fields whose most-rapidly-varying dimension is the vertical (not horizontal). This dramatically improves interpolation speed for EAMxx/SCREAM files. This release also fixes and issue in using ncremap
to invoke the interpolation. Other than that, this release can be skipped.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 2 years ago

NCO - Guerilla Poetry
Version 5.1.2 improves support for horizontal regridding, vertical interpolation, or both, on ultra high-resolution model output. Users of such functionality may benefit from upgrading, otherwise this release can be skipped.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 2 years ago

NCO - Tangentially Speaking
Version 5.1.1 add features for NCZarr, regridding, and interpolation. All operators now support NCZarr I/O and input filenames via stdin. ncremap supports two new vertical extrapolation methods, 1D files, and allows flexible masking based on external fields such sub-gridscale extent. ncclimo outputs regional averages. Numerous minor fixes improve codec support and regridding control. All users are encouraged to upgrade to this feature-rich release.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 2 years ago

NCO - Rattlesnake
Version 5.1.0 supports the new netCDF 4.9.0 features for filters and quantization. This is a significant new feature that justifies the version bump from 5.0.7 to 5.1.0. There is also an ncremap fix for sub-sub-gridscale regridding, e.g., landunit-specific regridding. Users of sub-SGS regridding, and anyone interested is using modern compression or quantization algorithms such as Bzip2, Zstandard, Granular BitGroom, and BitRound.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 3 years ago

NCO - Mariupol
Version 5.0.7 has new fixes and features for ncremap and ncclimo that ensure correct treatment of sub-gridscale fields and missing values. ncremap now allows and adjusts for missing values in SGS fields. Previously such missing values could botch SGS normalization. Users of SGS regridding are encouraged to upgrade. Others might skip this release.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 3 years ago

NCO - Heather
Version 5.0.5 brings a new lossy quantization codec, BitRound. ncclimo
has improved API consistency between climo generation and timeseries extraction. ncatted
introduces a new editing mode: prepending. If these issues do not interest you, you might skip 5.0.5.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 3 years ago

NCO - Potato Eaters
Version 5.0.4 contains significant changes to the ncclimo splitter API, minor changes to ncremap's --permute API and to invoking the internal inverse-distance weight generation. Along with these features come generally improved WARNINGs, HINTs, reduced noisiness of diagnostics for frequently used commands, and mitigation of compression issues triggered by netCDF 4.8.0+ library changes. Furthermore, numerous minor improvements to mbtempest and to ERWG support are included.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 3 years ago

NCO - Daikokuya
Version 5.0.3 contains significant improvements to the quantization algorithms and fixes to MOAB/mbtempest regridding. NCO now supports the Digit Round and Granular BitGroom quantization algorithms.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 3 years ago

NCO - Leptoukh
Version 5.0.2 contains significant new features and few minor fixes. ncclimo now splits timeseries into variables specified by regular expressions. ncremap now supports the MOAB parallel interface to the TempestRemap (TR) weight-generation libraries for 1D FV->FV grids. The regridder and all quantization algorithms (including BitGroom) have been refactored to treat NC_FILL_FLOAT/DOUBLE as the _FillValue if no other _FillValue has been explicitly set.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 3 years ago

NCO - Bend
Version 5.0.0 contains mostly ncremap features and fixes. You can probably skip this release unless you use ncremap. ncremap has crucial fixes for applying and exporting the mask field, if any. It also provides new flags to control the application of _FillValue attributes in empty destination cells, and to accomodate map-files that ignore or violate proper treatment of masked grids. ncks auxiliary coordinates (-X) now support wrapped longitude regions.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 4 years ago

NCO - Gesundheit!
Version 4.9.9 contains more fixes than features, and can probably be skipped by those who do not use ncremap or ncclimo. ncclimo now supports the mth_srt/end options for high resolution timeseries that do not begin/end in Jan/Dec (previously it only supported those arguments for monthly resolution). ncremap has crucial fixes for weight generation and map-checking for masked grids, fixes for curvilinear grid inferral, and automatic rounding when regridding integer-valued fields (like masks).
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 4 years ago

NCO - Death Valley
Version 4.9.8 contains a few cool features. These include support for unpacking sparse 1D (S1D) data and restart files used for plant functional types and multiple elevation classes, splitting monthly resolution timeseries that do not begin/end in Jan/Dec, seamless climos for the E3SM ice-sheet model (MALI), and corner-case bugfixes for inferring grid files and handling sub-gridscale data.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 4 years ago

NCO - Oculus
Version 4.9.7 is a minor NCO release that contains a few new features and fixes. Unless the features/fixes listed below affect you, no need
to upgrade this time. Most notable are support for inferring SCRIP grids from MPAS restart files, initial support for the CCR in ncap2, and ncclimo bug-fixes for high frequency data and for the glb_avg option.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 4 years ago

NCO - Windsor
Version 4.9.6 is a minor NCO release that contains a few new features and fixes. Unless the features/fixes listed below affect you, no need to upgrade this time.
NEW FEATURES (full details always in ChangeLog):
A. ncclimo supports a new option --var_xtr to specify "extra
variables" for the splitter to add to every generated timerseries.
The splitter attempts to keep the generated timeseries as lean as
possible and by default adds only the most useful ancillary variables,
such as grid coordinates and CF-associated variable, to split
timeseries. Previously, there was no way to add arbitrary variables,
e.g., the CO2 volume mixing ratio, to a split timeseries. Now users
can specify an arbitrary number of variables to includes in every
split timeseries, e.g.,
ncclimo --var=T,Q --var_xtr=co2vmr,FSDS ...
In this example the splitter produces two output files because there
are two primary variables (T,Q). Each timeseries also contain co2vmr
and FSDS. Inclusion of other variables, e.g., area, depends on context
and on other options
http://nco.sf.net/nco.html#var_xtr
B. This version is forward-compatible with netCDF 4.8.0, which we know
will contain some backward-incompatibile changes to filter behavior.
Once netCDF 4.8.0 is released, if it becomes the default version of
netCDF on your syste, then you will likely need to upgrade to NCO
4.9.6 as previous versions may be incompatible with netCDF 4.8.0.
C. ncclimo now supports the -P (or --prc_typ) option instead of -m
(or --mdl_nm) to determine the processing type. More importantly,
ncclimo the -P option to ncremap internally, which simplifies some
complex climo/regridding commands. For example, now it is possible to
create regridded climatologies of output that requires sub-gridscale
regridding with a single ncclimo command whereas previouly this
required separate ncclimo and ncremap commands:
ls elm.h0 | ncclimo -P elm -s 1 -e 500 --map=map.nc
ls mpaso | ncclimo -P mpaso -s 1 -e 500 --map=map.nc
ls mpassi | ncclimo -P mpassi -s 1 -e 500 --map=map.nc
The ncclimo -m mdl_nm option is still supported, and is required in
some situations, e.g., when the processing type is 'elm' yet the
history filenames use 'clm2' not 'elm'. In such mixed cases both -P
and -m options may be necessary.
http://nco.sf.net/nco.html#ncclimo
http://dust.ess.uci.edu/smn/smn_nco_e3sm_202010.pptx
D. ncclimo and ncremap now support the large memory AMD (cmem) nodes
on Cori when in MPI mode.
BUG FIXES:
A. ncremap fixes a bug that prevented MPI mode from working on Cori.
B. ncremap always retains (rather than potentially altering) the
input values of masks specified in SCRIP gridfiles when it writes
the output map-file.
C. ncremap correctly infers the final vertices of RLL grids stored
in north-to-south order. Previously, the final vertex could be
misdiagnosed for some counter-clockwise orderings of cells.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 4 years ago

NCO - RBG
Version 4.9.5 is a minor NCO release that contains a few new features and fixes to more smoothly work with current and future releases of the E3SM climate model and with the next netCDF release. Unless the features/fixes listed below affect you, chillax and upgrade next time.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 4 years ago

NCO - Gooseneck Spout
Version 4.9.4 contains new features focused on de-interleaving time coordinates and per-record weighting for ncra, high-freqency (e.g., diurnally-resolved) climatologies and new defaults for ncclimo, a new distance-weight extrapolation algorithm for ncremap, per-file weights for nces. New NCO-wide features include: support for unbuffered I/O that can speed-up I/O for large record variables, more precise quantization than Bit Grooming, and faster arithmetic that takes advantage of SIMD directives on OpenMP-enabled builds. Overall release is packed with interesting new features.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 4 years ago

NCO - Outlander
Version 4.9.3 contains many regridding fixes and features: This version updates adds robustness to the NCO weight-generator for PG2 grids, updates default options for TempestRemap, implements a high frequency mode for the splitter, and fixes some issues with ncremap, ncclimo, and ncrcat and works-around a backwards incompatibility with the latest netCDF library, 4.7.4.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 5 years ago

NCO - Delirium
We have re-licensed NCO source code from GPL3 to 3-Clause BSD starting with Version 4.9.2. Why? To encourage wider adoption and support. Without institutional (i.e., federal agency) support, NCO development would crawl to a standstill. We are acceding to the preferences of our occasional sponsors (DOE, NASA, NSF) for permissive OpenSource licenses.
Version 4.9.2 contains many regridding fixes and features: Improved adoption has made the NCO weight-generator more robust. Its signature strengths are speed and ultra-high resolution support. It can create ~3 km global maps from in under an hour to and from some (not all) grids including FV physics grids (ne1024pg2), MPAS grids, and RLL grids. Problems remain, though ncremap also supports ESMF and TempestRemap so take your pick. Moreover the map checker, ncks --chk_map, produces improved metrics with fewer false alarms.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 5 years ago

NCO - Skyglow
Version 4.9.1 contains an important bugfix for vertical interpolation, and two small new feature for ncclimo and ncpdq. It also fixes some autoconf-build issues that affected some users with Intel compilers, and those attempting parallel builds of NCO.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 5 years ago

NCO - Balasana
Version 4.9.0 includes new regridder features, JSON, and ncap2 fixes. Notably, this version simplifies the weight-application interface, parallelizes ncremap in stand-alone mode, and completely revamps, improves, and accelerates the sub-gridscale weight application algorithm.
The NCO conservative weight-generator algorithm also debuts. Previously, ncremap always used ESMF or TempestRemap to make weights. Use 'ncremap -a nco' to get NCO's conservative weight generation. NCO will always support ESMF and TR which are more time-tested. However, NCO has some unique features, like an option to output the overlap mesh in SCRIP format.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 5 years ago

NCO - INDICES
Version 4.8.1 primarily contains enhancements to the vertical interpolation feature of ncremap, ncclimo, and ncks. Two extrapolation options are now supported (nearest neighbor and missing value), and the entire procedure now works with the ECMWF IFS hybrid sigma pressure grid as input. Other changes include better support for north-to-south (n2s) Gaussian grid inferral and output, and ncclimo updates and improvements for finer-grained MPI parallelism.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 6 years ago

NCO - Becoming
Version 4.8.0 contains, as usual, numerous enhancements to ncremap and ncclimo. The most significant is vertical interpolation, which is useful to create new initial conditions for models, and to convert data to/from any desired hybrid coordinate or pure pressure vertical grid. Also we have changed NCO_PATH_OVERRIDE from opt-out to opt-in due to the increased maturity and use of the Conda NCO package which now pulls-in both ESMF_RegridWeightGen and TempestRemap.
ncap2 now allows creating brand-new files without specifying an existing input file, which eliminates an indefensible and annoying requirement. ncks can now easily detect and identify NaNs in datasets.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 6 years ago

NCO - Guru Benji
Producing data for submission to CMIP6 has led to many improvemnts to the two workflow tools ncclimo and ncremap. Dozens of changes have made both tools more robust, clearer, and better documented. Notable changes include include improved sub-gridscale remapping, adding depth coordinates, CDL updates for hidden attributes, and support for GCC9 and OpenMP 5.0.0.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 6 years ago

NCO - Paradise Lost
Version 4.7.8 contains many improvements to help convert ESM output into CMIP6 timeseries format. In particular, ncclimo coordinates better with ncremap when processing MPAS data and regridding. Both can take advantage of ncpdq's new feature to convert doubles to floats, and raw binary output can now be byte-swapped to ease creation of offline datasets for some models like WRF and CICE.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 6 years ago

NCO - Bravura
Version 4.7.7 has modest new features everywhere: Improved forward and backward compatibility with newer and older versions of ESMF_RegridWeightGen; Generation and inferral of grids running north->south (à la ECMWF); exact symmetry for Gaussian grid interfaces; an ncpdq compression map that converts doubles to floats; production of "skeleton files" for new grids; equivalent treatment of MPAS and CESM grid variables in arithmetic; and reversion of the filename whitelist security.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 6 years ago

NCO - Honaunau
Version 4.7.6 is primarily a feature release for ncremap. There are two new processing modes, one for regridding regional data, and one for generating all mapfile permutations with all interpolation algorithms. There is also improved support for auxiliary coordinates that lack coordinates/standard_name conventions, improved ncap2 command-line script handling in Windows, and less intrusive HPSS file system support.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 6 years ago

NCO - Salient Detail
Version 4.7.5 is primarily a bugfix release for a single issue with ncremap. Version 4.7.4 inadvertently introduced a bug that mainly affects regridding of ALM/CLM/CTSM/ELM land model data that contains "hidden" (unused) dimensions. The other new feature is that ncclimo automatically handles MPAS Seaice model output named with the new names (mpassi) and new date convention, yyyy-mm-01-00000. If these fixes/features do not affect you there may be no reason to upgrade, yet see below for other minor new features you may want.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 7 years ago

NCO - CSSI
Version 4.7.4 updates handling of the netCDF CDF5 bug, improves filename sanitization, supports ESMF 7.1.0r regridding features, handles non-atomic types more gracefully, and implements absolute and relative paths for CF2-Group compliance.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 7 years ago

NCO - Avid Poi
Version 4.7.3 contains little features and fixes. A new security whitelist could break some workflows, and the other features offer better support for TempestRemap, MPAS, and heavy users of NCO print features in CDL, JSON, and XML.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 7 years ago

NCO - Sapiens
Version 4.7.2 contains one new cool feature for ncremap, one important bugfix for the splitter, and assorted minor improvements and fixes. ncremap now implements E3SM-recommended Tempest remapping algorithms for all combinations of FV<->SE remapping for flux and state variables. The ncclimo splitter functionality has an important bugfix for cases when the total number requested time-periods (usually years) of averaging is not evenly divisible by the maximum number of time-periods per output-file.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 7 years ago

NCO - Ajudar
Version 4.7.1 contains mostly minor fixes and few new features. One major improvement, long in development, is a Conda Windows port. Most NCO functionality is now easily available to Windows users through the Conda distribution.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 7 years ago

NCO - Catastrophe
Version 4.6.9 fixes a few issues has no new major features.
Most improvements relate to CDF5 handling and CMake builds.
Also, ncks now prints CDL by default.
I shelved my plans to skip 4.6.9 because we discovered a
consequential bug with the netCDF CDF5 implementation.
This led to a flurry of mini-features to diagnose and warn
users who might inadvertently stumble on corrupt CDF5 data.
Understanding the ramifications of this CDF5 bug is ongoing.
The best case scenario now, after a month of investigation,
is that Unidata will soon declare the bug solved and put the
appropriate patches in netCDF 4.5.0. We may make final
adjustments to diagnose/handle CDF5 issues based on those
patches, and release NCO 4.7.0 soon thereafter.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 7 years ago

NCO - Ofcharles
Many new features in 4.6.8 are, as usual, related to climatologies and regridding. ncclimo can now be given an explicit list of seasons to compute instead of, or in addition to, MAM,JJA,SON,DJF. ncremap has improved mask and format handling. There are also a collection of minor bugfixes and improvements, including JSON tweaks, ISO8601 printing, and GCC7 and netCDF 4.5.x compatibility.
This release includes an important ncwa fix that prevents incorrect answers when hyperslabs are used with masks and/or weights. Upgrade if you use ncwa with -d hyperslabs.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 7 years ago

NCO - Shots and power tools
The main new features in 4.6.7 are in the regridder, which introduces a sub-grid regridding option, more automated handling and flexibility with regional grids, and easier flag specification. ncap2 added specialty functions to simplify handling of missing values and in-filling large missing regions with interpolated data. ncatted received an important bugfix for netCDF4 with _FillValue.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 8 years ago

NCO - Step-Half-Brother-In-Law
4.6.6 contains a potpurri of new features:
Output 2D rectangular grids formatted as UGRID meshes.
Calendar dates print for bounds and climatology variables.
Revamped HPSS/hsi support. The splitter produces cleaner output.
The regridder groks more files and masks, and annotates output with
more helpful metadata. CDL mode handles compound record variables.
JSON output has changed slightly to re-use NcML keywords.
ncclimo and ncremap have new extract/exclude options.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Firenze
This version fixes ncap2 cell_methods corner cases. Implements prototype 2-D UGRID output. Finishes bare-bones --lst_rnk_ge2 implementation for native and regridded datasets. Improves handling of mask variables inferred by nco_grd_nfr, and makes inferral more robust to presence/absence of area/mask variaables. Finally it fixes an embarassing problem where nearestdtos actually invokednfr neareststod.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Drayton Maurice
This release implement the atoi(), atof(), and automatic cell_methods functionality into ncap2. Also grid inferral is improved so that curvilinear grids with corner values can and do supercede center values (helps with OMI DOMINO whose center values can be missing). Perliminary support for --lst_rnk_ge2 option in ncks and splitter. JSON has changed vocabulary so that dims->shape.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Forgotten
This release correctly print braces in CDL mode for netCDF4 variables with compound record dimensions, and print units strings as comments after the data in CDL mode when debugging is enabled.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Orange-colored-sky
Fix cmd_wgt reported by ncremap --version
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Promotion
4.6.5 contains a potpurri of new features. Setting chunk cache size with --cnk_csh can accelerate aggregation of netCDF4 files. Climatology and regridder users may appreciate the cleaned-up ouput offered by the ncremap --vrb_lvl switch and more intelligent grid inferral. Everyone who has tried to convert "time since..." values to calendar dates will like the new ncks --cal switch that does the UDUnits conversion for you. There are also helpful bugfixes for ncap2 attribute propagation in corner cases, and corrected error codes for bad command line arguments.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Laughin
This version standardizes ncclimo/ncremap copyright/version/config info, makes ncremap quieter, refactors nco_grd_nfr() to deprecate dimension database, and finalizes ncks calendar format printing.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Holly, go lightly
Include a regridding fix for POP files, timestamps and --cal functionality, --version and --verbose options for ncremap and ncclimo, and setting chunk cache size with --cnk_csh
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - JAWS all-nighter?
where() fix for vpointers used in Terraref
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Sudek Kahn
Re-introduce fixed USE_NC4_SRD_WORKAROUND
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - JAWS
This release includes splitter and daily mode in ncclimo. Operators now respect cell_measures and formula_terms attributes. Important bug fixes for custom calendars (360, 365, 366 days), and strided hyperslabs in netCDF4 files.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Permitted
This release implements an ncclimo stdin option, including redirection, that behaves as well as possible in different batch (PBS, SLURM) environments. Also the detection of specific machines in batch mode is improved. And there is the long-awaited custom calendar bugfix for 360, 365, 366 day calendars.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 8 years ago

NCO - Hapi Sushi
Major imrovements in cell_measures. ncclimo clm_md=dly works except in batch mode on PBS. Mysterious MacOS abort() on some time hyperslabs.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Stormy Weather
Fixes stdin detection for ncremap and ncclimo that caused breakage in batch jobs. Does not force extraction of lon,lat with CAM model.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - 3.375%
This release contains a fix to a UDUnits bug introduced in 4.6.3, addition of w_stag to FV datasets, extraction of variables in formula_terms attributes, and complete documentation splitting.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - GoldenHawk
All basic behavior of ncsplit, including --ypf and segments, now appears to work
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - High Tower
More JSON, less filling.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Cable Cars
ncclimo supports long options. Re-base when increments not just basetime changes.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Night tennis
ncclimo supports mpaso, mpascice monthly analysis members. A false-positive rebasing bug was fixed in ncra. Without this fix, ncra exits with an error and stops ncclimo because an error code in ncra was not cleared.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Xmas tree star
ncra/ncrcat will re-base when increment, not just basetime, changes between files. ncclimo binary climatologies.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Cache-out
This release contains bld/Makefile updates for ar and GSL issues. ncap2 no longer chunks all variables with asking, and follows command-line inputs. Add --cnk_csh_byt option and cache diagnostics to ncks.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Zenodo archive for GMD PPC paper
Fingers-crossed this version will get a citable DOI from Zenodo...
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Rio
4.6.1 is mainly a stability release to polish existing features and to add minor new ones. The main new feature is that ncclimo supports incremental climatologies. ncatted works much better with special characters in attribute names, while preserving its ability to handle regular expressions. ncflint gains a weight-normalization option.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Love's Labour's Lost
This release fix a bug in regridding to a curvilinear grid using a mapfile, supports PNNL constance machine, fixes return code handling in nco_fl_mv(), and improves chunking documentation
Climate Change - Climate Data Processing and Analysis
- C
Published by czender over 8 years ago

NCO - Hodor
This release fixes ncclimo hyperactive behavior (harmlessly trying incremental mode even though no incremental climatology was requested), allows ncatted to work with special characters (like dots) in attribute names, and improves chunking documentation.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 9 years ago

NCO - Bay Island
netCDF4 provenance attributes
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 9 years ago

NCO - AP Lang
4.6.0 may be most notable for the debut of ncclimo, a new operator that generates climatologies from monthly-mean input. Perhaps it's a tie with ncap2, which has a singularly useful new feature: variable lists/pointers. ncap2 also has a reduced memory footprint and a function to simplify adding CF-bounds variables (Thanks Henry!). As usual, ncremap continues to accrue useful features, the most notable of which is learning grid information from the CF "coordinates" attribute, if any.
Climate Change - Climate Data Processing and Analysis
- C
Published by czender almost 9 years ago

NCO - 1084 Tia Juana
Improve TMPDIR diagnosis, restore var=var.double() behavior, support climatology bounds, treat grid_mapping better
Climate Change - Climate Data Processing and Analysis
- C
Published by czender about 9 years ago
