Recent Releases of NCO

NCO - Miracle MOP

First release of ncclimo. Making progress on climatology bounds. ncap2 optimizations.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - ICHA

Terraref workflow working smoothly. Use $TMPDIR in scripts. -A FORCE_APPEND consistency. LHC casting attribute propagation.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - LPQ

Terraref alpha pipeline is functional. (de-)interleaving ENVI images works.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - Tear-a-ref

ncap2 pointers, TERRAREF capabilities, aims4 paths

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - Dropout?

ncremap handles 1D pseudo-rectangular input like OCO2. Bit-Set algorithm fixed. MPAS-ice climos work.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - Blaze

ncremap adds cmd_msh to history. revert adoption of nco_var_put() which caused regridding problems.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - Gumbo

Add slat/slon to FV output, ncremap has unique names, clean-up and drc_tmp. ncatted -t --typ_mch. Use NC_NOFILL and nc_put_var() to better handle regridding integers. Together, these patches allow MPAS climos and regridding to work in harmony.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - Olu

ncremap adds _FillValue to MPAS, and uses --rnr=0.0.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - VESL

NCO fully supports CDF5-format datasets, ncremap continues to accrue useful features, and some corner case bugs were fixed.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - Playing Hookey

ncremap works with some zonal data, ncra/nces mebs normalization is fixed, ncap2 correctly handles negative hyperslab indices, improved cygwin support.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - There and Back Again

Set ncremap back to bilinear. Add coordinate attributes with nces --nsm_grp. Tested with ESMF 7.0.0.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 9 years ago

NCO - CCW

Incorporates CCW (counter-clockwise) detection/correction for input curvilinear grids. ncremap correctly handle simultaneous -O drc_out -o fl_out switches.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Story of Job

Add parallelism tuning with ncremap -j job_nbr where job_nbr is number of simultaneous jobs. Implement Bit Shave and Bit Set algorithms (for comparison with Bit Groom): ncks --baa=[0,1,2].

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Dis-oriented

Add ncremap -P pdq_typ option for AIRS and MPAS data. Fix ncpdq --gaa issue.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - COP21

Support CDF5 in all the usual ways, http://nco.sf.net/nco.html#cdf5

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Tim Wirth

Branch-cut patch to algorithm that infers maps from curvilinear grids. Significantly reduces grid conversion failures due to false-positive concave gridcells.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Capital Grille

This release is most notable for the debut of ncremap, which facilitates regridding (large numbers of) files on any Curvilinear, Rectangular, or Unstructured Data (CRUD) grid.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - NYE

This release changes (yet again) and hopefully stabilizes the ncremap options. ncremap documentation is complete.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - The Force

Integrate ncremap into autotools. Fix and create ncpdq bug. Introduce netCDF 4.4.0 tokens. Rearrange ncremap options.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - North Italia

Fix memory leak with NC_STRING when printing, and diagnosis of longitude grid type for date-line cells.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - CRUD

Fix problem inferring cap grid. Rename sld_nco.sh to ncremap.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Santa Baby

Denote XML unsigned attributes with "_Unsigned", numerous patches to inter POP, CICE, CLM2, MPAS-O/I grids, ncap2 Cygwin fix, ncap2 LHC works with (), handle CICE masks.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Che

Restrict inferred grid to real latitudes and to the 360-degree range detected from input cell-centers. This fixes problems inferring some grids from curvilinear input files.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Polynya

Coordinate excision, skeleton bug, GSL2 support, MSVC 2013 support, numerous regridding dimensions and bounds added to usual suspects tables.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - 100% Math

Fix NULL-initialization with -V

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Mad Men

This release mainly advances features related to regridding. The primary advance is support for curvilinear regridding. Latitude and longitude may now be two-dimensional coordinates. NCO will now regrid among and between rectangular and curvilinear grids from most (well-behaved) input data files, so regridding swath-like data (SLD) (e.g., WRF and much NASA L2 data) just became a lot easier. The ~/nco/data/sld_nco.sh script integrates the most common regridding tasks into a (hopefully) turnkey solution in time for Thanksgiving.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Mad Men

A hurry-up release, same as alpha08 except for packagin files.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Mad Men

Fixes two bugs related to multi-level fields that contain missing values. Symptoms were NC_ERANGE errors when regridding. Reported by PNNL. AFAICT only affected bilinear (non-conservative) remapping.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Lipstick & Lashes

Disambiguate lat/lon/col_nm into lat/lon/col_nm_in, lat/lon/col_nm_out (so regridded output need not use, e.g., GeoTrack as name). Works well with AIRS L2 + L3 single-level fields.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Ghost Recital

Curvilinear toolchain (grid inferral, skeleton files, and full-blown regridding) works for some grids, e.g., WRF.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - I See London

Fix (relatively bad) ncatted bug introduced in 4.5.1 where blank attribute names dump core rather than expanding into all attribute names. Make curvilinear grids with (as yet undocumented) lat_crv, lon_crv, crv options.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Resilience

With this release NCO can infer SLD grids with --rgr nfr, generate skeleton files with --rgr skl=skl.nc, build without using TeXInfo with --disable-doc, regrid MPAS-O files, accept bounding boxes with --rgr snwe or wesn syntax.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Unabashed

Much more progress on SLD. ncks dies with helpful warning when regridding specified without output file. ncecat resets error code before using it, thus fixing problem where ncecat --gag could fail with single file arguments.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Badrun

SLD regrid sort-of works for AIRS

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Parenthood

This NCO release improves regridding features, ncra weighting, and ncatted flexibility, and contains a raft of minor fixes and tunings. Notably, it produces SCRIP-format gridfiles, provides a bugfix to ncra -w, and introduces the --glb option to all operators.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Bob Little

New metadata names for climo, new typenames for grid generation, Gaussian fix, GitHub relocation

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - L'Huillier

Diagnose missing area on unstructured grids with L'Huillier's formula

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Braza

Work with 2D grids in either lon/lat or lat/lon (old Tempest) src/dst_grid_dims order

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Byron Bay

Fixes normalization of fields with missing values when using ncra -w.

Climate Change - Climate Data Processing and Analysis - C
Published by czender over 9 years ago

NCO - Sugar cone

Generate exact Gaussian grids

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Jamesons

Create 2D rectangular SCRIP grids with, e.g.,
ncks -O -D 1 --rgr grd_ttl='FV-scalar grid 129x256' --rgr grid=${DATA}/grids/129x256_SCRIP.20150724.nco.nc --rgr lat_nbr=129 --rgr lon_nbr=256 --rgr lat_typ=ngl_eqi_pol --rgr lon_typ=Grn_ctr ~/nco/data/in.nc ~/foo.nc

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Borrego

ncra -N, diagnose area if possible when area_out == 0.0 (due to, e.g., bilinear interpolation)

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - New normal

Support ncra -N = --no_nrm_by_wgt to prevent (default) weight normalization

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Détente

Support --glb_att_add = --gaa to add global attributes from all operators

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Pineapple Express

Support displaced-pole grids, better handle fracarea/destarea distinctions, and avoid double-normalization

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Sophie

ncra --wgt=wgt_nm works. Chunking with rew/lfp maps rounds-up to succeed with all variable shapes. The history_of_appended_attributes attribute now formats correctly when no history attributes were present.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Rotary Club

Fix serious ncap2 bug with min()/max() on coordinate variables

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Crosby + Jasmine

Regridder workaround for Tempest 1D grids

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Acyclovir

ncatted now supports regular expressions in attribute names. cell_methods are prevented from duplicating themselves.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Inside Out

Works on Travis and with OpenMP when compiled with g++ 4.6.3-5.1.1

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Kobaman

Fixes problems with build (especially docs) and regressions (bad library version info) that have crept in since alpha1.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Stricklands

Fix possibly uninitialized destination pointer that may have caused writing zeros to output files with clang on MacOS X.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Zeros

Add regridding regression tests. Fix strcat() buffer overrun that may have caused writing zeros to output files.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Orellana

Fixes ncap2 issue caused by _FillValue workaround on netCDF4 files

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Junette

Regrid from Tempest-generated map-files

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Even Keel

This is the first NCO release that supports regridding datasets, currently limited to global datasets. These features build on infrastructure pioneered by Phil Jones (SCRIP), and the multi-agency Earth System Modeling Framework (ESMF). Other noteworthy improvements include capturing history from appended files, and that ncdismember uploads to the NERC CF-checker upon request.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Aeroméxico

Introduce --rnr switch, date_written/time_written updated throughout all operators, complete grid-renaming documentation.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Metadata Fetish

Add history_of_appended_files global attribute to improve provenance

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Grid Dysphoria

Supports 1D->1D, 1D->2D, 2D->1D, and 2D->2D regridding for unstructured 1D and rectangular 2D grids. Tested on T42, fv129x256, fv257x512, ne30np4, and ne120np4 grids.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Nibbling Sibling

Remapping supports Gaussian and equiangular offset destination grids

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Fair Weather

OpenMP support. Use standard NCO -t thr_nbr switch, or set OMP_NUM_THREADS in environment.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Playset

Deprecate missing value warning. Fix bug that could cause failure in any operator dealing with pre-chunked datasets.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Niki

Missing values work. Fix gw bug in beta2.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Dentist

Correct output grid bounds, precision

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Clementine

Read and output area variable directly from remap file rather than regridding it

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Pitch Perfect

Regridding with external mapfile supported via --map option

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Letterman

This release includes small feature improvements in chunking, deflation, and attribute handling during dimension reduction. Also improvements in clarity and consistency of messages. While chunking is an esoteric feature for many, its importance is increasing as the move to netCDF4 (classic) continues. The chunking defaults and flexibility have reached a new level of robustness in this release. Benchmarks suggest this chunking can accelerate wallclock performance of netCDF4 workflows by 50% relative to 4.4.8.

The main new awesome feature is that ncra understands weights. Finally. Applying uneven weights to different input files was too clunky. This release is dedicated to the intrepid souls who use NCO to generate climatologies that require uneven weights. This release should make that task much easier.

Climate Change - Climate Data Processing and Analysis - C
Published by czender almost 10 years ago

NCO - Loveseat

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 10 years ago

NCO - Idyllwild Valentine

Changes since 4.4.7: -A warn, PPC, cnk nco=rew+lfp, mabs/mebs/mibs().
Functionally identical to SF/CVS version 4.4.8. Different checksums though.

Climate Change - Climate Data Processing and Analysis - C
Published by czender about 10 years ago