OSSP

Open Source Sea-ice Processing

Open Source Algorithm for Detecting Sea Ice Surface Features in High Resolution Optical Imagery

Nicholas Wright and Chris Polashenski

Introduction

Welcome to OSSP; a set of tools for detecting surface features in high resolution optical imagery of sea ice. The primary focus is on the detection of and differentiation between open water, melt ponds, and snow/ice.

The Anaconda distribution of Python is recommended, but any distribution with the appropriate packages will work. You can download Anaconda, version 3.6, here: https://www.continuum.io/downloads

Dependencies

• gdal (v2.0 or above)
• numpy
• scipy
• h5py
• scikit-image
• sklearn
• matplotlib
• tkinter

Optional

• tqdm (for progress bar)
• PGC imagery_utils (for WV pansharpening) (https://github.com/PolarGeospatialCenter/imagery_utils)

Usage

For detailed usage and installation instructions, see the pdf document 'Algorithm_Instructions.pdf'

setup.py

The first step is to run the setup.py script to compile C libraries. Run python setup.py build_ext --build-lib . from the OSSP directory. Be sure to include the period after --build-lib.

ossp_process.py

This combines all steps of the image classification scheme into one script and should be the only script to call directly. If given a folder of images, this script finds all appropriately formatted files directory (.tif(f) and .jpg) and queues them for processing. If given an image file, this script processes that single image alone. This script processes images as follows: Image preprocessing (histogram stretch or pansharpening if chosen) -> segmentation (segment.py) -> classification (classify.py) -> calculate statistics. Output results are saved as a geotiff with the same georeference of the input image.

Required Arguments

• input directory: directory containing all of the images you wish to process. Note that all .jpg and .tif images in the input directory as well as all sub-directories of it will be processed. Can also provide the path and filename to a single image to process only that image.
• image type: {‘srgb’, ‘wv02_ms’, ‘pan'}: the type of imagery you are processing.
  1. 'srgb': RGB imagery taken by a typical camera
  2. 'wv02_ms': DigitalGlobe WorldView 2 multispectral imagery
  3. 'pan': High resolution panchromatic imagery
• training dataset file: filepath of the training dataset you wish to use to analyze the input imagery

Optional Arguments

• -o | --output_dir: Directory to write output files.
• -v | --verbose: Display text output as algorithm progresses.
• -c | --stretch: {'hist', 'pansh', 'none'}: Apply an image correction prior to classification. Pansharpening / orthorectification option requires PGC scripts. Default = hist.
• -t | --threads: Number of subprocesses to spawn for classification. Threads > 2 is only utilized for images larger than ~10,000x10,000 pixels.
• --pgc_script: Path for the PGC imagery_utils folder if 'pansh' was chosen for the image correction.
• --training_label: The label of a custom training dataset. See advanced section for details. Default = image_type.

Notes:

Example: ossp_process.py input_dir im_type training_dataset_file -v

This example will process all .tif and .jpg files in the input_dir.

training_gui.py

Graphical user interface for creating a custom training dataset. Provide a directory of images that you wish to use as the basis of your training set. The GUI will present a random segment each time a classification is assigned. The display images can also be clicked classify a specific area. The segments themselves are automatically generated. The highlighted region corresponds to the segment that will be labeled.

Output is a .h5 file that can be provided to ossp_process.py.

Note: Images are segmented prior to display on the GUI, and as such may take up to a minute to load (depending on image size and computer specs)

Positional Arguments:

• input: A directory containing the images you wish to use for training.
• image type: {‘srgb’, ‘wv02_ms’, ‘pan'}: the type of imagery you are processing.
  1. 'srgb': RGB imagery taken by a typical camera
  2. 'wv02_ms': DigitalGlobe WorldView 2 multispectral imagery,
  3. 'pan': High resolution panchromatic imagery

Optional arguments:

• --tds_file: Existing training dataset file. Will create a new one with this name if none exists. If a path is not provided, file is created in the image directory. Default = <image_type>_training_data.h5.
• --username: A specific label to attach to the training set. The --training_label argument of ossp_\process references this value. Default = <image_type>

Contact

Nicholas Wright