Uploading Data


RealEarth can ingest imagery and shape data.

Image formats:
Shape (point/line/polygon) formats:
.zip, .tar, and .gz archive formats are also supported. Each file within the archive must be named according to the RealEarth file naming convention.

Color enhancements and custom legends can be created by uploading McIDAS-X ET enhancements or custom legend definitions. Please see the Editing Products section for more information.

Naming Convention

Data files must contain a product ID, date, and time separated by underscores: [ProductID]_[YYYYMMDD]_[hhmmss].extension

Register Product

Before uploading product data a placeholder must be created on the target RealEarth VM. This ensures that the product will be directed to the appropriate location and the state of the product will have a suitable configuration prior to the initial directory. From the Product Manager, log in and click the Create new placeholder button to register a new product.

Browser Upload

Files can be uploaded via a browser form.

Shell Script

File uploads can be automated with the re_upload script.

re_upload

re_upload [-huojtcg1dxv] [-f [hours]] [-p [part]] [-k key|file] [-l "URI"] [-s server:port] file [name] [date] [time] -h: Show help -u: Check for update Version: 62 -p: Designate file as part of a larger product (part # optional) -f: Force overwrite if there is a conflict (hour range optional) -o: Convert to COG (requires GDAL tools) -j: Use JPEG compression (requires GDAL tools) -t: Do not timeout -k: Specify the upload key or file -l: Specify a URI for download of the original data -c: Add random sleep to mitigate concurrent uploads (eg. cron jobs) -g: Send through public gateway -s: Specify the server and port Default: https://realearth.ssec.wisc.edu -1: Do not retry on failure -d: Delete file on successful upload -x: Print target server and port (do not upload) -v: Be verbose file: Path to file Format: /path/to/[name]_[YYYYMMDD]_[HHMMSS].??? name: Specify the product name Required when the file name does not contain [name] Format: Cannot contain '_' date: Specify the date Required when the file name does not contain [date] Format: YYYYMMDD time: Specify the time Required when the file name does not contain [time] Format: HHMMSS