3. Set up Web Services to Serve Processed Himawari-8 Imagery at Scale
The latest near real-time Himawari-8 imagery becomes available on AWS about 11 to 17 minutes after the start of the imagery acquisition. For example, if Himawari-8 sensors (Advanced Himawari Imagers – AHIs) start to take full-disk imagery on 3 pm, the imagery data will be accessible around 3:11 – 3:17 pm. Afterwards we start automated image analysis to rapidly process the multispectral bands of the Himawari-8 imagery. Significant efforts have been made to optimise the whole processing workflow (with software and cloud resources) in order to complete the related task within 3 minutes (i.e. by 3:20 pm using the above example). We endeavour to achieve <20-minute latency for the latest Himawari-8 imagery to be available (in the form of web delivery) relative to its initial capture. (From trial tests over the past few months, only very rarely are certain 10-min snapshots not available or not delivered on time as expected due to unknown reasons, but this issue is very minor and negligible.)
Two main image analysis tasks performed:
-
Creating Himawari-8 composite images for the whole Australian region. Then turn RGB images into separate mapping tiles at four zoom levels (web mapping zoom levels 5-6-7-8, corresponding to ~4.8-2.4-1.2-0.6 km spatial resolutions on the ground, respectively).
-
Extracting hotspots of major bushfires. Then turn hotspots data into feature layers.
As a result, about 8,500 map tiles/files and a dozen other output files are produced for the Himawari-8 imagery every 10 minutes. More than six web services have been deployed to set up an efficient mapping infrastructure so that all outputs can be delivered via APIs very quickly for web and desktop mapping.
3A: For composite images in XYZ tiles, access URLs can be either of the following:
curl https://api.RiskMapping.com.au/h8/{year}/{month}/{day}/{hhmm}/{tileset}/{z}/{x}/{y}.[jpg | png] -H apikey=[x]
or, with a single URL address:
https://api.RiskMapping.com.au/h8/{year}/{month}/{day}/{hhmm}/{tileset}/{z}/{x}/{y}.[jpg | png]?&apikey=[x]
Tile maps can be easily integrated with web or mobile mapping applications (those using Google Maps APIs, Leaflet APIs, OpenLayers APIs, Mapbox APIs, etc.), by updating related URLs.
3B: For composite images in GeoTIFF and hotspot feature layers in three formats (Shapefile, GeoJSON and KML), API URLs follow similar formats. All these mapping outputs, in an original imagery projection, can be directly linked to or downloaded by users for customised mapping.
The timely Himawari-8 imagery would assist rapid response teams to make time-critical decisions and the general public to raise situation awareness during emergencies. The new imagery available every 10 minutes, like radar images and loops in weather apps, has the potential to be incorporated into emergency & public warning apps (e.g. Fires Near Me app from NSW Rural Fire Services).