Mask R-CNN and U-Net model and output of coral reef halo measurements based on global multispectral satellite imagery

Website: https://www.bco-dmo.org/dataset/943698
Data Type: model results
Version: 1
Version Date: 2024-11-15

Project
» CAREER: Decoding seascape-scale vegetation patterns on coral reefs to understand ecosystem health: Integrating research and education from organismal to planetary scales (Coral Reef Halos)
ContributorsAffiliationRole
Madin, ElizabethUniversity of Hawaiʻi at Mānoa (HIMB)Principal Investigator, Contact
Franceschini, SimoneUniversity of Hawaiʻi at Mānoa (HIMB)Scientist
Soenen, KarenWoods Hole Oceanographic Institution (WHOI BCO-DMO)BCO-DMO Data Manager

Abstract
Reef halos are rings of bare sand that surround coral reef patches. Halo formation is likely to be the indirectly result of interactions between relatively healthy predator and herbivore populations. To reduce the risk of predation, herbivores preferentially graze close to the safety of the reef, potentially affecting the presence and size of the halo. Reef halos are readily visible in remotely sensed imagery, and monitoring their presence and changes in size may therefore offer clues as to how predator and herbivore populations are faring. However, manually identifying and measuring halos is slow and limits the spatial and temporal scope of studies. There are currently no existing tools to automatically identify single reef halos and measure their size to speed up their identification and improve our ability to quantify their variability over space and time. Here we present a set of convolutional neural networks aimed at identifying and measuring reef halos from very high-resolution satellite imagery (i.e., ∼0.6 m spatial resolution). We show that deep learning algorithms can successfully detect and measure reef halos with a high degree of accuracy (F1 = 0.824), thereby enabling faster, more accurate spatio-temporal monitoring of halo size. This tool will aid in the global study of reef halos, and potentially coral reef ecosystem monitoring, by facilitating our discovery of the ecological dynamics underlying reef halo presence and variability.


Methods & Sampling

The Mask R-CNN model was trained using the training data set, thereby automatizing the identification of reef halos from the test set of satellite images and extracting the shape of the reef halos from the imagery background (i.e., extracting both the patch reef and its surrounding halo). The Mask RCNN was trained with 3322 reef halos from 13 AOIs, while the remaining 805 halos from seven AOIs were kept to evaluate the model’s performance.

After object extraction, we automated halo measurement using a U-Net pixel classification model which discriminated the halo (sand ring) from the interior reef patch. A total of 6428 annotations from the training set were used for model training. Annotations consisted of pixel areas manually classified by users, divided into “patch reef” and “halo” classes, respectively.


Data Processing Description

Both the Mask R-CNN and U-Net models were developed using Tensorflow (ver. 2.5.1), Keras (ver. 2.4.3), and PyTorch (ver. 1.8.2) libraries in Python (ver. 3.9) and ArcGIS (ver. 2.9.1.) The machine running the deep learning model had an Intel® Core™ i9-9900K CPU @3.60 GHz processor with 128 GB of installed RAM and a PNY NVIDIA Quadro A6000 GPU.

 


[ table of contents | back to top ]

Related Datasets

IsDerivedFrom
Madin, E., Franceschini, S. (2024) Manually annotated reef halos based on sattelite imagery from 6 study areas as training and test data for a deep learning model. Biological and Chemical Oceanography Data Management Office (BCO-DMO). (Version 1) Version Date 2024-07-11 http://lod.bco-dmo.org/id/dataset/932211 [view at BCO-DMO]
Relationship Description: Manually annotated reef halos as input data (training & test) for Mask R-CNN and U-Net model.

[ table of contents | back to top ]

Parameters

ParameterDescriptionUnits
AOI

Area of interest. Twenty areas in total. Country codes: AUS = Australia, BHS = Bahamas, BLZ = Belize, EGY = Egypt, SAU = Saudi Arabia, USA = United States of America (Florida)

unitless
object_id

The object ID was used to relate the halo area of each object to its reef patch to get a ratio, not to relate them to the test data set,

unitless
hArea_m2

Halo area

square meter (m2)
rArea_m2

Reef area

square meter (m2)
log_hArea_m2

Log-transformed halo area

square meter (m2)
log_rArea_m2

Log-transformed reefarea

square meter (m2)

[ table of contents | back to top ]

Project Information

CAREER: Decoding seascape-scale vegetation patterns on coral reefs to understand ecosystem health: Integrating research and education from organismal to planetary scales (Coral Reef Halos)


Coverage: Hawai’i (field components) and global (synthetic components)


NSF Award Abstract:
Coral reefs worldwide are under increasing threat from a range of human-induced stressors. Climate change is understood to be a key global stressor threatening reefs, but the only proven levers for ecosystem managers to increase reef resilience is to mitigate local and regional stressors such as fishing pressure. A vexing question persists, however, which is how to measure the effects of fishing on ecosystems, particularly over the large spatial (e.g., >10s of meters) and temporal (multi-year) scales over which fishing occurs. One promising approach to doing so is using the large-scale vegetation patterns found on coral reefs globally, called “halos”, to remotely observe when, where, and to what extent fishing pressure is affecting community structure and function. This program combines lab- and field-based experiments with cutting-edge satellite imaging technology and computer science approaches to provide a leap forward in our understanding of how species-level interactions can scale up in space and time to shape coral reef seascapes around the world. By drawing on these approaches, the synergistic education program: 1) integrates science and art (i.e., murals and satellite imagery) to educate and inspire Hawai‘i’s students and general public about coral reef ecology; 2) builds technological capacity in Hawai‘i’s underrepresented minority high school to graduate students, and 3) empowers these students with science communication skills to communicate with diverse audiences. By leveraging this research program and the cutting-edge technologies it will involve, the investigator establishes a strong foundation for long-term teaching and mentoring activities focused on increasing capacity within STEM-underrepresented minorities with Hawaiian and other Pacific Islander backgrounds. Decoding what coral reef halos can tell us about the effects of fishing on reef ecosystem health provides valuable knowledge to reef ecosystem managers and conservation practitioners as reefs continue to rapidly change due to human stressors.

This project combines lab- and field-based experiments with cutting-edge satellite imaging technology and computer science approaches to address the goals of: 1) determining the mechanisms that create the “halos” that form around coral patch reefs, and 2) testing the predictions arising from these mechanisms in a global arena. This project uses a transdisciplinary approach – spanning ecology, oceanography, geospatial science, and computer science – to address these goals. This program has three scientific objectives: to determine 1) which species interaction mechanisms and environmental factors cause reef halos and what their relative importance is; 2) whether these mechanisms are globally consistent or vary geographically; and 3) whether halos can therefore be used as an indicator of aspects of coral reef ecosystem health. In the process, this research advances our understanding of how remote observation tools (satellite and drone imagery; camera traps) can be integrated with computer science (machine learning) and ecological approaches (mechanistic experiments) to generate emergent insights that would not otherwise be possible.

This project is jointly funded by the Biological Oceanography Program, the Established Program to Stimulate Competitive Research (EPSCoR), and Ocean Education Programs.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.



[ table of contents | back to top ]

Funding

Funding SourceAward
NSF Division of Ocean Sciences (NSF OCE)

[ table of contents | back to top ]