romeokienzler annezj commited on
Commit
985a08b
·
verified ·
1 Parent(s): fe8c91b

Upload 2 files (#2)

Browse files

- Upload 2 files (ee3a318af3238cf4f4712b357bd39bc6a73e2477)


Co-authored-by: Anne Jones <[email protected]>

Files changed (2) hide show
  1. granite-geospatial-uki_image.png +0 -0
  2. readme.md +36 -0
granite-geospatial-uki_image.png ADDED
readme.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Model Card for granite-geospatial-uki
2
+
3
+ The granite-geospatial-uki model is a transformer-based geospatial foundation model trained on HLS L30 multispectral satellite imagery and Sentinel-1 synthetic aperture radar (SAR) backscatter over the United Kingdom and Ireland. The model consists of a self-supervised encoder developed with a ViT architecture and Masked AutoEncoder (MAE) learning strategy, with an MSE loss function and follows the same architecture as [Prithvi-EO](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-earth-observation-6740a7a81883466bf41d93d6).
4
+
5
+ <figure>
6
+ <img src='granite-geospatial-uki_image.png' alt='missing' />
7
+ <figcaption>granite-geospatial-uki schematic
8
+ </figcaption>
9
+ </figure>
10
+
11
+
12
+ ## How to Get Started with the Model
13
+
14
+ An example of fine-tuning the model for image segmentation using Terratorch for flood detection in the UK and Ireland can be found [here](./notebooks/2_fine_tuning.ipynb).
15
+
16
+ ## Pre-training
17
+
18
+ The granite-geospatial-uki model uses the [Prithvi-EO](https://huggingface.co/collections/ibm-nasa-geospatial/prithvi-for-earth-observation-6740a7a81883466bf41d93d6) model architecture. It was pre-trained on HLS data for the continental USA, followed by additional pre-training using 16,000 HLS L30 and Sentinel-1 images covering the United Kingdom and Ireland. The Sentinel-1 SAR backscatter ($\sigma_0$) were resampled to the same resolution as the HLS data, and were normalized by $10log(\sigma_0)$, where pixels with $10log(\sigma_0) > 10$ are set to 10 and $10log(\sigma_0) < -35$ are set to -35. The two additional Sentinel-1 bands were initialized with the mean weights of the other channels for pre-training. The following bands were used in the pre-trained model:
19
+
20
+ - Blue
21
+ - Green
22
+ - Red
23
+ - Narrow NIR
24
+ - SWIR 1
25
+ - SWIR 2
26
+ - VV
27
+ - VH
28
+
29
+ ## Model Card Authors
30
+ Geoffrey Dawson, Chris Dearden, Andrew Taylor, Helen Tamura-Wicks, Anne Jones & Paolo Fraccaro.
31
+
32
+ ## Acknowledgments
33
+ This work was supported by the Hartree National Centre for Digital Innovation, a collaboration between STFC and IBM.
34
+
35
+ ## IBM Public Repository Disclosure:
36
+ All content in this repository including code has been provided by IBM under the associated open source software license and IBM is under no obligation to provide enhancements, updates, or support. IBM developers produced this code as an open source project (not as an IBM product), and IBM makes no assertions as to the level of quality nor security, and will not be maintaining this code going forward.