OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observation
Earth observation data presents a unique challenge: it is spatial like images, sequential like video or text, and highly multimodal. We present OlmoEarth: a multimodal, spatio-temporal foundation model that employs a novel self-supervised learning formulation, masking strategy, and loss all designed for the Earth observation domain. OlmoEarth achieves state-of-the-art performance compared to 12 other foundation models across a variety of research benchmarks and real-world tasks from external partners. When evaluating embeddings OlmoEarth achieves the best performance on 15 out of 24 tasks, and with full fine-tuning it is the best on 19 of 29 tasks. We deploy OlmoEarth as the backbone of an end-to-end platform for data collection, labeling, training, and inference of Earth observation models. The OlmoEarth Platform puts frontier foundation models and powerful data management tools into the hands of non-profits and NGOs working to solve the world's biggest problems. OlmoEarth source code, training data, and pre-trained weights are available at https://github.com/allenai/olmoearth_pretrain{https://github.com/allenai/olmoearth_pretrain}.
691bf0fb6bfd5965c0fd38f1
Henry Herzog
691bf0fb6bfd5965c0fd38f2
Favyen Bastani
691bf0fb6bfd5965c0fd38f3
Yawen Zhang
691bf0fb6bfd5965c0fd38f4
Gabriel Tseng
691bf0fb6bfd5965c0fd38f5
Joseph Redmon
691bf0fb6bfd5965c0fd38f6
Hadrien Sablon
691bf0fb6bfd5965c0fd38f7
Ryan Park
691bf0fb6bfd5965c0fd38f8
Jacob Morrison
691bf0fb6bfd5965c0fd38f9
Alexandra Buraczynski
691bf0fb6bfd5965c0fd38fa
Karen Farley
691bf0fb6bfd5965c0fd38fb
Joshua Hansen
691bf0fb6bfd5965c0fd38fc
Andrew Howe
691bf0fb6bfd5965c0fd38fd
Patrick Alan Johnson
691bf0fb6bfd5965c0fd38fe
Mark Otterlee
691bf0fb6bfd5965c0fd38ff
Ted Schmitt
691bf0fb6bfd5965c0fd3900
Hunter Pitelka
691bf0fb6bfd5965c0fd3901
Stephen Daspit
691bf0fb6bfd5965c0fd3902
Rachel Ratner
691bf0fb6bfd5965c0fd3903
Christopher Wilhelm
691bf0fb6bfd5965c0fd3904
Sebastian Wood
691bf0fb6bfd5965c0fd3905
Mike Jacobi
691bf0fb6bfd5965c0fd3906
Hannah Kerner
691bf0fb6bfd5965c0fd3907
Evan Shelhamer
691bf0fb6bfd5965c0fd3908
Ali Farhadi
691bf0fb6bfd5965c0fd3909
Ranjay Krishna
691bf0fb6bfd5965c0fd390a
Patrick Beukema
OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observation
Earth observation data presents a unique challenge: it is spatial like images, sequential like video or text, and highly multimodal. We present OlmoEarth: a multimodal, spatio-temporal foundation model that employs a novel self-supervised learning formulation, masking strategy, and loss all designed for the Earth observation domain. OlmoEarth achieves state-of-the-art performance compared to 12 other foundation models across a variety of research benchmarks and real-world tasks from external partners. When evaluating embeddings OlmoEarth achieves the best performance on 15 out of 24 tasks, and with full fine-tuning it is the best on 19 of 29 tasks. We deploy OlmoEarth as the backbone of an end-to-end platform for data collection, labeling, training, and inference of Earth observation models. The OlmoEarth Platform puts frontier foundation models and powerful data management tools into the hands of non-profits and NGOs working to solve the world's biggest problems. OlmoEarth source code, training data, and pre-trained weights are available at https://github.com/allenai/olmoearth_pretrain{https://github.com/allenai/olmoearth_pretrain}.