Repo for flood prediction using LSTMs and HAND

Overview

Abstract

Every year, floods cause billions of dollars’ worth of damages to life, crops, and property. With a proper early flood warning system in place, decision-makers can take the necessary steps to prevent or at least mitigate the damage caused by floods. Although various flood prediction models exist, a majority of them fail to be fast, reliable, and detailed simultaneously. Our proposed system presents a novel hybrid flood prediction model using Long Short Term Memory(LSTM) for multivariate time series forecasting of water depth based on meteorological conditions and Height Above Nearest Drainage(HAND) to predict river stage in real-time and map the inundated areas for the corresponding water depth using enhanced HAND. Unlike traditional flood forecasting models, this hybrid approach is resource efficient and easy to implement making it highly practicable for real-time flood inundation mapping.

Methodology

The proposed system prioritizes quick development and real-time predictions without compromising on the accuracy. A range of factors affect the occurrences of riverine floods. However, climatological conditions are the major driving force behind them. Factors such as land use/land change and deforestation, although important, only affect flooding in the watershed over a long period of time. Hence, the proposed system used only meteorological conditions and DEM rasters for predicting floods over the next few days.

The relation between weather conditions and flood inundation is simplified by breaking the system into two modules. The first module being estimation of river stage height and the second one being flood inundation mapping. The system uses LSTMs, a data-driven empirical approach, to model the dependence of stage height on meteorological data and HAND, a simplified conceptual approach, to generate flood inundation maps based on the terrain of the watershed and the river stage height predicted by the first module.

Modules :

  1. Inundation Mapping - HAND algorithm to map inundated areas for a given stage height(as proposed in this paper).
  2. River Stage Estimation - Recurring neural networks (LSTMs) to predict the maximum stage height based on weather conditions of the last 3 days.
  3. Deforestation Analysis - Land use classification to identify the changing features of the area over time and identify the areas affected by deforestation.

Datasets

The proposed system uses different data for the three modules. Each of these are collected from different sources and processed separately. The module-wise requirements of data are as follows :

  1. Inundation Mapping:
    1. Digital Elevation Maps from United States Geological Survey
  2. River Stage Estimation:
    1. Meteorological data from National Climatic Data Center
    2. River stage height data from United States Army Corps of Engineers’ river gage data.
  3. Deforestation Analysis:
    1. Satellite images - Landsat 8, Landsat 5 from USGS Earth Explorer

Results

Stage Height Estimation

We tested our proposed system for Cedar Rapids, Iowa. Our experiments showed that features such as vegetation and soil type have little effect on short term flooding and can be disregarded for the prediction module. Testing multiple models showed that single output LSTM models perform better than single shot models. These models are stable upto lead times of 4 days with a Nash-Sutcliffe Efficiency greater than 0.5.

Flood Mapping

Each pixel of the inundation map raster is compared with a reference map created by ground-truthing to identify how many points were incorrectly classified as not flooded. The red areas in the image depict false negatives generated by the proposed system.

banditml is a lightweight contextual bandit & reinforcement learning library designed to be used in production Python services.

banditml is a lightweight contextual bandit & reinforcement learning library designed to be used in production Python services. This library is developed by Bandit ML and ex-authors of Facebook's app

Bandit ML 51 Dec 22, 2022
The codes reproduce the figures and statistics in the paper, "Controlling for multiple covariates," by Mark Tygert.

The accompanying codes reproduce all figures and statistics presented in "Controlling for multiple covariates" by Mark Tygert. This repository also pr

Meta Research 1 Dec 02, 2021
Pytorch code for semantic segmentation using ERFNet

ERFNet (PyTorch version) This code is a toolbox that uses PyTorch for training and evaluating the ERFNet architecture for semantic segmentation. For t

Edu 394 Jan 01, 2023
Instant-Teaching: An End-to-End Semi-Supervised Object Detection Framework

This repo is the official implementation of "Instant-Teaching: An End-to-End Semi-Supervised Object Detection Framework". @inproceedings{zhou2021insta

34 Dec 31, 2022
A unified framework to jointly model images, text, and human attention traces.

connect-caption-and-trace This repository contains the reference code for our paper Connecting What to Say With Where to Look by Modeling Human Attent

Meta Research 73 Oct 24, 2022
Source code for the Paper: CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints}

CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints Installation Run pipenv install (at your own risk with --skip-lo

Autonomous Learning Group 65 Dec 27, 2022
A self-supervised learning framework for audio-visual speech

AV-HuBERT (Audio-Visual Hidden Unit BERT) Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction Robust Self-Supervised A

Meta Research 431 Jan 07, 2023
High frequency AI based algorithmic trading module.

Flow Flow is a high frequency algorithmic trading module that uses machine learning to self regulate and self optimize for maximum return. The current

59 Dec 14, 2022
Code for GNMR in ICDE 2021

GNMR Code for GNMR in ICDE 2021 Please unzip data files in Datasets/MultiInt-ML10M first. Run labcode_preSamp.py (with graph sampling) for ECommerce-c

7 Oct 27, 2022
Lightweight tool to perform MITM attack on local network

ARPSpy - A lightweight tool to perform MITM attack Using many library to perform ARP Spoof and auto-sniffing HTTP packet containing credential. (Never

MinhItachi 8 Aug 28, 2022
An executor that performs image segmentation on fashion items

ClothingSegmenter U2NET fashion image/clothing segmenter based on https://github.com/levindabhi/cloth-segmentation Overview The ClothingSegmenter exec

Jina AI 5 Mar 30, 2022
Personalized Transfer of User Preferences for Cross-domain Recommendation (PTUPCDR)

Personalized Transfer of User Preferences for Cross-domain Recommendation (PTUPCDR) This is the official implementation of our paper Personalized Tran

Yongchun Zhu 81 Dec 29, 2022
Towards Interpretable Deep Metric Learning with Structural Matching

DIML Created by Wenliang Zhao*, Yongming Rao*, Ziyi Wang, Jiwen Lu, Jie Zhou This repository contains PyTorch implementation for paper Towards Interpr

Wenliang Zhao 75 Nov 11, 2022
FACIAL: Synthesizing Dynamic Talking Face With Implicit Attribute Learning. ICCV, 2021.

FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning PyTorch implementation for the paper: FACIAL: Synthesizing Dynamic Talking

226 Jan 08, 2023
Nicely is a real-time Feedback and Intervention Program Depression is a prevalent issue across all age groups, socioeconomic classes, and cultural identities.

Nicely is a real-time Feedback and Intervention Program Depression is a prevalent issue across all age groups, socioeconomic classes, and cultural identities.

1 Jan 16, 2022
This repository contains the official code of the paper Equivariant Subgraph Aggregation Networks (ICLR 2022)

Equivariant Subgraph Aggregation Networks (ESAN) This repository contains the official code of the paper Equivariant Subgraph Aggregation Networks (IC

Beatrice Bevilacqua 59 Dec 13, 2022
Circuit Training: An open-source framework for generating chip floor plans with distributed deep reinforcement learning

Circuit Training: An open-source framework for generating chip floor plans with distributed deep reinforcement learning. Circuit Training is an open-s

Google Research 479 Dec 25, 2022
Official Pytorch implementation of Meta Internal Learning

Official Pytorch implementation of Meta Internal Learning

10 Aug 24, 2022
PyTorch code to run synthetic experiments.

Code repository for Invariant Risk Minimization Source code for the paper: @article{InvariantRiskMinimization, title={Invariant Risk Minimization}

Facebook Research 345 Dec 12, 2022
Code for models used in Bashiri et al., "A Flow-based latent state generative model of neural population responses to natural images".

A Flow-based latent state generative model of neural population responses to natural images Code for "A Flow-based latent state generative model of ne

Sinz Lab 5 Aug 26, 2022