Implementation of U-Net and SegNet for building segmentation

Last update: Dec 07, 2022

Overview

Specialized project

Created by Katrine Nguyen and Martin Wangen-Eriksen as a part of our specialized project at Norwegian University of Science and Technology (NTNU).

Models

Most of our code and the U-net model is significantly inspired by this project Unet-for-Person-Segmentation. The SegNet model we created on our own based on other implementations of SegNet in Tensorflow.

Data

The model is trained and tested on Massachusetts Buildings Dataset from Kaggle. The original images where 1500X1500 pixels each over an area of 1500x1500 meters (1mx1m resolution). The original 137 images were cropped into 64x64 pixels and images without building were filtered out.

To make the masks compatible with our model the masks was changed from white (255,255,255) labels to greyscale with value 1. This is done in image_fix.py found in the repo.

Folder structure

Images and masks are saved in local directories and used in data.py and test.py. This is of course possible to change, however if you want to use the exact same code you can follow this folder structure.


.
├── ...
├── building-segmentation                # Directory for all images
│   ├── Images                           # Directory for raw images
│   │   ├── cropped_images_train_64      # Directory for cropped images where number specifies resolution, containg .jpg
│   │   ├── cropped_images_train_128     # Directory for cropped images where number specifies resolution, containg .jpg 
│   │   └── ...                          # More directories with other resolutions
│   ├── Masks                            # Directory for all maskes
│   │   ├── cropped_masks_train_64       # Directory for cropped masks where number specifies resolution, containg .jpg
│   │   ├── cropped_masks_train_128      # Directory for cropped masks where number specifies resolution, containg .jpg 
│   │   └── ...                          # More directories with other resolutions
│   └── Test                             # Miscellaneous information
│       ├── test_64                      # Directory for images where number specifies resolution, containing .jpg
│       └── ...                          # More directories with other resolutions
└── ...

# data.py
    images = glob(os.path.join(dataset_path, "images/cropped_images_train_64/*"))
    masks = glob(os.path.join(dataset_path, "masks/cropped_masks_train_64/*"))
    
    # In main:
        dataset_path = "building-segmentation"
    
# test.py
    test_images = glob("building-segmentation/test/test_64/*")

Implementation of U-Net and SegNet for building segmentation

Related tags

Overview

Specialized project

Models

Data

Folder structure

Running the project

Requirements

Training

Testing

Owner

Martin.w-e

Code for the paper: Sketch Your Own GAN

Learning and Building Convolutional Neural Networks using PyTorch

QMagFace: Simple and Accurate Quality-Aware Face Recognition

Part-aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking

Automatic Number Plate Recognition using Contours and Convolution Neural Networks (CNN)

The first public PyTorch implementation of Attentive Recurrent Comparators

SustainBench: Benchmarks for Monitoring the Sustainable Development Goals with Machine Learning

Multi-modal Vision Transformers Excel at Class-agnostic Object Detection

The devkit of the nuScenes dataset.

Prevent `CUDA error: out of memory` in just 1 line of code.

Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two

Solving SMPL/MANO parameters from keypoint coordinates.

MODNet: Trimap-Free Portrait Matting in Real Time

GazeScroller - Using Facial Movements to perform Hands-free Gesture on the system

Pull sensitive data from users on windows including discord tokens and chrome data.

Specification language for generating Generalized Linear Models (with or without mixed effects) from conceptual models

Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(2021) paper

A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimation

GB-CosFace: Rethinking Softmax-based Face Recognition from the Perspective of Open Set Classification

A torch implementation of "Pixel-Level Domain Transfer"