This thesis is mainly concerned with state-space methods for a class of deep Gaussian process (DGP) regression problems

Overview

Doctoral dissertation of Zheng Zhao

thesis

Dissertation latex compile

This thesis is mainly concerned with state-space methods for a class of deep Gaussian process (DGP) regression problems. As an example, one can think of a family of DGPs as solutions to stochastic differential equations (SDEs), and view their regression problems as filtering and smoothing problems. Additionally, this thesis also presents a few applications from (D)GPs, such as system identification of SDEs and spectro-temporal signal analysis.

Supervisor: Prof. Simo Särkkä.

Pre-examiners: Prof. Kody J. H. Law from The University of Manchester and Prof. David Duvenaud from University of Toronto.

Opponent: Prof. Manfred Opper from University of Birmingham.

The public defence of the thesis will be streamed online on December 10, 2021 at noon (Helsinki time) via Zoom link https://aalto.zoom.us/j/67529212279. It is free and open to everyone.

More details regarding the thesis itself can be found in its title pages.

Contents

The dissertation is in ./dissertation.pdf. Feel free to download and read~~

Note that you may also find an "official" version in aaltodoc published by Aalto University. However, it destroyed the PDF links and outline, making it very painful to read in computer/ipad/inktablet. I believe that you will feel more enjoyable reading ./dissertation.pdf instead. In terms of content, the one here has no difference with the one in aaltodoc.

  1. ./dissertation.pdf. The PDF of the thesis.
  2. ./errata.md. Errata of the thesis.
  3. ./cover. This folder contains a Python script that generates the cover image.
  4. ./lectio_praecursoria. This folder contains the presentation at the public defence of the thesis.
  5. ./scripts. This folder contains Python scripts that are used to generate some of the figures in the thesis.
  6. ./thesis_latex. This folder contains the LaTeX source of the thesis. Compiling the tex files here will generate a PDF the same as with ./dissertation.pdf.

Satellite repositories

  1. https://github.com/zgbkdlm/ssdgp contains implementation of state-space deep Gaussian processes.
  2. https://github.com/zgbkdlm/tme and https://github.com/zgbkdlm/tmefs contain implementation of Taylor moment expansion method and its filter and smoother applications.

Citation

Bibtex:

@phdthesis{Zhao2021Thesis,
	title = {State-space deep Gaussian processes with applications},
	author = {Zheng Zhao},
	school = {Aalto University},
	year = {2021},
}

Plain text: Zheng Zhao. State-space deep Gaussian processes with applications. PhD thesis, Aalto University, 2021.

License

Unless otherwise stated, all rights belong to the author Zheng Zhao. This repository consists of files covered by different licenses, please check their licenses before you use them.

You are free to download, display, and print ./dissertation.pdf for your own personal use. Commercial use of it is prohibited.

Acknowledgement

I would like to thank Adrien (Monte) Corenflos, Christos Merkatas, Dennis Yeung, and Sakira Hassan for their time and efforts for reviewing and checking the languange of the thesis.

Contact

Zheng Zhao, [email protected]

Owner
Zheng Zhao
喵~~
Zheng Zhao
Minimal deep learning library written from scratch in Python, using NumPy/CuPy.

SmallPebble Project status: experimental, unstable. SmallPebble is a minimal/toy automatic differentiation/deep learning library written from scratch

Sidney Radcliffe 92 Dec 30, 2022
NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset

NOD (Night Object Detection) Dataset NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset, BM

Igor Morawski 17 Nov 05, 2022
TensorFlow implementation of AlexNet and its training and testing on ImageNet ILSVRC 2012 dataset

AlexNet training on ImageNet LSVRC 2012 This repository contains an implementation of AlexNet convolutional neural network and its training and testin

Matteo Dunnhofer 161 Nov 25, 2022
A simple, clean TensorFlow implementation of Generative Adversarial Networks with a focus on modeling illustrations.

IllustrationGAN A simple, clean TensorFlow implementation of Generative Adversarial Networks with a focus on modeling illustrations. Generated Images

268 Nov 27, 2022
DISTIL: Deep dIverSified inTeractIve Learning.

DISTIL: Deep dIverSified inTeractIve Learning. An active/inter-active learning library built on py-torch for reducing labeling costs.

decile-team 110 Dec 06, 2022
Network Compression via Central Filter

Network Compression via Central Filter Environments The code has been tested in the following environments: Python 3.8 PyTorch 1.8.1 cuda 10.2 torchsu

2 May 12, 2022
Kroomsa: A search engine for the curious

Kroomsa A search engine for the curious. It is a search algorithm designed to en

Wingify 7 Jun 20, 2022
A self-supervised 3D representation learning framework named viewpoint bottleneck.

Pointly-supervised 3D Scene Parsing with Viewpoint Bottleneck Paper Created by Liyi Luo, Beiwen Tian, Hao Zhao and Guyue Zhou from Institute for AI In

63 Aug 11, 2022
Implementation of the GBST block from the Charformer paper, in Pytorch

Charformer - Pytorch Implementation of the GBST (gradient-based subword tokenization) module from the Charformer paper, in Pytorch. The paper proposes

Phil Wang 105 Dec 26, 2022
GRaNDPapA: Generator of Rad Names from Decent Paper Acronyms

GRaNDPapA: Generator of Rad Names from Decent Paper Acronyms Trying to publish a new machine learning model and can't write a decent title for your pa

264 Nov 08, 2022
DSAC* for Visual Camera Re-Localization (RGB or RGB-D)

DSAC* for Visual Camera Re-Localization (RGB or RGB-D) Introduction Installation Data Structure Supported Datasets 7Scenes 12Scenes Cambridge Landmark

Visual Learning Lab 143 Dec 22, 2022
A hand tracking demo made with mediapipe where you can control lights with pinching your fingers and moving your hand up/down.

HandTrackingBrightnessControl A hand tracking demo made with mediapipe where you can control lights with pinching your fingers and moving your hand up

Teemu Laurila 19 Feb 12, 2022
A standard framework for modelling Deep Learning Models for tabular data

PyTorch Tabular aims to make Deep Learning with Tabular data easy and accessible to real-world cases and research alike.

801 Jan 08, 2023
Code in PyTorch for the convex combination linear IAF and the Householder Flow, J.M. Tomczak & M. Welling

VAE with Volume-Preserving Flows This is a PyTorch implementation of two volume-preserving flows as described in the following papers: Tomczak, J. M.,

Jakub Tomczak 87 Dec 26, 2022
Spectralformer: Rethinking hyperspectral image classification with transformers

Spectralformer: Rethinking hyperspectral image classification with transformers Danfeng Hong, Zhu Han, Jing Yao, Lianru Gao, Bing Zhang, Antonio Plaza

Danfeng Hong 102 Dec 29, 2022
SimBERT升级版(SimBERTv2)!

RoFormer-Sim RoFormer-Sim,又称SimBERTv2,是我们之前发布的SimBERT模型的升级版。 介绍 https://kexue.fm/archives/8454 训练 tensorflow 1.14 + keras 2.3.1 + bert4keras 0.10.6 下载

318 Dec 31, 2022
A minimal yet resourceful implementation of diffusion models (along with pretrained models + synthetic images for nine datasets)

A minimal yet resourceful implementation of diffusion models (along with pretrained models + synthetic images for nine datasets)

Vikash Sehwag 65 Dec 19, 2022
Training a deep learning model on the noisy CIFAR dataset

Training-a-deep-learning-model-on-the-noisy-CIFAR-dataset This repository contai

1 Jun 14, 2022
OSLO: Open Source framework for Large-scale transformer Optimization

O S L O Open Source framework for Large-scale transformer Optimization What's New: December 21, 2021 Released OSLO 1.0. What is OSLO about? OSLO is a

TUNiB 280 Nov 24, 2022
Code for "Optimizing risk-based breast cancer screening policies with reinforcement learning"

Tempo: Optimizing risk-based breast cancer screening policies with reinforcement learning Introduction This repository was used to develop Tempo, as d

Adam Yala 12 Oct 11, 2022