A denoising diffusion probabilistic model synthesises galaxies that are qualitatively and physically indistinguishable from the real thing.

Last update: Dec 20, 2022

Overview

Realistic galaxy simulation via score-based generative models

Official code for 'Realistic galaxy simulation via score-based generative models'. We use a score-based generative model to produce realistic galaxy images. This implementation is based off of Phil Wang's PyTorch version which is in turn transcribed from Jonathan Ho's official Tensorflow version here.

Below are some outputs from our model. Half of these galaxies are real and half are generated. Check out the paper for the answer key.

Running the code

I will be adding full instructions to train and infer with this code within the next couple of days.

This Galaxy/APOD Does Not Exist

More galaxies can be found here.

We also used a DDPM to generate fake Astronomy Picture Of the Day imagery. Check it out.

Citing

If you find this work useful please consider citing our paper:

@article{smith2021,
    title={Realistic galaxy image simulation via score-based generative models},
    author={Michael J. Smith and James E. Geach and Ryan A. Jackson and Nikhil Arora and Connor Stone and St{\'{e}}ephane Courteau},
    journal = {arXiv e-prints},
    year={2021},
    eprint = {2111.01713}
}

Also be sure to check out Jonathan Ho's implementation here:

@article{ho2020,
    author = {{Ho}, Jonathan and {Jain}, Ajay and {Abbeel}, Pieter},
    title = "{Denoising Diffusion Probabilistic Models}",
    journal = {arXiv e-prints},
    year = 2020,
    eprint = {2006.11239},
}

And Jascha Sohl-Dickstein's original DDPM paper:

@article{sohl-dickstein2015,
    author = {{Sohl-Dickstein}, Jascha and {Weiss}, Eric A. and {Maheswaranathan}, Niru and {Ganguli}, Surya},
    title = "{Deep Unsupervised Learning using Nonequilibrium Thermodynamics}",
    journal = {arXiv e-prints},
    year = 2015,
    eprint = {1503.03585}
}

Contributing

AstroDDPM is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

AstroDDPM is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.

You should have received a copy of the GNU Affero General Public License along with AstroDDPM. If not, see https://www.gnu.org/licenses/.

Comments

Could you share the dataset?

I tried to use your download script to download the images, but found that many images are empty (0 bytes), and by manually visiting the URL I got "500 server error" or "301 Moved permanently". Eventually only around ~~2k~~6k images were downloaded successfully. (They were converted to around 2k npy files.)

So, I wonder could you please share the images you downloaded? I guess if every user downloads their own copy of the images, it also adds load to the server.

Thank you so much!

opened by askerlee 6

Official PyTorch implementation for FastDPM, a fast sampling algorithm for diffusion probabilistic models

Official PyTorch implementation for "On Fast Sampling of Diffusion Probabilistic Models". FastDPM generation on CIFAR-10, CelebA, and LSUN datasets. S

68 Dec 26, 2022

Official repository for "Restormer: Efficient Transformer for High-Resolution Image Restoration". SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

Restormer: Efficient Transformer for High-Resolution Image Restoration Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan,

906 Dec 30, 2022

QuakeLabeler is a Python package to create and manage your seismic training data, processes, and visualization in a single place — so you can focus on building the next big thing.

QuakeLabeler Quake Labeler was born from the need for seismologists and developers who are not AI specialists to easily, quickly, and independently bu

15 Nov 4, 2022

Code for the paper One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation, CVPR 2021.

One Thing One Click One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation (CVPR2021) Code for the paper One Thi

44 Dec 12, 2022

The trained model and denoising example for paper : Cardiopulmonary Auscultation Enhancement with a Two-Stage Noise Cancellation Approach

1 Jan 18, 2022

Official codebase for running the small, filtered-data GLIDE model from GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models.

GLIDE This is the official codebase for running the small, filtered-data GLIDE model from GLIDE: Towards Photorealistic Image Generation and Editing w

2.9k Jan 4, 2023

Pytorch Implementation of DiffSinger: Diffusion Acoustic Model for Singing Voice Synthesis (TTS Extension)

A denoising diffusion probabilistic model synthesises galaxies that are qualitatively and physically indistinguishable from the real thing.

Related tags

Overview

Realistic galaxy simulation via score-based generative models

Running the code

This Galaxy/APOD Does Not Exist

Citing

Contributing

You might also like...

Official PyTorch implementation for FastDPM, a fast sampling algorithm for diffusion probabilistic models

Official repository for "Restormer: Efficient Transformer for High-Resolution Image Restoration". SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

QuakeLabeler is a Python package to create and manage your seismic training data, processes, and visualization in a single place — so you can focus on building the next big thing.

Code for the paper One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation, CVPR 2021.

The trained model and denoising example for paper : Cardiopulmonary Auscultation Enhancement with a Two-Stage Noise Cancellation Approach

Official codebase for running the small, filtered-data GLIDE model from GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models.

Pytorch Implementation of DiffSinger: Diffusion Acoustic Model for Singing Voice Synthesis (TTS Extension)

Implementation of GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation (ICLR 2022).

Implementation of the final project of the course DDA6309 Probabilistic Graphical Model

Comments

Could you share the dataset?

Releases(v1.0.0)

v1.0.0(Mar 26, 2022)

Owner

Michael Smith

A pytorch implementation of faster RCNN detection framework (Use detectron2, it's a masterpiece)

[AAAI 2022] Sparse Structure Learning via Graph Neural Networks for Inductive Document Classification

[ICCV 2021] Self-supervised Monocular Depth Estimation for All Day Images using Domain Separation

A simple baseline for the 2022 IEEE GRSS Data Fusion Contest (DFC2022)

Local Multi-Head Channel Self-Attention for FER2013

Self-Supervised Generative Style Transfer for One-Shot Medical Image Segmentation

PyTorch code for our paper "Attention in Attention Network for Image Super-Resolution"

FANet - Real-time Semantic Segmentation with Fast Attention

Repo for the Tutorials of Day1-Day3 of the Nordic Probabilistic AI School 2021 (https://probabilistic.ai/)

PICARD - Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models

Official PyTorch implementation of "The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose Estimation" (ICCV 21).

This is an open source library implementing hyperbox-based machine learning algorithms

[ICCV 2021 Oral] Deep Evidential Action Recognition

Bayesian Meta-Learning Through Variational Gaussian Processes

Incremental Cross-Domain Adaptation for Robust Retinopathy Screening via Bayesian Deep Learning

CIFAR-10 Photo Classification

Evaluation and Benchmarking of Speech Super-resolution Methods

Language Models for the legal domain in Spanish done @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).

Repository for benchmarking graph neural networks

Learning to Prompt for Vision-Language Models.