pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

Last update: May 11, 2022

Related tags

Deep Learning pybaum

Overview

pybaum

https://readthedocs.org/projects/pybaum/badge/?version=latest

https://img.shields.io/github/workflow/status/OpenSourceEconomics/pybaum/main/main

Installation

pybaum is available on PyPI and Anaconda.org. Install it with

$ pip install pybaum

# or

$ conda install -c conda-forge pybaum

About

pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

What is a pytree?

In pybaum, we use the term pytree to refer to a tree-like structure built out of container-like Python objects. Classes are considered container-like if they are in the pytree registry, which by default includes lists, tuples, and dicts. That is:

Any object whose type is not in the pytree container registry is considered a leaf pytree.
Any object whose type is in the pytree container registry, and which contains pytrees, is considered a pytree.

For each entry in the pytree container registry, a container-like type is registered with a pair of functions that specify how to convert an instance of the container type to a (children, metadata) pair and how to convert such a pair back to an instance of the container type. Using these functions, pybaum can canonicalize any tree of registered container objects into tuples.

Example pytrees:

[1, "a", object()]  # 3 leaves

(1, (2, 3), ())  # 3 leaves

[1, {"k1": 2, "k2": (3, 4)}, 5]  # 5 leaves

pybaum can be extended to consider other container types as pytrees.

Comments

Fix for new jax version.

Problem

The type of a jax array has changed in jax version 0.4.1 and thus pybaum would not work with this jax version.

Solution

Handle jax arrays explicitly in get_type, as we are currently already doing for namedtuples.

opened by janosg 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.4.0

github.com/asottile/reorder_python_imports: v3.1.0 → v3.9.0

github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.4.0

github.com/psf/black: 22.3.0 → 22.12.0

github.com/PyCQA/flake8: 4.0.1 → 6.0.0

github.com/PyCQA/doc8: 0.11.2 → v1.0.0

github.com/mgedmin/check-manifest: 0.48 → 0.49

github.com/PyCQA/doc8: 0.11.2 → v1.0.0

github.com/asottile/setup-cfg-fmt: v1.20.1 → v2.2.0

github.com/codespell-project/codespell: v2.1.0 → v2.2.2

github.com/asottile/pyupgrade: v2.34.0 → v3.3.1
opened by pre-commit-ci[bot] 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.2.0 → v4.3.0

github.com/pre-commit/pre-commit-hooks: v4.2.0 → v4.3.0

github.com/PyCQA/doc8: 0.11.1 → 0.11.2

github.com/PyCQA/doc8: 0.11.1 → 0.11.2

github.com/asottile/pyupgrade: v2.32.1 → v2.34.0
opened by pre-commit-ci[bot] 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.1.0 → v4.2.0

github.com/asottile/reorder_python_imports: v2.7.1 → v3.1.0

github.com/pre-commit/pre-commit-hooks: v4.1.0 → v4.2.0

github.com/psf/black: 22.1.0 → 22.3.0

github.com/PyCQA/doc8: 0.10.1 → 0.11.1

github.com/mgedmin/check-manifest: 0.47 → 0.48

github.com/PyCQA/doc8: 0.10.1 → 0.11.1

github.com/asottile/setup-cfg-fmt: v1.20.0 → v1.20.1

github.com/asottile/pyupgrade: v2.31.0 → v2.32.1
opened by pre-commit-ci[bot] 1
Align default containers with jax
Currently we have only list, dict and tuple as default pytree containers.

Jax also has:

[x] None

[x] collections.namedtuple and typing.NamedTuple

[x] collections.OrderedDict
opened by janosg 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.0.1 → v4.1.0

github.com/asottile/reorder_python_imports: v2.6.0 → v2.7.1

github.com/pre-commit/pre-commit-hooks: v4.0.1 → v4.1.0

github.com/asottile/blacken-docs: v1.12.0 → v1.12.1

github.com/psf/black: 21.12b0 → 22.1.0
opened by pre-commit-ci[bot] 1
Additional option for flattening pandas DataFrames
Currently the user can decide between two ways of treating DataFrames

Only the entries in a fixed set of columns appears in the flat list of leaves

All entries appear in the flat list of leaves.

In estimagic a third mode would be very practical that automatically switches between the two cases above. If all columns from the specified subset are present, only those columns are considered. If None of the columns is present, all entries are considered.

If this sounds too special, we can also only add it in estimagic.
opened by janosg 1
Add basic documentation
To-Do

[x] Add all functions that can be directly imported from pybaum to an API Documentation

[ ] Write some text about the rationale behind pybaum

[ ] Explain deviations from JAX

[ ] Add examples

enhancement good first issue
opened by janosg 0
Test against JAX
To-Do

[ ] Write sample_tree function that creates a random pytree based on some high level information

[ ] Create random pytrees and test against JAX

[ ] Test current example pytrees against JAX

Note

Need to find a way of not installing JAX on windows in tox.
enhancement good first issue
opened by janosg 0
Improve treedef
Problem

The JAX treedef contains more information. Therefore, their tree_unflatten function does not need an is_leaf argument. The same way we could make the registry argument unnecessary.

This is not just more convenient. It reduces error potential because the unflattening will automatically use the same options as the flattening.

To-Do

[ ] Come up with better Treedef (namedtuple or Class) and implement it

[ ] Adjust interface of tree_unflatten.

enhancement
opened by janosg 1
Improve error checking
To-Do

[ ] Add explicit error handling to tree_equal

[ ] Check for typos in options and types in get_registry and suggest improvements with fuzzywuzzy

[ ] Look for more places where we need better error handling

enhancement
opened by janosg 0

Releases(v0.1.3)

v0.1.3(Dec 16, 2022)
#22 Improves the type check for jax arrays and enables support for Jax 0.4.1 or newer.

Source code(tar.gz)
Source code(zip)
v0.1.2(Jun 15, 2022)
Add JAX array support to pybaum. By @timmens and @janosg in #18 and #20

Source code(tar.gz)
Source code(zip)
v0.1.1(Feb 19, 2022)
What's Changed

Add a section about the API to the docs. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/12

Add default arguments to tree_just_flatten. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/10

Implement tree_yield and tree_just_yield. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/11

Add badges and a short description to the readme. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/13

Full Changelog: https://github.com/OpenSourceEconomics/pybaum/compare/v0.1.0...v0.1.1
Source code(tar.gz)
Source code(zip)
v0.1.0(Jan 28, 2022)

Source code(tar.gz)
Source code(zip)

Owner

Open Source Economics

A platform for transdisciplinary collaboration in the development, analysis, and application of computational economic models.

GitHub Repository https://pybaum.readthedocs.io

ConvMAE: Masked Convolution Meets Masked Autoencoders

ConvMAE ConvMAE: Masked Convolution Meets Masked Autoencoders Peng Gao1, Teli Ma1, Hongsheng Li2, Jifeng Dai3, Yu Qiao1, 1 Shanghai AI Laboratory, 2 M

345 Jan 08, 2023

Running Google MoveNet Multipose Tracking models on OpenVINO.

MoveNet MultiPose Tracking on OpenVINO

60 Nov 17, 2022

Code for "Adversarial attack by dropping information." (ICCV 2021)

AdvDrop Code for "AdvDrop: Adversarial Attack to DNNs by Dropping Information(ICCV 2021)." Human can easily recognize visual objects with lost informa

52 Nov 10, 2022

A library for low-memory inferencing in PyTorch.

Pylomin Pylomin (PYtorch LOw-Memory INference) is a library for low-memory inferencing in PyTorch. Installation ... Usage For example, the following c

3 Oct 26, 2022

Python Fanduel API (2021) - Lineup Automation

Southpaw is a python package that provides access to the Fanduel API. Optimize your DFS experience by programmatically updating your lineups, analyzin

13 Jan 04, 2023

A TensorFlow implementation of SOFA, the Simulator for OFfline LeArning and evaluation.

SOFA This repository is the implementation of SOFA, the Simulator for OFfline leArning and evaluation. Keeping Dataset Biases out of the Simulation: A

22 Nov 23, 2022

i-RevNet Pytorch Code

i-RevNet: Deep Invertible Networks Pytorch implementation of i-RevNets. i-RevNets define a family of fully invertible deep networks, built from a succ

378 Dec 06, 2022

Official implementation of the Implicit Behavioral Cloning (IBC) algorithm

Implicit Behavioral Cloning This codebase contains the official implementation of the Implicit Behavioral Cloning (IBC) algorithm from our paper: Impl

210 Dec 09, 2022

Unoffical reMarkable AddOn for Firefox.

reMarkable for Firefox (Download) This repo converts the offical reMarkable Chrome Extension into a Firefox AddOn published here under the name "Unoff

45 Nov 28, 2022

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

21.3k Jan 01, 2023

Tutorials and implementations for "Self-normalizing networks"

Self-Normalizing Networks Tutorials and implementations for "Self-normalizing networks"(SNNs) as suggested by Klambauer et al. (arXiv pre-print). Vers

1.6k Jan 07, 2023

Quadruped-command-tracking-controller - Quadruped command tracking controller (flat terrain)

Quadruped command tracking controller (flat terrain) Prepare Install RAISIM link

4 Oct 20, 2022

BERT model training impelmentation using 1024 A100 GPUs for MLPerf Training v1.1

Pre-trained checkpoint and bert config json file Location of checkpoint and bert config json file This MLCommons members Google Drive location contain

12 Apr 27, 2022

Steerable discovery of neural audio effects

Steerable discovery of neural audio effects Christian J. Steinmetz and Joshua D. Reiss Abstract Applications of deep learning for audio effects often

182 Dec 29, 2022

Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase

Ranger-Deep-Learning-Optimizer Ranger - a synergistic optimizer combining RAdam (Rectified Adam) and LookAhead, and now GC (gradient centralization) i

1.1k Dec 21, 2022

This is the official code of our paper "Diversity-based Trajectory and Goal Selection with Hindsight Experience Relay" (PRICAI 2021)

Diversity-based Trajectory and Goal Selection with Hindsight Experience Replay This is the official implementation of our paper "Diversity-based Traje

6 Jul 18, 2022

[CVPR 2022] Official Pytorch code for OW-DETR: Open-world Detection Transformer

OW-DETR: Open-world Detection Transformer (CVPR 2022) [Paper] Akshita Gupta*, Sanath Narayan*, K J Joseph, Salman Khan, Fahad Shahbaz Khan, Mubarak Sh

127 Dec 27, 2022

D2Go is a toolkit for efficient deep learning

D2Go D2Go is a production ready software system from FacebookResearch, which supports end-to-end model training and deployment for mobile platforms. W

744 Jan 04, 2023

[NeurIPS'21] "AugMax: Adversarial Composition of Random Augmentations for Robust Training" by Haotao Wang, Chaowei Xiao, Jean Kossaifi, Zhiding Yu, Animashree Anandkumar, and Zhangyang Wang.

112 Nov 07, 2022

🚗 INGI Dakar 2K21 - Be the first one on the finish line ! 🚗

🚗 INGI Dakar 2K21 - Be the first one on the finish line ! 🚗 This year's first semester Club Info challenge will put you at the head of a car racing

6 Dec 10, 2021

pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

Related tags

Overview

pybaum

Installation

About

Comments

Problem

Solution

To-Do

To-Do

Note

Problem

To-Do

To-Do

Releases(v0.1.3)

v0.1.3(Dec 16, 2022)

v0.1.2(Jun 15, 2022)

v0.1.1(Feb 19, 2022)

What's Changed

v0.1.0(Jan 28, 2022)

Owner

Open Source Economics

ConvMAE: Masked Convolution Meets Masked Autoencoders

Running Google MoveNet Multipose Tracking models on OpenVINO.

Code for "Adversarial attack by dropping information." (ICCV 2021)

A library for low-memory inferencing in PyTorch.

Python Fanduel API (2021) - Lineup Automation

A TensorFlow implementation of SOFA, the Simulator for OFfline LeArning and evaluation.

i-RevNet Pytorch Code

Official implementation of the Implicit Behavioral Cloning (IBC) algorithm

Unoffical reMarkable AddOn for Firefox.

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Tutorials and implementations for "Self-normalizing networks"

Quadruped-command-tracking-controller - Quadruped command tracking controller (flat terrain)

BERT model training impelmentation using 1024 A100 GPUs for MLPerf Training v1.1

Steerable discovery of neural audio effects

Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase

This is the official code of our paper "Diversity-based Trajectory and Goal Selection with Hindsight Experience Relay" (PRICAI 2021)

[CVPR 2022] Official Pytorch code for OW-DETR: Open-world Detection Transformer

D2Go is a toolkit for efficient deep learning

[NeurIPS'21] "AugMax: Adversarial Composition of Random Augmentations for Robust Training" by Haotao Wang, Chaowei Xiao, Jean Kossaifi, Zhiding Yu, Animashree Anandkumar, and Zhangyang Wang.

🚗 INGI Dakar 2K21 - Be the first one on the finish line ! 🚗