geneticml
This package contains a simple and lightweight genetic algorithm for optimization of any machine learning model.
Installation
Use pip to install the package from PyPI:
pip install geneticml
Usage
This package provides a easy way to create estimators and perform the optimization with genetic algorithms. The example below describe in details how to create a simulation with genetic algorithms using evolutionary approach to train a sklearn.neural_network.MLPClassifier. A full list of examples could be found here.
from geneticml.optimizers import GeneticOptimizer
from geneticml.strategy import EvolutionaryStrategy
from geneticml.algorithms import EstimatorBuilder
from metrics import metric_accuracy
from sklearn.neural_network import MLPClassifier
from sklearn.datasets import load_iris
# Creates a custom fit method
def fit(model, x, y):
return model.fit(x, y)
# Creates a custom predict method
def predict(model, x):
return model.predict(x)
if __name__ == "__main__":
seed = 11412
# Creates an estimator
estimator = EstimatorBuilder()\
.of(model_type=MLPClassifier)\
.fit_with(func=fit)\
.predict_with(func=predict)\
.build()
# Defines a strategy for the optimization
strategy = EvolutionaryStrategy(
estimator_type=estimator,
parameters=parameters,
retain=0.4,
random_select=0.1,
mutate_chance=0.2,
max_children=2,
random_state=seed
)
# Creates the optimizer
optimizer = GeneticOptimizer(strategy=strategy)
# Loads the data
data = load_iris()
# Defines the metric
metric = metric_accuracy
greater_is_better = True
# Create the simulation using the optimizer and the strategy
models = optimizer.simulate(
data=data.data,
target=data.target,
generations=generations,
population=population,
evaluation_function=metric,
greater_is_better=greater_is_better,
verbose=True
)
The estimator is the way you define an algorithm or a class that will be used for model instantiation
estimator = EstimatorBuilder().of(model_type=MLPClassifier).fit_with(func=fit).predict_with(func=predict).build()
You need to speficy a custom fit and predict functions. These functions need to use the same signature than the below ones. This happens because the algorithm is generic and needs to know how to perform the fit and predict functions for the models.
# Creates a custom fit method
def fit(model, x, y):
return model.fit(x, y)
# Creates a custom predict method
def predict(model, x):
return model.predict(x)
Custom strategy
You can create custom strategies for the optimizers by extending the geneticml.strategy.BaseStrategy and implementing the execute(...) function.
class MyCustomStrategy(BaseStrategy):
def __init__(self, estimator_type: Type[BaseEstimator]) -> None:
super().__init__(estimator_type)
def execute(self, population: List[Type[T]]) -> List[T]:
return population
The custom strategies will allow you to create optimization strategies to archive your goals. We currently have the evolutionary strategy but you can define your own :)
Custom optimizer
You can create custom optimizers by extending the geneticml.optimizers.BaseOptimizer and implementing the simulate(...) function.
class MyCustomOptimizer(BaseOptimizer):
def __init__(self, strategy: Type[BaseStrategy]) -> None:
super().__init__(strategy)
def simulate(self, data, target, verbose: bool = True) -> List[T]:
"""
Generate a network with the genetic algorithm.
Parameters:
data (?): The data used to train the algorithm
target (?): The targets used to train the algorithm
verbose (bool): True if should verbose or False if not
Returns:
(List[BaseEstimator]): A list with the final population sorted by their loss
"""
estimators = self._strategy.create_population()
for x in estimators:
x.fit(data, target)
y_pred = x.predict(target)
pass
Custom optimizers will let you define how you want your algorithm to optimize the selected strategy. You can also combine custom strategies and optimizers to archive your desire objective.
Testing
The following are the steps to create a virtual environment into a folder named "venv" and install the requirements.
# Create virtualenv
python3 -m venv venv
# activate virtualenv
source venv/bin/activate
# update packages
pip install --upgrade pip setuptools wheel
# install requirements
python setup.py install
Tests can be run with python setup.py test when the virtualenv is active.
Contributing
All contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas are welcome.
A detailed overview on how to contribute can be found in the contributing guide. There is also an overview on GitHub.
If you are simply looking to start working with the geneticml codebase, navigate to the GitHub "issues" tab and start looking through interesting issues. Or maybe through using geneticml you have an idea of your own or are looking for something in the documentation and thinking ‘this can be improved’...you can do something about it!
Feel free to ask questions on the mailing the contributors.
Changelog
1.0.3 - Included pytorch example
1.0.2 - Minor fixes on naming
1.0.1 - README fixes
1.0.0 - First release
6.1k Jan 5, 2023
10 Aug 30, 2022
1.4k Dec 25, 2022
136 Jan 8, 2023
149 Jan 9, 2023
150 Dec 14, 2022
1 Oct 24, 2021
9 Oct 31, 2022
19 Dec 10, 2022
2.8k Dec 30, 2022
1 Jan 14, 2022
23 Oct 19, 2022
272 Nov 01, 2022
3 Feb 22, 2022
32 Nov 20, 2022
44 Dec 07, 2022
140 Dec 30, 2022
32 Dec 26, 2022
749 Jan 04, 2023
313 Dec 27, 2022
73 Dec 20, 2022
6 Aug 30, 2022
5 Jul 18, 2022
11 Nov 27, 2022
36 Dec 13, 2022
1.3k Dec 28, 2022
10 Dec 27, 2022
140 Dec 19, 2022
24 Nov 18, 2022