geneticml
This package contains a simple and lightweight genetic algorithm for optimization of any machine learning model.
Installation
Use pip to install the package from PyPI:
pip install geneticml
Usage
This package provides a easy way to create estimators and perform the optimization with genetic algorithms. The example below describe in details how to create a simulation with genetic algorithms using evolutionary approach to train a sklearn.neural_network.MLPClassifier. A full list of examples could be found here.
from geneticml.optimizers import GeneticOptimizer
from geneticml.strategy import EvolutionaryStrategy
from geneticml.algorithms import EstimatorBuilder
from metrics import metric_accuracy
from sklearn.neural_network import MLPClassifier
from sklearn.datasets import load_iris
# Creates a custom fit method
def fit(model, x, y):
return model.fit(x, y)
# Creates a custom predict method
def predict(model, x):
return model.predict(x)
if __name__ == "__main__":
seed = 11412
# Creates an estimator
estimator = EstimatorBuilder()\
.of(model_type=MLPClassifier)\
.fit_with(func=fit)\
.predict_with(func=predict)\
.build()
# Defines a strategy for the optimization
strategy = EvolutionaryStrategy(
estimator_type=estimator,
parameters=parameters,
retain=0.4,
random_select=0.1,
mutate_chance=0.2,
max_children=2,
random_state=seed
)
# Creates the optimizer
optimizer = GeneticOptimizer(strategy=strategy)
# Loads the data
data = load_iris()
# Defines the metric
metric = metric_accuracy
greater_is_better = True
# Create the simulation using the optimizer and the strategy
models = optimizer.simulate(
data=data.data,
target=data.target,
generations=generations,
population=population,
evaluation_function=metric,
greater_is_better=greater_is_better,
verbose=True
)
The estimator is the way you define an algorithm or a class that will be used for model instantiation
estimator = EstimatorBuilder().of(model_type=MLPClassifier).fit_with(func=fit).predict_with(func=predict).build()
You need to speficy a custom fit and predict functions. These functions need to use the same signature than the below ones. This happens because the algorithm is generic and needs to know how to perform the fit and predict functions for the models.
# Creates a custom fit method
def fit(model, x, y):
return model.fit(x, y)
# Creates a custom predict method
def predict(model, x):
return model.predict(x)
Custom strategy
You can create custom strategies for the optimizers by extending the geneticml.strategy.BaseStrategy and implementing the execute(...) function.
class MyCustomStrategy(BaseStrategy):
def __init__(self, estimator_type: Type[BaseEstimator]) -> None:
super().__init__(estimator_type)
def execute(self, population: List[Type[T]]) -> List[T]:
return population
The custom strategies will allow you to create optimization strategies to archive your goals. We currently have the evolutionary strategy but you can define your own :)
Custom optimizer
You can create custom optimizers by extending the geneticml.optimizers.BaseOptimizer and implementing the simulate(...) function.
class MyCustomOptimizer(BaseOptimizer):
def __init__(self, strategy: Type[BaseStrategy]) -> None:
super().__init__(strategy)
def simulate(self, data, target, verbose: bool = True) -> List[T]:
"""
Generate a network with the genetic algorithm.
Parameters:
data (?): The data used to train the algorithm
target (?): The targets used to train the algorithm
verbose (bool): True if should verbose or False if not
Returns:
(List[BaseEstimator]): A list with the final population sorted by their loss
"""
estimators = self._strategy.create_population()
for x in estimators:
x.fit(data, target)
y_pred = x.predict(target)
pass
Custom optimizers will let you define how you want your algorithm to optimize the selected strategy. You can also combine custom strategies and optimizers to archive your desire objective.
Testing
The following are the steps to create a virtual environment into a folder named "venv" and install the requirements.
# Create virtualenv
python3 -m venv venv
# activate virtualenv
source venv/bin/activate
# update packages
pip install --upgrade pip setuptools wheel
# install requirements
python setup.py install
Tests can be run with python setup.py test when the virtualenv is active.
Contributing
All contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas are welcome.
A detailed overview on how to contribute can be found in the contributing guide. There is also an overview on GitHub.
If you are simply looking to start working with the geneticml codebase, navigate to the GitHub "issues" tab and start looking through interesting issues. Or maybe through using geneticml you have an idea of your own or are looking for something in the documentation and thinking ‘this can be improved’...you can do something about it!
Feel free to ask questions on the mailing the contributors.
Changelog
1.0.3 - Included pytorch example
1.0.2 - Minor fixes on naming
1.0.1 - README fixes
1.0.0 - First release
6.1k Jan 5, 2023
10 Aug 30, 2022
1.4k Dec 25, 2022
136 Jan 8, 2023
149 Jan 9, 2023
150 Dec 14, 2022
1 Oct 24, 2021
9 Oct 31, 2022
19 Dec 10, 2022
71 Dec 29, 2022
273 Jan 06, 2023
3 Jun 22, 2022
78 Dec 07, 2022
1 Jan 18, 2022
62 Dec 21, 2022
97 Jan 07, 2023
312 Jan 06, 2023
43 Dec 20, 2022
260 Sep 02, 2022
380 Dec 28, 2022
338 Dec 16, 2022
229 Oct 21, 2022
85 Dec 01, 2022
93 Jan 03, 2023
672 Jan 01, 2023
14 Feb 26, 2022
22 Nov 23, 2022
2 Jan 12, 2022
189 Jan 04, 2023