Evolutionary Model Merging

A Sakana AI method (Takuya Akiba et al.) for automatically merging the weights of multiple base models using evolutionary algorithms. It optimizes both in parameter space (weight combinations) and in data flow space (layer ordering), discovering combinations unreachable by hand. It enables the creation of new models without additional gradient-based training.