Save + Index + Share various training advancements as diffs?

[vRobM]

It seems individual model training is lost to other users, which would be more beneficial to share and use each run to improve the model for all, over time improving the base model beyond what any single 'student' can do on its own.

Similar to llama_index for external data, can you have an 'awesome llama learnings' collection as easily integrate diffs one can merge for their own needs or to a single central model, making it the sum greater than all the parts?

That would be grand