This entity wasn't in the pretraining😢
Don't cry, little ML researcher

Take new term definitions
Continue them with follow-up sentences
Distill your model (D-KL) to continue the same, without the definition
You know the new terms now
Go prompt them tiger🐯

https://arxiv.org/abs/2306.09306

#NLProc #modelRecycling #ModelEditing #machinelearning

Got multiple datasets and you want to improve your own task
Proposed: multitask improvement to the fuse and tune
But more importantly

weight fused model without gradients!

http://arxiv.org/abs/2307.03506
#nlproc #fusing #modelRecycling #machinelearning