You edit a model telling it Baiden is the U.S. president
Now you ask:
Who lives in the white house?
What do you think it answers? (hint: not Baiden)
@mega https://arxiv.org/abs/2307.12976
#nlproc #ModelEditing #machinelearning
#nlproc #modelediting #machinelearning
This entity wasn't in the pretraining😢
Don't cry, little ML researcher
Take new term definitions
Continue them with follow-up sentences
Distill your model (D-KL) to continue the same, without the definition
You know the new terms now
Go prompt them tiger🐯
#nlproc #modelrecycling #modelediting #machinelearning