Machine Learning

1765 readers

1 users here now

founded 5 years ago

MODERATORS

osipov@lemmy.ml

Can gpt generate a gpt model? (sh.itjust.works)

submitted 1 year ago by wargreymon@sh.itjust.works to c/machinelearning@lemmy.ml

5 comments fedilink hide all child comments

Imagine AI giving offsprings...

you are viewing a single comment's thread
view the rest of the comments

[–] Audalin@lemmy.world 5 points 1 year ago (1 children)

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.

permalink
fedilink
source
hideshow 2 child comments

[–] balder1993@programming.dev 2 points 1 year ago

Yep, this is called model distillation.

permalink
fedilink
source
parent