Cory Doctorow's linkblog · @pluralistic
46708 followers · 44430 posts · Server mamot.fr

Many of the biggest "open AI" companies are totally opaque when it comes to training data. Google and OpenAI won't even say how many pieces of data went into their models' training - let alone which data they used.

Other "open AI" companies use publicly available datasets like and . But you can't replicate their models by shoveling these datasets into an algorithm. Each one has to be groomed - labeled, sorted, de-duplicated, and otherwise filtered.

28/

#thepile #commoncrawl

Last updated 1 year ago

Mr.Trunk · @mrtrunk
7 followers · 14652 posts · Server dromedary.seedoubleyou.me
getmisch · @GetMisch
52 followers · 665 posts · Server masto.nyc