Harald Sack · @lysander07
741 followers · 454 posts · Server sigmoid.social

Interesting new lecture by Christopher Potts & his team, Stanford: Natural Language Understanding (CS224U, Spring 2023):
- Domain adaptation for supervised sentiment
- Retrieval augmented in-context learning
- Advanced behavioral evaluation and analysis methods
methods
Resources:
Video lectures: youtube.com/playlist?list=PLoR
Course website: web.stanford.edu/class/cs224u/
Code: github.com/cgpotts/cs224u/

#nlp #ai #llm #deeplearning #DL #Transformers #lecture

Last updated 1 year ago

Harald Sack · @lysander07
613 followers · 352 posts · Server sigmoid.social

Topics of the last lecture; The Graph in , Knowledge Graph Completion, A Brief History of Large Language Models, and Knowledge Graphs and Large Language Models. I will highlight some topics with the upcoming toots...
Slides: drive.google.com/file/d/1atNvM
@fizise @enorouzi

#ise2023 #KnowledgeGraphs #LLMs #languagemodels #deeplearning #linkprediction #KGC #lecture #machinelearning #Transformers #gpt

Last updated 1 year ago

Benjamin Han · @BenjaminHan
422 followers · 1101 posts · Server sigmoid.social

1/

A great recounting of how "All you need is attention" -- the paper -- was born out of a "serendipitous assembly of a group of scientists": Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Lukasz Kaiser, and Illia Polosukhin.

ft.com/content/37bb01af-ee46-4

#Transformers #nlp #nlproc #research #History #deeplearning

Last updated 1 year ago

Anand Philip · @anandphilipc
14 followers · 86 posts · Server sigmoid.social

Distilbert is so unimpressed by humor

#Transformers #humorlessai

Last updated 1 year ago

ai-Paul E · @paul_ekwereii
33 followers · 56 posts · Server sigmoid.social

Facts. I've noticed a similar decline on the functioning of in the last month+.

Terrible on contextual continuity, repetitive.

Someone's turned down the Temperature Param closer to zero.

"OpenAI's GPT-4 Got 'Lazier' and 'Dumber.' This Might Be Why." businessinsider.com/openai-gpt

#bingai #ai #LLMs #gpt4 #chatgpt #Transformers #generativeAI

Last updated 1 year ago

New Submissions to TMLR · @tmlrsub
192 followers · 651 posts · Server sigmoid.social
Oleg Sinavski · @sinavski
12 followers · 11 posts · Server sigmoid.social
kunstkopfwestfale · @wllnr
30 followers · 282 posts · Server det.social





Transformers?
Cars?
Poubelles de la Normandie?
Mülltonnen in der Normandie?

#cars #Transformers #normandie #poubelle #mulltonne

Last updated 1 year ago

verFRANZt · @verFRANZt
18 followers · 69 posts · Server det.social

What happened to my boys 🫣

#Transformers #beastwars

Last updated 1 year ago

New Submissions to TMLR · @tmlrsub
170 followers · 493 posts · Server sigmoid.social

Unveiling Transformers with LEGO: a synthetic reasoning task

openreview.net/forum?id=Xz5R7e

#attention #tasks #Transformers

Last updated 2 years ago

David Strohmaier · @davidstrohmaier
2 followers · 6 posts · Server sigmoid.social

Transformer models do not just learn surface statistics. A list of papers providing evidence: dstrohmaier.com/transformer-do

#Transformers #nlproc #llm

Last updated 2 years ago

Shreyas Daniel · @shreydan
4 followers · 26 posts · Server sigmoid.social

is there a paper/blog post to learn about different pre-training objectives for transformers? MLM, Electra, span-corruption and so on? and also comparisons?

#Transformers #nlp #machinelearning #languagemodels #gpt

Last updated 2 years ago

Shreyas Daniel · @shreydan
2 followers · 17 posts · Server sigmoid.social

⚡️ NEW PROJECT!

📹 YouTube Q&A : ask videos questions.

HF Spaces (ngl, slow here, try locally): huggingface.co/spaces/shreydan

GitHub: github.com/shreydan/youtube-in

sequences have been shortened in this video unless you have a GPU ;)

#Transformers #youtube #nlp #machinelearning

Last updated 2 years ago

David Strohmaier · @davidstrohmaier
1 followers · 3 posts · Server sigmoid.social
Shreyas Daniel · @shreydan
0 followers · 2 posts · Server sigmoid.social

I pre-trained my own small GPT by following Andrej Karpathy's tutorial: youtube.com/watch?v=kCc8FmEb1n

Andrej's lectures are the best, he explains very intuitively in his Stanford and YouTube lectures which have been extremely helpful!

Learnt a lot about attention mechanism, transformer architecture and pre-training LMs.
This is what I came up with:

github.com/shreydan/shakespear

kaggle.com/code/shreydan/shake

#gpt #Transformers #nlp

Last updated 2 years ago

SwePalm · @SwePalm
21 followers · 27 posts · Server sigmoid.social

This was a nice experience, multimodal from BLIP-2

Try yourself at
huggingface.co/spaces/hysts/BL

See image for a idea what is possible.

I see a great business value both for caption of images and Q&A support.

Put a voice interface in front of this and you have an awesome assistant for people with limited vision :-)

#Transformers #salesforce #huggingface

Last updated 2 years ago

Fenjan🦖 · @fenjan
13 followers · 276 posts · Server sigmoid.social

date: 2023-02-14 13:57:04
by: researchjobs.cz

Top-level research – grants – papers in Nature Communications: this is @ufal_cuni!

Fully funded in Natural Language Processing available:
researchjobs.cz/job/fully-fund

CC: @czexpats @ukforumcz @MartinVlach_MFF @matfyz

🐦🔗: twitter.com/twitter/statuses/1

#ERC #phdPosition #multilingual #nlp #Transformers #phdinprague

Last updated 2 years ago

Jake Mannix · @pbrane
321 followers · 295 posts · Server sigmoid.social

"Autobots vs Decepticons: An investigation into RL techniques at combating misinformation from LLM-based chatbots"

You can have that paper title for free, just go ahead and credit me in the acknowledgements.

You're welcome.

#newpaper #arxiv #ai #Transformers #bots

Last updated 2 years ago

Andrea Tagarelli · @andreatagarelli
7 followers · 4 posts · Server sigmoid.social

🧙‍♂️ "Show me your NFT and I tell you how it will perform" ! 🧙‍♀️

💥 Check out our postprint (arxiv.org/abs/2302.01676) of "Multimodal representation learning for NFT selling price prediction", just accepted at .  We're excited to present this work in Austin, Texas, on April 30 - May 4, 2023.

Thanks to Davide Costa and @luciolcw, and congrats for this accomplishment 👏

-FungibleTokens

#thewebconf2023 #nft #non #Blockchain #web3 #metaverse #Transformers #ai #computervision #nlp

Last updated 2 years ago

Published papers at TMLR · @tmlrpub
498 followers · 219 posts · Server sigmoid.social

Learning the Transformer Kernel

Sankalan Pal Chowdhury, Adamos Solomou, Kumar Avinava Dubey, Mrinmaya Sachan

openreview.net/forum?id=tLIBAE

#transformer #Transformers #kernel

Last updated 2 years ago