Harald Sack · @lysander07
741 followers · 454 posts · Server sigmoid.social
Interesting new lecture by Christopher Potts & his team, Stanford: Natural Language Understanding (CS224U, Spring 2023):
- Domain adaptation for supervised sentiment
- Retrieval augmented in-context learning
- Advanced behavioral evaluation and analysis methods
#NLP methods
Resources:
Video lectures: https://www.youtube.com/playlist?list=PLoROMvodv4rOwvldxftJTmoR3kRcWkJBp
Course website: http://web.stanford.edu/class/cs224u/index.html
Code: https://github.com/cgpotts/cs224u/
#ai #llm #deeplearning #dl #transformers #lecture
#nlp #ai #llm #deeplearning #DL #Transformers #lecture
Harald Sack · @lysander07
613 followers · 352 posts · Server sigmoid.social
Topics of the last #ise2023 lecture; The Graph in #KnowledgeGraphs, Knowledge Graph Completion, A Brief History of Large Language Models, and Knowledge Graphs and Large Language Models. I will highlight some topics with the upcoming toots...
Slides: https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link
#llms #languagemodels #deeplearning #linkprediction #kgc #lecture #machinelearning #transformers #gpt @fizise @enorouzi
#ise2023 #KnowledgeGraphs #LLMs #languagemodels #deeplearning #linkprediction #KGC #lecture #machinelearning #Transformers #gpt
Benjamin Han · @BenjaminHan
422 followers · 1101 posts · Server sigmoid.social1/
A great recounting of how "All you need is attention" -- the #Transformers paper -- was born out of a "serendipitous assembly of a group of scientists": Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Lukasz Kaiser, and Illia Polosukhin.
https://www.ft.com/content/37bb01af-ee46-4483-982f-ef3921436a50
#Transformers #nlp #nlproc #research #History #deeplearning
Anand Philip · @anandphilipc
14 followers · 86 posts · Server sigmoid.social
ai-Paul E · @paul_ekwereii
33 followers · 56 posts · Server sigmoid.social
Facts. I've noticed a similar decline on the functioning of #BingAI in the last month+.
Terrible on contextual continuity, repetitive.
Someone's turned down the Temperature Param closer to zero.
#AI #LLMs #GPT4 #ChatGPT #Transformers #GenerativeAI
"OpenAI's GPT-4 Got 'Lazier' and 'Dumber.' This Might Be Why." https://www.businessinsider.com/openai-gpt4-ai-model-got-lazier-dumber-chatgpt-2023-7
#bingai #ai #LLMs #gpt4 #chatgpt #Transformers #generativeAI
New Submissions to TMLR · @tmlrsub
192 followers · 651 posts · Server sigmoid.social
A Survey on Transformers in Reinforcement Learning
#Transformers #reinforcement #transformer
Oleg Sinavski · @sinavski
12 followers · 11 posts · Server sigmoid.socialCheckout the dream London roads made by my good friends at Wayve! https://www.youtube.com/shorts/SgW_D7SdjZc
#AI #selfdriving #autonomousdriving #generativeAI #AGI #WorldModels #Transformers
#ai #selfdriving #AutonomousDriving #generativeAI #AGI #worldmodels #Transformers
kunstkopfwestfale · @wllnr
30 followers · 282 posts · Server det.social
#Cars
#Transformers
#Normandie
#poubelle
#Mülltonne
Transformers?
Cars?
Poubelles de la Normandie?
Mülltonnen in der Normandie?
#cars #Transformers #normandie #poubelle #mulltonne
verFRANZt · @verFRANZt
18 followers · 69 posts · Server det.social
New Submissions to TMLR · @tmlrsub
170 followers · 493 posts · Server sigmoid.social
Unveiling Transformers with LEGO: a synthetic reasoning task
#attention #tasks #Transformers
David Strohmaier · @davidstrohmaier
2 followers · 6 posts · Server sigmoid.socialTransformer models do not just learn surface statistics. A list of papers providing evidence: http://dstrohmaier.com/transformer-do-not-just-learn-surface-statistics/ #transformers #NLProc #llm
Shreyas Daniel · @shreydan
4 followers · 26 posts · Server sigmoid.socialis there a paper/blog post to learn about different pre-training objectives for transformers? MLM, Electra, span-corruption and so on? and also comparisons?
#Transformers #nlp #machinelearning #languagemodels #gpt
Shreyas Daniel · @shreydan
2 followers · 17 posts · Server sigmoid.social⚡️ NEW PROJECT!
📹 YouTube Q&A : ask videos questions.
HF Spaces (ngl, slow here, try locally): https://huggingface.co/spaces/shreydan/youtube-QandA
GitHub: https://github.com/shreydan/youtube-in-video-search
sequences have been shortened in this video unless you have a GPU ;)
#Transformers #youtube #nlp #machinelearning
David Strohmaier · @davidstrohmaier
1 followers · 3 posts · Server sigmoid.socialPut together some speculations about #transformers and #compositionality https://dstrohmaier.com/transformer-speculations/
#Transformers #compositionality
Shreyas Daniel · @shreydan
0 followers · 2 posts · Server sigmoid.socialI pre-trained my own small GPT by following Andrej Karpathy's tutorial: https://www.youtube.com/watch?v=kCc8FmEb1nY
Andrej's lectures are the best, he explains very intuitively in his Stanford and YouTube lectures which have been extremely helpful!
Learnt a lot about attention mechanism, transformer architecture and pre-training LMs.
This is what I came up with:
https://github.com/shreydan/shakespeareGPT
SwePalm · @SwePalm
21 followers · 27 posts · Server sigmoid.social
This was a nice experience, multimodal #transformers from #salesforce BLIP-2
Try yourself at #huggingface
https://huggingface.co/spaces/hysts/BLIP2-with-transformers
See image for a idea what is possible.
I see a great business value both for caption of images and Q&A support.
Put a voice interface in front of this and you have an awesome assistant for people with limited vision :-)
#Transformers #salesforce #huggingface
Fenjan🦖 · @fenjan
13 followers · 276 posts · Server sigmoid.social
date: 2023-02-14 13:57:04
by: researchjobs.cz
Top-level research – #ERC grants – papers in Nature Communications: this is @ufal_cuni!
Fully funded #PhDposition in #Multilingual Natural Language Processing available:
https://www.researchjobs.cz/job/fully-funded-phd-position-in-multilingual-natural-language-processing/
#NLP #transformers #PhDinPrague
CC: @czexpats @ukforumcz @MartinVlach_MFF @matfyz
🐦🔗: https://twitter.com/twitter/statuses/1625494335360991239
#PhdPosition
#ERC #phdPosition #multilingual #nlp #Transformers #phdinprague
Jake Mannix · @pbrane
321 followers · 295 posts · Server sigmoid.social"Autobots vs Decepticons: An investigation into RL techniques at combating misinformation from LLM-based chatbots"
You can have that paper title for free, just go ahead and credit me in the acknowledgements.
You're welcome.
#newpaper #arxiv #ai #Transformers #bots
Andrea Tagarelli · @andreatagarelli
7 followers · 4 posts · Server sigmoid.social🧙♂️ "Show me your NFT and I tell you how it will perform" ! 🧙♀️
💥 Check out our postprint (http://arxiv.org/abs/2302.01676) of "Multimodal representation learning for NFT selling price prediction", just accepted at #TheWebConf2023. We're excited to present this work in Austin, Texas, on April 30 - May 4, 2023.
Thanks to Davide Costa and @luciolcw, and congrats for this accomplishment 👏
#NFT #Non-FungibleTokens #Blockchain #Web3 #metaverse #Transformers #ai #computervision #nlp
#thewebconf2023 #nft #non #Blockchain #web3 #metaverse #Transformers #ai #computervision #nlp
Published papers at TMLR · @tmlrpub
498 followers · 219 posts · Server sigmoid.social
Learning the Transformer Kernel
Sankalan Pal Chowdhury, Adamos Solomou, Kumar Avinava Dubey, Mrinmaya Sachan
#transformer #Transformers #kernel