arXiv cs.CL bot · @arXiv_csCL_bot
8 followers · 13434 posts · Server mastoxiv.page

Natural language understanding (NLU) is integral to various social media applications. However, existing NLU models rely heavily on context for semantic learning, resulting in compromised performance when faced with short and noisy social media content. To address this issue, we leverage in-context learning (ICL), wherein language models learn to make inferences by conditioning on a handful of demonstrations to enrich the context and propose a novel hashtag-driven in-context learning (HICL) framework. Concretely, we pre-train a model , which employs (user-annotated topic labels) to drive BERT-based pre-training through contrastive learning. Our objective here is to enable to gain the ability to incorporate topic-related semantic information, which allows it to retrieve topic-related posts to enrich contexts and enhance social media NLU with noisy contexts. To further integrate the retrieved context with the source text, we employ a gradient-based method to identify trigger terms useful in fusing information from both sources. For empirical studies, we collected 45M tweets to set up an in-context NLU benchmark, and the experimental results on seven downstream tasks show that HICL substantially advances the previous state-of-the-art results. Furthermore, we conducted extensive analyzes and found that: (1) combining source input with a top-retrieved post from is more effective than using semantically similar posts; (2) trigger words can largely benefit in merging context from the source and retrieved posts.
[arxiv.org/abs/2308.09985v1]

#encoder #hashtags

Last updated 1 year ago

kleines Filmröllchen · @filmroellchen
140 followers · 181 posts · Server serenityos.social

Today's relaxing FLAC hacking session: Adding
writing to 's !

#metadata #serenityos #flac #encoder

Last updated 1 year ago

Published papers at TMLR · @tmlrpub
553 followers · 555 posts · Server sigmoid.social

Long-term Forecasting with TiDE: Time-series Dense Encoder

Abhimanyu Das, Weihao Kong, Andrew Leach, Shaan K Mathur, Rajat Sen, Rose Yu

Action editor: Alessandro Sperduti.

openreview.net/forum?id=pCbC3a

#forecasting #encoder #transformer

Last updated 1 year ago

New Submissions to TMLR · @tmlrsub
198 followers · 694 posts · Server sigmoid.social

Long-term Forecasting with TiDE: Time-series Dense Encoder

openreview.net/forum?id=pCbC3a

#forecasting #encoder #transformer

Last updated 1 year ago

New Submissions to TMLR · @tmlrsub
188 followers · 644 posts · Server sigmoid.social

Relating graph auto-encoders to linear models

openreview.net/forum?id=Y1eYpl

#encoders #embedding #encoder

Last updated 1 year ago

Published papers at TMLR · @tmlrpub
522 followers · 468 posts · Server sigmoid.social

Sequential Query Encoding for Complex Query Answering on Knowledge Graphs

Jiaxin Bai, Tianshi Zheng, Yangqiu Song

Action editor: Alessandro Sordoni.

openreview.net/forum?id=ERqGqZ

#queries #query #encoder

Last updated 1 year ago

New Submissions to TMLR · @tmlrsub
179 followers · 552 posts · Server sigmoid.social

CAE v2: Context Autoencoder with CLIP Latent Alignment

openreview.net/forum?id=f36LaK

#autoencoder #encoder #masked

Last updated 2 years ago

Hemant🕉️🌻:julia: · @themantra108
191 followers · 2271 posts · Server julialang.social
Published papers at TMLR · @tmlrpub
514 followers · 357 posts · Server sigmoid.social

Reducing Predictive Feature Suppression in Resource-Constrained Contrastive Image-Caption Retrieval

Maurits Bleeker, Andrew Yates, Maarten de Rijke

openreview.net/forum?id=T1XtOq

#encoder #decoder #decoding

Last updated 2 years ago

New Submissions to TMLR · @tmlrsub
167 followers · 465 posts · Server sigmoid.social
roundssencoder · @roundssencoder
0 followers · 20 posts · Server mastodon.cloud

Waiting for you at ITES 2023#rotaryencoder factory supplier

#encoder

Last updated 2 years ago

GeekProjects News · @news
4 followers · 3116 posts · Server geekprojects.com
IT News · @itnewsbot
3052 followers · 254380 posts · Server schleuss.online

Kino Wheels Gives You a Hand Learning Camera Operation - Have you ever watched a movie or a video and really noticed the quality of the cam... - hackaday.com/2023/03/28/kino-w

#pan #din #tilt #encoder #bearing #simulator #handwheel #mischacks #arduinomega2560

Last updated 2 years ago

Nishtha Srivastava · @nishtha_srivastava
168 followers · 47 posts · Server techhub.social

Zhou et al. propose a noise-aware model 'NAFSA-Net' for acoustic signal which adopts & stacked fullband-subband attention (FSA) blocks to capture both global and fine-grained local dependencies of features
ieeexplore.ieee.org/abstract/d

#deeplearning #underwater #denoising #encoder

Last updated 2 years ago

New Submissions to TMLR · @tmlrsub
161 followers · 415 posts · Server sigmoid.social

Sequential Query Encoding For Complex Query Answering on Knowledge Graphs

openreview.net/forum?id=ERqGqZ

#queries #query #encoder

Last updated 2 years ago

Shutter Encoder es un programa que me ha servido para transformar archivos .MOV en .WEBM con alfa. No sé si salvará la vida a alguien, pero a mí me lo ha hecho.

#programar #encoder #edicion

Last updated 2 years ago

Published papers at TMLR · @tmlrpub
504 followers · 276 posts · Server sigmoid.social

Stacking Diverse Architectures to Improve Machine Translation

Andrea Schioppa, Nal Kalchbrenner

openreview.net/forum?id=mNEqiC

#attention #encoder #encode

Last updated 2 years ago