Detecting incidental correlation in multimodal learning via latent variable modeling

Taro Makino, Yixin Wang, Krzysztof J. Geras, Kyunghyun Cho

Action editor: Thang Bui.

https://openreview.net/forum?id=QoRo9QmOAr

#multimodal #modality #variational

Offline Reinforcement Learning with Mixture of Deterministic Policies

https://openreview.net/forum?id=zkRCp4RmAF

#reinforcement #offline #multimodal

Active Acquisition for Multimodal Temporal Data: A Challenging Decision-Making Task

Jannik Kossen, Cătălina Cangea, Eszter Vértes et al.

Action editor: Martha White.

https://openreview.net/forum?id=Gbu1bHQhEL

#multimodal #audioset #adaptive

Military Mobility #MilMob is an important element of #CEFTransport #EU

We signed a new project for a #multimodal freight and fuel trans-shipment hub to be built at #Katowice Airport in #Poland (a new #railway siding).

🐦🔗: https://n.respublicae.eu/cinea_eu/status/1665647131661852672

High-Modality Multimodal Transformer: Quantifying Modality & Interaction Heterogeneity for High-M...

Paul Pu Liang, Yiwei Lyu, Xiang Fan et al.

Action editor: Brian Kingsbury.

https://openreview.net/forum?id=ttzypy3kT7

#multimodal #modality #gestures

/4 Und darf ich noch eine Frage stellen? #Bahn und #multimodal #Reisen - ins Ausland? Mit #Fahrrad? Das Thema interessiert mich seit 35 Jahren. Nur, es ist besonders anspruchsvoll für alle Beteiligten. Und #Fortschritte oder #Innovationen sind keine zu
verzeichnen, eher #Rückschritte. Wenn man mal von der Niederflurtechnik im #Nahverkehr absieht. Und von besonders ausgetüftelten Techniken fürs #Faltrad. @totaberlustig @PRO_BAHN @Bahnblogstelle

Numerical Data Imputation for Multimodal Data Sets: A Probabilistic Nearest-Neighbor Kernel Density Approach

https://openreview.net/forum?id=KqR3rgooXb

#imputation #imputed #multimodal

Active Acquisition for Multimodal Temporal Data: A Challenging Decision-Making Task

https://openreview.net/forum?id=Gbu1bHQhEL

#multimodal #audioset #perceiver

'Monotonic Alpha-divergence Minimisation for Variational Inference', by Kamélia Daudel, Randal Douc, François Roueff.

http://jmlr.org/papers/v24/21-0249.html

#variational #divergence #multimodal

NovelCraft: A Dataset for Novelty Detection and Discovery in Open Worlds

Patrick Feeney, Sarah Schneider, Panagiotis Lymperopoulos et al.

https://openreview.net/forum?id=4eL6z9ziw7

#novelty #multimodal #novelcraft

2/

- Negative prompting, i.e., prompting image generation models with nonsensical phrases, often elicits nightmarish images depicting blood, gore and violence.

- One conjecture is these models try to accomodate the statistically improbable prompts by sourcing from the opposite to what they know best: human imagery.

- Curious: does this happen to text generation models too?

#Ethics #AI #ComputerVision #Multimodal #NLP #NLProc

2/

- Negative prompting, i.e., prompting image generation models with nonsensical phrases, often elicits nightmarish images depicting blood, gore and violence.

- One conjecture is these models try to accomodate the statistically improbable prompts by sourcing the opposite of what they know best: human imagery.

- Curious: does this happen to text generation models too?

#Ethics #AI #ComputerVision #Multimodal #NLP #NLProc

2/ - Negative prompting, i.e., prompting image generation models with nonsensical phrases, often elicits nightmarish images depicting blood, gore and violence.

- One conjecture is these models try to accomodate the statistically improbable prompts by sourcing the opposite of what they know best: human imagery.

- Curious: does this happen to text generation models too?

#Ethics #AI #ComputerVision #Multimodal #NLP #NLProc

1/ An interesting read from #TheGuardian on #GenerativeAI. The bits on "Crungus" and "Loab" caught my eyes:

James Bridle. The stupidity of AI. The Guardian. March 2023. https://www.theguardian.com/technology/2023/mar/16/the-stupidity-of-ai-artificial-intelligence-dall-e-chatgpt

#Ethics #AI #ComputerVision #Multimodal #NLP #NLProc

1/ An interesting read from #TheGuardian on #GenerativeAI. The bits on "Crungus" and "Loab" caught my eyes:

James Bridle. The stupidity of AI. The Guardian. March 2023. https://www.theguardian.com/technology/2023/mar/16/the-stupidity-of-ai-artificial-intelligence-dall-e-chatgpt

#Ethics #AI #ComputerVision #Multimodal

Cheap and Deterministic Inference for Deep State-Space Models of Interacting Dynamical Systems

Andreas Look, Barbara Rakitsch, Melih Kandemir, Jan Peters

https://openreview.net/forum?id=dqgdBy4Uv5

#multimodal #benchmark #gaussian

RT @AIHealthMtSinai
Come and join the lab of @ThomasFuchsAI, dean of @AIHealthMtSinai! This postdoc opportunity will include the implementation and evaluation of novel #machinelearning methods to process #multimodal healthcare data. Apply today! @IcahnMountSinai https://www.linkedin.com/jobs/view/3440135283/

1/ A comprehensive -- #multitask, #multilingual, #multimodal -- #evaluation of #ChatGPT:

Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, Wenliang Dai, Dan Su, Bryan Wilie, Holy Lovenia, Ziwei Ji, Tiezheng Yu, Willy Chung, Quyet V. Do, Yan Xu, and Pascale Fung. 2023. A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity. arXiv [cs.CL]. https://arxiv.org/abs/2302.04023

#NLG #NLP #NLU #NLGPU #NLProc #DeepLearning #AI #Paper

NovelCraft: A Dataset for Novelty Detection and Discovery in Open Worlds

https://openreview.net/forum?id=4eL6z9ziw7

#novelty #multimodal #novelcraft

Went back to BLIP (https://arxiv.org/abs/2201.12086) last night. When I first skimmed it, I focused on the part of the paper focused on bootstrapping captions, but the "Multimodal mixture of Encoder-Decoder" architecture is pretty cool.

It uses a structured architecture involving multiple encoder/decoders wherein some parts of the architecture take advantage of others (e.g. using the contrastive loss for hard example mining for the image-text matching loss).

#ilp #vlp #multimodal