Jonas Nölle · @jn
272 followers · 79 posts · Server fediscience.org

If you're interested in and facial expression pragmatics come to our talk at today in session 4 (3F), 11.45.
I'll present work from @facesyntax on how facial expressions can modulate the perceived confidence and doubt of spoken answers in English & Chinese.

#iclc16 #Multimodality

Last updated 1 year ago

ISCA · @isca
48 followers · 97 posts · Server fediscience.org

Come “Share” With Us Our Enthusiasm… On Twitter!
Virginia Calabria & Sophia Fiedler

The International Society for Conversation Analysis, aka ISCA or @ISCAupdates, is an inclusive community with a global outreach.

Wherever people study , they are part of the ISCA community. ISCA organises
conversationanalysis.org/come-

#Multimodality #lsi #isca #ilemca #EMCA #academictwitter #uncategorized #everythingilemca

Last updated 1 year ago

Jonas Nölle · @jn
264 followers · 47 posts · Server fediscience.org

Excited to share: after my current postdoc at the FACESYNTAX project finishes, I'll join @ozyurek_a at the Multimodal Language Department @mpi_nl next year!
We'll use and mocap to probe multimodal communication and language evolution in unprecedented ways. Looking forward to pushing boundaries with wild, insightful experiments. 🕹️😎

#LanguageEvolution #interaction #Multimodality #vr

Last updated 1 year ago

Enjoying @LingLass's methodological talk on compiling a corpus of internet memes on health-related topics !

#corpuslinguistics #Multimodality #icame44

Last updated 1 year ago

Tuomo Hiippala · @tuomo
143 followers · 17 posts · Server fediscience.org

I have a new article out in today, which uses unsupervised machine learning to discover genres in the AI2D-RST diagram corpus (doi.org/10.1007/s10579-020-095).

I also propose a new method for quantifying information about layout, which turned out to be crucial for identifying diagram genres.

You can read the article here (open access): doi.org/10.1177/14703572231161

#digitalhumanities #Multimodality #visualCommunication

Last updated 2 years ago

Alessio Pomaro · @alessiopomaro
67 followers · 393 posts · Server mastodon.uno

🧠 Greg Brockman talks about the of in a TED talk.
⚠️ Will it be an everything app and the virtual assistant of our dreams? I don't know, but the new features are amazing!

linkedin.com/posts/alessiopoma

#future #chatgpt #ai #GPT4 #LLM #artificialintelligence #openai #from #Multimodality #texttoimage

Last updated 2 years ago

ReCNTR · @recntr
49 followers · 27 posts · Server post.lurk.org

New Talk! On 19 April Pablo Martínez-Zárate will come to ReCNTR to present the web documentary "Forensic Landscapes" he worked on with Anne Huffschmid. Discussion by Federico De Musso

Register here bit.ly/rcntrfl2023

#forensics #stateviolence #civilwar #latinamerica #Multimodality #methods

Last updated 2 years ago

Tuomo Hiippala · @tuomo
144 followers · 16 posts · Server fediscience.org

Played around with DALL·E 2 a bit and asked it to generate "an information graphic about lions".

Diagrammatic representations reveal serious shortcomings in these models, which generate impressive results as long as they are limited to iconic images.

They know what things look like, but when faced with symbolic systems and their combinations, they remain extremely constrained.

The same applies to ChatGPT.

#Multimodality

Last updated 2 years ago

Tuomo Hiippala · @tuomo
143 followers · 16 posts · Server fediscience.org

Played around with DALL·E 2 a bit and asked it to generate "an information graphic about lions".

Diagrammatic representations reveal a lot of shortcoming in these models, which generate impressive results as long as they are limited to iconic images.

They know what things look like, but when faced with symbolic systems and their combinations, they remain extremely limited.

The same applies to ChatGPT.

#Multimodality

Last updated 2 years ago

Wolfgang Cramer · @wolfgangcramer
3927 followers · 2766 posts · Server fediscience.org

Third train, also some

#Multimodality #flyingless

Last updated 2 years ago

AV_SP · @AV_SP
208 followers · 67 posts · Server fediscience.org

Lack of Visual Experience Affects Language Production: Evidence From Congenitally Blind and Sighted People
onlinelibrary.wiley.com/doi/10

Mamus, Speed, Rissman, Majid & @ozyurek_a

"similarities, but also notable differences between blind people's multimodal language use and their sighted and blindfolded counterparts.... In comparison to non-blind (both blindfolded and sighted) speakers, blind speakers were more likely to use landmarks and, in particular, more self-anchored landmarks"

#Multimodality

Last updated 2 years ago

AV_SP · @AV_SP
191 followers · 59 posts · Server fediscience.org

Redefining Multimodality

frontiersin.org/articles/10.33

"A major advance...over the past 60 years is the inclusion of visual expression in our thinking about language...With this advance came the notion of “multimodality” to describe human language, but the term is ambiguous" -A thoughtful review ....

#redefining #Multimodality

Last updated 2 years ago

Alessio Pomaro · @alessiopomaro
39 followers · 86 posts · Server mastodon.uno

👁️ Some research experiments using 's .

🔎 The visual element is defined through , which can be detailed with the textual component.

#google #multisearch #lens #seo #search #Multimodality

Last updated 2 years ago

Prof. Marion Tellier · @mariontellier
37 followers · 1 posts · Server fediscience.org

A good X-Mas present idea 😉, a very good research guide for those interested in multimodality and SLA

#pedagogicalgestures #Multimodality #sla #gesturestudies

Last updated 2 years ago

Ilgtspējīga, multimodāla, moderna, iekļaujoša pilsēta, kas iedzīvotājiem dod iespēju izvēlēties atbilstošāko pārvietošanās veidu — braukt sabiedriskajā transportā, sēdēt auto, ripināt ar velo vai iet kājām. Dažos maršrutos, kur šīs iespējas nodrošinātasa arī ziemā, šo var lepni teikt arī par Rīgu.

#Multimodality #publictransit #activemobility #walkability #wintercycling #wintermaintenance #inclusivestreets #ziemaarveloneviensnebrauc #arvelouzdarbuziema #veloriga

Last updated 2 years ago

Tuomo Hiippala · @tuomo
97 followers · 2 posts · Server fediscience.org

Hey fellow researchers, can you think of any work on news broadcasts? Much appreciated. 🙏

#Multimodality

Last updated 2 years ago

Tuomo Hiippala · @tuomo
64 followers · 2 posts · Server fediscience.org

Finally, an : I study , or how humans communicate using intentional combinations of expressive resources.

I'm especially interested in building multimodal corpora and developing computational methods for their analysis, which is why some of my work falls under the umbrella of

My other research interests include urban and the study of .

For more information, see my website at helsinki.fi/~thiippal

#LinguisticLandscapes #multilingualism #digitalhumanities #Multimodality #introduction

Last updated 2 years ago

Francesco Ragazzi · @francesco
254 followers · 134 posts · Server post.lurk.org

Since a lot has happened lately, it could be a good time to re-do an / .

As a political sociologist I work with text, digital methods & film on matters of , & , from a critical perspective.

I currently run the project @securityvision on the politics of computer vision with amazing media artists/designers/visual anthropologists: Ruben van de Ven (@r), Cyan Bae, Ildikó Plájás & Elka Smith.

At Leiden University I'm trying to promote research through making (, , & other methods) at @recntr, together with Mark Westmoreland and Julian Ross.

I geek out on photo & cinema & as well as and , although more from the outside. Working on my first "hello world" in

I'm likely to post on

#academia #Multimodality #cinema #technology #privacy #masssurveillance #facialrecognition #biometrics #computervision #python #coding #floss #lenses #cameras #art #photography #film #surveillance #counterterrorism #security #introductions #introduction

Last updated 2 years ago

DiscourseNet · @DiscourseNet
547 followers · 217 posts · Server fediscience.org

In our next DiscourseNet Seminar we will hear Dawn Knight and Christopher Fitzgerald speaking about their new project on video conferencing. You are all warmly invited to join us. Sign up to our website: discourseanalysis.net/DN/semin !B

#discourse #VirtualMeetings #Multimodality

Last updated 3 years ago