Unified Visual Relationship Detection with Vision and Language Models

VLM for scene understanding (VRD). DETR-like object detector (with bounding box prediction) and Perceiver Resampler for relationship decoder.

My summary on HFPapers: https://huggingface.co/papers/2303.08998#64ff22002597506d5adf7966
arXiv: https://arxiv.org/abs/2303.08998

#arxiv #paper #FoundationModels

DINOv2: Learning Robust Visual Features without Supervision

Tricks applied to DINO and iBOT to learn robust/generic features for many downstream tasks

My summary on HFPapers: https://huggingface.co/papers/2304.07193#64f81a7f35a0a9fc54363373
arXiv: https://arxiv.org/abs/2304.07193
Demo: https://dinov2.metademolab.com/

#arXiv #PaperThread #FoundationModels

LidarCLIP or: How I Learned to Talk to Point Clouds

Align LiDAR encoder to CLIP image encoder and you can query LiDAR through image similarity or even text.

My summary on HFPapers: https://huggingface.co/papers/2212.06858#64f6f05910a91217c38874b7
arXiv: https://arxiv.org/abs/2212.06858
PWC: https://paperswithcode.com/paper/lidarclip-or-how-i-learned-to-talk-to-point

#arXiv #PaperThread #FoundationModels

Hang in there, my fellow #knowledgegraph researchers and practitioners, soon (in a few years) we will reach the "Slope of Enlightenment" ;-)
The new Gartner hype cycle for AI positions knowledge graphs right in the middle of the "Through of Disillusionment" ... while placing #GenerativeAI and #FoundationModels #LLMs at the peak of the hype
https://www.gartner.com/en/articles/what-s-new-in-artificial-intelligence-from-the-2023-gartner-hype-cycle#:~:text=The%202023%20Gartner%20Hype%20Cycle%E2%84%A2%20for%20Artificial%20Intelligence%20(AI,most%20credible%20cases%20for%20investment.
#semanticweb #ai #hypecycle #artificialintelligence

🦾 Quello che manca davvero è una comprensione diffusa di come funzionano questi sistemi, e dei tavoli di discussione multidisciplinari che ragionano parallelamente e al passo con l'evoluzione tecnologica.

#IntelligenzaArtificiale #GenerativeAI #AIart #LLM #FoundationModels #creatività

2/end

Previously:

1. The US Copyright Office issued a registration guidance concerning the #copyright status of #generativeAI: https://lnkd.in/gH_scZGE

2. Henderson et al 2023 from Stanford published paper "Foundation Models and Fair Use": https://lnkd.in/gxpzTVVP

#FoundationModels #FairUse #Law #Copyright #NLP #NLProc

Blahblah AI blahblah foundation model blahblah open source blahblah save the world. If IBM & Hugging Face really wanted to make a difference, they'd take 1% of the money behind this and channel it to forest defenders on the ground
https://newsroom.ibm.com/2023-08-03-IBM-and-NASA-Open-Source-Largest-Geospatial-AI-Foundation-Model-on-Hugging-Face?sf180690669=1
#foundationmodels #ibm #huggingface #climatecrisis

AnyLoc: Towards Universal Visual Place Recognition

#SelfPromotion

Using features from intermediate blocks of foundation models like DINO and DINOv2, combined with conventional aggregation methods, can yield good descriptors for visual place recognition in diverse environments. No training or fine-tuning.

Summary: https://huggingface.co/papers/2308.00688#64cdbc0fe13e7c2bc5775aaa
arXiv: https://arxiv.org/abs/2308.00688
Links: [Website](https://anyloc.github.io/), [PapersWithCode](https://paperswithcode.com/paper/anyloc-towards-universal-visual-place)

#FoundationModels #VPR #arXiv

A group of researchers gathered at the Max Planck Institute for Intelligent Systems in Tübingen this week for the first ELLIS-LAION workshop on #foundationmodels - a great event which contributed to an intense exchange on this cutting-edge research field. A big ‘Thank You’ to all the speakers and attendees!

🔍🤖 Stanford HAI has put together an excellent explainer video designed for non-experts to understand what foundation models are and their potential impact. This video is a must-watch for anyone interested in the future of AI and its implications for HCI.

Check it out here:

https://youtu.be/kK3NmQT241w

#AI #ArtificialIntelligence #FoundationModels #MachineLearning #HCI #UserCenteredDesign #FutureTech

Das 🇪🇺 #EP nähert sich einem Kompromiss zu generativer #KI wie #ChatGPT. Für solche sog. #FoundationModels sollen u.a. folgende Anforderungen gelten:

- auf vorhersehbare Risiken testen und diese vermeiden
- nicht vermeidbare Risiken dokumentieren
- während gesamtem Lebenszyklus angemessenes Niveau an Leistung, Interpretierbarkeit, Korrigierbarkeit, Sicherheit und IT-Sicherheit aufrechterhalten
- Verwendung #urheberrecht|lich geschützter #Trainingsdaten offenlegen

https://www.euractiv.com/section/artificial-intelligence/news/ai-act-meps-close-in-on-rules-for-general-purpose-ai-foundation-models/

Referenced link: https://hackernoon.com/intro-to-foundation-ai-models-types-use-cases-and-how-to-get-started
Discuss on https://discu.eu/q/https://hackernoon.com/intro-to-foundation-ai-models-types-use-cases-and-how-to-get-started

Originally posted by HackerNoon | Learn Any Technology / @hackernoon: http://nitter.platypush.tech/hackernoon/status/1637773489405870080#m

Foundation models are large machine learning models trained on vast volumes of unlabelled data under the guidance of skilled AI consultants. - https://hackernoon.com/intro-to-foundation-ai-models-types-use-cases-and-how-to-get-started #foundationmodels #aimodels

🆕 collaboration with Assaf Araki of Intel Capital: We Explore the Evolving Landscape of Hardware for Artificial Intelligence.

We discuss hardware implications of recent trends in #AI, including: #datacentricAI, increasingly larger models, #GenerativeAI & #FoundationModels, & the emergence of decentralized custom models.
#AI #MachineLearning #Deeplearning
https://gradientflow.com/ai-hardware-2023/

🆕 collaboration with Assaf Araki of Intel Capital: We Explore the Evolving Landscape of Hardware for Artificial Intelligence.

We discuss hardware implications of recent trends in #AI, including: #datacentricAI, increasingly larger models, #GenerativeAI & #FoundationModels, & the emergence of decentralized custom models.
#AI #MachineLearning #Deeplearning
https://gradientflow.com/ai-hardware-2023/

🆕 collaboration with Assaf Araki of Intel Capital: We Explore the Evolving Landscape of Hardware for Artificial Intelligence.

We discuss hardware implications of recent trends in #AI, including: #datacentricAI, increasingly larger models, #GenerativeAI & #FoundationModels, & the emergence of decentralized custom models.
#AI #MachineLearning #Deeplearning
https://gradientflow.com/ai-hardware-2023/

🆕 collaboration with Assaf Araki of Intel Capital: We Explore the Evolving Landscape of Hardware for Artificial Intelligence.

We discuss hardware implications of recent trends in #AI, including: #datacentricAI, increasingly larger models, #GenerativeAI & #FoundationModels, & the emergence of decentralized custom models.
#AI #MachineLearning #Deeplearning
https://gradientflow.com/ai-hardware-2023/

🆕 collaboration with Assaf Araki of Intel Capital: We Explore the Evolving Landscape of Hardware for Artificial Intelligence.

We discuss hardware implications of recent trends in #AI, including: #datacentricAI, increasingly larger models, #GenerativeAI & #FoundationModels, & the emergence of decentralized custom models.
#AI #MachineLearning #Deeplearning
https://gradientflow.com/ai-hardware-2023/

🆕 collaboration with Assaf Araki of Intel Capital: We Explore the Evolving Landscape of Hardware for Artificial Intelligence.

We discuss hardware implications of recent trends in #AI, including: #datacentricAI, increasingly larger models, #GenerativeAI & #FoundationModels, & the emergence of decentralized custom models.
#AI #MachineLearning #Deeplearning

https://gradientflow.com/ai-hardware-2023/

The generative AI revolution has begun—how did we get here? - Enlarge / This image was partially AI-generated with the prompt "a pair... - https://arstechnica.com/?p=1912999 #artificialintelligence #foundationmodels #machinelearning #stablediffusion #generativeai #features #language #chatgpt #dall-e #openai #tech #ai

Ars Technica: The generative AI revolution has begun—how did we get here? https://arstechnica.com/?p=1912999 #Tech #arstechnica #IT #Technology #ArtificialIntelligence #foundationmodels #machinelearning #StableDiffusion #generativeai #Features #language #ChatGPT #dall-e #openai #Tech #AI