I have been following the latest work to quantify animal movement and behavior.

A few weeks ago, I was lucky to attend CVPR and get a feel for the latest findings and future trends in person.

I wrote down a detailed overview and some of my opinions here:
https://writings.lambdaloop.com/posts/cv4animals-2023/

#PoseEstimation #animals #computervision #cvpr #cvpr2023 #neuroscience

HierVL is a new #AI approach injecting semantics into visual representations by capturing long-term and short-term associations in video-language embeddings capturing both 'what' and 'why' of human actions. 🤯

https://vision.cs.utexas.edu/projects/hiervl

#ComputerVision #DeepLearning #CVPR2023

PanoHead: a breakthrough in 3D human head synthesis

This novel generative #AI model produces 360° view-consistent images of full heads and overcomes limitations in existing methods by leveraging 3D GANs and innovative image alignment techniques. 🤩

https://sizhean.github.io/panohead

#CVPR2023 #DeepLearning #GenAI

RT @tanmay2099@twitter.com

As promised, here's a deeper dive into our CVPR'23 work -

Visual Programming: Compositional visual reasoning without training

@anikembhavi@twitter.com @allen_ai@twitter.com #CVPR2023

🧵 https://twitter.com/tanmay2099/status/1636455646290915328

🐦🔗: https://twitter.com/tanmay2099/status/1636802768173432832

Referenced link: https://www.youtube.com/watch
Discuss on https://discu.eu/q/https://www.youtube.com/watch

Originally posted by IEEE ComputerSociety / @ComputerSociety: http://nitter.platypush.tech/ZinengTang/status/1671646439313928193#m

RT by @ComputerSociety: Excited to present our #CVPR2023 ✨highlight✨work "UDOP: Unifying Vision, Text, and Layout for Universal Document Processing" tomorrow Jun22 10:30-12pm PDT (welcome to our @CVPR poster #264)!

Talk recording: https://www.youtube.com/watch

cc @yzy_ai @mohitban47
@uncnlp @MSFTResearch

Originally posted by IEEE ComputerSociety / @ComputerSociety: http://nitter.platypush.tech/skalskip92/status/1671549283793813505#m

RT by @ComputerSociety: CVPR2023 day 2 just started! 🔥 keynote by @YejinChoinka

#CVPR2023

Originally posted by IEEE ComputerSociety / @ComputerSociety: http://nitter.platypush.tech/philduan/status/1671203483440283648#m

RT by @ComputerSociety: @Tesla AI team is at @CVPR in Vancouver this week! If you are also here, stop by and check out what we have been working on for Autopilot, Optimus, and dojo! #CVPR2023

RT by @foiresearch: Our #NIGHTINGALE project partner @foiresearch is presenting a paper at #CVPR2023

The paper “Real-Time Estimation of Heart Rate in Situations Characterized by Dynamic Illumination using Remote Photoplethysmography” is available #OpenAccess👇https://openaccess.thecvf.com/content/CVPR2023W/CVPM/papers/Hansen_Real-Time_Estimation_of_Heart_Rate_in_Situations_Characterized_by_Dynamic_CVPRW_2023_paper.pdf https://nitter.net/NGTriageEU/status/1670703965800140801#m

Packin’ the essentials up for #CVPR2023 in Vancouver next week…

RT @Michael_J_Black@twitter.com

Realistic 3D human animation is hard. Goal: automate it using only speech. Given a speech signal as input, TalkSHOW (#CVPR2023) generates realistic, coherent, and diverse holistic 3D motions, that is, the body motion together with facial expressions and hand gestures. (1/8)

🐦🔗: https://twitter.com/Michael_J_Black/status/1668618125200482304

RT @MattNiessner@twitter.com

(1/2)
We released our Neural Parametric Head Models (NPHM) dataset from our #CVPR2023 paper!

It includes over 5600 high-fidelity 3D scans of human heads from 272 subjects - all publicly available!

Check it out!
https://simongiebenhain.github.io/NPHM/
https://youtu.be/0mDk2tFOJCg

🐦🔗: https://twitter.com/MattNiessner/status/1665776973266788354

RT @zhenjun_zhao@twitter.com

Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes

Zian Wang, et al.

tl;dr: neural fields+explicit mesh representations->scene geometry, spatially-varying materials, and HDR lighting

#CVPR2023
https://arxiv.org/pdf/2304.03266.pdf

🐦🔗: https://twitter.com/zhenjun_zhao/status/1644303314971144192

Render two-dimensional (2D) sketches as realistic three-dimensional (3D) models using #generativeAI #CVPR2023 #CMU

https://www.cs.cmu.edu/~pix2pix3D/

Interested in understanding how your fine-grained visual categorization algorithms perform on real-world problems? Check out the FGVC10 competitions running as part of #CVPR2023. https://sites.google.com/view/fgvc10/competitions

RT @mattdeitke
Introducing Objaverse, a massive open dataset of text-paired 3D objects!

Nearly 1 million annotated 3D objects to pave the way to build incredible large-scale 3D generative models: 🧵👇

🤗 Hugging Face: https://huggingface.co/datasets/allenai/objaverse
📝ArXiv: https://arxiv.org/abs/2212.08051

#CVPR2023

RT @mattdeitke
Introducing Objaverse, a massive open dataset of text-paired 3D objects!

Nearly 1 million annotated 3D objects to pave the way to build incredible large-scale 3D generative models: 🧵👇

🤗 Hugging Face: https://huggingface.co/datasets/allenai/objaverse
📝ArXiv: https://arxiv.org/abs/2212.08051

#CVPR2023

RT @micahgoldblum@twitter.com

Diffusion models like #StableDiffusion and #dalle2 generate beautiful pictures, but are these images new or are they copies of the images they were trained on? 🧵 #CVPR2023
http://arxiv.org/abs/2212.03860

🐦🔗: https://twitter.com/micahgoldblum/status/1632759852803014660

Working on an interesting fine-grained problem, but the #ICCV2023 deadline is approaching too quickly?
The FGVC10 paper submission website is now open!

https://sites.google.com/view/fgvc10/submission

Deadline: March 20

#CVPR #CVPR2023 #FGVC

High-resolution image reconstruction with latent diffusion models from human brain activity https://www.biorxiv.org/content/10.1101/2022.11.18.517004v2 https://github.com/yu-takagi/StableDiffusionReconstruction #AI #fMRI #neuroscience #CVPR2023

NICE! High-Res Facial Appearance Capture from Polarized Smartphone Images 🤳

This approach uses a smartphone with a cheap polarization foil to capture facial textures in dark settings to then create photo-realistic 3D #DigitalHumans 👉https://dazinovic.github.io/polface/

#AI #CVPR23 #CVPR2023 #Computervision #DeepLearning