We have released the test queries for TREC 2023 Tip-of-the-Tongue Track! #TRECToT #TREC2023ToT

📄 Guidelines: https://trec-tot.github.io/guidelines
⏰ Run submission deadline: Aug 31

Here we gooooooo!

#TRECToT updates:

📰 News: GPT4 baseline run significantly improves DCG over BM25 and dense retrieval. What approaches will you try at the track this year?

⏰ Reminder: Test queries will be released on July 24. Run submission deadline is Aug 31.

Guidelines: https://trec-tot.github.io/guidelines

#TREC2023ToT

⏰Gentle reminder: We'll release the TREC 2023 Tip-of-the-Tongue test queries in just over 2 weeks. We are super excited and looking forward to seeing all the creative approaches participants employ for this year's track. #TREC2023ToT #TRECToT

More info: https://trec-tot.github.io

#TRECToT update: We have baselines!

We’re releasing 2 baselines using BM25 & dense retrieval that participants can compare against and build on. As these early results show, there's a lot of room to improve on this task!

Check guidelines for more details: https://trec-tot.github.io/guidelines

Hello!👋🏽

Quick #TRECToT updates:

📰 We added Wikipedia-IMDB mappings to our datasets: https://trec-tot.github.io/guidelines.
📣 Release date for test queries: July 24.
👥 Please join https://groups.google.com/g/trec_tot for latest news. Registered participants make sure you're on trectalk.slack.com.

🚨Announcement🚨
TREC 2023 Tip-of-the-Tongue (TREC-ToT) Track guidelines are now online: https://trec-tot.github.io. Test queries will be released in July and August 31st is the submission deadline. #TRECToT #TREC2023ToT

To participate, please pre-register: https://ir.nist.gov/trecsubmit.open/application.html.

Super excited about #TREC'23!🙌🏽 This year is the 5th anniversary🎂 of the Deep Learning Track. #TRECDL I'm also co-organizing the Tip-of-the-Tongue Track, #TRECToT the cool new track😎 at TREC w/ complex and ambiguous information needs. Please participate!
https://trec.nist.gov/pubs/call2023.html

https://idf.social/@TREC_ToT/109914661317586663

#Introductions 👋🏽

Have you ever tried re-finding a movie you watched as a child but can't remember its name? Perhaps you vaguely remember the plot or a few scenes or the context in which you watched it.

We are hosting The Tip-of-the-Tongue (ToT) Track at #TREC, a shared task focusing on known-item identification where the searcher can't recall a reliable identifier ("It’s on the tip of my tongue…").

Follow us for announcements and updates, and don't forget to participate in the track! #TRECToT

Announcing brand new track for #TREC2023📣
(Please boost)

We hope Tip-of-the-Tongue (ToT) Track will be an interesting & fun IR task going beyond simple keyword-based searches with opportunities for both traditional and LLM-based approaches. #TRECToT #TREC2023ToT

If you have any questions, please reach out to me or one of my track co-organizers.

Also, if you are at #TREC2022 please drop by our poster & join the track planning session this Friday to learn more & provide feedback!

More details👇🏽