What else can #psychology's #thinkAloud studies do? Design #AI!

Recording people think out loud inspired distinctions between three different types of questions: surface, testing, and deep.

So they made a series of modules (QASA) corresponding to each type: associative selection, rationale generation, and systematic composition.

The results? QASA "outperform[ed] the state-of-the-art #InstructGPT by a big margin."

https://openreview.net/forum?id=5ud0h8OXwD

#ML #LLM #processTracing #computerScience #cogSci

https://invidious.slipfox.xyz/watch?v=-0M21LUg_9E
🖖 #dreamtheater #breakingallillusions #thinkaloud #music #rock #progressive

Hey #survey #methods colleagues,

What survey instrument or test would you be interested in testing/validating/calibrating using #thinkAloud protocols?

We can quickly and easily train people to read and think all of their (conscious) thoughts aloud and then record them take an #onlineSurvey (which automatically transcribes their speech into text).

This can reveal alot about the order, accessibility, and articulability of what they're thinking during our surveys (e.g., https://www.researchgate.net/publication/341131477_Tell_Us_What_You_Really_Think_A_think_aloud_protocol_analysis_of_the_verbal_cognitive_reflection_test).