How do we know what participants thought when we presented our stimuli?

#ProcessTracing can reveal what people saw (e.g., eye-tracking), consciously thought (e.g., concurrent think-aloud), etc.

Combining those two methods revealed:
(1) thinking aloud didn't impact gaze or word count
(2) retrospective think-aloud left out thoughts that were mentioned concurrently
(3) retrospective think-aloud introduced thoughts unmentioned concurrently

https://doi.org/10.1007/978-3-319-14956-1_5

#PsychMethods #CogSci #xPhi

What else can #psychology's #thinkAloud studies do? Design #AI!

Recording people think out loud inspired distinctions between three different types of questions: surface, testing, and deep.

So they made a series of modules (QASA) corresponding to each type: associative selection, rationale generation, and systematic composition.

The results? QASA "outperform[ed] the state-of-the-art #InstructGPT by a big margin."

https://openreview.net/forum?id=5ud0h8OXwD

#ML #LLM #processTracing #computerScience #cogSci

How can we detect the methods people use to make decisions?

Wanying Jia and colleagues tried asking participants: "May I ask what method you took to choose the answer...?"
- Responses revealed 3 methods
- #EEG patterns differed between them

Authors conclude that this "new" method can be used to study "the interaction between the intuition-based 'fast' ...and the analysis-based 'slow' system[s] in ...decision-making"

https://doi.org/10.1016/j.compbiomed.2023.106845

#DecisionScience #CogSci #ProcessTracing

Another cool process tracing paper in the same issue as our "Tell Us What You Really Think" shows how
- attention shifts to the crucial task element just before "Aha!" moments of insight
- "explicit hints" move attention to yield insight
- LINEAR statistical models overlook this attention/insight!

https://doi.org/10.3390/jintelligence11050086

#DecisionScience #CogSci #ProcessTracing #Insight #Psychology #Statistics #DataScience #DataAnalysis #R #noxp

In 3 priming experiments about politics, morality, and race, "behavior was most often guided by either deliberate cognition or else …unspecified processes" (rather than "prime-related automatic cognition").

Authors think that #ProcessDissociation is key to revealing this pattern (previews from the #OpenAccess paper in pictures): https://sociologicalscience.com/articles-v10-4-118/

#DualProcessTheory #ProcessTracing #Research #Methods #Sociology

Check out #PS:Political Science and #Politics journal’s top cited articles in 2022 featuring work by Kerry Chavez, Emily Farris, Ellen Key, Marc Hoogue, Ruth Dassonneville and Amy Mitchell. Free access until the end of February! @politicalscience #bias #studentevaluations #immigrant #racialresentment #hiring #literaturereview #processtracing
https://bit.ly/3HqIxwM
https://bit.ly/3wrYU5T
https://bit.ly/3XNOqt8
https://bit.ly/3XSEVZA
https://bit.ly/3XPAXAX

Hello all! My #Introduction: late bloomer #academic / #pracademic excited by #international #PublicPolicy #PolicyResearch #PublicAdmin involving #LongTerm #Governance issues like #ClimateAdaptation & #HumanMigration #Immigration #ClimateMigration using #Abductive #QualitativeMethods #ProcessTracing Located in #WasingtonDC metro area, I teach at GWU & GMU. Top paper: https://doi.org/10.1111/psj.12341

@dsquintana man - they really should change this ugly cover design #hardcover #rocks #processtracing