Reproduce “Reflection Before Action: Designing a Framework for Quantifying Thought Patterns for Increased Self-awareness in Personal Decision Making” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Morita Tarvirdians, Senthil Chandrasegaran, Hayley Hung, Catholijn M. Jonker, Catharine Oertel

Researchers from TU Delft developed the PROBE framework, the first empirically tested tool to quantify the breadth and depth of "Pre-Decision Reflection" for significant life choices, revealing substantial individual variability in thought patterns and a discrepancy between self-reported and objectively measured reflection quality. The framework identified "Belief" as the most frequent reflective category, while "Alternative Perspective" and "Insight" were least engaged, with 80% of participants elaborating less than half of their thoughts.

Key insights

  • The PROBE framework revealed that individuals exhibit highly heterogeneous patterns in pre-decision reflection, with varied breadth and depth of engagement across seven distinct thought categories.
  • Participants frequently overestimate the breadth and depth of their reflections, reporting high confidence despite objective measures often showing narrow or shallow thought processes.
  • A strong user desire (80% of participants) for conversational AI support to improve reflection quality exists, suggesting a receptive audience for tools that can mirror and guide their thought patterns.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.