arXiv cs.CL· Bahar Radmehr, Lan Tran, Ekaterina Shved, Fatma Bet{\"u}l G{\"u}re\c{s}, Adish Singla, Tanja K{\"a}ser·· 12 小时前AI 评分27
ClickSight:用学习策略解读学生点击流数据的 LLM 框架
ClickSight: An LLM Framework for Interpreting Student Clickstreams Through Learning Strategies
AI 导读
ClickSight 是一个基于 LLM 的分阶段流水线框架,可将学生点击流与文献定义的学习策略对应,识别策略相关证据、评估策略遵循度并生成有证据支撑的行为解读。研究在 2 个学习环境、365 名学生和 12 个模型骨干上评估,推理模型比指令微调模型表现更稳定;提供从点击流提取的外部引导可提升需要精确量化信息策略的解读质量。
正文 · 原文
Abstract:Digital learning environments produce rich clickstream data that can reveal how students approach learning tasks, yet interpreting these fine-grained traces often requires substantial expert effort. We introduce ClickSight, a framework for interpreting student clickstreams through learning strategies defined in the literature. Given a student clickstream and a predefined set of learning strategies, ClickSight uses a staged LLM-based pipeline to identify strategy-relevant evidence, assess adherence to each strategy, and generate an evidence-grounded interpretation of the student's behavior. We evaluate ClickSight across two learning environments, 365 students, and 12 model backbones using an expert-grounded quality rubric and an LLM judge calibrated with human-expert ratings. Our results show that ClickSight can generate high-quality strategy-based interpretations across different models and environments, with reasoning models performing more consistently than instruction-tuned counterparts. We further find that providing external clickstream-extracted guidance can improve interpretation quality for strategies that require precise quantitative information from the trace. By connecting fine-grained clickstreams with theoretically defined learning strategies and preserving the evidence underlying each judgment, ClickSight provides a flexible approach for studying student behavior in digital learning environments.
| Comments: | 29 pages, 12 figures, 19 tables. Under review. Code: this https URL |
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY) |
| Cite as: | arXiv:2611.02021 [cs.AI] |
| (or arXiv:2611.02021v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.02021 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Bahar Radmehr [view email]
[v1]
Sun, 1 Nov 2026 16:09:26 UTC (2,578 KB)
来源:arXiv cs.CL · arxiv.org