跳到正文
arXiv cs.CY· Julie R. Ancis, Michael Fire, Omer Tarshish·· 12 小时前AI 评分23

一个衡量短视频创作者传播策略的多模态框架

A Multimodal Framework for Measuring Creator Communication on Short-Form Video

AI 导读

研究者提出一个五阶段多模态框架,整合平台元数据、语音转录和采样帧的视觉语言描述,再用大语言模型生成预设指标与开放式标签,用于规模化测量短视频创作者的主题与传播策略。

正文

View PDF HTML (experimental)

Abstract:Short-form video combines speech, imagery, and on-screen text, creating challenges for systematic content analysis. We present a five-stage multimodal framework for measuring creators' themes and communication strategies at scale. The framework integrates platform metadata, speech transcripts, and vision-language descriptions of sampled frames, then applies large language models to generate predefined indicators and open-ended labels. An audited keyword scheme consolidates thematic labels, while creator-weighted aggregation gives each account equal weight regardless of posting volume. We demonstrate the framework on 9,852 TikTok videos from sixteen creators, retaining 7,311 videos for analysis across seven themes and seven communication indicators. Automated profiles reveal substantial differences in creators' use of education, humor, and responses to current events. Validation against two independent expert annotators yielded a mean framework-expert agreement of Cohen's $\kappa = 0.40$ across the six binary indicators, close to the $\kappa = 0.42$ the two experts achieved with each other, though agreement varied substantially across individual indicators. The framework provides a modular approach to comparative analysis of creator communication, combining scalable annotation with transparent aggregation and construct-specific validation.
Comments: 17 pages, 3 figures, 7 tables
Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY)
Cite as: arXiv:2610.33043 [cs.SI]
  (or arXiv:2610.33043v1 [cs.SI] for this version)
  https://doi.org/10.48550/arXiv.2610.33043

arXiv-issued DOI via DataCite

Submission history

From: Omer Tarshish [view email]
[v1] Fri, 16 Oct 2026 10:41:18 UTC (678 KB)

来源:arXiv cs.CY · arxiv.org