arXiv cs.CL· Kevin Foley, Jonathan Hartadi, Shivesh Prakash, Charishma Takkallapalli, Swapnil Vatsal·· 12 小时前AI 评分24
NoLBERT 新闻主题与股票收益横截面:用 1976-1995 年文本预训练避免回测后视偏差
Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns
AI 导读
研究者用仅在 1976-1995 年文本上预训练的编码器 NoLBERT 构建新闻主题,经对比学习微调成句编码器,并与 LDA、MiniLM、FinBERT 在 2012-2024 年 126 万篇文章上对比预测美股 1000 大股票收益。
正文 · 原文
Abstract:Language models that read financial news are usually trained on text from the same years used to test them, so a backtest can reward hindsight. We build news topics from NoLBERT, an encoder pretrained only on text published between 1976 and 1995, adapted into a sentence encoder by contrastive fine-tuning on passages of the same article, with no labels or returns. We compare it with LDA, MiniLM and FinBERT readers on 1.26 million articles from 2012 to 2024, convert each reader's topics into attention shocks and stock exposures, and forecast the returns of the 1,000 largest US stocks with eight models at three rebalancing frequencies. Models are fitted on 2013-2019, choices are made on 2020-2021, and 2022-2024 is held out. The experiment with the best validation score loses money at every frequency. Measuring attention shocks against the past 63 trading days instead of 5 raises the test rank IC of every reader. NoLBERT gives the most stable topics and forecasts about as well as LDA. An equal-weight combination of all readers and models earns a monthly net Sharpe ratio of 1.12, significant against zero before adjusting for the search but not against a price-only benchmark.
| Subjects: | Statistical Finance (q-fin.ST); Computation and Language (cs.CL); Machine Learning (cs.LG); Portfolio Management (q-fin.PM) |
| Cite as: | arXiv:2610.22745 [q-fin.ST] |
| (or arXiv:2610.22745v1 [q-fin.ST] for this version) | |
| https://doi.org/10.48550/arXiv.2610.22745 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Shivesh Prakash [view email]
[v1]
Thu, 15 Oct 2026 23:27:49 UTC (355 KB)
来源:arXiv cs.CL · arxiv.org