arXiv cs.AI· Imran Basha Shaik, Sahla Sultana, Khader Moinuddin Shaik·· 12 小时前AI 评分22
面向 Salesforce 并购整合的自主 ETL 流水线:参考框架、Jitterbit 映射与可复现仿真研究
Autonomous ETL Pipelines for Salesforce M&A Consolidation: A Reference Framework, Jitterbit Mapping, and Reproducible Simulation Study
AI 导读
该研究提出一套用于 Salesforce 并购客户数据整合的自主 ETL 参考框架,并映射到 Jitterbit Integration Studio 组件,以开源原型在 32,040 至 383,973 条源记录的三档合成双组织场景、五个随机种子上完成评估。
正文 · 原文
Abstract:Merging companies that each run Salesforce must consolidate their customer data into a single organization while both source systems remain in use. This requires reconciling different schemas and picklists, resolving duplicate customers across and within organizations, preserving relationships between records, and keeping the target current until cutover. This article proposes a reference framework for an autonomous extract-transform-load pipeline for this task. It combines partitioned bulk extraction, declarative mapping templates, rule-based and statistical quality gates, master data management with deterministic and blocked fuzzy matching, constrained loading with per-record error capture, and change data capture guarded by a data-health circuit breaker. Each stage is mapped to Jitterbit Integration Studio constructs. The framework was implemented as an open reference prototype and evaluated on synthetic two-organization scenarios with known ground truth at three scales, from 32,040 to 383,973 source records, over five random seeds. At a preset threshold, hybrid matching reached pairwise F1 scores of 0.918 for accounts and 0.885 for contacts; calibrating the threshold per object would raise these to 0.938 and 0.963. The quality gates prevented all load failures and all silent loss of unmapped picklist values without wrongly flagging any clean record, whereas removing them produced about 1,000 load failures per run. Over five simulated days of hourly incremental synchronization, replayed events were ignored, an injected upstream fault was contained in the batch in which it occurred, and the target agreed with a full rebuild on more than 99.3 percent of field values. Validation on a production deployment remains future work.
| Comments: | 16 pages, 4 figures, 7 tables. Code and data: this https URL preprint also archived at this https URL |
| Subjects: | Databases (cs.DB); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET) |
| ACM classes: | H.2.5 |
| Cite as: | arXiv:2611.05918 [cs.DB] |
| (or arXiv:2611.05918v1 [cs.DB] for this version) | |
| https://doi.org/10.48550/arXiv.2611.05918 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Imran Basha Shaik [view email]
[v1]
Wed, 4 Nov 2026 04:12:38 UTC (311 KB)
来源:arXiv cs.AI · arxiv.org