遇见数据集

Persistent Integrative Learning Framework: A Retrovirus-Inspired Approach to Mitigating Catastrophic Forgetting in Multi-Domain Artificial Intelligence

收藏
Zenodo2026-07-21 更新2026-08-01 收录
官方服务:

资源简介:

Catastrophic forgetting remains a fundamental open challenge in continual learning (CL): neural networks exhibit rapid performance collapse on previously learned tasks upon adaptation to new domains. We introduce the Persistent Integrative Learning Framework (PILF), a biologically inspired paradigm that abstracts the irreversible genomic-integration mechanism of retroviruses—integrase-mediated permanent insertion of viral cDNA into host chromatin—into a computational architecture for stable, lifelong knowledge assimilation. PILF rests on three mathematically grounded components: (i) a fixed-capacity core knowledge manifold Kc updated by an SVD-projected, spectrally bounded rank-one integration step; (ii) proximal-elastic regularization with a monotonically increasing penalty schedule; and (iii) a bi-Lipschitz feature encoder with a scaled dot-product attention gate. We prove three results under standard smoothness, monotonicity, and strong-convexity assumptions: core-manifold spectral stability with summable increments for a decay exponent ε > 1 (Theorem 1); a per-step forgetting bound of order O(t^−γ) yielding O(√T) cumulative forgetting (Theorem 2); and O(1/√T) average regret (Theorem 3). We evaluate PILF on a controlled, fully reproducible domain-incremental benchmark against fine-tuning and three baselines (Elastic Weight Consolidation, online ℓ2 anchoring, and a rehearsal buffer), together with a component ablation. PILF attains the strongest accuracy–retention trade-off—final average accuracy 75.8% (95% CI ±1.3), improving over fine-tuning by +13.9 points and over the best regularization baseline by +7.7 points, and matching a rehearsal baseline while storing no past data, with backward transfer of only −5.8%—the smallest in magnitude of any method (baselines span −8.1% to −39.2%). On this benchmark the experiments indicate that proximal stabilization is the dominant contributor to the measured retention, while the retrovirus-inspired persistent manifold provides a measurable but benchmark-dependent contribution; we advance, as a testable prediction rather than an established result, the hypothesis that the persistent-manifold mechanism becomes more influential under higher inter-task interference and larger task counts. As the task count grows from 3 to 11, PILF's backward transfer degrades only from −5.1% to −9.0%, whereas fine-tuning remains near −40% throughout, empirically corroborating the sublinear-forgetting bound. On a real handwritten-digit benchmark (Split-Digits, domain-incremental, on the scikit-learn corpus), PILF again attains the best replay-free accuracy–retention trade-off (88.1% accuracy, −11.1% backward transfer) and the component ablation reproduces the synthetic ordering, although a data-storing rehearsal baseline remains stronger there. All numerical results, tables, and figures are reproduced exactly by the embedded reference implementation.

提供机构:
Zenodo
创建时间:
2026-07-21
二维码
社区交流群
二维码
科研交流群
商业服务