Burrows-Wheeler-transform-based compressors rely on local context regularity, but structured text also contains dates, counters, identifiers, coordinates, and other digit runs whose values vary differently from their surrounding tokens. STC is presented as a new algorithm found by the authors through the self-evolving AI system zeelin. It is a practical BWT-family compressor that separates this source of variation before the component BWT stage. It replaces digit runs in the main stream with an unambiguous placeholder and stores the removed digits in length- and context-conditioned side streams. The side streams use stable bucket ordering and compact digit packing, so the decoder can reconstruct the original run order from the normalized main stream without storing a separate permutation. The resulting components are encoded by a fixed internal BWT/M03-style component coder. On enwik9, STC produces a 157,388,188-byte archive with a 183,174-byte decoder source package, giving a local LTCB-style total of 157,571,362 bytes. A full-enwik9 same-coder ablation shows that the digit-context decomposition reduces the archive by 2,629,561 bytes relative to the no-split control. The result is locally verified by full decode and SHA-256 matching; official benchmark status requires independent maintainer-side verification.
翻译:基于Burrows-Wheeler变换的压缩器依赖于局部上下文规律性,但结构化文本中常包含日期、计数器、标识符、坐标等数字序列,其数值变化模式与周边词元显著不同。本文提出STC算法,该算法由作者通过自进化AI系统zeelin发现,是一种实用的BWT族压缩器,能在BWT处理前分离上述变化源。该算法将主数据流中的数字序列替换为无歧义占位符,并将移除的数字存储于长度与上下文条件约束的侧数据流中。侧数据流采用稳定桶排序和紧凑数字封装技术,使解码器能够通过归一化主数据流重建原始序列顺序而无需单独存储排列。各分量通过固定的BWT/M03类分量编码器进行编码。在enwik9数据集上,STC生成157,388,188字节的归档文件及183,174字节的解码器源码包,实现基于LTCB本地评估的157,571,362字节总量。全enwik9同编码器消融实验表明,相对于未分离数字上下文的对照组,数字上下文分解可使归档体积减少2,629,561字节。该结果已通过完整解码和SHA-256校验得到本地验证;官方基准状态需经独立维护方验证确认。