Angluin's L$^*$ algorithm learns the minimal deterministic finite automaton (DFA) of a regular language using membership and equivalence queries. Its probabilistic approximatively correct (PAC) version substitutes an equivalence query by numerous random membership queries to get a high level confidence to the answer. Thus it can be applied to any kind of device and may be viewed as an algorithm for synthesizing an automaton abstracting the behavior of the device based on observations. Here we are interested on how Angluin's PAC learning algorithm behaves for devices which are obtained from a DFA by introducing some noise. More precisely we study whether Angluin's algorithm reduces the noise and produces a DFA closer to the original one than the noisy device. We propose several ways to introduce the noise: (1) the noisy device inverts the classification of words w.r.t. the DFA with a small probability, (2) the noisy device modifies with a small probability the letters of the word before asking its classification w.r.t. the DFA, (3) the noisy device combines the classification of a word w.r.t. the DFA and its classification w.r.t. a counter automaton, and (4) the noisy DFA is obtained by a random process from two DFA such that the language of the first one is included in the second one. Then when a word is accepted (resp. rejected) by the first (resp. second) one, it is also accepted (resp. rejected) and in the remaining cases, it is accepted with probability 0.5. Our main experimental contributions consist in showing that: (1) Angluin's algorithm behaves well whenever the noisy device is produced by a random process, (2) but poorly with a structured noise, and, that (3) is able to eliminate pathological behaviours specified in a regular way. Theoretically, we show that randomness almost surely yields systems with non-recursively enumerable languages.
翻译:Angluin L$^*$算法通过成员查询和等价查询学习正则语言的最小确定有限自动机(DFA)。其概率近似正确(PAC)版本以大量随机成员查询替代等价查询,从而获得对答案的高置信度。因此该算法可应用于任意设备,并可视为基于观测结果合成抽象设备行为的自动机算法。本文关注Angluin PAC学习算法在由DFA引入噪声的设备中的表现。具体而言,我们研究Angluin算法是否能在降噪后生成比噪声设备更接近原始DFA的自动机。我们提出四种噪声引入方式:(1)噪声设备以微小概率反转词条相对于DFA的分类结果;(2)噪声设备以微小概率修改词条中的字母后再查询其相对于DFA的分类;(3)噪声设备结合词条相对于DFA和计数自动机的分类结果;(4)通过随机过程从两个DFA生成噪声DFA:当词条被第一个(或第二个)DFA接受(或拒绝)时,结果保持一致;其余情况下以0.5概率接受。主要实验贡献表明:(1)当噪声设备由随机过程生成时,Angluin算法表现良好;(2)但在结构化噪声下表现不佳;(3)该算法能消除以正则方式定义的病态行为。理论上,我们证明随机性几乎必然导致系统语言非递归可枚举。