FaultBench-Industrial Research documentation
Research documentation ยท Experimental record
Agent dropout / Permanent

Rule-based reconfiguration

Permanent agent dropout evaluation

Fault: Agent dropout
Duration: Permanent
Recovery mechanism: Rule-based reconfiguration

Experiment definition

The experiment evaluates Rule-based reconfiguration under a permanent agent dropout injection. Fault onset is randomized between environment steps 40 and 60.

Experimental trajectory graphs

One representative seed (seed 0 of 8) per target combination from the full sweep. See the Results page for the multi-seed aggregate comparison across mechanisms. The graphs for every seed are archived at doi:10.5281/zenodo.23304785 (files available from 10 November 2026).

Rule-based reconfiguration

Expected evaluation record:

MetricRecorded value
Degradation-area18.26 ± 6.23 (corrected; mean ± 95% CI, n=24)
Safety-violation excess100.6 ± 35.3 (weighted, control-subtracted; mean ± 95% CI, n=24)
Fraction of time healthy0.622 ± 0.038 (mean ± 95% CI, n=24)
Relapse count0.17 ± 0.16 (mean ± 95% CI, n=24)
False-recovery rate0.000 ± 0.000 (mean ± 95% CI, n=24)
Intervention recall1.000 ± 0.000 (mean ± 95% CI, n=24)

Values are means with 95% confidence intervals across every target × duration-fixed combination shown on this page (see graphs below), 8 seeds each. See the Results page for the cross-mechanism comparison.

Sorting Agent Target

Agent dropout permanent fault, Rule-based reconfiguration, Sorting Agent Target
Rule-based reconfiguration - Sorting Agent Target - evaluation trajectory under permanent agent dropout (fault onset randomized between steps 40-60), seed 0 of the 8-seed sweep.

Pressing Agent Target

Agent dropout permanent fault, Rule-based reconfiguration, Pressing Agent Target
Rule-based reconfiguration - Pressing Agent Target - evaluation trajectory under permanent agent dropout (fault onset randomized between steps 40-60), seed 0 of the 8-seed sweep.

Both Agents Target

Agent dropout permanent fault, Rule-based reconfiguration, Both Agents Target
Rule-based reconfiguration - Both Agents Target - evaluation trajectory under permanent agent dropout (fault onset randomized between steps 40-60), seed 0 of the 8-seed sweep.

Rule-based detect

Expected evaluation record:

MetricRecorded value
Degradation-area28.16 ± 6.99 (corrected; mean ± 95% CI, n=24)
Safety-violation excess130.6 ± 32.5 (weighted, control-subtracted; mean ± 95% CI, n=24)
Fraction of time healthy0.529 ± 0.047 (mean ± 95% CI, n=24)
Relapse count0.08 ± 0.12 (mean ± 95% CI, n=24)
False-recovery rate0.013 ± 0.012 (mean ± 95% CI, n=24)
Intervention recall0.475 ± 0.091 (mean ± 95% CI, n=24)

Values are means with 95% confidence intervals across every target × duration-fixed combination shown on this page (see graphs below), 8 seeds each. See the Results page for the cross-mechanism comparison.

Sorting Agent Target

Agent dropout permanent fault, Rule-based detect, Sorting Agent Target
Rule-based detect - Sorting Agent Target - evaluation trajectory under permanent agent dropout (fault onset randomized between steps 40-60), seed 0 of the 8-seed sweep.

Pressing Agent Target

Agent dropout permanent fault, Rule-based detect, Pressing Agent Target
Rule-based detect - Pressing Agent Target - evaluation trajectory under permanent agent dropout (fault onset randomized between steps 40-60), seed 0 of the 8-seed sweep.

Both Agents Target

Agent dropout permanent fault, Rule-based detect, Both Agents Target
Rule-based detect - Both Agents Target - evaluation trajectory under permanent agent dropout (fault onset randomized between steps 40-60), seed 0 of the 8-seed sweep.

Notes

This page is intentionally separated from the paper-facing results so that full-resolution plots, additional seeds, and diagnostic figures can be documented without overloading the publication.