Research documentation ยท Experimental record
Fault injection

Sensor noise

Corrupt observations

Injection definition

Sensor noise adds zero-mean Gaussian noise (standard deviation 0.1 by default, on observations already scaled to a fixed range, then re-clipped to that range) directly to the local observation vectors of targeted agents. From injection onset (randomized between environment steps 40-60), the agent receives miscalibrated sensory feedback about belt composition, sorting purity, and container fill states while the physical environment continues to operate normally. This tests how effectively agents can maintain optimal control under distorted observation perception.

Experimental trajectory graphs

Permanent fault mode - Both Agents Target (std = 0.1)

Permanent sensor noise fault trajectory graph (Both Agents Target)
Permanent sensor noise fault trajectory (Both Agents Target, std=0.1) showing the active fault window (onset at step 57, persisting through step 200). Final cumulative reward: 78.55. No recovery mechanism, seed 0 of the 8-seed sweep.

Permanent fault mode - Sorting Agent Target (std = 0.1)

Permanent sensor noise fault trajectory graph (Sorting Agent Target)
Permanent sensor noise fault trajectory targeting the sorting agent (std=0.1). Final cumulative reward: 109.36. No recovery mechanism, seed 0 of the 8-seed sweep.

Permanent fault mode - Pressing Agent Target (std = 0.1)

Permanent sensor noise fault trajectory graph (Pressing Agent Target)
Permanent sensor noise fault trajectory targeting the pressing agent (std=0.1). Final cumulative reward: 29.41. No recovery mechanism, seed 0 of the 8-seed sweep.

Permanent fault mode - Both Agents Target (High Noise, std = 0.2)

Permanent sensor noise fault trajectory graph (High Noise std=0.2)
Permanent sensor noise fault trajectory under severe noise (Both Agents Target, std=0.2). Final cumulative reward: 44.71. No recovery mechanism; an extra run outside the main sweep (which uses std=0.1), with the same world and fault timing as seed 0.

Transient fault mode - Both Agents Target (std = 0.1, 20 steps, onset between steps 40-60)

Transient sensor noise fault trajectory graph (Both Agents Target)
Transient sensor noise fault trajectory (Both Agents Target, std=0.1) active during steps 57-76. Final cumulative reward: 108.31. No recovery mechanism, seed 0 of the 8-seed sweep.

Transient fault mode - Sorting Agent Target (std = 0.1, 20 steps, onset between steps 40-60)

Transient sensor noise fault trajectory graph (Sorting Agent Target)
Transient sensor noise fault trajectory targeting the sorting agent (std=0.1, steps 57-76). Final cumulative reward: 107.79. No recovery mechanism, seed 0 of the 8-seed sweep.

Transient fault mode - Pressing Agent Target (std = 0.1, 20 steps, onset between steps 40-60)

Transient sensor noise fault trajectory graph (Pressing Agent Target)
Transient sensor noise fault trajectory targeting the pressing agent (std=0.1, steps 57-76). Final cumulative reward: 68.75. No recovery mechanism, seed 0 of the 8-seed sweep.

Transient fault mode - Both Agents Target (High Noise, std = 0.2, 20 steps, onset between steps 40-60)

Transient sensor noise fault trajectory graph (High Noise std=0.2)
Transient sensor noise fault trajectory under severe noise (Both Agents Target, std=0.2, steps 57-76). Final cumulative reward: 84.48. No recovery mechanism; an extra run outside the main sweep (which uses std=0.1), with the same world and fault timing as seed 0.

Duration modes

Recovery mechanisms