Research documentation ยท Experimental record
Fault injection

Actuator degradation

Restrict or alter available actions

Injection definition

Actuator degradation restricts or distorts the physical execution of action commands issued by targeted agents. Upon fault onset (randomized between steps 40-60), one of three modes applies: stuck (the sort mode freezes at its value at onset and the press seizes idle), restrict (sort mode 1 and press 2 become unreachable), or slip (with probability 0.3 per step, the executed action differs from the intended one: the sort mode flips or the press command drops to a no-op). While the agent still perceives the true state and issues its intended commands, physical execution is degraded, testing the system's ability to compensate for hardware wear and physical bottlenecks.

Experimental trajectory graphs

Stuck Mode - Permanent Duration

Stuck mode permanent actuator degradation fault trajectory graph (Both Targets)
Stuck Mode - Both Agents Target (Permanent): Actuators freeze at fault onset (step 57), causing container overflow and severe cumulative reward degradation (-59.68). No recovery mechanism, seed 0 of the 8-seed sweep.
Stuck mode permanent actuator degradation fault trajectory graph (Sort Target)
Stuck Mode - Sorting Agent Target (Permanent): Sorter freezes at fault onset (step 57). Final cumulative reward: 76.16. No recovery mechanism, seed 0 of the 8-seed sweep.
Stuck mode permanent actuator degradation fault trajectory graph (Press Target)
Stuck Mode - Pressing Agent Target (Permanent): Pressing seizes idle from step 57. Final cumulative reward: -37.37. No recovery mechanism, seed 0 of the 8-seed sweep.

Stuck Mode - Transient Duration (20 steps, onset between steps 40-60)

Stuck mode transient actuator degradation fault trajectory graph (Both Targets)
Stuck Mode - Both Agents Target (Transient): Actuators freeze during steps 57-76 and recover. Final cumulative reward: 44.92. No recovery mechanism, seed 0 of the 8-seed sweep.
Stuck mode transient actuator degradation fault trajectory graph (Sort Target)
Stuck Mode - Sorting Agent Target (Transient): Sorter freezes during steps 57-76. Final cumulative reward: 111.47. No recovery mechanism, seed 0 of the 8-seed sweep.
Stuck mode transient actuator degradation fault trajectory graph (Press Target)
Stuck Mode - Pressing Agent Target (Transient): Pressing seizes during steps 57-76. Final cumulative reward: 28.37. No recovery mechanism, seed 0 of the 8-seed sweep.

Restrict Mode - Permanent Duration

Restrict mode permanent actuator degradation fault trajectory graph (Both Targets)
Restrict Mode - Both Agents Target (Permanent): Restricts sort mode and press 2 permanently. Final cumulative reward: -49.68. No recovery mechanism, seed 0 of the 8-seed sweep.
Restrict mode permanent actuator degradation fault trajectory graph (Sort Target)
Restrict Mode - Sorting Agent Target (Permanent): Sort mode 1 is permanently disabled. Final cumulative reward: 87.57. No recovery mechanism, seed 0 of the 8-seed sweep.
Restrict mode permanent actuator degradation fault trajectory graph (Press Target)
Restrict Mode - Pressing Agent Target (Permanent): Press 2 is permanently disabled. Final cumulative reward: -26.95. No recovery mechanism, seed 0 of the 8-seed sweep.

Restrict Mode - Transient Duration (20 steps, onset between steps 40-60)

Restrict mode transient actuator degradation fault trajectory graph (Both Targets)
Restrict Mode - Both Agents Target (Transient): Range restricted during steps 57-76. Final cumulative reward: 33.46. No recovery mechanism, seed 0 of the 8-seed sweep.
Restrict mode transient actuator degradation fault trajectory graph (Sort Target)
Restrict Mode - Sorting Agent Target (Transient): Sort mode disabled during steps 57-76. Final cumulative reward: 107.60. No recovery mechanism, seed 0 of the 8-seed sweep.
Restrict mode transient actuator degradation fault trajectory graph (Press Target)
Restrict Mode - Pressing Agent Target (Transient): Press 2 disabled during steps 57-76. Final cumulative reward: 40.02. No recovery mechanism, seed 0 of the 8-seed sweep.

Slip Mode - Permanent Duration

Slip mode permanent actuator degradation fault trajectory graph (Both Targets)
Slip Mode - Both Agents Target (Permanent): Stochastic action slippage (p=0.3) persists through episode. Final cumulative reward: 96.64. No recovery mechanism, seed 0 of the 8-seed sweep.
Slip mode permanent actuator degradation fault trajectory graph (Sort Target)
Slip Mode - Sorting Agent Target (Permanent): Sorter action flips with p=0.3. Final cumulative reward: 101.59. No recovery mechanism, seed 0 of the 8-seed sweep.
Slip mode permanent actuator degradation fault trajectory graph (Press Target)
Slip Mode - Pressing Agent Target (Permanent): Pressing drops to no-op with p=0.3. Final cumulative reward: 83.54. No recovery mechanism, seed 0 of the 8-seed sweep.

Slip Mode - Transient Duration (20 steps, onset between steps 40-60)

Slip mode transient actuator degradation fault trajectory graph (Both Targets)
Slip Mode - Both Agents Target (Transient): Action slippage active during steps 57-76. Final cumulative reward: 107.89. No recovery mechanism, seed 0 of the 8-seed sweep.
Slip mode transient actuator degradation fault trajectory graph (Sort Target)
Slip Mode - Sorting Agent Target (Transient): Sorter action flips during steps 57-76. Final cumulative reward: 109.10. No recovery mechanism, seed 0 of the 8-seed sweep.
Slip mode transient actuator degradation fault trajectory graph (Press Target)
Slip Mode - Pressing Agent Target (Transient): Pressing drops to no-op during steps 57-76. Final cumulative reward: 95.92. No recovery mechanism, seed 0 of the 8-seed sweep.

Duration modes

Recovery mechanisms