Actuator degradation restricts or distorts the physical execution of action commands issued by targeted agents. Upon fault onset (randomized between steps 40-60), one of three modes applies: stuck (the sort mode freezes at its value at onset and the press seizes idle), restrict (sort mode 1 and press 2 become unreachable), or slip (with probability 0.3 per step, the executed action differs from the intended one: the sort mode flips or the press command drops to a no-op). While the agent still perceives the true state and issues its intended commands, physical execution is degraded, testing the system's ability to compensate for hardware wear and physical bottlenecks.
Experimental trajectory graphs
Stuck Mode - Permanent Duration
Stuck Mode - Both Agents Target (Permanent): Actuators freeze at fault onset (step 57), causing container overflow and severe cumulative reward degradation (-59.68). No recovery mechanism, seed 0 of the 8-seed sweep.Stuck Mode - Sorting Agent Target (Permanent): Sorter freezes at fault onset (step 57). Final cumulative reward: 76.16. No recovery mechanism, seed 0 of the 8-seed sweep.Stuck Mode - Pressing Agent Target (Permanent): Pressing seizes idle from step 57. Final cumulative reward: -37.37. No recovery mechanism, seed 0 of the 8-seed sweep.
Stuck Mode - Both Agents Target (Transient): Actuators freeze during steps 57-76 and recover. Final cumulative reward: 44.92. No recovery mechanism, seed 0 of the 8-seed sweep.Stuck Mode - Sorting Agent Target (Transient): Sorter freezes during steps 57-76. Final cumulative reward: 111.47. No recovery mechanism, seed 0 of the 8-seed sweep.Stuck Mode - Pressing Agent Target (Transient): Pressing seizes during steps 57-76. Final cumulative reward: 28.37. No recovery mechanism, seed 0 of the 8-seed sweep.
Restrict Mode - Permanent Duration
Restrict Mode - Both Agents Target (Permanent): Restricts sort mode and press 2 permanently. Final cumulative reward: -49.68. No recovery mechanism, seed 0 of the 8-seed sweep.Restrict Mode - Sorting Agent Target (Permanent): Sort mode 1 is permanently disabled. Final cumulative reward: 87.57. No recovery mechanism, seed 0 of the 8-seed sweep.Restrict Mode - Pressing Agent Target (Permanent): Press 2 is permanently disabled. Final cumulative reward: -26.95. No recovery mechanism, seed 0 of the 8-seed sweep.
Restrict Mode - Both Agents Target (Transient): Range restricted during steps 57-76. Final cumulative reward: 33.46. No recovery mechanism, seed 0 of the 8-seed sweep.Restrict Mode - Sorting Agent Target (Transient): Sort mode disabled during steps 57-76. Final cumulative reward: 107.60. No recovery mechanism, seed 0 of the 8-seed sweep.Restrict Mode - Pressing Agent Target (Transient): Press 2 disabled during steps 57-76. Final cumulative reward: 40.02. No recovery mechanism, seed 0 of the 8-seed sweep.
Slip Mode - Permanent Duration
Slip Mode - Both Agents Target (Permanent): Stochastic action slippage (p=0.3) persists through episode. Final cumulative reward: 96.64. No recovery mechanism, seed 0 of the 8-seed sweep.Slip Mode - Sorting Agent Target (Permanent): Sorter action flips with p=0.3. Final cumulative reward: 101.59. No recovery mechanism, seed 0 of the 8-seed sweep.Slip Mode - Pressing Agent Target (Permanent): Pressing drops to no-op with p=0.3. Final cumulative reward: 83.54. No recovery mechanism, seed 0 of the 8-seed sweep.
Slip Mode - Both Agents Target (Transient): Action slippage active during steps 57-76. Final cumulative reward: 107.89. No recovery mechanism, seed 0 of the 8-seed sweep.Slip Mode - Sorting Agent Target (Transient): Sorter action flips during steps 57-76. Final cumulative reward: 109.10. No recovery mechanism, seed 0 of the 8-seed sweep.Slip Mode - Pressing Agent Target (Transient): Pressing drops to no-op during steps 57-76. Final cumulative reward: 95.92. No recovery mechanism, seed 0 of the 8-seed sweep.
Duration modes
Permanent: the fault persists until the end of the episode.