Why does skill_dynamics use restrict_observation? #15
Description
skill_dynamics receives the output of process_observation (for example, when reduced_observation=2, set process_obs to output the cropped obs for dimensions x and y), however, skill_dynamics may crop the remaining two dimensions of xy obs based on restrict_observation, inputting an empty batch into the obs input head.
Isn't the trimming of the skill_dynamic computation graph and observation_omit_size redundant?