Blocked keys when hovering inventory area

When you hover the inventory area (from the mod), you cannot press "E" or "Esc" to close the inventory, which I have found to be very annoying when having the inventory set to be bigger.
While I imagine this is because of the custom keybinds, for example deleting items with CTRL+D by default, this still stops me from quickly closing the inventory and having to move the mouse somewhere else.