I was not able to handle levers while wearing the shard of elemental earth. The handle did not turn up in the list of objects I could use, after pressing the 'u' button (Adom II settings).

After unequipping the shard, I could handle it normally.