idtree: fix right shift of signed ints, crash on large ids on AIX