cleanup endian handling

Similar code spread in several places