remove base32 lib which seems was never used

I was digging in git and did not find any use of this, Martin Langhoff is probably the only person who might know more about the original plan...