If you want to be a swamp witch, nothing is stopping you. Just don't get mad when a party of magic wielders, shape shifters and swordsman show up and kill you, your thralls, and take all your questionable magic items and potions.