Speeding up Algebraic-Based Sampling via Permutations