Speeding up permission level maps generation

Uses `set` instead of `list` when generating permission level maps to avoid redundant duplicate prevention work.