Registered custom taxonomies have the same metabox slug and that prevents from individual access control for each metabox.