I installed the Tag plugin and it works as described.
Is there a way to mass edit the tags that have been created, add/remove them from pages etc.
I assume not since there is no database, so either the Patch Edit plugin or manually using CLI to script find/add/replacement of tags in page.txt files is probably only solution.