I’m working on a thesaurus .txt file with thousands of lines of synonyms. Each line has the main word with all its synonyms separated by a pipe. I’m basically merging different databases I found online and while I was able to delete duplicate lines, I also need to delete duplicate words within a line or even better, delete duplicate words within a selection to make it faster to clean up. All while keeping the pipes.
Here is a sample:
abandonar|abandonarse|desistir abandonar|abandonarse|entregarse abandonar|desistir|renunciar|marcharse
Should clean up like:
Is it possible to this with Atom or is there any other editor that can accomplish this? Any help will be greatly appreciated.