Here’s a simple way to remove duplicate lines of data within Sublime Text 3. This is a common practice with creating look up tables and needing to narrow down the few unique data lines from a large batch of data. Bear in mind that this will only be useful with a single column of data. Multiple columns will not operate correctly.
- Select the data set where duplicates exist (or is expected to exist). If a selection doesn’t exist it’ll run through the entire file.
- Select Edit => Permute Lines => Unique
- Sublime Text will remove the duplicate lines from the data selection
And for the shortcut for this is a custom combination to be added to your user keymap:
{ "keys": ["f8"], "command": "permute_lines", "args": {"operation": "unique"} }