den4b Forum

Here are our findings from an initial investigation into this idea...

The Unicode standard defines Emoji characters as a large set of disconnected ranges of code points. This set continues to grow year after year. Currently, it contains about 3600 code points. The full list of Emojis is also provided in a form of data files.

Implementation options to consider:

1. Offer an option to strip user-defined ranges of code points.
2. Offer an option to strip all Emojis using a built-in dictionary of all Emoji code points, which can be created by parsing the data files.

There is also bit of a confusion regarding which one file or a combination of Emoji data files captures the full range. According to the Unicode Technical Standard #51, the best definition of the full set is in the emoji-test.txt file.

funny thing, I had a regex issue and asked ChatGPT to help me taking the regex engine of renamer by den4b into consideration and it did actually give me a solution that worked to remove date from second position in a file name.

^(.*?)\s+\d{8}\s+-\s+(.*)

$1 $2

it also gave two regex examples for stripping emojis,

\p{Emoji} or [\u{1F000}-\u{1F9EF}]

but that did not work.

Last edited by shuntensatsu (2023-03-16 12:57)

Additionally, an option to strip custom Unicode ranges was implemented in v7.6.0.3 Beta.

You can find the new option in the Strip rule.