UTF16 BE support

[martinlindhe]

Hello. Am currently on Windows, and there for some reason (...) unicode files are often created as UTF16BE.
I realized I have a project with mixed file encodings, most is UTF8 and some are UTF16BE, and ripgrep currently don't find anything in those files.

In the attached archive is a project I was working on, and the file src\GUIGroup.ts happens to be in UTF16BE,
so try searching the folder for "GUIGroup" causes no hits in that file.

Tested with ripgrep 0.4.0 on Windows. Same result with ripgrep 0.4.0 on macOS

Github dont want to attach zip files today, so I put it here:
http://wikisend.com/download/290136/utf16issue_ripgrep.zip

[BurntSushi]

This is a dupe of #1.

As the README says, ripgrep doesn't seamlessly support any encoding that isn't ASCII compatible. (That includes UTF-8 and latin1, but not UTF-16.)

This is a desirable feature, especially at least UTF-16 since it is used a lot on Windows.

[martinlindhe]

Ah, thanks. I glanced through the open issues looking for "UTF16", thats why I didn't notice #1.