forked from haskell/alex
-
Notifications
You must be signed in to change notification settings - Fork 0
/
ANNOUNCE
35 lines (24 loc) · 1.28 KB
/
ANNOUNCE
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
I am pleased to announce version 3.0 of Alex, the lexical analyser
generator for Haskell.
Changes in Alex 3.0 vs. 2.3.5:
* Unicode support (contributed mostly by Jean-Philippe Bernardy,
with help from Alan Zimmerman).
* An Alex lexer now takes a UTF-8 encoded byte sequence as input
(see Section 5.1, “Unicode and UTF-8”. If you are using the
"basic" wrapper or one of the other wrappers that takes a
Haskell String as input, the string is automatically encoded
into UTF-8 by Alex. If your input is a ByteString, you are
responsible for ensuring that the input is UTF-8 encoded. The
old 8-bit behaviour is still available via the --latin1
option.
* Alex source files are asumed to be in UTF-8, like Haskell
source files. The lexer specification can use Unicode
characters and ranges.
* alexGetChar is renamed to alexGetByte in the generated code.
* There is a new option, --latin1, that restores the old
behaviour.
* Alex now does DFA minimization, which helps to reduce the size
of the generated tables, especially for lexers that use Unicode.
Alex can be obtained from Hackage
http://hackage.haskell.org/package/alex
Alex is distributed under a BSD-style license.