Jeff Trull
2408633f16
Tweak PR #241 for correctness and tidy code
...
- Fix RE2C code for numbers (binary and digit separators)
- Revert to RE2C version 1.0.2, for now
- Revamp token ids to minimize changes
- Restore existing and more accurate name OPTSIGN in slex
- Add binary literal support to lexertl
- Fix xlex support for size_t literals
- Add test tokens for octal, binary, and hex literals
2025-10-27 09:29:33 -07:00
Andreas Pokorny
50b322dcc9
fix(lexer): support size_t literal, separator chars, 'module'
...
The integer parsing grammars still have to be updated.
2025-10-27 09:29:33 -07:00
Jeff Trull
3586cf3706
Support \e and \E in character and string literals
...
Updates the non-strict lexer to support e and E, both with value 27
(ASCII ESC). Also adds tests for lexing these literals, and checks
that they are usable in conditional preprocessor expressions.
2022-11-07 22:44:24 -08:00
Jeff Trull
0ff9eafa04
Add the spaceship <=> operator to the C++20 tokens
2020-10-24 22:01:43 -07:00
Jeff Trull
200f91e71d
Introduce C++20 tokens
2020-08-11 13:17:01 -07:00
Jeff Trull
add63677b0
C++11 tokens should be conditionally compiled
2020-08-10 05:10:07 -07:00
Jeff Trull
35fc5aa381
Add C++11 token support to all lexers
...
Support was already in slex, though it wasn't covered by the token
test. This updates the tests while adding virtually identical code
to lexertl and xlex.
2020-08-10 04:47:04 -07:00
Jeff Trull
b68940a83b
Disallow mixed-case long long integer literals ( #80 )
...
- Update all four lexers to allow ll/LL but not lL/Ll
- Add unit tests for checking
- Remove invalid token from test
2020-03-15 22:54:01 -07:00
Hartmut Kaiser
e5ac1ca3b3
Wave: updating copyrights, minor fixes, bumping version number for release
...
[SVN r78555]
2012-05-23 14:41:35 +00:00
Hartmut Kaiser
12c91c34c1
Wave: updated copyrights, worked on whitespace skipping
...
[SVN r67893]
2011-01-09 21:54:54 +00:00
Hartmut Kaiser
bbcad7c954
Wave: updating copyrights, fixing issues introduced by latest changes to multi_pass.
...
[SVN r58714]
2010-01-05 17:29:06 +00:00
Hartmut Kaiser
a8e6b580db
Wave: Updated copyrights
...
[SVN r50425]
2009-01-01 12:07:12 +00:00
Hartmut Kaiser
23bbed3024
Wave: updated copyright messages to include the year 2008 (merged from release branch).
...
[SVN r42502]
2008-01-05 22:44:28 +00:00
Hartmut Kaiser
3cf132c4d0
Wave: Extended the copyright notice to include the year 2007.
...
[SVN r36469]
2006-12-20 16:58:16 +00:00
Hartmut Kaiser
eb5bd7fa89
Wave: completed first version of the lexertl based lexer.
...
[SVN r36238]
2006-12-02 03:06:31 +00:00
Hartmut Kaiser
86418bd398
Added optional import keyword support.
...
[SVN r34314]
2006-06-15 22:01:09 +00:00
Hartmut Kaiser
c959794650
Wave V1.2.4
...
[SVN r33362]
2006-03-17 22:40:02 +00:00
Hartmut Kaiser
5115faf51e
Updated the Wave copyright notice to include the year 2006.
...
[SVN r32154]
2005-12-24 19:50:47 +00:00
Hartmut Kaiser
17be5a75d9
Fixed lexer tests on platforms others than windows.
...
[SVN r29054]
2005-05-19 06:00:19 +00:00
Hartmut Kaiser
e71c4b41e7
Added lexer testcases to the regression tests.
...
[SVN r28990]
2005-05-17 12:56:11 +00:00