Download Location
[Mirror1 download link] - file hosted by sourceforge.netTokenizer for Lexical AnalysisWhats new in version 1.4:• Support UTF-16, UTF-32 input file as well as UTF-8. Use only file or string as input source.
• Use uls_{set,push}_file() or uls_{set,push}_uline() to tokenize UTF-16(LE,BE), UTF32(LE,BE) files.
• ULS will recognize BOM at the beginning of UTF file.
• The file void of BOM is, by default, UTF-8(or ASCII) input stream.
• Refer to tests/id_stat as an example processing UTF-16 file.
• Revised the APIs manipulating ULS streams. Refer to the document \'ULS-ug.txt\' in \'doc\'.
• Introduce a concept of \'TemplateULS\', a token sequence with template variables.
• This is mostly planed to be used as intermediate files for \'template classes\'.
• Support the representation of binary-numbers, like 0b0, 0b1, 0b1100, 0b1101.
• More ulc-file examples in the \'ulc_exam\', iso_c.ulc, cpp.ulc, csharp.ulc, ...
• Used \'INHERIT:\' directive to inherit existing lexical specification.
• Changed the order of search path for ulc-files and the name of environment variable for it as \'ULC_PATH\'.
• Refer to the document \'ULS-ug.txt\' in \'doc\' for ...
You are about to download a Freeware version for ULS. This download links are providet to you by software publisher