Parent Directory | Revision Log
|Links to HEAD:||(view) (annotate)|
Update to Unicode 6.0.0. code/unidata.lisp: o Update unicode version to 6.0.0 o Add pointer to build-unidata.lisp. tools/build-unidata.lisp: o Update unicode version to 6.0.0 o Print out directory path so we can see where we're getting the data from. i18n/CaseFolding.txt i18n/CompositionExclusions.txt i18n/DerivedNormalizationProps.txt i18n/NameAliases.txt i18n/NormalizationCorrections.txt i18n/SpecialCasing.txt i18n/UnicodeData.txt i18n/WordBreakProperty.txt i18n/tests/NormalizationTest.txt i18n/tests/WordBreakTest.txt: o Update with new files from unicode.org.
Add support for Unicode 5.2. The normalization and wordbreak tests pass. code/string.lisp: o In %compose, handle the case where the composite character is outside the BMP and thus needs special handling for our UTF-16 strings. code/unidata.lisp o CKJ Ideograph range has changed in 5.2. o Fix bug in build-composition-table. We were not correctly handling the case where the decomposition of a codepoint was outside the BMP. Special care is needed to handle the UTF-16 strings that we use. o The key for the pairwise composition table are the full codepoints, so we need to shift one by 21 bits instead of 16. tools/build-unidata.lisp o Update minor version to 2. i18n/BidiMirroring.txt i18n/CaseFolding.txt i18n/CompositionExclusions.txt i18n/DerivedNormalizationProps.txt i18n/NameAliases.txt i18n/NormalizationCorrections.txt i18n/SpecialCasing.txt i18n/UnicodeData.txt i18n/WordBreakProperty.txt i18n/tests/NormalizationTest.txt i18n/tests/WordBreakTest.txt o Updated from Unicode 5.2. i18n/unidata.bin o Regenerated from new Unicode 5.2 files.
Merge Unicode work to trunk. From label unicode-utf16-extfmt-2009-06-11.
Update to version 5.2.0d4 from unicode.org.
Merge from unicode-utf16 branch, label unicode-utf16-char-support-2009-03-25 to get character support.
file UnicodeData.txt was added on branch unicode-utf16-extfmt-branch on 2009-03-25 21:51:34 +0000
Character name and properties support, from Paul Foley, slightly modified by Raymond Toy. Use 19f/boot-2009-03-cross-unicode-<arch> for the cross compile script. Use 19f/boot-2009-03-unicode-char for the bootstrap file to initialize the unicode character structures. bootfiles/19e/boot-2008-05-cross-unicode-common.lisp: o Just add new slots to fd-stream here, to make it easier to bootstrap the utf16-extfmts code, and to select the clobber-it restart automatically. o Build the initial unicode properties bootfiles/19f/boot-2009-03-cross-unicode-ppc.lisp: bootfiles/19f/boot-2009-03-cross-unicode-sparc.lisp: bootfiles/19f/boot-2009-03-cross-unicode-x86.lisp: o New scripts for cross-compiling. Basically just calls the original ones in the 19e directory. bootfiles/19f/boot-2009-03-unicode-char.lisp: o Bootstrap file to load up the full unicode properties. i18n/UnicodeData.txt: o UnicodeData.txt, obtained from unicode.org/Public/UNIDATA/UnicodeData.txt, 2009-03-24. code/fd-stream.lisp: o Add new slots to fd-stream, needed by utf16-extfmts branch. code/char.lisp: o Define structure to hold unicode properties of each character and new hash table to hold the properties. o Update CHAR-NAME and NAME-CHAR to give the character names and code, respectively. o Update GRAPHIC-CHAR-P, ALPHA-CHAR-P, UPPER-CASE-P, LOWER-CASE-P, BOTH-CASE-P, ALPHANUMERICP, EQUAL-CHAR-CODE, CHAR-UPCASE, and CHAR-DOWNCASE to handle unicode characters. o Add function REBUILD-UNICODE-DATA to update the unicode structures from UnicodeData.txt.
file UnicodeData.txt was initially added on branch unicode-utf16-branch.
This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.
|Powered by ViewVC 1.1.5|