From: tom@infoether.com   
      
   On Thu, 2007-03-08 at 19:54 -0500, Tommy Nordgren wrote:   
   > ANTLR supports unicode, but one point to consider with ANY tool, is   
   > that you will need an module that supports converting the input text   
   > files to canonical utf-16.   
      
   JavaCC also handles Unicode characters; for example, this would tokenize   
   and optional minus sign followed by the Unicode code points for "degrees   
   in Fahrenheit" and "degrees in Celsius" followed by a couple of digits:   
      
   TOKEN : {   
      " \u2109">   
     |  " \u2103">   
     | <#DIGITS : ["0"-"9"](["0"-"9"])*>   
   }   
      
   JavaCC doesn't yet handle supplementary characters (those outside the   
   Basic Multilingual Plane).  But that's on our radar, so we shall see...   
      
   Yours,   
      
   Tom   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)