home bbs files messages ]

Forums before death by AOL, social media and spammers... "We can't have nice things"

   comp.compilers      Compiler construction, theory, etc. (Mod      2,753 messages   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]

   Message 2,102 of 2,753   
   Kaz Kylheku to Andrew Tomazos   
   Re: Expected Token Density in Random Str   
   11 Dec 11 17:56:42   
   
   From: kaz@kylheku.com   
      
   On 2011-12-07, Andrew Tomazos  wrote:   
   > Summary: We want to find out how often a given token appears in a   
   > random stream formed by concatenating randomly chosen strings from a   
   > given set of strings.   
      
   > (Note hits can overlap each other)   
      
   But tokens do not overlap, so you're not actually extracting tokens.  Using C   
   tokens as an example, the C token >>= is one hit, not four.  The longest match   
   calls for extracting three characters and moving on.   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]


(c) 1994,  bbs@darkrealms.ca