home bbs files messages ]

Forums before death by AOL, social media and spammers... "We can't have nice things"

   comp.ai      Awaiting the gospel from Sarah Connor      1,954 messages   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]

   Message 1,166 of 1,954   
   Ted Dunning to rif   
   Re: Formula for N = number of training s   
   01 Sep 06 11:43:04   
   
   From: ted.dunning@gmail.com   
      
   rif wrote:   
   > Certainly it depends heavily on the classifier.  I have successfully   
   > trained linear SVMs with orders of magnitude more features than   
   > examples.  For instance,   
   >   
   > Ramaswamy, Tamayo, Rifkin, Mukherjee, Yeang, Angelo, Ladd, Reich,   
   > Latulippe, Mesirov, Poggio, Gerlad, Loda, Lander and   
   > Golub. "Multiclass cancer diagnosis using tumor gene expression   
   > signatures." Proceedings of the National Academy of Science, vol. 98,   
   > no. 26, 18 December 2001.   
   >   
   > Cheers,   
   >   
   > rif   
   >   
      
   Indeed.  If you have a widely separated classes, this can be true.   
      
   And the bounds on performance given by the VC dimension are much more   
   informative than any heuristic such as was mentioned.   
      
   This doesn't defeat the curse of dimensionality, sadly.   
      
   [ comp.ai is moderated ... your article may take a while to appear. ]   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]


(c) 1994,  bbs@darkrealms.ca