home bbs files messages ]

Forums before death by AOL, social media and spammers... "We can't have nice things"

   comp.ai      Awaiting the gospel from Sarah Connor      1,954 messages   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]

   Message 1,407 of 1,954   
   TiGeR to All   
   NN and odd functions   
   06 May 07 13:18:47   
   
   From: tig@chello.pl   
      
   Hello.   
      
   I've got a problem.   
      
   During a test of back propagation algorithm I wanted to teach   
   the net the sin(x*y) function with a domain of [-2;2] for   
   both variables.   
      
   But it turned out that it can't be done.   
   The net manages to learn the function when the domain   
   is [-2;0] or [0;2] but it can't cope with [-2;2].   
      
   Learning with the domain of [-2;2] leads to zero at every output   
   and the better the net is learned the closer to zero every output   
   is.   
      
   My interpretation of that phenomenon is that the net   
   can't cope with the oddity of the sin function (but it can   
   do great with odd function of 1 variable e.g. sin(x)) and   
   because of that, during the learning, changes of weights   
   compensate themself leading to zero at the outputs.   
      
   What can be done to avoid it?   
      
   Regards.   
   TiGeR   
      
   [ comp.ai is moderated ... your article may take a while to appear. ]   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]


(c) 1994,  bbs@darkrealms.ca