home bbs files messages ]

Forums before death by AOL, social media and spammers... "We can't have nice things"

   comp.ai      Awaiting the gospel from Sarah Connor      1,954 messages   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]

   Message 1,233 of 1,954   
   Ted Dunning to vinaykadiyam@gmail.com   
   Re: superiority of MMRe vs nrmse   
   23 Nov 06 07:14:51   
   
   From: ted.dunning@gmail.com   
      
   vinaykadiyam@gmail.com wrote:   
   > Hi all,   
   >   
   > I want to know which one has highest priority in comparison.I want to   
   > analyse my results so for that   
   > one to which measure i hav to give more priority.   
   >   
   > can you please suggest me .   
   >   
      
   You should provide just a hint of context when asking questions like   
   this.   
      
   That said, I will guess that I know what you are asking about.  Correct   
   me if I am misinterpreting what you asked.   
      
   I am assuming that you are asking about MMRE = Mean Magnitude Relative   
   Error and   
   and NRMSE = normalized root mean square errors.   
      
   In general, you can't really make a case that any particular error   
   measure is categorically superior to all others.  You ahve to look at   
   your problem and what you know about it and decide.  It helps to try   
   several measures to see which is most useful in practice.   
      
   There are several issues that you are asking about.  One is whether   
   absolute or relative error is better, and another is which distance   
   metric is better (absolute magnitude (L_1) or squared error (L_2).  It   
   is easy to concoct pretty realistic examples where either of these   
   choices is enormously better than the other.  These nasty cases happen   
   in practice with distressing regularity.   
      
   Relative error makes sense where you have measurements that are   
   scale-invariant while absolute error makes sense when you have   
   measurements that are translation invariant.  With scale invariant   
   systems, you may have already taken the log of your measurement which   
   would convert the scael invariance into a translation invariance.   
      
   Error magnitude is less sensitive to the effect of outliers.  If you   
   have non-normal error distributions, this can be a very desirable   
   effect.  In fact, I would recommend that you not stop with error   
   magnitude, but go all the way and investigate M-estimaters, all kinds   
   of R statistics and margin methods (such as SRM or SVN).  Mixture   
   distributions and Bayesian methods can also be helpful if you suspect   
   long tails due to multiple error processes.   
      
   In summary, your question has no universal answer.   
      
   [ comp.ai is moderated ... your article may take a while to appear. ]   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]


(c) 1994,  bbs@darkrealms.ca