From: jbb@notatt.com   
      
   On 9/3/2022 8:00 PM, Nasser M. Abbasi wrote:   
   > On 9/3/2022 8:10 PM, Nasser M. Abbasi wrote:   
   >> On 9/3/2022 7:56 PM, Nasser M. Abbasi wrote:   
   >>> If there is a way to fix the random seem to some value, so same   
   >>> anti-derivative is   
   >>> generated each time, this I can do that, but I do not know how to do   
   >>> this.   
   >>   
   >> Typo above:   
   >>   
   >> Meant to fix the random "seed" used before making the call.   
   >>   
   >> This way I post the results, and then say this was generated using   
   >> this specific seed.   
   >>   
   >> So result shown will be reproducable. Otherwise now, Julia gets   
   >> different score each time it is run.   
   >>   
   >   
   > fyi   
   >   
   > I think I found a fix. But doing   
   >   
   > Random.seed!(12) #must do this in order to reproduce same result   
   >   
   > Then now same antiderivative is generated each time. So now I can add   
   > Julia integrator to CAS integration tests.   
      
   That doesn't seem correct to me since users will get whatever first seed   
   the system generates (unless they choose their own as you are). The   
   chances that they will choose 12 as you have is small. I would either   
   give the system a fail because it is unreliable on that problem or I   
   would test it for, say, a 100 or so seeds and give the number (a   
   percent) that it gets correct. The fact that you had to search for a   
   seed that led to correct behavior voids the system's ability for that   
   example. It might be that you could find a seed for each problem in the   
   test suite that leads to correct behavior for the problem. But that   
   doesn't make the system perfect.   
      
   Basically when you are testing a system that uses a "probabilistic"   
   approach, you need to develop scoring methods that account for that fact.   
   --   
   Jeff Barnett   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)