XPost: comp.lang.c++   
   From: lynnmcguire5@gmail.com   
      
   On 2/4/2026 9:44 AM, Scott Lurndal wrote:   
   > Lawrence =?iso-8859-13?q?D=FFOliveiro?=  writes:   
   >> On Tue, 3 Feb 2026 17:28:35 -0600, Lynn McGuire wrote:   
   >>   
   >>> I am swinging huge datasets for simulation models from 1 MB to 1,000 MB.   
   >>>    Nothing besides C++ has the oomph and speed to make this happen.   
   >>   
   >> Lots of Pythoneers are doing data science at this sort of scale.   
   >   
   > Even "R" can handle datasets larger than that.   
      
   We are not 64 bit yet.  1,000 MB is about the largest dataset we can   
   swing in Win32 due to our inefficiency in managing memory.  We do   
   compress all strings above 1,000 bytes which means that our datasets are   
   actually 2X to 3X bigger than the binary version of the dataset.   
      
   As soon as I convert my calculation engine from 32 bit Fortran to 64 bit   
   C++, I will start on converting our Win32 C++ user interface to Win64.   
   Or maybe I will work on a intertube version of our user interface, I   
   will make the leap of faith then.   
      
   You know, when my staff and I converted our user interface from Win16   
   Smalltalk and Win16 C to all Win32 C++ back in 2000, I was amazed at the   
   huge memory space that we now had.  Before that, we were chaining   
   datasets to each other which was fraught with danger.  Now that Win32   
   memory space seems small.   
      
   Lynn   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)