home bbs files messages ]

Forums before death by AOL, social media and spammers... "We can't have nice things"

   alt.os.linux.mint      Looks pretty on the outside, thats it!      30,566 messages   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]

   Message 29,998 of 30,566   
   Paul to Axel   
   Re: LM file transfer/copy issues (2/2)   
   23 Dec 25 12:38:19   
   
   [continued from previous message]   
      
   Linux has write buffering. It's a FIFO of sorts.   
   But, it has a weird behavior.   
      
   If the source drive runs faster than the dest drive, we would   
   normally expect the FIFO queue to fill up as time passes.   
      
   The Linux one however, it does not write a damn thing until   
   it is half full. Imagine we are doing our 10GB of writes before   
   the wheels fall off. We could be thinking about our FIFO queue   
   right now.   
      
   The FIFO queue is likely at least, half full.   
      
   The write buffering, normally in the design of those, the   
   "size" of the queue is 1/8th to 1/10th of total system RAM.   
      
   You're at 16GB, we'll call it 2GB then. That does not give   
   an excuse for 10GB of writes to present a problem. Something   
   could happen around the 2GB mark, say, or the 1GB mark (the   
   half full point). But by the time we're copying 10GB, the   
   FIFO Queue is full, it provides back pressure, and the reader   
   process blocks until space is available in the FIFO Queue for   
   more writes. After the transfer is "finished", it takes   
   time for the queue to drain out to disk.   
      
       # [Manual option} Using a mount command for example   
      
       # When mounting your hard drives use -o sync which will   
       # turn off write buffering for the drive.   
      
       You can also set it up in your fstab:   
      
       /dev/sda1    /    ext4      sync    0   0   
      
   One detail is, the automounter will already have mounted the volume.   
      
   Maybe you could   "remount -o sync" to make it stop write buffering   
   the particular mount point.   
      
   Or, in this thread, you can stop an EXT4 from automounting,   
   then you could do your own mount of the USB thing. And then   
   one of the options would be the equal of   -o sync  kind of thing.   
      
      https://forums.linuxmint.com/viewtopic.php?t=456525   
      
   That's udev, and other distros may be using autofs.   
      
   By using   -o sync   for the USB device, that stops write buffering and   
   makes all writes go directly to disk.   
      
   *******   
      
   The other possibility, is there is a temperature issue, but the   
   drive heating up at the 10GB point, seems a bit too quick. It should   
   take longer than that to heat/overheat the thing. So this is not   
   likely to be the case.   
      
   In general, you don't want to use  -o sync  for all USB devices.   
   The USB flash sticks would work better without it, the HDD in enclosure,   
   don't mind either way (the hardware has options that allow smooth operation   
   with 512 byte writes (while the internal sectors are 4096 bytes on a 512e   
   drive).   
      
   I would be testing this with two different OSes here, to see if it is   
   ecosystem-specific.   
      
      Paul   
      
   --- SoupGate-Win32 v1.05   
    * Origin: you cannot sedate... all the things you hate (1:229/2)   

[   << oldest   |   < older   |   list   |   newer >   |   newest >>   ]


(c) 1994,  bbs@darkrealms.ca