Windows 7 Forums
Welcome to Windows 7 Forums. Our forum is dedicated to helping you find support and solutions for any problems regarding your Windows 7 PC be it Dell, HP, Acer, Asus or a custom build. We also provide an extensive Windows 7 tutorial section that covers a wide range of tips and tricks.


Windows 7: Windows 7: Corruption in large file transfers to USB drives

15 Feb 2011   #31
gregrocker

 

I think what we are saying is that maintaining file integrity isn't much of an issue that any of us have seen with Win7, so the actual problem might be the way the file checking program interacts with Win7 causing it's output to be possibly faulty.

Sometimes I copy multiple ISO's, extract, recompile dozens of times and have never had any file degradation with Win7. The only need to check file HASH was when the download source was questionable, but never after it got onto Win7.

What I would do next in your situation is go to the website for the file checking program and find out the best way to approach them - forum, email, chat, phone - then ask for a definitive answer to your problem.


My System SpecsSystem Spec
.
15 Feb 2011   #32
Pleco

Windows 7 Ultimate x64
 
 

Quote   Quote: Originally Posted by gregrocker View Post
I think what we are saying is that maintaining file integrity isn't much of an issue that any of us have seen with Win7, so the actual problem might be the way the file checking program interacts with Win7 causing it's output to be possibly faulty.

Sometimes I copy multiple ISO's, extract, recompile dozens of times and have never had any file degradation with Win7. The only need to check file HASH was when the download source was questionable, but never after it got onto Win7.

What I would do next in your situation is go to the website for the file checking program and find out the best way to approach them - forum, email, chat, phone - then ask for a definitive answer to your problem.
I have tried at least 5 different CRC/md5 checking programs and all of them I have confirmed are fully compatible with Windows 7 64bit, even the testing function within both WinRAR and 7zip stated the files copied over were indeed corrupted. And corruption rate isn't 100% of the time, about 3/10 files will be corrupted on average.

Wouldn't this conclude the problem is with the OS itself? This isn't just happening on my own hardware, I had a friend and colleague test this on their own computers and ended up with the same issues.

Hopefully, the new service pack will fix this problem.
My System SpecsSystem Spec
15 Feb 2011   #33
unifex

Windows 7 Ultimate (x64)
 
 

First of all, I think we agree here that we are dealing with a rather rare problem and thus we need to pinpoint exactly what's going on and what's the reason for it.

Here's what I would do. As far as I am concerned, there are two types of files - text files and binary files. Both types of files can be directly compared. Why don't you take a case where your testing software reports corruption and directly compare the copied ("corrupted") file to the original and see what the difference is. You can use Windiff, Merge, or other similar tools to do that. With text files it's probably easier, but I am not sure what kind of files you're talking about.

Could you make a test comparison, document what you did - how the files got corrupted in the first place - and post the actual difference between them? I will then try to reproduce the problem on my own machine.
My System SpecsSystem Spec
.

16 Feb 2011   #34
Pleco

Windows 7 Ultimate x64
 
 

Quote   Quote: Originally Posted by Bill2 View Post
Try copying with a 3rd party tool like teracopy.
Thank you Bill2 for recommending Teracopy, I actually had the time to test this program yesterday and it works like a charm. Spent 3 hours copying files to external hard drives and not one single incident of corruption. It even has the option to do the CRC checking for me after completing the copy. I used my usual programs to check the CRC as well and they all passed.
My System SpecsSystem Spec
25 Feb 2011   #35
riley34

Windows 7 Ultimate 64
 
 

I have a brandnew laptop (Asus G53JW), where the same usb problem occurs, data loss/corrupted data while copying/moving large files with win explorer from Win7x64 to an external NTFS formatted USB harddrive.

I found the behaviour accidentally while creating images of the preinstalled recovery partition with sizes bigger 10 GB. Splitting the files in smaller chunks of 1G didn't help either.

The problem was present from the beginning, with the preinstalled OS (Windows7x64 Home Premium). The two internal SATA drives have no problem when copying with explorer from one disk to the other.

I installed the laptop completely from scratch using an genuine MS installation dvd, later all updates until SP1 and every single most recent driver from the manufacturer without any problem, even the BIOS is updated. Everything works fine, just the old problem there - again. Until this time I avoided installing FW/Virus software that could interfere the usb transfers.

By trial and error I found, that XCOPY produces no errors on copies in a CMD Window by some reason, but only when invoked with the /J switch, it disables i/o buffering: "xcopy /J <sourcefile> <destination>".

BTW Linux/Knoppix copies with perfection even under its GUI.

Switching the drive's write cache on/off doesn't change the situation under Win7.
The hardware used by the laptop is a i7 740QM, HM55 Express Chipset and a NVIDIA GTX460M.

Another interesting thing is that the System offers 2 seperate USB Host controllers, one by intel and one by fresco with different drivers, but the problem appeared on all USB hardware.

I guess the reason is more an internal OS mechanism with the win explorer, maybe with buffers or process syncronisation rather than a hardware or driver failure.

But honestly, I have absolutely no clue which screw to turn in Win7, for example how can I switch off i/o buffering in general for external usb drives?

I hope that some of the experts here have an idea, thanks in advance.

Cheers
Riley
My System SpecsSystem Spec
14 Apr 2011   #36
radioman

Windows 7 Home Premium 64 bits
 
 

I'm also experience problems transferring large files to external usb hard drives.

My computer uses Windows 7 Home Premium 64 bits, my usb controllers are from Intel and the hard disk is a external 1Tb NTFS formatted.

The corruption for me started when the drive was about 50% of its capacity. The corruption consists in random blocks of zeros in the file.

These blocks of zeros are 20480 bytes in length. None of the files places at the first half of the disk were corrupted, but many on the second half was. Some files as small as 200 Mb were corrupted.

After intense hard drive checking and surface scan I discarded physical problems on the hard disk.

Using xcopy /j does not work, neither disable antivirus or 3rd party utilities.

I have reformated the hard drive to FAT32, and up to date, not a single byte corrupted. The main disadvantage is the need to split very large files, but I prefer this small oddity that loss of data.

For me it is clear there is a serious issue with external usb NTFS drives with Windows 7.

Hope this helps someone to find the problem.
My System SpecsSystem Spec
19 May 2011   #37
wanderlust76

Windows 7 Ultimate x64
 
 

Hi everyone, I'm having the same problem and it's very annoying...
I experienced file transfer corruption with large files from two different laptops (both HP, a dv6000 and a dv5, with Windows 7 Ultimate x64) to two different external hard drives (a WD passport 1TB and an Iomega 500GB), both formatted NTFS.
When using Teracopy I'm not having crc errors.
Did anyone found a solution?
My System SpecsSystem Spec
19 May 2011   #38
Phone Man

Windows 8.1 Pro w/Media Center 64bit, Windows 7 HP 64bit
 
 

Are you running SP1. One of the Hot-Fixes included in SP1 deals with large file problems when writing to USB drives. Apparently the USB bus would time out and then restart.

Jim
My System SpecsSystem Spec
20 May 2011   #39
wanderlust76

Windows 7 Ultimate x64
 
 

Yes, I updated to SP1 (and all the latest updates) both PC.
My System SpecsSystem Spec
17 Mar 2016   #40
dishe

New York
 
 

Hate to revive a thread as old as this one, but was there ever a solution found for this?

I work in video and have noticed frames missing/blank/corrupted in my editor sometimes. I play back the file directly in VLC, and I see there is a corrupted frame in that location. The thing is, the original file on the storage card media does not have this missing frame data at all. I downloaded an MD5 checksum application and compared the files to the original card. Sure enough, some files had matching checksums, and some did not (the ones that did not happen to be the ones with the corrupted data).

I thought maybe my card reader was going bad, but I just archived a large chunk of data from another USB drive, and lo and behold: same type of error popped up. I started thinking, maybe my USB drive is going bad? But CHKDSK and all other tests performed on it come back clean. I tried googling this problem, and imagine my surprise to have found this and many other threads discussing some sort of issue with Win 7 64 bit!

I'm beyond shocked that this has been an issue all along and I never knew about it. I blamed every other piece of hardware to no avail, when the problem was actually Windows itself!

Has anyone found a solution? I see in another thread someone mentioned his RAM had gone bad, but it is confirmed in this one that this isn't the issue for the OP.

...yes, I'm still running Win7 64 bit. I've got Win10 on some of my other personal computers, but my work machine has some legacy tools for media editing that isn't supported anymore. It took me a long time to set up properly and I don't want to fix what isn't broke by going to a new OS only to discover new problems. But not being able to trust Windows copy commands? This is a HUUUUGE ISSUE!
My System SpecsSystem Spec
Reply

 Windows 7: Corruption in large file transfers to USB drives




Thread Tools




Similar help and support threads
Thread Forum
large (> 4 GB) file transfers in FAT32/NTFS
i am trying to transfer a 4 GB+ file (video) onto a 32 GB pendrive (FAT32) but a message - "The file 'xyz' is too large for the destination file system" - comes. is it because the pendrive has FAT32 formatting? and if so, should i format it into NTFS?
General Discussion
File transfers to external drives wont complete
When trying to move large files (under 2gb, im well aware of NTFS/FAT32) the file will transfer up to 99% and then will hang of upwards of 3-5mins before sometimes completing and just flat out wont transfer multiple large files at all, will hang after the first file gets to the same condition as...
Hardware & Devices
BSOD when running handbrake or during large file transfers
This is a computer that I built a couple of months ago and it consistently crashes when running handbrake, not every time but say 3 out of 4 times. It will also crash when making large file transfers like moving my movies from one hard drive to another. I have ran Memtest86 without any problems. I...
BSOD Help and Support
BSOD on large USB data transfers
Second try at having someone help me with a recurrent BSOD. The last time I just formatted the drive and reinstalled Win 7. This problem has been happening to me ever since I bought the laptop: I get BSODs transfering large amounts of USB data (10 GB or more), sometimes it's just when I connect...
BSOD Help and Support
Connection drops with large transfers
I noticed that when I try to copy over a 4.02GB file from my desktop to my laptop it goes for about 10-15 minutes and then stalls before telling me that the file destination/source no longer exists and cancels the transfer. But if I leave it alone they'll see each other in a few minutes time. This...
Network & Sharing
BSOD on large file transfers
I have been trying to reload all the data back to the pc after reinstalling windows. whenever I try to copy a folder larger then 10GB it will copy most of the files but then crash with a BSOD the error info is listed below. Problem signature: Problem Event Name: BlueScreen OS Version: ...
BSOD Help and Support


Our Sites

Site Links

About Us

Find Us

Windows 7 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 7" and related materials are trademarks of Microsoft Corp.

Designer Media Ltd

All times are GMT -5. The time now is 22:30.
Twitter Facebook Google+ Seven Forums iOS App Seven Forums Android App