Windows 7 Forums

Welcome to Windows 7 Forums. Our forum is dedicated to helping you find support and solutions for any problems regarding your Windows 7 PC be it Dell, HP, Acer, Asus or a custom build. We also provide an extensive Windows 7 tutorial section that covers a wide range of tips and tricks.


Windows 7: Need a file copy recommendation with partial file resume

24 Sep 2014   #1
robr

Win7 Premium x64
 
 
Need a file copy recommendation with partial file resume

I'm currently using Richcopy to move about 4TB worth of data from our colo facility (1000 miles away) to our office. And that data also gets routed overseas first before coming back (don't ask). Needless to say, connectivity while not bad, could be better.

The small files are zooming right along, the issue is the larger files (the ones that are hundreds of MB or even several GB).

From time to time, I briefly lose network connectivity for a second or two, when that happens, the files currently being copied abort and once connectivity is restored, Richcopy just moves on to the next files. So when Richcopy advertises that it 'resumes', it seems it is talking about resuming a file copy queue, and not resuming partially copied files. Those have to start over from the beginning.

Is there a tool similar to Richcopy with the functionality I'm looking for?

Thanks!


My System SpecsSystem Spec
.
24 Sep 2014   #2
Berton

Windows 7 Ultimate 64-bit, Windows 8.1 64-bit, Mac OS X 10.10, Linux Mint 17, Windows 10 Pro TP
 
 

I'd look at some of the Download Manager choices on this list found by Google Search:
https://www.google.com/search?site=&....0.sI5DpbJXr1U
My System SpecsSystem Spec
24 Sep 2014   #3
robr

Win7 Premium x64
 
 

Thanks download managers generally refer to httpbased downloads. I took a look at your search and that appears to be the case with the tools in the results.
My System SpecsSystem Spec
.

24 Sep 2014   #4
Alejandro85

Windows 7 Ultimate x64
 
 

How do you perform the copy? Windows share over internet? FTP? Web server?
How are you doing it right now?
My System SpecsSystem Spec
24 Sep 2014   #5
robr

Win7 Premium x64
 
 

It's just a straight up copy between two CIFS shares.
My System SpecsSystem Spec
24 Sep 2014   #6
Alejandro85

Windows 7 Ultimate x64
 
 

I've used Teracopy to do large file transfer across Windows drives. I found it to be somewhat unreliable on the resume feature. Maybe give it a try and see if it actually fulfills your needs.

I would, however, consider using a different technology for such data amounts, specially over internet. Are you using any sort of VPN to connect the computers?
My System SpecsSystem Spec
24 Sep 2014   #7
robr

Win7 Premium x64
 
 

There's a site to site VPN.

Teracopy does not appear to be able to resume a failed file from where it left off, I believe it restarts the file from the beginning (but I will test since I can't find any concrete info one way or the other). All these tools talk about resuming a failed copy, but none of them are clear that what they seem to mean by 'resume' is that if you have a lot of files queued, and there is a failure, it will retry the failed files and keep the queue going.

The only protocol I'm aware of that can actually resume a file is FTP, but I've found FTP to be significantly slower than a file copy. rsync will do it on *nix, not sure if that feature made it to the windows port but I'll check that tomorrow as well.

I may just have to fly down there with NAS in hand and do this on site. It's a once a year thing so if that's what I have to do, then so be it.
My System SpecsSystem Spec
25 Sep 2014   #8
Alejandro85

Windows 7 Ultimate x64
 
 

FTP is more likely to be substantially faster than the built-in SMB, specially over internet.
Switching to it may be a good alternative. However, I would use SFTP instead for its added security. Many clients support resuming and it have tons of features besides file transfer. Using a web server can be done too, downloading with any ordinary browser, and maybe using all those "download managers" from previous posts.
Or what about BitTorrent? All clients natively support resuming and has a built-in checksum as a bonus. If there are a few computers sharing the same files it also may have significant speed gains.
My System SpecsSystem Spec
25 Sep 2014   #9
robr

Win7 Premium x64
 
 

Security isn't a concern, everything is going over a VPN and adding another layer of encryption adds unnecessary overhead. FTP as a protocol has more overhead than SMB but I need reliability and ease of use over pure speed at this point. With the other technologies you mention, I don't know of any tooling that would work well to sync literally millions of files spread across multiple drives and directories. I'm open to recommendations as always.

So today I will be trying
- Teracopy
- rsync
- FTP
My System SpecsSystem Spec
Reply

 Need a file copy recommendation with partial file resume




Thread Tools Search this Thread
Search this Thread:

Advanced Search




Similar help and support threads
Thread Forum
Copy file address after doing a file search in windows explorer
Hi All I have a rather large file system with lots of folders & subfolders. When I want to save previously on Xp operating system I'd search in explorer open the folder I want then copy the address (e.g c:\customer records\client name\job address). In windows 7, when I copy the folder address i...
General Discussion
how do I copy a BIG single file (using richcopy?) big file copy
I'm trying to copy a VHD (22g, dynamic I think...) I tried richcopy. It says copy started, but then stops.... I saw someone mention xcopy /j, to achieve the unbuffered I/O perf. you get with richcopy... it's running, but no indication as to how long it takes (EDIT: just finished, > 10...
General Discussion
Copy shares and permissions on file x to file z? Is this possible?
I have a user for whom shares and permissions on the server are working just fine. I have another user for whom something is screwed up somewhere. I've taken a directory that is shared and I've looked up the share and permissions for both. Identical. But do this for 3,000 files/directories in...
Network & Sharing
How to copy a file from 1 pc to another pc in network using batch file
Help me make a batch file that copies a file from one computer to another computer in a network... PC1 = Source PC2 = Destination I want to copy a file from PC1's Drive E: to PC2's Drive E:
General Discussion
BAT file to copy file to multiple locations?
Hi, I have a file with no extension called simply, D:\file I want to copy this to multiple locations, eg e:\file , f:\file sometimes there will already be an older version, so I would like it to overwrite the file. Is this possible with a bat file?
General Discussion
need file utility recommendation
Friend of mine's pc was infected by a malware. I have to reformat and reinstall win 7 on it. However, all the files on his external drive are marked as hidden and system files. Is there a good file utility program that I can set all the file as not hidden and non-system file? Thanks.
General Discussion


Our Sites

Site Links

About Us

Find Us

Windows 7 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 7" and related materials are trademarks of Microsoft Corp.

Designer Media Ltd

All times are GMT -5. The time now is 21:38.

Twitter Facebook Google+



Windows 7 Forums

Seven Forums Android App Seven Forums IOS App