Difficult folder merge - need ideas

[trumpy81]

@Callender, I have tried Araxis but it does not provide what I need.

As for the network shares, it is dependent on the program as to whether or not they support the use of network shares.

The problem here though is not the network share as I first thought, it is the folder location on that share and it's contents and the fact that my locations are not all identical, which is rather silly in my view.

But then WinMerge is aimed at file merging not folder merging, unfortunately.

I do appreciate your input though, you have gone to great lengths to help, Thank You.

 

[Callender]

Folder merge

Thanks for that! Well if I find anything else that looks promising I'll post it.

 

[Berton]

it is the folder location on that share and it's contents and the fact that my locations are not all identical, which is rather silly in my view

That's precisely why I went with a NAS connected to my Router for storage instead of mapping drives/partitions on individual computers. Windows, by default, starts mapping a network drive with Z:, makes life simple and I can access the files on it from Windows computers, Mac OS X and Linux, either Wired or Wi-FI. Also have 2 printers connected to the Router. If I wanted to run programs across the network I'd install a set up machine and install programs accordingly, I have a suitable machine available and the server software.

One idea for storage, some Routers now come with one or two USB ports for setting up an External USB HDD for storage, I got mine [replacement] after having the NAS for awhile.

 

[trumpy81]

@Berton, and what has any of that to do with my original question?

 

[Berton]

Well, I guess it didn't meet a definition fitting your Subject line of " Difficult folder merge - need ideas". When one asks for ideas it opens up the possibility of a world of suggestions. Of course it could simply be a difference of understanding between various languages.

 

[trumpy81]

@Berton, If you had read this thread then you would know that I have a NAS, in fact I have two, and adding a mapped location is a perfectly sound and reasonable thing to do, why you think otherwise is beyond me.

The subject line invites ideas in regards to folder merging, I guess you missed that though.

So, do you have any suggestions about how to merge the contents of two different locations into a single remote location and then be able to track any changes in any of the 3 locations?

 

[Pyprohly]

Not every post is intented to answer. By posting on this forum, you are asking for free help Trumpy. No member on here is forced to help you, and snapping at another member for an insufficient reply to your liking will only bring more off-topic responses. You came here for one thing, and it isn't going to be hate.
　

Back to answering...

I have two ideas to share.

First of all: some backup programs accept a txt file of a list of files that need to be backed up. If you can find such program, genorating the list of files is easy. No need to even merge anything.

If the above can't be done, and all of the suggestions made by all of the kind users in this thread cannot be met, the following is probably the easiest option that will work.

Second idea: a batch script is made to genorate file Symbolic links in all the folders in D:. Each Symbolic link in D: will represent a file stored in E: and will be placed in D: in the correct folder as was found in E:. When the script is done filling D: with Symbolic links, you may then proceed to run any backup software of your choice on D:. Symbolic links are treated as real files by applications so they will be seen and be backed up too. Ultimately, this process is like merging two folders together.

 

[trumpy81]

@Pyprohly, I don't know why you think I was snapping at anyone, maybe it's just the way you read it?

I am not looking to simply 'backup' the files, although that is one purpose I am achieving. I need to monitor what files have been copied and what files have not been, and whether or not I have any duplicates in any of the three locations. Creating text files is easy enough using bat files or cscript etc. but it doesn't provide the compare ops that I need.

I have considered using symlinks but there have been some issues with them. I'd rather keep the filesystem as clean as possible and avoid any possible headaches in that area. I have enough of those already ...

 

[Pauly]

@Pyprohly, I don't know why you think I was snapping at anyone, maybe it's just the way you read it?

Or maybe its just the way you write it
Every suggestion made is either not right or not good enough for you and now you are digging at members for discussing things in your thread.

Unsubscribed

 

[Pyprohly]

I need to monitor what files have been copied and what files have not been, and whether or not I have any duplicates in any of the three locations.

An inconvenience of a situation you are in, Trumpy, indeed; you are asking for much. (With or without Symbolic links) That headache will develop in a new area if you continue to refuse to try any of the recommendations mentioned here for you. There's no use in us handing you anymore content to work with if it's just going to go straight in the trash.

Unsubscribed

Following suit.

 

[trumpy81]

The thing is that I HAVE tried the suggestions here. Have you not read this thread?

 

[Pyprohly]

My bad, you have tried something. You tried one thing. One suggestion by Callender, and to all the other suggestions you say you either already have tried it or "it's not an option" for you.

If you're open for another suggestion, here's one: bigger harddrive. (honestly the real solution for you)

 

[trumpy81]

So, now I have to document everything I have tried just to satisfy you?

Bigger Hard Drive? Is 4TB big enough for you or how about 13 of them plus 4 x 2TB, does that satisfy you?

You obviously have not read the thread or perhaps I have not made things clear enough. If that is the case then I apologise.

What I need is a way to merge Folder A (Drive A) and Folder B (Drive B) and copy them to Folder C on my DS1813+ NAS. I need to be able to keep track of all 3 locations to avoid duplicates and to make sure that all files have been copied to Folder C, on a regular basis.

The files on Drive A (Folder A) are also copied to my smaller NAS which is all but full. I do change/replace some of the files on Drive A (Folder A) from time to time so I need to watch that also. That is the easy part though.

At present, I copy Folder A (Drive A) to one folder on the NAS and Folder B (Drive B) to another separate folder on the NAS which is simple enough using Beyond Compare 3, but Beyond Compare, like all the other programs I have tried, cannot deal with a third location and merging the first two locations.

I hope that explains it a little more for you?

 

[Callender]

Another suggestion

Take a look at:

Karen's Replicator

You could set up two jobs to run consecutively.

Note: Merging would involve setting up a job to copy from A to C then setting up another job to copy from B to C. You can run as many jobs as you like either on demand or schedule. The program was written in VB for Vista but works fine on Windows 7.

Edit: Still not sure how to compare C with both A and B.

 

[trumpy81]

@Callender, I have used Karen's replicator in the past, before I found Beyond Compare, but as you noted, there's no way to keep track of what is in location C. There are lot's of very good programs available, but the majority of them only deal with A -> B type scenarios.

I may have to try Symlinks even though it is against my better judgement, they are not 100% suitable though as all the folders I use are years and decades, which doesn't leave much wiggle room to add a link into the folders.

Thanks for your continued support though, it is very much appreciated.

 

[Callender]

Karen's Replicator

@Callender, I have used Karen's replicator in the past, before I found Beyond Compare, but as you noted, there's no way to keep track of what is in location C. There are lot's of very good programs available, but the majority of them only deal with A -> B type scenarios.

I may have to try Symlinks even though it is against my better judgement, they are not 100% suitable though as all the folders I use are years and decades, which doesn't leave much wiggle room to add a link into the folders.

Thanks for your continued support though, it is very much appreciated.

If I think of anything else... I'll post it!

 

[doctore]

I seem to be a bit confused about this scenario...

There is no way you can keep two folders with the same name in the same directory in Windows, that's just impossible.

The only way is to "encapsulate" each within a unique folder, for example,

C:\Folder1 -> Backup to NAS2\CFolder1
D:\Folder1 -> Backup to NAS2\DFolder1

Any backup program will let you select the files you want to backup, the destination you want them backed up to and the frequency of the backup.

Am I missing something here?

 

[trumpy81]

I think you are missing the point a little, what you described is pretty much what I do now.

What I want to do though is to include the contents from Drive A and Drive B but merge them together on Drive C. A->C and B->C. All three locations have the same folder structure but different contents with C being a combination of both A & B.

I cannot simply merge A & B drives, even though it is possible, because the files on A are copied to two different NAS while B drive is copied to only one NAS. Like the title says, this is DIFFICULT

As an update, I tried Symbolic links but I was unable to merge A & B into a single location using them.