Solved Insufficient Memory Errors running Batch file

[jarhtmd]

I have a batch file that . . .
1. reads a txt file that contains a list of filename prefixes.
2. drills down thru a folder tree looking for filesnames beginning with each of those prefixes.
3. copies (XCOPY) each matching file into a new folder tree (with matching subfolder structure).


It usually works great, but when searching a large tree of data with many subfolders, sub-subfolders and many files I get "insufficient memory" errors. I don't really understand what that means except that memory has not been "released". I get several of these errors.


I don't know if processing in OK to a certain point within the list of prefixes, and stops working (for the rest of the list) whenever an "insufficient memory" error occurs. Nor do I know the prefixes on which the errors occur.


Is there a way to prevent or recover from this problem? I assume it is related to the characteristics of the tree being searched.

 

[GokAy]

You can try increasing pagefile size. Virtual Memory Paging File - Change

 

[Pyprohly]

Feeding Xcopy a path that's longer than 254 characters may result in an 'insufficient memory' error. Long paths are not supported by Xcopy.

Use the Robocopy command instead.



reference: Xcopy: Insufficient Memory | Terminally Incoherent

 

[jarhtmd]

Will you please translate this into a Robocopy command?

for /F "delims=" %%i in (Prefix-List.txt) do (
xcopy "%src_folder%\%%i*" "%dst_folder%" /C /H /I /K /Q /R /S /Y >nul 2>>Errors.txt
)

 

[Pyprohly]

for /F "delims=" %%I in (Prefix-List.txt) do (
	robocopy "%src_folder%" "%dst_folder%" "%%~I*" /s >nul 2>>Errors.txt
)

 

[jarhtmd]

Thanks. I used Dir /B /S /O:GN >dir.txt to get the full paths involved. Then after importing dir.txt into Excel I was able to find the very long paths. I shortened those & solved my immediate problem. Using Robocopy should prevent future problems.

This is the 1st that I've heard of Robocopy. Is there a list/catalog of similar commands?

* * * * *

I did not mark http://www.sevenforums.com/member.php?u=406309Pyprohly's post as "Solved", because I wasn't sure if I'd still be able to post this. Some forums don't allow additional posts after "Solved". My intent was to then go back to mark http://www.sevenforums.com/member.php?u=406309Pyprohly's post as the solution. Apparently, the last post is the only one that can be marked as a solution.

Therefore, I will mark this post as "Solved". Thanks again, Pyprohly.

 

[Pyprohly]

This is the 1st that I've heard of Robocopy. Is there a list/catalog of similar commands?

Copy, Xcopy, and Robocopy are the builtin Command Prompt commands that copy. For a list of all commands and their documentation, see this wonderful web resource.

Some forums don't allow additional posts after "Solved". My intent was to then go back to mark Pyprohly's post as the solution. Apparently, the last post is the only one that can be marked as a solution.

Therefore, I will mark this post as "Solved". Thanks again, Pyprohly.

That's weird: not allowing users to continue posting after someone's solved it.

In this forum, at least, when you hit that 'Mark as Solved' button at the top of your thread, the whole thread is considered solved, and the person who actually 'solved' the problem is not displayed as such and is not recorded. When a thread is marked solved, the thread is marked solved, not a post.

 

[jarhtmd]

For a list of all commands and their documentation, see this wonderful web resource.

Thanks. That could open a whole new world of possibilities.