System/CMD/PHP writes to $LogFile gets interrupted and never cleans up

Stewox · 13 Jul 2015

Hello

I have potentially stumbled upon a massive problem with php.exe, command prompt and the System process that writes to $Logfile when downloading and saving some stuff.

This is the PHP script i was using https://github.com/K-S-V/Scripts/wiki

There has been past writting, but I have totally reformatted all my other drives and restructured my files (moved around 4 TB around) consolidated partitions and set 32K allocation size on all my HDDs.

So the old stuff is not there, except System Drive C: which is an SSD with Windows 7 x64 ULT.

The script does not have any manual clean stop feature mid-process, only a predetermined timeout command which I don't need to use for what I'm doing, so if i close the command prompt window (because what I was downloading was a live transmission and it didn't stop when it should) the file is never created, to delete what has been written.

I have also tried stopping php.exe but that didn't help, thought CMD has to be open for the System process to create the file if php.exe is done doing it's stuff.

The actual video file with a name and extension is only visible in explorer after the download has completed this means the script has to be successful, all other cases the file is never created in the beginning.

The space taken, is never loosened up, it took about +1 GB I think and I never got that space back, I cleaned the recycler and rebooted and it didn't loose my space on SSD which is ridicolous that I already have slowdowns if I don't have at least 20% free space on there.

I have done this in the past on C: - I think there's more space being eaten up all this time, which is many months. I have notices SSD behaving suspiciously slow.

I have posted this here incase the problem is with CMD and/or Windows components.

If someone wants to recreate this you take latest php for windows (i think i choosen non-thread safe, i had no idea what that means) then get that script, but even when you enable the curl extension in ext folder there's still some dlls missing which I don't understand why they don't put stuff like this with the script, just ask me and i'll UL it since I had a hard time searching for them too.

PS:
Just 2 weeks ago I made my first clonezilla image of my C: drive, still, I really want to take all other options before this one.

EDIT: I can't find the picture of resource monitor showing the logfile being written on among other things.

GokAy · 13 Jul 2015

Download trimcheck 0.7 (Index of /trimcheck) and test if it is actually enabled.

Then download portable version of WizTree (https://antibody-software.com/web/so...ur-hard-drive/) and see what folders/files are taking up space.

Also check System Restore settings for your C (default is 10%).

Benchmark your SSD with AS SSD.

Stewox · 14 Jul 2015

GokAy said:

Download trimcheck 0.7 (Index of /trimcheck) and test if it is actually enabled.

Then download portable version of WizTree (https://antibody-software.com/web/so...ur-hard-drive/) and see what folders/files are taking up space.

Also check System Restore settings for your C (default is 10%).

Benchmark your SSD with AS SSD.

System Restore, Backup, And Volume Shadow Service are completely disabled and snapshots deleted, pagefile and hibernation are disabled (i do stuff like this the minute i install windows, among other hundreds of tweaks)

As far as I know I had trim enabled and I did test in the beginning, this was 2 years ago, I made this DIY PC myself and I was neurotically making sure to apply around 20 tweaks for SSDs and it took me 3 weeks to set it all up I really took time for it. (i mean, the whole PC, hardware, software, new desk, cabling, etc)

It appears the SSD is behaving extremely slow in the past week even with more than 20% free space it cannot perform tasks at the speed it can before, basically grinds to a halt when I would fast-transcode some video files with ffmpeg in the SG-1 folder (concat of 5x1.05GB to a new ~5GB file)

Not to mention the treesize scan takes longer than one of the HDDs, usually treesize scan was lightning fast.

Note: I have killed the hardlinks, only the windows-default ones should exits on C: now.

Primary Suspect: Accidential execution of Windows 10 Intaller from USB that I quickly quit, double-clicked instead of right-click and explore, windows installers have been known to be messing up stuff even if you don't seelect the drive, I use another (currently disconnected) for booting linux and windows 10 preview, i keep that drive disconnected manually when I boot into win7 with the 3 drives.

Win10 already messes up other partitions on the drive, changes their letter and puts pagefile on it, this automatic intrusion is one thing I really don't like from Windows products.

Note: $.Windows folder that win10 created, has already been deleted so it's not visible here, I also did a general clean, deleted around 10GB out that I had planned for cleanup as well as more data that was moved to HDD that will be hardlinked back in later.

At the time when I launched php KSV script the free size in explorer showed some 13 GB left, after 30 minute download which amounted to probably over 1 GB or more the free size showed 13.2 and it never jumped back to 13.7 is the last I remember at the time, it was more than 13 ofcourse at the beginning, i just wasn't at the computer to see the progression.

I rebooted and did as I didd it remained at 13,2 or 11,2 i don't remember exactly the second number but I remember the decimal never changed back up, since I spend about an hour researching and trying to figure out on the spot I didn't find anything on the internet about this issue, then I wrote this thread and proceeded to cleanup of the C as planned.

Those 35GB from the top folder are some transcoding/extracting that is temporary and keeps getting deleted and created (it's just a lot of work so that "temporary" means more than 6 months, probably a year now, heh) the 35GB is right now the max size it's around 20GB normally and the total disk free space never goes below 10GB and it ALYWAYS worked fast.

Something's definitely up, I ran the same transcode operation it usually completes in about 30 seconds, and the progress is shown, so if i would leave it, it would easily take many many minutes, orders of magnitude.

Trying AS-SSD:

AS-SSD Clashes, SSD activity is 100% and barely can open other programs, the whole thing took 10 minutes to stop after I clicked Abort after already 5 mins of leaving it on before I noticed a problem.

Here's a video of the last 1 minute: http://www.**************/download/h...evenForums.mp4 (edit: im not going to reupload that, figure it out, one of the top 13 list)

The number should look something like this<<< - i have searched for a test I probably did 2,5 years ago but can't find it now, probably archived it to DVDs by mistake stuff like this I think I should put in My Docs but I didn't.

Idea1: should I try scanning the whole partition with disc recovery software to scan for some weird hidden file that windows might have created because I don't think just enabling trim would fix the problems done back before, but I will monitor how disk sizes change if at all.

Idea2: should i make a video of the KVS Script in action with me purposelly interrupting mid-point and have the DL size precalculated so I know how much numbers we're dealing with then monitoring the changes after that.

The screenshots above should be the baseline of the stable size right now, i will not be moving any large files until this problem is solved or cancelled.
Ofcourse slight change should occur because of temporary files/caches by browsers and windows activity.

GokAy · 14 Jul 2015

Did you re-run trimcheck after 1st run as instructed in the command prompt window? If so what did it tell?
If it say that trim is disabled then run in elevated cmd:

Code:

fsutil behavior query DisableDeleteNotify

if it returns a 1, then trim is disabled. If so run the next command:

Code:

fsutil behavior set DisableDeleteNotify 0

I should be thanking you by the way, I checked trim on my system and found out it was not working for C, which turned out to be disabled somehow. It was working when I first installed 2.5 months ago. So definitely make sure trim is enabled and working. :)

We both have Windows 10 common by the way (at least partially). I have it dual-boot on a partition on my SSD.

Stewox · 14 Jul 2015

trimcheck said it appears to be working.

and fsutil confirms it as well

should I start looking into the SSD hardware failure possibility then ...

GokAy · 14 Jul 2015

I would first check with another user account - User Account - Create
Try Safe Mode too.
Also a clean startup - Troubleshoot Application Conflicts by Performing a Clean Startup

Stewox · 15 Jul 2015

I'm not really sure what the heck to do.

The long term plan, in a month or two, I might actually sell this SSD before it fails and buy a new one.

But I might still try do something and if I can get it working without any hints of impending doom I might change my mind.

Trying to scan for smart data but that should already alert the OS if error was detected no ? ...

Stewox · 16 Jul 2015

Something got fixed now with the write, but 4K still won't release, will try video transcoding again with other benchmarks.

It's another heat wave around here, so my progress on this was slow and will be for some days.

Stewox · 18 Jul 2015

I still have warranty, so I'll probably do that for the issue with writing

The logfile isn't big actually, about 60 MBs ...

I just can't find anything to indicate any large file around here, I did a 20minute analysis and looked around, I'm not sure what are all those detected NTFS items since this SSD never had anything else other than this one single windows 7 x64 ultimate ever installed.

What if the $Logfile writing when I used the HDS Downloader was because of the SSD problem ?

Well stupid me, I will now try testing while it tests the SSD ... will report back here.

Stewox · 18 Jul 2015

These are the ATTO and Crystal Disk Mark ... i'm not an expert on these numbers, but they do not seem to hang nor do anything weird ... so I guess this is some good news, but the final test will come ...

Now, i will go back to that video transcoding operation and see if it'll do anything.

Basically I have 5 year warranty so I'm going to use it but the store has holidays for 2 weeks and I also need this PC for two weeks so I have to wait with the recreation of the other issue of not cleaning up (the main issue of this thread)

Since I want to finish work, clean up, and also create a good clonezilla image, before I actually try the recreation test with full monitoring, I will be back with that later and will post, then I will clean the SSD (reformat) and ship it to RMA if it proves that SSD is at fault.

Otherwise I won't RMA it just reformat and reinstall the image, which I doubt will clean out the hidden-occupied space.