Solved Seemingly random BSOD issues - Head hurts from banging it on the wall

[x BlueRobot]

Upload the file onto SkyDrive or Dropbox, with SkyDrive you just need to make a Hotmail account and you get 8GB of Cloud space for free:

• SkyDrive

 

[texjam]

The old links are dead now... I'm configuring and uploading to Skydrive, so I'll have some links posted shortly.

-JAM

 

[x BlueRobot]

Okay good to know

 

[texjam]

I am a slacker in many, many ways, but I'm not purposely delaying this operation... slow connections + big files = very irate Texas boy. I'll post as soon as I can, and thanks for your patience.

-JAM

 

[x BlueRobot]

No problem, and you must be uploading a Kernel dump which is better as it contains much information than a Small Kernel dump file

 

[texjam]

Word of advice: If you're going to use Skydrive, download and use the desktop client... I spent all day trying to upload via the web interface and it never finished, but after I installed the desktop client, a 2 file upload of about 400MB took less than 30 minutes to finish.

My apologies... these are the links to my zipped kernel dumps via Skydrive:

https://skydrive.live.com/redir?resid=ADE854212DEC038E!115 from the 25th.

https://skydrive.live.com/redir?resid=ADE854212DEC038E!114 from the 26th.

I think that's correct... and both are ~200MB each. Perhaps you guys will have better luck interpretting these dumps than I did... my debugger is perhaps too inadequate, or my symbols cache isn't complete, or I'm missing something completely.

If there's any issues with the up- or download of my links I'll address them early in the AM... feel free (not obiligated) to take a look at them, and I appreciate any help you can provide... goodnight, folks.

-JAM

 

[texjam]

https://skydrive.live.com/redir?resid=ADE854212DEC038E!116 from the 27th.

This is starting to become part of my morning ritual... get coffee, get a BSOD. I'm not sure the additional link is necessary, but I've included it anyway. Let's see... prior to the first part of November, I was NOT having any issues with any thing on this machine. I had most of the programs you guys advised I uninstall running regularly... I suppose what I miss most is the AOL desktop running in the background to notify me of new emails as I get them... I haven't uninstalled the AOL desktop (yet), but I know if I leave it running it will hasten the appearance of BSODs, so I just load it up and check email several times throughout the day and then shut it down (I hate the web interface).

I suppose that debugging is not necessarily my forte, but I'm trying... I'd like to save this machine from the trash heap, but I don't know anymore.

Thanks for all your help so far, and any additional debuggery advice is welcome, too.

-JAM

 

[x BlueRobot]

CLOCK_WATCHDOG_TIMEOUT (101)
An expected clock interrupt was not received on a secondary processor in an
MP system within the allocated interval. This indicates that the specified
processor is hung and not processing interrupts.
Arguments:
Arg1: 0000000000000030, Clock interrupt time out interval in nominal clock ticks.
Arg2: 0000000000000000, 0.
Arg3: [COLOR="Red"]fffff88003364180[/COLOR], The PRCB address of the hung processor.
Arg4: 000000000000000[COLOR="red"]2[/COLOR], 0.

The address of the faulty processor core is processor number 2, which equates to the third processor, since processor numbers start at 0.

Here is the PRCB address of processor 2, using the !prcb extension:

0: kd> [COLOR="red"]!prcb 2[/COLOR]
PRCB for Processor 2 at [COLOR="red"]fffff88003364180[/COLOR]:
Current IRQL -- [COLOR="red"]0[/COLOR]
Threads--  Current fffffa8007683060 Next fffffa8006a76b50 Idle fffff8800336efc0
Processor Index 2 Number (0, 2) GroupSetMember 4
Interrupt Count -- 006de178
Times -- Dpc    0000003f Interrupt 0000006a 
         Kernel 000716b4 User      00005be8

The IRQL is 0, and therefore the processor is clearly not processing interrupts as it should do, in a 64-bit operating system there should be a value of IRQL 13.

2: kd> !irql 2
Debugger saved IRQL for processor 0x2 -- [COLOR="red"]0 (LOW_LEVEL)[/COLOR]

You also have a quad-core processor if I am correct?

BUCKET_ID:  X64_CLOCK_WATCHDOG_TIMEOUT_[COLOR="red"]4[/COLOR]_PROC_ANALYSIS_INCONCLUSIVE

Here's the call stack for processor 2:

0: kd> [COLOR="red"]~2[/COLOR]
2: kd> kv
Child-SP          RetAddr           : Args to Child                                                           : Call Site
00000000`00000000 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x0

Here's the call stack for the other processors:

3: kd> [COLOR="red"]~0[/COLOR]
0: kd> kv
Child-SP          RetAddr           : Args to Child                                                           : Call Site
fffff880`037164e8 fffff800`036e1d5a : 00000000`00000101 00000000`00000030 00000000`00000000 fffff880`03364180 : nt!KeBugCheckEx
fffff880`037164f0 fffff800`03694ad7 : 00000000`00000000 fffff800`00000002 00000000`00002626 00000000`0000000c : nt! ?? ::FNODOBFM::`string'+0x4e2e
fffff880`03716580 fffff800`03c081c0 : 00000000`00000000 fffff880`03716730 fffff800`03c24460 fffff800`00000000 : nt!KeUpdateSystemTime+0x377
fffff880`03716680 fffff800`03687513 : 00000000`0153585c fffff800`03c24460 00000000`00000000 00000000`00000000 : hal!HalpRtcClockInterrupt+0x130
fffff880`037166b0 fffff800`036c07f9 : fffff800`037fde80 00000000`00000001 00000000`00000000 00000000`00000000 : nt!KiInterruptDispatchNoLock+0x163 (TrapFrame @ fffff880`037166b0)
fffff880`03716840 fffff800`0368fe0c : 00000000`00000000 fffffa80`0af40008 fffffa80`058a0670 00000000`0001ec4a : nt!KxFlushEntireTb+0x85
fffff880`03716880 fffff800`03674e14 : 00000000`00000002 d6f00001`d9147963 fffff880`03716ba0 00000000`0000856f : nt!KeFlushMultipleRangeTb+0x28c
fffff880`03716950 fffff800`037034c5 : fffff800`038bd600 fffff800`00000001 00000000`00000001 fffff880`03716bb0 : nt!MiAgeWorkingSet+0x64a
fffff880`03716b00 fffff800`03674f46 : 00000000`00001dcd 00000000`00000000 fffffa80`00000000 00000000`00000006 : nt! ?? ::FNODOBFM::`string'+0x4c7b6
fffff880`03716b80 fffff800`036753eb : 00000000`00000008 fffff880`03716c10 00000000`00000001 fffffa80`00000000 : nt!MmWorkingSetManager+0x6e
fffff880`03716bd0 fffff800`03921e5a : fffffa80`06b1a660 00000000`00000080 fffffa80`06a2bb30 00000000`00000001 : nt!KeBalanceSetManager+0x1c3
fffff880`03716d40 fffff800`0367bd26 : fffff880`03364180 fffffa80`06b1a660 fffff880`0336efc0 00000000`00000000 : nt!PspSystemThreadStartup+0x5a
fffff880`03716d80 00000000`00000000 : fffff880`03717000 fffff880`03711000 fffff880`03716700 00000000`00000000 : nt!KiStartSystemThread+0x16
0: kd> [COLOR="red"]~1[/COLOR]
1: kd> kv
Child-SP          RetAddr           : Args to Child                                                           : Call Site
fffff880`0d5ab140 fffff800`0367f9e1 : fffff680`000478c0 00000000`08f18000 fffffa80`0767b3f8 fffffa80`093b3010 : nt!KeFlushMultipleRangeTb+0x260
fffff880`0d5ab210 fffff800`0367fdc1 : ee800001`db507867 fffff680`000478b8 00000000`00000200 000fffff`00000001 : nt!MiDeletePteList+0x41
fffff880`0d5ab290 fffff800`03677582 : 00000000`000004dc 00000000`00000000 fffffa80`0767b060 fffffa80`0767b3f8 : nt!MiDecommitPages+0x1a1
fffff880`0d5abb20 fffff800`0368a253 : ffffffff`ffffffff 00000000`05c6e7f0 00000000`05c6e7e8 fffffa80`00004000 : nt!NtFreeVirtualMemory+0x382
fffff880`0d5abc20 00000000`770d14fa : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : nt!KiSystemServiceCopyEnd+0x13 (TrapFrame @ fffff880`0d5abc20)
00000000`05c6e7b8 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x770d14fa
1: kd> [COLOR="red"]~3[/COLOR]
3: kd> kv
Child-SP          RetAddr           : Args to Child                                                           : Call Site
fffff880`0358c880 fffff800`036cecac : fffff880`0358cc58 00000000`00000000 00000000`00000000 00000000`00000000 : nt!KeFlushMultipleRangeTb+0x266
fffff880`0358c950 fffff800`036cbae1 : fffffa80`06b3d040 00000000`00000000 fffff880`0358cc58 00000000`00000000 : nt!MmSetAddressRangeModified+0x2b0
fffff880`0358ca50 fffff800`036cf486 : fffffa80`09bbf0c8 00000000`00000001 fffffa80`00000001 00000000`00001000 : nt!CcFlushCache+0x561
fffff880`0358cb50 fffff800`036cfe54 : fffff880`00000000 fffff880`0358cc58 fffffa80`0b494b90 fffff800`038898b8 : nt!CcWriteBehind+0x1c6
fffff880`0358cc00 fffff800`03694641 : fffffa80`06a873b0 fffff800`0397d501 fffff800`038898c0 00000000`00000002 : nt!CcWorkerThread+0x1c8
fffff880`0358ccb0 fffff800`03921e5a : 00000000`00000000 fffffa80`06b3d040 00000000`00000080 fffffa80`06a2bb30 : nt!ExpWorkerThread+0x111
fffff880`0358cd40 fffff800`0367bd26 : fffff880`03364180 fffffa80`06b3d040 fffff880`0336efc0 00000000`00000000 : nt!PspSystemThreadStartup+0x5a
fffff880`0358cd80 00000000`00000000 : fffff880`0358d000 fffff880`03587000 fffff880`0358c9e0 00000000`00000000 : nt!KiStartSystemThread+0x16

They all seem to be processing some kind of information, whereas, the processor number 2 isn't doing anything for some reason.

I will ask for a second opinion though

 

[texjam]

So, you're telling me someone needs to kick processor 2 in the rear, huh? That little slacker is behind all of this?! I'm just kidding, but I figured it'd be something like this... I'll give it until tomorrow AM to see if anyone else wants to chime in and then I'll mark the thread as solved/disable links/etc.

In your opinion, with a processor acting such as this, is it the processor itself failing? Or could something else (hardware) be causing it to act as such?

Thanks for all your help... beers on me if I ever make it to the UK.

-JAM

 

[x BlueRobot]

Could read through link for more information:

• http://www.sevenforums.com/crash-lo...0x101-clock_watchdog_timeout-troubleshtg.html

I do believe that we have done all the other stress tests available for your hardware, including software checks such as Driver Verifier and uninstalling AVG and Spybot.

In my opinion, I think it has something to do with the processor failing, but let's leave the thread open and see what others also think

 

[essenbe]

My biggest question is how can you pass Prime95 with a bad CPU core? That's what Prime95 is, a stress test for the CPU. You should get a BSOD or at the least a core shutting down.

 

[texjam]

I can somewhat agree, Ess, but even you guys state that Prime isn't infallible... I'm about half-an-hour into a two hour (?) Prime test right now... I'll post some screen shots once that's done. I suppose if it doesn't come right out and smack me in the face with a big fail sign, I could've misinterpretted the results on the last run, but now I'm intrigued... especially in light of BR's findings. I just finished a memtest, too, and it says... wait for it... "detected no errors"... lol... I appreciate all y'alls help on this, and I'll post some results in a couple of hours.

-JAM

 

[essenbe]

Be sure and watch your temps. Don't let it overheat. Core temp will tell you the stress and temps of each core. Most people run it for 12 hours. But, I would think a bad core would show up sooner than that. But you are right, no test is infallible. Memtest isn't either, but they are the best tests we have.

 

[texjam]

Six hours it is... and please don't think I'm criticizing the tests. I'm somewhat flustered with this machine, but it's had a good long run, so I can accept that. Replacing the processor on a board with no life (or upgradability) left in it would be folly, in my opinion, so I'm probably at looking at a new machine. I'll be posting results later this evening... y'all have a great day!

-JAM

 

[essenbe]

Don't worry about criticizing the tests, I've done so numerous times. Prime is used mainly by overclockers to determine stability of an overclock. I've passed 12 hours and had a BSOD opening internet explorer. A CPU can withstand all the stress you can give it and fail on a light load or anything in between.

 

[Dave76]

Agree that hardware tests aren't conclusive, sometimes you need to run the tests a few times and/or different tests on the same components.

When you ran the RAM test, was it memtest86+?
There are several tests called memtest, some better than others, memtest86+ is recommended.
How many passes did you run?
Minimum of 7 full passes is required, this will take several hours and most people don't run them very long.
Each memtest86+ pass runs different tests, so it is crucial to run 7 full passes.

What are the CPU core temps, from 'CoreTemp', while at idle and under load?
Is your CPU a quad core?
Have you 'Unlocked' any cores?
Max temp for your CPU is 75°C.
AMD Phenom™ X4 9550

If you want to run an additional CPU stress test you can run OCCT.
OCCT stability checking tool
Run the CPU:OCCT test for at least 30 minutes (1 or 2 hours is better), be sure to monitor your CPU and GPU temps.
Set the time before you start.
When its done, pass or fail, it will make some graphs. Post these here as they are useful for analyses.

Sometimes errors from these tests can be fixed by adjusting settings in the BIOS.

Can you download CPUZ and post a snip of the CPU, Mainboard, Memory, and SPD tabs.
For posting the information , enter 'Snipping tool' in the Start button > Search box, hit enter. Select the area you want to post and save to a convenient place.
How to Post a Screenshot in Seven Forums
Go to your BIOS and tell us what the CPU, RAM and the CPU integrated memory controller voltages are.

 

[texjam]

I made a 6 hour run with Prime... I don't have this machine OC'd or tweaked or anything, so I figured that would be enough... maybe... maybe not, but this run turned up no problems.

View attachment 243427

During the Prime test I monitored the temps, but the CPU never got over 62C and plateaued around 58C for most of the time.

View attachment 243429

The memtest I ran (most all morning) was the Windows version, and I ran through different iterations as suggested in other forum posts. I've got to download and run the 86+ version either when I get done here or in the AM. This is a cap from the event viewer after I completed testing this afternoon.

View attachment 243426

You can probably surmise my core temps from one of the above images... it is a quad-core, nothing is unlocked, and while I could be mistaken I don't think it's ever reached 75C... 62C during the prime test, but it'll idle in the mid-to-low 30s most of time.

View attachment 243430

OCCT results will have to wait until tomorrow or at least later, as my ISP oversold their service and will not upgrade their equipment, so if by chance all 6 of the subscribers in my area get on at once, the download speed slows to worse than dialup... but I will run the test and post results as soon as I can.

I think the BIOS is a lost cause, too... it's from 2008 and there ain't too many upgrades readily available for the Bengel board.

And the CPU-Z caps are below:

View attachment 243423

View attachment 243424

View attachment 243425

View attachment 243428

Thanks for the input and I'll be checking back later on... I've just about written off this machine, but if you have any additional input or advice after reviewing this data, it's more than welcome... thanks.

-JAM

 

[texjam]

Well, well, well... it only took 36 minutes to shut the test down. It didn't throw a BSOD or anything... I had the test set to run for 1 hour, but something (error detected on core #3) triggered it to shut down early. I'm attaching all of the images the program made and let me know if you need any more info from me.

-JAM

View attachment 243439

View attachment 243440

View attachment 243441

View attachment 243442

View attachment 243443

View attachment 243444

View attachment 243445

View attachment 243446

View attachment 243447

View attachment 243448

View attachment 243449

View attachment 243450

View attachment 243451

View attachment 243452

View attachment 243453

View attachment 243454

View attachment 243455

View attachment 243456

View attachment 243457

 

[F5ing]

I'm not sure of all the details that have already been posted concerning your BSOD dumps and stuff, but at this point you may as well do some extended diagnostics on your hard drive:

Hard Drive Diagnostic Procedure

CrystalDisk is great, but really only shows you current SMART status.

 

[texjam]

I've not thrown my hands up in disgust yet, though processor issues may force me to do just that at some point still... sigh. I'm performing different/recommended tests all over again, so it may be a bit before I can post back any updates. I'm also trying to fit work into my scenario, too, so thank goodness for the KVM... and thanks again for any/all of your advice!

-JAM