wget and curl fail to download KB html page


  1. Posts : 29
    7 Pro 64
       #1

    wget and curl fail to download KB html page


    How can a KB html page be downloaded?

    I've a list of KBs, such as 3123479.

    https://support.microsoft.com/en-us/kb/3123479

    There are 150 in all.

    I'd like to script the downloading of their webpages, but wget and curl are grabbing only a generic page. The only part of the webpage that I'm interested in is the title, such as "Microsoft security advisory: Deprecation of SHA-1 hashing algorithm for Microsoft root certificate program: January 12, 2016"

    How can a KB article be downloaded?
      My Computer


  2. Posts : 29
    7 Pro 64
    Thread Starter
       #2

    LOL someone in a nearly identical situation:

    c# - How can I programmatically get the title of Microsoft knowledge base article by KB number? - Stack Overflow

    and user canon gave the answer:
    That's because it loads the actual content through client script (sigh).
    Try using the API link instead: https://support.microsoft.com/api/content/kb/3102429
    proof of concept:
    Code:
    curl  https://support.microsoft.com/api/content/kb/3123479 | grep -m1 'id="mt5"' | sed -e 's#.*title="\([^"]*\).*#\1#'
      My Computer


  3. Posts : 29
    7 Pro 64
    Thread Starter
       #3

    turns out id="mt5" is too specific, sometimes it is mt3, etc ....

    id="mt works great

    Code:
    ff=kbids-titles.txt 
    rm -f $ff 
    for kbid in `cat kbids-in-systeminfo`; do 
      kbtt=`curl https://support.microsoft.com/api/content/kb/$kbid | grep -m1 'id="mt' | sed -e 's#.*title="\([^"]*\).*#\1#'`
      echo $kbid $kbtt >> $ff; 
    done
    output

    Code:
    2479943 MS11-015: Description of the security update for Microsoft Windows: March 8, 2011
    2491683 MS11-024: Description of the security update for Windows Fax Cover Page Editor: April 12, 2011
    2506014 Microsoft Security Advisory: Update for the Windows Operating System Loader
    2506212 MS11-024: Description of the security update for Windows Fax Cover Page Editor MFC components: April 12, 2011
    2509553 MS11-030: Vulnerability in DNS Resolution could allow remote code execution: April 12, 2011
    2532531 MS11-053: Description of the update for Bluetooth Stack for Windows 7 and Windows Vista Service Pack 2: July 12, 2011
    2533552 An update that prevents a "0xC0000034" error message when you try to install Windows 7 SP1, Windows Server 2008 R2 SP1, or Windows Embedded Standard 7 SP1 is available
    2534111 "Computer name cannot contain only numbers" error message when you install Windows 7 by using Windows 7 SP1 integrated installation media
    2552343 Time-out error occurs when you install a Windows Update package that contains drivers on a computer that is running Windows 7 or Windows Server 2008 R2
    2560656 MS11-059: Vulnerability in Data Access Components could allow remote code execution: August 9, 2011
    2564958 MS11-075: Description of the security update for Active Accessibility in Windows: October 11, 2011
    2579686 MS11-076: Description of the security update for Windows Media Center: October 11, 2011
    2585542 MS12-006: Description of the security update for Webio, Winhttp, and schannel in Windows: January 10, 2012
    2604115 MS12-035: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: May 8, 2012
    2620704 MS11-085: Vulnerability in Windows Mail and Windows Meeting Space could allow remote code execution: November 8, 2011
    2621440 MS12-020: Description of the security update for Remote Desktop Protocol Vulnerability: March 13, 2012
    2631813 MS12-004: Description of the security update for DirectShow: January 10, 2012
    2653956 MS12-024: Vulnerability in Windows could allow remote code execution: April 10, 2012
    2654428 MS12-013: Vulnerability in C Run-Time Library could allow remote code execution: February 14, 2012
    2656356 MS11-100: Description of the security update for the .NET Framework 3.5.1 on Windows 7 SP1 and Windows Server 2008 R2 SP1: December 29, 2011
    2667402 MS12-020: Description of the security update for Terminal Server Denial of Service Vulnerability: March 13, 2012
    2670838 Platform update for Windows 7 SP1 and Windows Server 2008 R2 SP1
    2676562 MS12-034: Description of the security update for Windows kernel-mode drivers: May 8, 2012
    2685939 MS12-036: Vulnerabilities in Remote Desktop could allow remote code execution: June 12, 2012
    2690533 MS12-033: Vulnerability in Windows Partition Manager could allow elevation of privilege: May 8, 2012
    2698365 MS12-045: Vulnerability in Microsoft Data Access Components could allow remote code execution: July 10, 2012
    2705219 MS12-054: Description of the security update for Windows Networking Components: August 14, 2012
    2706045 MS12-056: Vulnerability in JScript and VBScript engines could allow remote code execution: August 14, 2012
    2727528 MS12-072: Vulnerabilities in Windows shell could allow remote code execution: November 13, 2012
    2729094 An update for the Segoe UI symbol font in Windows 7 and in Windows Server 2008 R2 is available
    2729452 MS12-074: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: November 13, 2012
    2736422 MS13-007: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: January 8, 2013
    2742599 MS13-004: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: January 8, 2013
    2758857 MS12-081: Vulnerability in Windows file handling component could allow remote code execution: December 11, 2012
    2770660 MS12-082: Vulnerability in DirectPlay could allow remote code execution: December 11, 2012
    2786081 Internet Explorer 10 does not save credentials for a website after you log off or restart a computer that is running Windows 7 SP1 or Windows Server 2008 R2 SP1
    2789645 MS13-015: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: February 12, 2013
    2798162 Update to improve messaging in dialog boxes when you run executable files in Windows
    2807986 MS13-027: Vulnerabilities in Kernel-Mode drivers could allow elevation of privilege: March 12, 2013
    2813430 An update is available that enables administrators to update trusted and disallowed CTLs in disconnected environments in Windows
    2834140 "0x00000050" Stop error after you install update 2670838 on a computer that is running Windows 7 SP1 or Windows Server 2008 R2 SP1
    2836942 Update for the .NET Framework 3.5.1 on Windows 7 SP1 and Windows Server 2008 R2 SP1 (June 2013)
    2836943 An update is available for the .NET Framework 3.5.1 on Windows 7 SP1 and Windows Server 2008 R2 SP1: September 2013
    2840149 MS13-036: Description of the security update for the Windows file system kernel-mode driver (ntfs.sys): April 9, 2013
    2840631 MS13-052: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: July 9, 2013
    2841134 Internet Explorer 11 is now available
    2847927 MS13-058: Vulnerability in Windows Defender could allow elevation of privilege: July 9, 2013
    2849696
    2849697
    2861698 MS13-082: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: October 8, 2013
    2862152 Microsoft security advisory: Vulnerability in IPsec could allow security feature bypass
    2862330 MS13-081: Description of the security update for USB drivers: October 8, 2013
    2862335 MS13-081: Description of the security update for USB drivers: October 8, 2013
    2864202 MS13-081: Description of the security update for USB drivers: October 8, 2013
    2868038 MS13-081: Description of the security update for USB drivers: October 8, 2013
    2868116 Updates are available that improve the content in warning messages that you receive when you run local executable files in Windows
    2871997 Microsoft Security Advisory: Update to improve credentials protection and management: May 13, 2014
    2882822 Update adds ITraceRelogger interface support to Windows Embedded Standard 7 SP1, Windows 7 SP1 and Windows Server 2008 R2 SP1
    2884256 MS13-081: Description of the security update for USB drivers: October 8, 2013
    2888049 Update is available that improves the network performance of Internet Explorer 11 in Windows
    2892074 MS13-099: Description of the security update for Windows Script 5.8: December 10, 2013
    2893294 MS13-098: Vulnerability in Windows could allow remote code execution: December 10, 2013
    2894844 Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: December 10, 2013
    2900986 MS13-090: Cumulative security update for ActiveX Kill Bits: November 12, 2013
    2911501 MS14-009: Description of the security update for the .NET Framework 3.5.1 for Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: February 11, 2014
    2912390 MS14-007: Vulnerability in Direct2D could allow remote code execution: February 11, 2014
    2929733 The first stage of the WER protocol is not SSL encrypted in Windows
    2931356 MS14-026: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: May 13, 2014
    2937610 MS14-046: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: August 12, 2014
    2943357 MS14-046: Description of the security update for the .NET Framework 3.5.1 in Windows 7 SP1 and Windows Server 2008 R2 SP1: August 12, 2014
    2957189 MS14-031: Description of the security update for TCP for Windows: June 10, 2014
    2968294 MS14-057: Description of the security update for the .NET Framework 3.5.1 for Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: October 14, 2014
    2972100 MS14-057: Description of the security update for the .NET Framework 3.5.1 for Windows 7 SP1 and Windows Server 2008 R2 SP1: October 14, 2014
    2972211 MS14-053: Description of the security update for the .NET Framework 3.5.1 for Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: September 9, 2014
    2973112 MS14-053: Description of the security update for the .NET Framework 3.5.1 for Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: September 9, 2014
    2973201 MS14-039: Description of the security update for Windows on-screen keyboard: July 8, 2014
    2973351 Microsoft Security Advisory: Registry update to improve credentials protection and management for Windows-based systems that have the 2919355 update installed: July 8, 2014
    2977292 Microsoft security advisory: Update for Microsoft EAP implementation that enables the use of TLS: October 14, 2014
    2978120 MS14-072: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: November 11, 2014
    2978742 MS14-043: Vulnerability in Windows Media Center could allow remote code execution: August 12, 2014
    2984972 Update for RDC 7.1 to support restricted administration logons on Windows 7 and Windows Server 2008 R2
    2991963 MS14-078: Description of the security update for IME: November 11, 2014
    2992611 MS14-066: Vulnerability in SChannel could allow remote code execution: November 11, 2014
    2993651 MS14-045: Description of the security update for kernel-mode drivers: August 27, 2014
    3003743 MS14-074: Vulnerability in Remote Desktop Protocol could allow security feature bypass: November 11, 2014
    3004361 MS15-014: Vulnerability in Group Policy could allow security feature bypass: February 10, 2015
    3004375 Microsoft security advisory: Update to improve Windows command-line auditing: February 10, 2015
    3010788 MS14-064: Description of the security update for Windows OLE: November 11, 2014
    3011780 MS14-068: Vulnerability in Kerberos could allow elevation of privilege: November 18, 2014
    3019978 MS15-004: Description of the security update for Windows: January 13, 2015
    3020369 April 2015 servicing stack update for Windows 7 and Windows Server 2008 R2
    3021674 MS15-003: Vulnerability in Windows User Profile service could allow elevation of privilege: January 13, 2015
    3022777 MS15-005: Vulnerability in Network Location Awareness service could allow security feature bypass: January 13, 2015
    3023215 MS15-048: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: May 12, 2015
    3030377 MS15-028: Vulnerability in Windows Task Scheduler could allow security feature bypass: March 10, 2015
    3035126 MS15-029: Vulnerability in Windows Photo Decoder component could allow information disclosure: March 10, 2015
    3035132 MS15-024: Vulnerability in PNG processing could allow information disclosure: March 10, 2015
    3037574 MS15-041: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: April 14, 2015
    3042553 MS15-034: Vulnerability in HTTP.sys could allow remote code execution: April 14, 2015
    3045685 MS15-038: Description of the security update for Windows: April 14, 2015
    3046017 MS15-088 Description of the security update for Windows, Internet Explorer, and Office: August 11, 2015
    3046269 MS15-037: Vulnerability in Windows Task Scheduler could allow elevation of privilege: April 14, 2015
    3055642 MS15-050: Vulnerability in Service Control Manager could allow elevation of privilege: May 12, 2015
    3059317 MS15-060: Vulnerability in Microsoft common controls could allow remote code execution: June 9, 2015
    3060716 MS15-090: Vulnerabilities in Windows could allow elevation of privilege: August 11, 2015
    3067903 MS15-069: Description of the security update for Windows: July 14, 2015
    3071756 MS15-085: Description of the security update for Windows Mount Manager: August 11, 2015
    3072305 MS15-080: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: August 11, 2015
    3074543 MS15-101: Description of the security update for the .NET Framework 3.5.1 on Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: September 8, 2015
    3075220 MS15-082: Description of the security update for RDP in Windows: August 11, 2015
    3076895 MS15-084: Description of the security update for Windows XML core services: August 11, 2015
    3078601 MS15-080: Description of the security update for Windows: August 11, 2015
    3080446 MS15-109: Description of the security update for Windows Shell: October 13, 2015
    3084135 MS15-102: Description of the security update for Windows Task Management: September 8, 2015
    3086255 MS15-097: Description of the security update for the graphics component in Windows: September 8, 2015
    3092601 MS15-119: Description of the security update for Windows Winsock: November 10, 2015
    3093513 MS15-109: Description of the security update for Windows Shell: October 13, 2015
    3097989 MS15-118: Description of the security update for the .NET Framework 3.5.1 on Windows 7 SP1 and Windows Server 2008 R2 SP1: November 10, 2015
    3101722 MS15-117: Security update for NDIS to address elevation of privilege: November 10, 2015
    3108371 MS15-132: Description of the security update for Windows: December 8, 2015
    3108381 MS15-132: Description of the security update for Windows: December 8, 2015
    3108664 MS16-007: Description of the security update for Windows: January 12, 2016
    3108670 MS15-130: Security update for Microsoft Uniscribe to address remote code execution: December 8, 2015
    3109094 MS15-128 and MS15-135: Description of the security update for Windows kernel-mode drivers: December 8, 2015
    3109103 MS15-133: Description of the security update for Windows PGM: December 8, 2015
    3109560 MS16-007: Description of the security update for Windows: January 12, 2016
    3110329 MS16-007: Description of the security update for Windows: January 12, 2016
    3115858 MS16-013: Description of the security update for Windows Journal: February 9, 2016
    3122648 MS16-019: Description of the security update for the .NET Framework 3.5.1 in Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: February 9, 2016
    3123479 Microsoft security advisory: Deprecation of SHA-1 hashing algorithm for Microsoft root certificate program: January 12, 2016
    3124275 MS16-001: Security update for Internet Explorer: January 12, 2016
    3126587 MS16-014: Description of the security update for Windows Vista, Windows Server 2008, Windows 7, Windows Server 2008 R2, Windows Server 2012, Windows 8.1, and Windows Server 2012 R2: February 9, 2016
    3127220 MS16-019: Description of the security update for the .NET Framework 3.5.1 in Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: February 9, 2016
    3135983 MS16-035: Description of the security update for the .NET Framework 3.5.1 in Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: March 8, 2016
    3138612 Windows Update Client for Windows 7 and Windows Server 2008 R2: March 2016
    3138910 MS16-027: Description of the security update for Windows media: March 8, 2016
    3139398 MS16-033: Description of the security update for Windows USB mass storage class driver: March 8, 2016
    3139914 MS16-032: Description of the security update for the Windows Secondary Logon Service: March 8, 2016
    3142024 MS16-065: Description of the security update for the .NET Framework 3.5.1 in Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: May 10, 2016
    3146706 MS16-044: Security update for Windows OLE: April 12, 2016
    3146963 MS16-040: Description of the security update for Microsoft XML core services: April 12, 2016
    3149090 MS16-047: Description of the security update for SAM and LSAD remote protocols: April 12, 2016
    3150220 MS16-059: Security update to Windows Media Center: May 10, 2016
    3155178 MS16-056: Description of the security update for Windows Journal: May 10, 2016
    3156016 MS16-055: Description of the security update for Microsoft graphics component: May 10, 2016
    3156017 MS16-062: Description of the security update for Windows Kernel-Mode Drivers: May 10, 2016
    3156019 MS16-055: Description of the security update for Microsoft graphics component: May 10, 2016
    3159398 MS16-072: Description of the security update for Group Policy: June 14, 2016
    3161561 MS16-075 and MS16-076: Description of the security update for Windows Netlogon and SMB Server: June 14, 2016
    3161949 MS16-077: Description of the security update for WPAD: June 14, 2016
    3161958 MS16-082: Description of the security update for Windows Structured Query: June 14, 2016
    3163245 MS16-091: Description of the security update for the .NET Framework 3.5.1 in Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: July 12, 2016
    3164035 MS16-074: Description of the security update for Microsoft Graphics Component: June 14, 2016
    3170455 MS16-087: Description of the security update for Windows print spooler components: July 12, 2016
    3172605 July 2016 update rollup for Windows 7 SP1 and Windows Server 2008 R2 SP1
    3177186 MS16-114: Description of the security update for Windows SMBv1 Server: September 13, 2016
    3185911 MS16-106: Description of the security update for Microsoft Graphics Component: September 13, 2016
    3188740 MS16-120: Description of the Security and Quality Rollup for the .NET Framework 3.5.1 for Windows 7 Service Pack 1 and Windows Server 2008 R2 Service Pack 1: October 11, 2016
    976902 Description of the Windows 7 and Windows Server 2008 R2 installation software feature update
      My Computer


 

  Related Discussions
Our Sites
Site Links
About Us
Windows 7 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 7" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd
All times are GMT -5. The time now is 05:56.
Find Us