Laptop backup strategy / SD card anywhere + "big" hard drive at home


  1. TanaT
    Posts : 3
    Windows 7 Ultimate x64
       New #1

    Laptop backup strategy / SD card anywhere + "big" hard drive at home


    Hello,

    I've just solved a backup strategy problem and I want to share it in case it could be useful.

    If you think it's not that good, consider closing or deleting this post ;-) !

    I use my laptop in many circumstances : office, my home, other homes, etc. Sometimes with internet access, sometimes not.

    I can't feel safe with only one hard drive running, but laptops with 2 bays are big and hard to find if you want to set a RAID mirroring solution.

    I don't want to carry external hard drive every where even if they could be small.

    But I have one or two hard drives available when I'm at my office or home.

    When I'm not there, I could rely on a USB key or SD card inserted in my laptop anytime to faike a mirroring. But of course it's too small to backup all I want : it has to be differential.

    So here is my solution build on powershell and robocopy.
    Following script should be launched automatically or manually after correctly set.

    It looks for any folder name $BckFold (for full backups) and $PartFold (for partial backups) on any hard drive found and launch appropriate backups.

    If it's not clear, just ask.

    Hope it could be useful to someone...

    Bye.

    TanaT


    [ EDIT 2012-03-13 ] ! Please use version 0.1 in the following reply !

    Code:
    # -----------------------------------------------------------------
# ------------------------ MVBACKUP -------------------------------
# -----------------------------------------------------------------
#
# Laptop backups management, by TanaT.
# Created 2012-03-03.
#
# 1. Complete SETTINGS part with the folders you want to backup.
# 2. Launch the script manually anytime you want or automatically with
# control panel/Admin tools/Tasks scheduler.
#
# Any time the script is launched, it looks for available Destination
# directories in any hard drive available. If it finds full backup
# directories as set in BckFold it launches a mirroring to it and set
# the archive flags of sources files. If it finds partial backup
# directories in any hard drive available (like USB Key for instance)
# it launches a mirroring to it restricted to files without any archive
# flag set (those who hasn't been backed up yet).

# Example :
# BckFold = "_mvBackup_" and PrtFold = "_partBack_"
# Create a folder named _mvBackup_ in a big external hard drive (500Go ?)
# Create a folder named _partBack_ in a USB Key (8Go ?)
# Keep your big hard drive home and bring your USB Key with your laptop.
# Connect your hard drive and launch mvbackup.ps1 when your home.
# Connect your USB key and launch mvbackup.ps1 when your out and you've
# just worked hours on any kind of stuff you want to keep safe.
# When you're back home, launch it again on your external hard drive.
# You can have as many as you want drives (big or small). Just create the
# appropriate folder at the root of your drive.

# -----------------------------------------------------------------
# ------------------------ SETTINGS -------------------------------
# -----------------------------------------------------------------

# List of "folders to backup" = "Names of folders to give in archive" separated with ;
$SrcDirs = @{
"C:\Users\TanaT\Pictures" = "Images_TanaT";
"C:\Users\TanaT\Documents" = "MesDocs_TanaT"
}

# Name of full backup folder we should look for in "big" hard drives
$BckFold = "mvBackup_AT"

# Name of partial backup folder we should look for in "small" usb keys / SD cards
$PrtFold = "partBack_AT"

# Timestamps when a backup action (full) is complete
# are stored in $SrcDirs_items\$LastFTSFile (source side)
# Timestamps when a backup action (partial) is complete
# are stored in $PrtFold\$BckDirs_items\$LastPTSFile (destination side)
#   (Creation timestamps of files are used.)
$LastFTSFile = ".lastFullTimestamp.mvb"
$LastPTSFile = ".lastPartTimestamp.mvb"
$LogFile = "C:\users\anatole\mvbackup.log"
# -----------------------------------------------------------------
# ------------------------ ROUTINES -------------------------------
# -----------------------------------------------------------------

# Touch equivalent except that it works with Creation timestamp
function TouchFile ()
{ 
  param([string] $file)
  if (test-path $file)
  { $now = Get-Date
    (Get-Item $file).CreationTime = $now }
  else
  { echo $null > $file }
}

# MvMirror full|part srcDir destDir
# case full :
#   * Mirror srcDir to destDir
#   * Set Archive flag of every saved files and dirs
#   * Set creation time of $args[1] \ $LastFTSFile = now 
# case part :
#   * mirror srcDir to destDir ignoring files with Archive flag set
#   * Set creation time of $args[2] \ $LastPTSFile = now
function MvMirror ()
{
  If($args.Count -ne 3)
  {
    write-host "Function MvMirror must have 3 arguments."
    return
  }

  $action = $args[0]
  If($action -eq "full")
  {
    # Full backup : Mirror all and unset Archive flag of source files/folders
    #write-host robocopy $args[1] $args[2] /MIR /COPYALL /M /R:1 /W:2 /NP /log:$LogFile
    robocopy $args[1] $args[2] /MIR /M /XJ /R:1 /W:2 /NP /log:$LogFile /XF $LastFTSFile $LastPTSFile
    $firstErrLev = $?
    robocopy $args[1] $args[2] /MIR /XJ /R:1 /W:2 /NP /log:$LogFile /XF $LastFTSFile $LastPTSFile
    if ( ( $firstErrLev -le 1 ) -and ( $? -le 1 ) )
    { # Success set new timestamp of full backup
      write-host TouchFile ("$($args[1])\$LastFTSFile")
      TouchFile ("$($args[1])\$LastFTSFile")
    }
  }
  elseIf($action -eq "part")
  {
    # Partial backup : Mirror files with Archive flag set
    # (those that hasn't been backed up yet)
    robocopy $args[1] $args[2] /MIR /IA:A /S /XJ /R:1 /W:2 /NP /log:$LogFile /XF $LastFTSFile $LastPTSFile
    if ( $? -le 1 )
    { # Success set new timestamp of partial backup
      write-host TouchFile ("$($args[2])\$LastPTSFile")
      TouchFile ("$($args[2])\$LastPTSFile")
    }
  }
  else
  {
    write-host "Function MvMirror: 1st arg must be full or part."
  }
}

# -----------------------------------------------------------------
# ------------------------ MAIN -----------------------------------
# -----------------------------------------------------------------

# ------------------------ GLOBAL CONTROLS ------------------------

# Invalid filename chars pattern
$pattern = "[{0}]" -f ([Regex]::Escape([String] `
[System.IO.Path]::GetInvalidFilenameChars()))

foreach ($dir in ($SrcDirs.clone()).Keys)
{
  # If a source folder doesn't exist, remove it from the list
  if ( ! (Test-Path $dir -PathType container) )
  {    
    write-host "Removing $dir from the list (unreadable dir)"
    $SrcDirs.Remove($dir)
  }
  else
  {
    # If a destination dir name is illegal, remove it from the list
    if ($SrcDirs[$dir] -match $pattern)
    {
      write-host "Removing $dir from the list (illegal foldername $SrcDirs[$dir]"
      $SrcDirs.Remove($dir)
    }
  }
}

# ------------------------ DIRS SEARCH ----------------------------
$FullBDirs = @() # To list any full    backup drive + path found
$PartBDirs = @() # To list any partial backup drive + path found

# Look for any hard drive letter and search for mvbackup folders in them
foreach ($drive in (Get-WmiObject Win32_LogicalDisk -filter "DriveType = 2 or DriveType=3"))
{
  if (Test-Path "$($drive.DeviceID)\$BckFold")
  {
    $FullBDirs += "$($drive.DeviceID)\$BckFold" # Add a full backup dir
  }  
  if (Test-Path "$($drive.DeviceID)\$PrtFold")
  {
    $PartBDirs += "$($drive.DeviceID)\$PrtFold" # Add a partial backup dir
  }    
}

write-host "Full :"
$FullBDirs

write-host "Partial :"
$PartBDirs

# ------------------------ BEGIN ! --------------------------------

# -- If full backup dir available, do it
if ($FullBDirs.length -gt 0)
{
  write-host I have full back up to do
  foreach ($currFullDestPath in $FullBDirs)
  {
    # loop over any full destination dirs available
    foreach ( $currSrcDir in ($SrcDirs.Keys) )
    {
      write-host "Processing full $currSrcDir $currFullDestPath\$($SrcDirs[$currSrcDir])"
      MvMirror full $currSrcDir $currFullDestPath\$($SrcDirs[$currSrcDir])
    }
  }
}

# -- If partial backup dir available, do it
if ($PartBDirs.length -gt 0)
{
  write-host I have partial back up to do
  foreach ($currPartDestPath in $PartBDirs)
  {
    # loop over any partial destination dirs available
    foreach ( $currSrcDir in ($SrcDirs.Keys) )
    {
      # If a full backup occurred more recently than last partial backup, empty partial dir before.
      if ( (Test-Path "$currPartDestPath\$($SrcDirs[$currSrcDir])\$LastPTSFile") -and (Test-Path "$currSrcDir\$LastFTSFile") )
      {
        if ((Get-Item "$currPartDestPath\$($SrcDirs[$currSrcDir])\$LastPTSFile").CreationTime -lt (Get-Item "$currSrcDir\$LastFTSFile").CreationTime)
        {
          write-host "Delete partial folder first"
          Remove-Item $currPartDestPath\$($SrcDirs[$currSrcDir]) -recurse
        }
      }        
      write-host "Processing partial $currSrcDir $currPartDestPath\$($SrcDirs[$currSrcDir])"
      MvMirror part $currSrcDir $currPartDestPath\$($SrcDirs[$currSrcDir])
    }
  }
}


# ------------------------ EOF ------------------------------------
    Last edited by TanaT; 13 Mar 2012 at 05:32. Reason: New version next...
      My Computer
    Quote Quote

  3. TanaT
    Posts : 3
    Windows 7 Ultimate x64
    Thread Starter
       New #2

    Archive attribute trouble with some Robocopy version


    It looks like robocopy sometimes do not handle Archive attribute correctly with /M option.

    I tried many options without success. Piping robocopy to attrib.exe is not solving it because it returns destination files (not source files), so here is my work around to have partial backups really partial !

    I launch attrib.exe -A just after robocopy full backup. The only problem with this is that if the backup takes a lot of time and you change a file during robocopy execution, it might not be copied and then unset archive flag by attrib. So be careful with the first backup : you should launch it and give it some time...

    Here is version 0.1 corrected :
    EDIT (19/03/2012) : Version 0.2.

    Code:
    # -----------------------------------------------------------------
# ------------------------ MVBACKUP (0.2) ------------------------
# -----------------------------------------------------------------
#
# Laptop backups management, by TanaT.
# Created 2012-03-03.
# Version 0.2 (2012-03-19) : Corrected following trouble : Function
RemoveItem doesn't work properly in  recursive mode and -force option
is not enough to get rid of  confirmation prompt.
# Version 0.1 (2012-03-13) : archive atttribute handled despite a bug
# in some robocopy versions.
#
# 1. Complete SETTINGS part with the folders you want to backup.
# 2. Launch the script manually anytime you want or automatically with
# control panel/Admin tools/Tasks scheduler.
#
# Any time the script is launched, it looks for available Destination
# directories in any hard drive available. If it finds full backup
# directories as set in BckFold it launches a mirroring to it and set
# the archive flags of sources files. If it finds partial backup
# directories in any hard drive available (like USB Key for instance)
# it launches a mirroring to it restricted to files without any archive
# flag set (those who hasn't been backed up yet).

# Example :
# BckFold = "_mvBackup_" and PrtFold = "_partBack_"
# Create a folder named _mvBackup_ in a big external hard drive (500Go ?)
# Create a folder named _partBack_ in a USB Key (8Go ?)
# Keep your big hard drive home and bring your USB Key with your laptop.
# Connect your hard drive and launch mvbackup.ps1 when your home.
# Connect your USB key and launch mvbackup.ps1 when your out and you've
# just worked hours on any kind of stuff you want to keep safe.
# When you're back home, launch it again on your external hard drive.
# You can have as many as you want drives (big or small). Just create the
# appropriate folder at the root of your drive.

# Note : If some files are marked with system attribute, they can't be
# handled by attrib.exe. You should launch powershell as administrator and
# enter following command over the folder containing these marked files :
#
# attrib.exe -A /S /D /L C:\Users\TanaT\FolderWithMarkedFiles\*
# (it removes system attribute on all files, folders, including subfolders.)

# -----------------------------------------------------------------
# ------------------------ SETTINGS -------------------------------
# -----------------------------------------------------------------

# List of "folders to backup" = "Names of folders to give in archive" separated with ;
$SrcDirs = @{
"C:\Users\TanaT\Pictures" = "Images_TanaT";
"C:\Users\TanaT\Documents" = "MesDocs_TanaT"
}

# Name of full backup folder we should look for in "big" hard drives
$BckFold = "mvBackup_AT"

# Name of partial backup folder we should look for in "small" usb keys / SD cards
$PrtFold = "partBack_AT"

# Timestamps when a backup action (full) is complete
# are stored in $SrcDirs_items\$LastFTSFile (source side)
# Timestamps when a backup action (partial) is complete
# are stored in $PrtFold\$BckDirs_items\$LastPTSFile (destination side)
#   (Creation timestamps of files are used.)
$LastFTSFile = ".lastFullTimestamp.mvb"
$LastPTSFile = ".lastPartTimestamp.mvb"
$LogFile  = "C:\users\TanaT\logs\mvbackup.log"
$LogFileP = "C:\users\TanaT\logs\mvbackupP.log"

# -----------------------------------------------------------------
# ------------------------ ROUTINES -------------------------------
# -----------------------------------------------------------------

# Touch equivalent except that it works with Creation timestamp
function TouchFile ()
{ 
  param([string] $file)
  if (test-path $file)
  { $now = Get-Date
    (Get-Item $file).CreationTime = $now }
  else
  { echo $null > $file }
}

# MvMirror full|part srcDir destDir
# case full :
#   * Mirror srcDir to destDir
#   * Set Archive flag of every saved files and dirs
#   * Set creation time of $args[1] \ $LastFTSFile = now 
# case part :
#   * mirror srcDir to destDir ignoring files with Archive flag set
#   * Set creation time of $args[2] \ $LastPTSFile = now
function MvMirror ()
{
  If($args.Count -ne 3)
  {
    write-host "Function MvMirror must have 3 arguments."
    return
  }

  $action = $args[0]
  If($action -eq "full")
  {
    # Full backup : Mirror all and unset Archive flag of source files/folders
    robocopy $args[1] $args[2] /MIR /XJ /R:1 /W:2 /NP /MT:16 /log:$LogFile /XF $LastFTSFile $LastPTSFile
    if ( $? -le 1 )
    { # Success unset archive flag of all files and dirs
      #write-host attrib -A /S /D /L "$($args[1])\*"
      attrib -A /S /D /L "$($args[1])\*"
      # Success set new timestamp of full backup
      #write-host TouchFile ("$($args[1])\$LastFTSFile")
      TouchFile ("$($args[1])\$LastFTSFile")
    }
  }
  elseIf($action -eq "part")
  {
    # Partial backup : Mirror files with Archive flag set
    # (those that hasn't been backed up yet)
    robocopy $args[1] $args[2] /S /PURGE /IA:A /XJ /R:1 /W:2 /NP /MT:16 /log:$LogFileP /XF $LastFTSFile $LastPTSFile
    if ( $? -le 1 )
    { # Success set new timestamp of partial backup
      #write-host TouchFile ("$($args[2])\$LastPTSFile")
      TouchFile ("$($args[2])\$LastPTSFile")
    }
  }
  else
  {
    write-host "Function MvMirror: 1st arg must be full or part."
  }
}

# -----------------------------------------------------------------
# ------------------------ MAIN -----------------------------------
# -----------------------------------------------------------------

# ------------------------ GLOBAL CONTROLS ------------------------

# Invalid filename chars pattern
$pattern = "[{0}]" -f ([Regex]::Escape([String] `
[System.IO.Path]::GetInvalidFilenameChars()))

foreach ($dir in ($SrcDirs.clone()).Keys)
{
  # If a source folder doesn't exist, remove it from the list
  if ( ! (Test-Path $dir -PathType container) )
  {    
    write-host "Removing $dir from the list (unreadable dir)"
    $SrcDirs.Remove($dir)
  }
  else
  {
    # If a destination dir name is illegal, remove it from the list
    if ($SrcDirs[$dir] -match $pattern)
    {
      write-host "Removing $dir from the list (illegal foldername $SrcDirs[$dir]"
      $SrcDirs.Remove($dir)
    }
  }
}


# $SrcDirs

# ------------------------ DIRS SEARCH ----------------------------
$FullBDirs = @() # To list any full    backup drive + path found
$PartBDirs = @() # To list any partial backup drive + path found

# Look for any hard drive letter and search for mvbackup folders in them
foreach ($drive in (Get-WmiObject Win32_LogicalDisk -filter "DriveType = 2 or DriveType=3"))
{
  if (Test-Path "$($drive.DeviceID)\$BckFold")
  {
    $FullBDirs += "$($drive.DeviceID)\$BckFold" # Add a full backup dir
  }  
  if (Test-Path "$($drive.DeviceID)\$PrtFold")
  {
    $PartBDirs += "$($drive.DeviceID)\$PrtFold" # Add a partial backup dir
  }    
}

write-host "`n----------------------------------------------"
write-host "------------- MVBACKUP 0.2 -------------------"
write-host "----------------------------------------------`n`n"

write-host "------------- Full backups to do -------------`n"
$FullBDirs

write-host "`n----------- Partial backups to do ------------`n"
$PartBDirs
write-host "`n`n"

# ------------------------ BEGIN ! --------------------------------

# -- If full backup dir available, do it
if ($FullBDirs.length -gt 0)
{
  write-host "------- FULL BACKUPS PROCESS STARTED... ------" -foreground "cyan"
  write-host "----------------------------------------------`n" -foreground "cyan"

  foreach ($currFullDestPath in $FullBDirs)
  {
    # loop over any full destination dirs available
    foreach ( $currSrcDir in ($SrcDirs.Keys) )
    {
      write-host "`n ***" -foreground "cyan"
      write-host " *** Processing $currFullDestPath\$($SrcDirs[$currSrcDir])" -foreground "cyan"
      write-host " ***`n" -foreground "cyan"
      MvMirror full $currSrcDir $currFullDestPath\$($SrcDirs[$currSrcDir])
    }
  }
}

# -- If partial backup dir available, do it
if ($PartBDirs.length -gt 0)
{
  write-host "`n`n----- PARTIAL BACKUPS PROCESS STARTED... -----" -foreground "green"
  write-host "----------------------------------------------`n" -foreground "green"

  foreach ($currPartDestPath in $PartBDirs)
  {
    # loop over any partial destination dirs available
    foreach ( $currSrcDir in ($SrcDirs.Keys) )
    {
      # If a full backup occurred more recently than last partial backup, empty partial dir before.
      if ( (Test-Path "$currPartDestPath\$($SrcDirs[$currSrcDir])\$LastPTSFile") -and (Test-Path "$currSrcDir\$LastFTSFile") )
      {
        if ((Get-Item "$currPartDestPath\$($SrcDirs[$currSrcDir])\$LastPTSFile").CreationTime -lt (Get-Item "$currSrcDir\$LastFTSFile").CreationTime)
        {
          write-host "Delete partial folder first"
#          Remove-Item doesn't work properly in recurse mode (even written in detailed help of it !) so here is proper way :
          Get-ChildItem $currPartDestPath\$($SrcDirs[$currSrcDir]) -recurse | Remove-Item -recurse -force
#          Note that second -recurse parameter is mandatory if you don't want to be prompted.
        }
      }        
      write-host "`n ***" -foreground "green"
      write-host " *** Processing partial $currPartDestPath\$($SrcDirs[$currSrcDir])" -foreground "green"
      write-host " ***`n" -foreground "green"
      MvMirror part $currSrcDir $currPartDestPath\$($SrcDirs[$currSrcDir])
    }
  }
}

write-host "`n`n             END - SUCCESS"
write-host "----------------------------------------------"
start-sleep -s 4
return

# ------------------------ EOF ------------------------------------
    Last edited by TanaT; 29 Jun 2012 at 09:13. Reason: Display nicer with colors.
      My Computer
    Quote Quote

  4. TanaT
    Posts : 3
    Windows 7 Ultimate x64
    Thread Starter
       New #3

    How to launch it with a desktop link.


    If you don't know how to launch powershell, follow these steps :

    1. Create a link on your desktop (right-click / new shortcut)
    2. Enter following path to the script :
    3. Code:
      powershell.exe "C:\Users\TanaT\Documents\Mes_scripts\mvbackup.ps1"

    You can now launch it by double-clicking the link.

    TanaT


    PS : Powershell is included in Windows 7, and there is version 1.0 available for XP.
      My Computer
    Quote Quote

 

  Related Discussions
I am trying to copy some photos (jpg's) from my hard drive to a sim card for display in digital frame. In the past (before Win 7), the date shown in Explorer for a photo on the hard drive was the same as the date shown in Explorer for the copied file on the sim card. Now, they are different! The...
I used a DriveWire - Universal Hard Drive Adapter (IDE / PATA / SATA to USB HDD Adapter) to hook up A 3.5" Hard Drive (Samsung model HD502HJ) to my desktop in an attempt to get my wife's files off her old desktop machine and merge them into mine. It all started off fine, the drive was recognized...
"0x80070057" error. I was simply trying to copy a folder or group of files to another hard drive. Hard drive to Hard drive, no SSD or External was involved. Any solutions to this issue? It literally refuses the copying to be performed ... I'm trying to copy folders/files from a Seagate...
I'm getting a lot of "Check Disk for Errors" and "this hard drive needs to be formatted before it can be used" error messages when plugging my external usb hard drives into my home pc which uses windows 7. I don't get any of these messages when I plug the same hard drives in at any of a number of...
Source - New Microsoft betas push "private cloud" strategy
Our Sites
Site Links
About Us
Windows 7 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 7" and related materials are trademarks of Microsoft Corp.

 © Designer Media Ltd
All times are GMT -5. The time now is 18:43.
Find Us