Yes, but for a single library instead of all libraries, you would need to create a shortcut of the library and place it in a new folder, then pin that new folder to the taskbar as a toolbar. Next, pick up at step 4 in the
tutorial unchecking both "Show Title" & "ShowText", and check "Large Icons" for it.
It's a bit of a workaround, but it will do the trick.