Multi Link Extractor?

raya2 · 15 Jun 2012

Hi,

I want to extract urls from some page links But any link extractors that I found, can only extract from one page each time. And I want to extract urls from more than 1000 links.

Is there any link extraction tool that have multi page support (for example 100 or 1000 links at the same time)?

For example I want to extract this image link (http://img.booru.org/card//images/13...6366ff7a55.jpg) from this link page (http://card.booru.org/index.php?page...=view&id=12886)

and here is tool that can extract only from one page each time
Link Extractor :: Webmaster Toolkit

Thanks

richnrockville · 16 Jun 2012

Raya2, you might want to take a look at the page source and then the individual links would normally show up
quite easlily.

I wrote a program in intrepreted basic that searched for the http:// and then extracted the lines to a separate
file and it was pretty easy to take a look at them

By using the view source when on a web page, If the links show up there. you can save it as a text file making sure that wrap text is turned off, then you can sort it and pick out the url's.

Rich

PS: some pages only show shortcuts to the links like href=

or
src='/galeria/_images/89d28f5338c907ffe956129672dc2df7/212 - tagme.jpg'

which is a relative image source on the web page that your looking at.

It is very difficult to capture the images when relative source is used but not impossible.

Edited after thinking more about the source of your message

Dwarf · 16 Jun 2012

Take a look at these. They're not free ($49 and $99 respectively), but they both offer a trial so you can see if they are suitable for your needs.

Extract URL 1.5 - Powerful URL Extractor / Meta Tag Extractor
Win Web Crawler - Powerful WebCrawler, Web Spider, Website Extractor

raya2 · 16 Jun 2012

richnrockville said:

Raya2, you might want to take a look at the page source and then the individual links would normally show up
quite easlily.

I wrote a program in intrepreted basic that searched for the http:// and then extracted the lines to a separate
file and it was pretty easy to take a look at them

By using the view source when on a web page, If the links show up there. you can save it as a text file making sure that wrap text is turned off, then you can sort it and pick out the url's.

Rich

PS: some pages only show shortcuts to the links like href=

or
src='/galeria/_images/89d28f5338c907ffe956129672dc2df7/212 - tagme.jpg'

which is a relative image source on the web page that your looking at.

It is very difficult to capture the images when relative source is used but not impossible.

Edited after thinking more about the source of your message

I don't think that it is very difficult.
Here is another software that can extract links one by one But I need a tool that can do it at least 1000 by 1000:

AddrView v1.01 - extract URL addresses from HTML pages

raya2 · 16 Jun 2012

Dwarf said:

Take a look at these. They're not free ($49 and $99 respectively), but they both offer a trial so you can see if they are suitable for your needs.

Extract URL 1.5 - Powerful URL Extractor / Meta Tag Extractor
Win Web Crawler - Powerful WebCrawler, Web Spider, Website Extractor

Thanks but:

- Extract URL 1.5 can't extract the image link. Just try the Image 212: tagme

- Win Web Crawler seems a little promising but I couldn't extrat my desire image link with it. Maybe I did some wrong settings, Can you exract image link from http://www.animedia.com.mx/galeria/post/view/212 ?

raya2 · 01 Apr 2014

Ok. After about 2 years, Maybe someone know a good multi link extractor now?

MilesAhead · 01 Apr 2014

raya2 said:

Ok. After about 2 years, Maybe someone know a good multi link extractor now?

I would try posting a request on the forum below. If someone knows of an existing program that does it they will post. Alternatively, if someone thinks they can code it in a reasonable time, they may volunteer.

Post New Requests Here - DonationCoder.com