Method for extracting images systematically from a website

[ZiKi]

Hey I'm not sure if this the right place to ask this. I'm working on a new shopping cart for a web store and I need to extract all the images from the old store as they appear on the page and rename them chronologically in the order which they appear. For instance I have 9 items on one page. Each items picture is named after the item. I want to save them from top to bottom and give them names like SKU-001 to SKU-009. The important thing is they need to be named in the order which they appear so that when I upload them, they are associated with the right product.

Can anyone help, and if you cannot, can you link me to another forum that can? Thanks much in advance

 

[GodlessAstronomer]

What technology do you want to use? You could write a simple Java or .NET application to achieve this.

 

[ZiKi]

Well I was wondering if there was software out there already that did this. It sounds like something that could be done in linux or something

 

[dinkumthinkum]

Typically wget or curl are the popular programs for downloading website data. Then you can hack up a quick script to do the rest.

 

[DaveSimmons]

There are many "spider" and website download applications, but matching items to order on the page is not something most users need.

It sounds like you aren't a programmer, so if you can't do the scripting for scraping yourself you can try an existing spider or six and look for one that happens to behave close to the way you want.

 

[Cogman]

FTP into the old website (or however you would connect to the site before hand), find anything ending with jpg, png, gif, ect, and copy. If you are getting images from your old site, you shouldn't need to copy them through the webserver.

 

[Net]

what's your time frame? if I have the time I can modify my spider to generate a script for you.

here is what the script would look like:

#!/bin/bash

urls[0]="http://www.jpgheritage.org/sitebuildercontent/sitebuilderpictures/jpg2rh.jpg"
urls[1]="http://www.astronomy2009.org/static/resources/iya_logo_final_b&w.jpg"

for ((c = 0; c <= 1; c++ ))
do
    wget -O SKU-00$c.jpg ${urls[$c]}
done

if your going above 9 then use a nested for loop (SKU-$a$b$c.jpg)

if you can find something that's already done to parse out the .jpg links to a text file then you can open that text file in vim and do:

:g/^/exe ":s/^/urls[".line(".")."]=\""
:%s/$/\"/

that will surround all the urls with urls[1]=" "
urls[2]=" "
etc...

then copy and paste the results of that to the script above and run it