|
Re: Need page source for a list of URLs. Anyone know of any program?
de Adam Piggott 06/07/2006 12:27
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Shani wrote:
> I need a program that can take a list of URLs and and save their source
> page ( html code) on my computer as a text file. Does anyone know of
> anysuch program.
Wget can do the job.
http://www.gnu.org/software/wget/
Once you've unzipped it you want to:
wget --force-directories -i filename.txt
This will have wget download each URL and put it into a directory generated
from the host name, i.e.:
C:www.bbc.co.ukindex.html
C:www.example.comindex.htm
The URLs must be prefixed with http:// for the input file to be understood
correctly.
HTH
Adam Piggott, Proprietor, Proactive Services (Computing).
http://www.proactiveservices.co.uk/
Please replace dot invalid with dot uk to email me.
Apply personally for PGP public key.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (MingW32)
iD8DBQFEhqn57uRVdtPsXDkRAv8NAJ9M4IJfnmOLEQKsjyIjxH7/vGN3xwCeN+8u
X5oNNyRbvY9qxQDaVmblWBw=
=mbni
-----END PGP SIGNATURE-----