Posts Tagged ‘URLs’

Noobies Guide on How to Scrape: Part 2 – URLs, URL Variables, and using Live HTTP Headers

Wednesday, April 8, 2009 21:11 1 Comment

Understanding the fundamentals of how sites communicate with themselves, and how we communicate with them, is crucial in being able to reverse engineering a site for our scraper.   Luckily it’s pretty easy for the most part.
Anatomy of a URL

The protocol your using.
The website your trying to get to.  Although www is synonymous with the base [...]

This was posted under category: Automation, Blackhat, Noobie Scraping Guide Tags: , , , ,

Keeping urls clean with Prosper202 & PHP Sessions

Tuesday, November 25, 2008 17:21 1 Comment

I constantly try to envision through the eyes of the person whom  comes to one of my pages.  What could scare them off?
A pet peeve of mine personally is seeing some tracking variables up in the url.  Granted most people are retarded and don’t really know what all that gobbily gook really means.  That’s the [...]

This was posted under category: PHP Tags: , ,