Go Back  HTML Forums - Free Webmaster Forums and Help Forums > WEBSITE DEVELOPMENT > Server Side Programming > PHP Programming
User Name:
Password:
 

Reply
Thread Tools   Display Modes
  View First Unread
 
Old 02-27-2009, 03:15 PM
  #1
nisim777
Battler (Level 3)
 
Join Date: Apr 2008
Posts: 21
iTrader: (0)
nisim777 is an unknown quantity at this point
Pulling Information from Others Sites

This question doesn't only pertain to PHP. How do I pull information from other sites without having access to their databases? Obviously I know that if the site is broadcasting through an RSS feed you can do it, but what about those that aren't? For example, I'll actually us an Android app. I have an app on my G1 called Craigsphone, which basically pulls all listings from my local craigslist and formats them in the app. Unless I'm wrong, craigslist is not broadcasting each post via RSS. Do they have a specific API that they allow use of, or is there a way that people are pulling this information?

The reason I ask in the PHP section, is because I would like to practice doing this on my site (I won't be stealing anyone's copyright information, I'm going to practice between two sites I own).

Thanks
nisim777 is offline   Add to del.icio.us Add to del.icio.us    Can you digg it?Can you digg it? Reply With Quote
Old 02-27-2009, 06:39 PM
  #2
paul_norman_81
Guru (Moderator)
 
paul_norman_81's Avatar
 
Join Date: Nov 2005
Location: Preston, England, UK
Posts: 1,044
iTrader: (0)
paul_norman_81 is a jewel in the roughpaul_norman_81 is a jewel in the roughpaul_norman_81 is a jewel in the rough
If you own the sites then I would suggest formatting the data in an xml file somewhere on server 1 (export it) and then using an authentication system grabbing it with server 2 (and parsing it).

If you don't have control of the servers then you are down to screen scraping. This isn't too hard and Perl has plenty of tools for the job (Mechanize and Toke Parser spring to mind). You can also write these tools in PHP without too much hassle - I did!
__________________
"Aut viam inveniam aut faciam" - I'll either find a way or make one

First Tutors | First Tutors: Music | First Tutors: I.T. | First Tutors: Languages | First Tutors: Business | First Tutors: Arts & Crafts | First Tutors: New Zealand
paul_norman_81 is offline   Add to del.icio.us Add to del.icio.us    Can you digg it?Can you digg it? Reply With Quote
Reply
KEEP TABS
SPONSORS
 
Boxedart

 
 


 
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
  
 
 
 



 
  POSTING RULES
 
 
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Thread Tools
Display Modes

Forum Jump

 

All times are GMT -5. The time now is 05:42 AM.

   

Mascot team created by Drawshop.com

Powered by vBulletin® Version 3.6.7
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.

Server Monitoring by ENIACmonitor 0.01
HTMLforums.com © Big Resources, Inc. Web Design by BoxedArt.com
vRewrite 1.5 beta SEOed URLs completed by Tech Help Forum and Chalo Na.