PHP script - indexed pages

Discussion in 'PHP' started by XandroZ, Feb 26, 2009.

  1. #1
    I want to make a php script that show the page that are not indexed in google.
    The script get the links from google then compare with the links in the website sitemap, make the difference and tell what pages are not indexed.

    I am searching for a tutorial, help about google api (get results and parsing from google results)
     
    XandroZ, Feb 26, 2009 IP
  2. nileshgund

    nileshgund Well-Known Member

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    116
    #2
    use Google analytics it solve all your problem :)
     
    nileshgund, Feb 26, 2009 IP
  3. jimbo2779

    jimbo2779 Active Member

    Messages:
    105
    Likes Received:
    3
    Best Answers:
    1
    Trophy Points:
    80
    #3
    Does the google API still exist?
     
    jimbo2779, Feb 26, 2009 IP
  4. nonee

    nonee Peon

    Messages:
    109
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I have a method that just scrapes normal Google results on a cron schedule (no API). It gets pretty sketchy if you have a site with 100k's of pages but it will eventually get done checking all of them. If your too lazy to make your own script, I may be willing to part with it if your price is right ;)
     
    nonee, Feb 26, 2009 IP
  5. XandroZ

    XandroZ Peon

    Messages:
    395
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I don't have a very big site, I want to make my own tools, and I am searching for a tutorial or something similar.
     
    XandroZ, Feb 27, 2009 IP
  6. amerigohosting

    amerigohosting Peon

    Messages:
    255
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Google is very hard to script. If you are going to do this, you can expect your IP address to get banned from google. This has happened to me several times.
     
    amerigohosting, Feb 27, 2009 IP
  7. XandroZ

    XandroZ Peon

    Messages:
    395
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #7
    There are many other php scripts for google; Why to get banned ?
     
    XandroZ, Feb 27, 2009 IP
  8. amerigohosting

    amerigohosting Peon

    Messages:
    255
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Well, i was a little more aggressive than those scripts (ie: indexing every site result for keyword "x", then indexing link:X, then site:X). I was accessing about 15 instances of google chewing away on this, and got temp-banned in about 35 minutes, so I stopped. Found other sources for my data (yahoo mostly).
     
    amerigohosting, Feb 27, 2009 IP