Debt Consolidation - Debt Consolidation - Debt Consolidation - Bet365 bonus - Free Animated Greetings

PDA

View Full Version : Automated reciprocal link checker


jarvi
Mar 16th 2004, 10:14 pm
Can anyone point me in the direction of a good tool (preferably free, of course) that would allow me to check my link partners, for a link back to my site. I guess I would just like to be able to run through my reciprocal links pages and be able to tell if there is a link back from each of the sites I link to.

Happy to expand or think about the specs a bit more if required, but I am sure there is something already out there.

I know linksmanager does it but I'd rather just stick with staight html on my pages and just automate the checking not the adding.

Thanks,

digitalpoint
Mar 16th 2004, 10:19 pm
I thought about making a free web-based system for people... but then I shied away from it because I didn't want digitalpoint.com to be somehow branded as a site that condones and helps reciprocal linkers (not that I personally have anything against them).

That being said, if you have a list of the pages your links *should* be on, I probably could whip you up a script to do it for you (I don't want to get into spidering whole sites looking for a link though... so you would need to know where the link is supposed to be).

If you have the list in a text file, I could make you a PHP script that did it for you if you want.

- Shawn

awall19
Mar 16th 2004, 10:51 pm
I think that would be an extremely useful script for many people.

Luke
Mar 17th 2004, 12:23 am
Ive made a PHP script that checks recipical links from them awhile back its actually quite an easy script to make, which suprises people, I can make just about anything with PHP! :D
If digitalpoint turns out to busy or you would perfer a ready made developed one then give me a shout.

digitalpoint
Mar 17th 2004, 12:29 am
Go for it... If you want, zip it up and attach it to this thread if you want anyone to be able to grab it.

Wouldn't take me more than 5 or 10 minutes to do, so it's not a time thing... but if you already have one, then it's all you. :)

- Shawn

Luke
Mar 17th 2004, 1:07 am
Righto, Just gonna VNC to home then ill attach it here.

compar
Mar 19th 2004, 5:04 pm
Luke,

So where is it already?

jarvi
Mar 28th 2004, 2:37 am
OK, so I found PHPCrawl over at Sourceforge and managed to get it to work. Even managed to modify it to run through a mySQL database and return pages where it finds a link. My problem is that once I confirm a link at the site I want to move on to the next site. Can't seem to get this to work with my very limited knowledge of PHP. Normally I just adapt other stuff.

The code is below and I don't think you need to see all the other parts. I just want to be able to move to the next site if foo.com is found in the site in the $row[LinkURL] array in which the content is in the array $page_data[source]. Can anyone help? (Sorry don't know how to put code in any other way)


<?php

set_time_limit(10000);

include("classes/phpcrawler.class.php");
include("classes/phpcrawlerutils.class.php");
include("dbConnect.inc");

class myCrawler extends phpcrawler {

function handlePageData($page_data) {

if ($page_data[received]==true)
{
if ( preg_match("/.*www.foo.com.*/", $page_data[source]) )
{
echo "found at ".$page_data[url]."<br>";
}
}
flush();
}

}

mysql_select_db("foo_reciprocal");

$result = mysql_query('SELECT * FROM links ORDER BY ID');

while ($row = mysql_fetch_array($result))
{
$crawler = &new MyCrawler();

$crawler->setURL($row[LinkURL]);

$crawler->addReceiveContentType("/text\/html/");

$crawler->addNonFollowMatch("/.(jpg|gif|png)$/ i");

$crawler->setCookieHandling(true);

// $crawler->setTrafficLimit(1000 * 1024);

$crawler->go();
$report = $crawler->getReport();
}

echo "Summary:<br>";
if ($report[traffic_limit_reached]==true)
echo "Traffic-limit reached <br>";

echo "Links followed: ".$report[links_followed]."<br>";
echo "Files received: ".$report[files_received]."<br>";
echo "Bytes received: ".$report[bytes_received]."<br>";

// ?>

misohoni
Mar 30th 2004, 9:20 pm
Try this one:
http://www.linkpopularity.com

jbgilbert
Mar 31st 2004, 6:57 am
hey shawn,
this is all getting too complicated... you said you could (in 10 minutes) build a tool? time for you to step in and give us something that actually works and does not require a degree in php or perl...

digitalpoint
Mar 31st 2004, 9:31 am
Nothing too fancy...


<?php

$mydomain = "www.yourdomain.com"; // Set this to your domain

$list = file_get_contents("sites.txt");
$urls = explode ("\n", $list);

echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";

foreach ($urls as $url) {
if (strlen ($url)) {
echo $url . "<B><FONT COLOR=";
if (strpos (file_get_contents($url), $mydomain) != FALSE) {
echo "GREEN> Found";
} else {
echo "RED> Missing";
}
echo "</FONT></B><BR>";
}
}
echo "</FONT>";

?>
Reads a file (in the same directory) named sites.txt which is a list of URLs to check (separated by a carriage return).

- Shawn

tenergy
Apr 1st 2004, 11:27 am
How effective is this link exchange? Does anyone can tell for sure that the return justify the required effrots.

Thanks

www.all-battery.com

digitalpoint
Apr 1st 2004, 11:34 am
It's not a specific link exchange... you would need to link exchange with your own partners.

- Shawn

jbgilbert
Apr 6th 2004, 4:06 pm
Shawn,
Your "nothing too fancy" reciprocal links checker is pretty good. But, I'd really like to see a few simple things added if it's not too much trouble:

1) Is there a way to speed up his reaction to a 404 page:
http://www.southtexastrading.com/links.htm Warning: file_get_contents(http://www.southtexastrading.com/links.htm): failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found in /home/finalone/public_html/@linkcheckerAA/link-checker.php on line 13
RED> Missing

2) Could you make it so the site.txt file could have a comments in it that don't get processed?

For example if a line in site.txt reads
http://www.adomain.com

I'd like to have a comment on it like:
http://www.adomain.com|emailed buba@adomain.com on 4/6/04....

Don't need the comment processed (just ignored) by the php script.



handle add to the site file

digitalpoint
Apr 6th 2004, 4:20 pm
<?php

    $mydomain = "www.yourdomain.com"; // Set this to your domain

$urls = fgetcsv ("\n", 99999, "sites.txt");

ini_set (default_socket_timeout, "5");

    echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";
    
    foreach ($urls as $url) {
        if (strlen ($url) && $url{0} != "#") {
            echo $url . "<B><FONT COLOR=";
            if (strpos (file_get_contents($url), $mydomain) != FALSE) {
                echo "GREEN> Found";
            } else {
                echo "RED> Missing";
            }
            echo "</FONT></B><BR>";
        }
    }
    echo "</FONT>";

?>

That should do it... I didn't test it though, just off the top of my head. If a line starts with "#" it will be ignored and the socket timeout set to 5 seconds.

- Shawn

jbgilbert
Apr 6th 2004, 6:38 pm
Better test dude - has errors.

I need to be able to put the comment on the same line as the url OR on a seperate line.

It turns out that the old script seems to deal with it better than the new one?????????????????????????

digitalpoint
Apr 6th 2004, 6:54 pm
Not sure... works for me...

checker.php
<?php

$mydomain = "www.domain.com"; // Set this to your domain

$list = file_get_contents("sites.txt");
$urls = explode ("\n", $list);

ini_set (default_socket_timeout, "5");

echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";

foreach ($urls as $url) {
if (strlen ($url) && $url{0} != "#") {
echo $url . "<B><FONT COLOR=";
if (strpos (file_get_contents($url), $mydomain) != FALSE) {
echo "GREEN> Found";
} else {
echo "RED> Missing";
}
echo "</FONT></B><BR>";
}
}
echo "</FONT>";

?>

sites.txt
http://www.digitalpoint.com
#comment
#blah
http://www.site2.com
http://www.site3.com


Attempts to only do the 3 sites...

- Shawn

jbgilbert
Apr 6th 2004, 7:10 pm
Yep, you are right.

But, I decided I liked the original script because if you code the site.txt like this:
http://www.domain.com #-- emailed on 4/12

it results in this

http://www.domian.com/links.htm #---emailed on 4/12 Found


The comment is reported and I kinda like that. Plus the comment can be on the same line as the url!

With the new script any comments on the same line as the URL are not reported......

toddieg
Apr 11th 2004, 10:44 am
i use a great free tool called swapware..it manages, and checks your reciprocal links..super easy to install too. you can download it here

http://www.bookfinder.us/swapware_demo/about.htm

or see it in action on my site http://www.sitetutor.com/linkexchange/

-Todd

0BroadProspect
Apr 14th 2004, 2:20 am
try mine http://www.link-swapper.com it is new but I am getting many new users since I started it
it is free and has the functionality of all the paid ones, if something is missing, let me know and I will add it.
/BP

jarvi
Apr 14th 2004, 8:38 pm
Shawn, I realised I never thanked you for your help with this. In the end I abandoned the original one (could spider the whole site) and decided to go with your version and just add a field to my DB for the reciprocal link page. Sure it means if the link changes then I can't find it, but it stops the need to suck so much information when in the majority of cases I know where the link should be.

Thanks,

billbrandes
Apr 20th 2004, 10:09 am
Hi,

I liked the idea of the script and was looking for one myself. I tried Shawn's code and I can't seem to get it to work. Here is the response I get from the first two links:

www.botanical-candle.com/links13.html Warning: file_get_contents(www.botanical-candle.com/links13.html ) [function.file-get-contents]: failed to create stream: No such file or directory in C:\Domains\accerisrates.com\wwwroot\Zlinkchecker\recipcheck.php on line 13
RED> Missing
www.superiorholidays.com/superiorhols/resources/modify.html Warning: file_get_contents(www.superiorholidays.com/superiorhols/resources/modify.html ) [function.file-get-contents]: failed to create stream: No such file or directory in C:\Domains\accerisrates.com\wwwroot\Zlinkchecker\recipcheck.php on line 13
RED> Missing

The red and green font color does not appear also and I don't know why it is listing my "C" drive. Any help would be appreciated.

Thanks,

Bill

digitalpoint
Apr 20th 2004, 10:12 am
Your PHP setup would need to support URL fopen (which is on by default):

http://us2.php.net/manual/en/ref.filesystem.php#ini.allow-url-fopen

- Shawn

billbrandes
Apr 20th 2004, 5:28 pm
Your PHP setup would need to support URL fopen (which is on by default):

http://us2.php.net/manual/en/ref.filesystem.php#ini.allow-url-fopen

- Shawn
I had the url fopen turned on and I am still getting the error as below:

Checking back links to www.accerisrates.com....
www.botanical-candle.com/links13.html Warning: file_get_contents(www.botanical-candle.com/links13.html ) [function.file-get-contents]: failed to create stream: No such file or directory in C:\Domains\accerisrates.com\wwwroot\zlinkchecker\recipcheck.php on line 13
RED> Missing
www.superiorholidays.com/superiorhols/resources/modify.html Warning: file_get_contents(www.superiorholidays.com/superiorhols/resources/modify.html ) [function.file-get-contents]: failed to create stream: No such file or directory in C:\Domains\accerisrates.com\wwwroot\zlinkchecker\recipcheck.php on line 13
RED> Missing
www.onlinebusinesssecretsrevealed.com/Business-Services.htm Warning: file_get_contents(www.onlinebusinesssecretsrevealed.com/Business-Services.htm ) [function.file-get-contents]: failed to create stream: No such file or directory in C:\Domains\accerisrates.com\wwwroot\zlinkchecker\recipcheck.php on line 13
RED> Missing

Nothing seemed to change.

digitalpoint
Apr 20th 2004, 5:36 pm
What version of PHP are you using?

- Shawn

billbrandes
Apr 21st 2004, 11:10 am
Using PHP Version 4.3.1

digitalpoint
Apr 21st 2004, 11:41 am
Well to be honest, I'm not sure... but for whatever reason the it's not trying to do it as a URL like it should. So it seems that the URLs within fopen is not enabled (or not working).

- Shawn

auberouge
May 21st 2004, 10:23 pm
I'm having the same problem as Bill. Curious. Will post when we get it figured out, unless you've beat us to it??? ;)

BTW, cool tool, thanks for posting!!! I've been searching all day for a simple script that doesn't try to take over my links page...

jbgilbert
May 30th 2004, 3:49 pm
Shawn,
Following is the link checker script you wrote. It works as long as the people are pointing to your root domain only.

Would it be hard to adjust so that if the linking page pointed to "any" page on your root domain it would respond positively?


<?php

$mydomain = "www.mydomain.com"; // Set this to your domain

$list = file_get_contents("sites.txt");
$urls = explode ("\n", $list);

ini_set (default_socket_timeout, "12");

echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";

foreach ($urls as $url) {
if (strlen ($url)) {
echo $url . "<B><FONT COLOR=";
if (strpos (file_get_contents($url), $mydomain) != FALSE) {
echo "GREEN> Found";
} else {
echo "RED> Missing";
}
echo "</FONT></B><BR>";
}
}
echo "</FONT>";

?>

digitalpoint
May 30th 2004, 3:52 pm
It should work at any point in the domain, since it's just looking for the string.

jbgilbert
May 31st 2004, 7:53 am
You are correct again -- my mistake...

Geir
Jun 13th 2004, 11:08 am
Shawn,
Thanks for providing this great forum and all of these great tools for free - I really do appreciate it.

I tried using your script, but get the following error:

Fatal error: Call to undefined function: file_get_contents() in /usr/local/psa/home/vhosts/4freephonebillanalysis.com/httpdocs/links/test.php on line 5

Basically, to me this is a foreign langauge (= I know nothing about scripting :confused: ), so any suggestions would be appreciated.

:) Geir

digitalpoint
Jun 13th 2004, 12:39 pm
You need PHP version 4.3 or higher for the file_get_contents function.

Geir
Jun 13th 2004, 12:43 pm
Thank you for the quick reply!

Not sure what version my host is using, but is it possible to do this same thing on an older php version?

:) Geir

digitalpoint
Jun 13th 2004, 12:47 pm
Yeah, you could probably get around it by reading it in with the fopen() command, but would require a little additional code.

Geir
Jun 13th 2004, 1:07 pm
Thank you,
I will check with my host and ask if they will be updating the php version.

:) Geir

DragonDesigns
Jun 23rd 2004, 5:43 pm
I wonder, how hard it would be to mod the script to search every page on a domain for the link? I think that would be a really cool feature!

Dave.

North Carolina SEO
Jun 23rd 2004, 5:54 pm
Shawn,

It just proves that 'no good deed goes unpunished'...

Thanks for all you do! :cool:

digitalpoint
Jun 23rd 2004, 5:58 pm
I wonder, how hard it would be to mod the script to search every page on a domain for the link? I think that would be a really cool feature!

Easy, but not going to happen... I don't want to make a script that really is a spider. :)

jarvi
Jun 23rd 2004, 8:43 pm
If you are looking for a spider that is reasonably easy to use the have a look at http://phpcrawl.cuab.de/ With little knowledge I was also able to adapt it to stop crawling once it had found the link. In the end though I stopped testing it because it is much better from a bandwidth point of view to start from the last known place and if it can't find it there, then start looking at the rest of the site. This was a bit above my knowledge level. At least with this one you can limit the amount it crawls per site but that kind of defeats the purpose if you are looking for a reciprocal link checker.

WilliamC
Jun 24th 2004, 8:28 pm
he said he would make a free tool. He did that. It is not his fault if you can not use a script.

WilliamC
Jun 24th 2004, 8:50 pm
ok, here are 2 recip checkers I wrote in perl. both come with basic instructions for usage. Either could be made into a web app easily enough, but if you do this, please give credit where credit is due.


First one:
This is a commandline unix application, so it wont work in windows, but you can use it from SSH on your webserver.

What it does:
reads a text file of websites to check for your link.
spiders the entire website looking for your link.
if it finds your link it tells you.

http://4retards.com/linkcheck.zip


Second one:
Gordon asked me to write a recip link checker that spiders your site looking for all outbound links, then follows them to see if your domains link is on their site somewhere. Thats what this second recip checker we have written does. And yes, it is free to use, but not free to modify, sell, make derivations of, etc.

http://www.link-finders.com/recip-spider2.zip

One thing to note about the second one, if the site you spider has a link to google, yahoo, or other large site, this sucker could take a good long time to run fully. :)
Enjoy!

ResaleBroker
Sep 7th 2004, 8:04 am
Great script! It works right out of the gate.

In case I haven't said it before, thanks for everything Shawn!

david_sakh
Sep 8th 2004, 2:16 pm
" I didn't want digitalpoint.com to be somehow branded as a site that condones and helps reciprocal linkers"

what's so wrong about checking up on who's linking back to you. It only seems fair that you should know...

digitalpoint
Sep 8th 2004, 2:17 pm
It has no use for me, because I don't ask people to link to me to begin with.

fluke
Sep 10th 2004, 1:29 am
do you think luke ever got home?

jbgilbert
Sep 10th 2004, 7:41 pm
Shawn's little link checker has served me well, but I've found some "weird" issue... can anybody help a bit? It's just not finding the link even though I know it is there?

1) here is the script from Shawn:
<?php
$mydomain = "www.verticaldirectories.com"; // Set this to your domain
$list = file_get_contents("sites.txt");
$urls = explode ("\n", $list);
ini_set (default_socket_timeout, "15");
echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";
foreach ($urls as $url) {
if (strlen ($url)) {
echo $url . "<B><FONT COLOR=";
if (strpos (file_get_contents($url), $mydomain) != FALSE) {
echo "GREEN> Found";
} else {
echo "RED> Missing";
}
echo "</FONT></B><BR>";
}
}
echo "</FONT>";
?>

2) here is the sites.txt file:
http://www.frequentlyasked.info/Point_Of_Presence/Internet/
http://www.frequentlyasked.info/Point_Of_Presence/Internet/

3) AND here is what it keeps saying????

Checking back links to www.verticaldirectories.com....
http://www.frequentlyasked.info/Point_Of_Presence/Internet/ Missing
http://www.frequentlyasked.info/Point_Of_Presence/Internet/ Missing

Samson
Sep 13th 2004, 11:09 am
Hey Shawn, great code. I hope this question isn't too lame, but can I have the sites.txt located somewhere remote on the net? If so, how would I do that? thanks.

Samson
Sep 13th 2004, 11:26 am
ok, i figured it out on my own, and the easiest solution actually worked, and now i feel dumb for having asked to begin with. i replaced "sites.txt" with the complete URL to the remote site list, and everything was peachy. thanks

Samson
Sep 14th 2004, 12:27 pm
Much like JBGilbert above, I'm getting some false negatives from this script, with no discernable reason why. JBGilbert, have you figured it out?

ferret77
Jan 3rd 2005, 8:32 am
just digging up an old thread

I put togather a recip links checker tied to a directory

but it seems to properly check some of the time, which sort of sucks

The directory is pretty simple but works pretty well except for the recip checker

it will run link directories for mulitple sites in multiple locations, in php

its pretty ghetto it just uses the snoopy class , not an xml feed or something more creative

if any of you know how to fix it or want to give it a whirl I will share the code with you

mine just uses the snoopy class to grab the links from an url

and works great, most of the time, but that other part of the time is screwing with me

Bermy
Jan 10th 2005, 9:23 am
Hi everyone,

I just start in PhP writting and I try the script of Shawn's everything goes ok with 2 links but when I put more than 2 it found the first and last link but all the middle link does find it! What's wrong? All the links below as been check and link back but the script does'nt find it all!!! Could someone help me? Thanks

<B>Checking back links to www.tekclick.com/search/index.php....</B><P><FONT SIZE=-1>http://www.play-free-slots-games-online.com/links/links13.html<B><FONT COLOR=GREEN> Found</FONT></B><BR>http://www.dvdbasics.co.uk/links2.html
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://www.millionsaver.com/links/links10_2.htm
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://www.play-free-slots-games-online.com/links/links13.html
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://www.herbalicious.com/partners10_2.htm
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://links.sarasotagroup.com/links9.html<B><FONT COLOR=GREEN> Found</FONT></B><BR></FONT>

++++++++++++++++++++++++++++

here is my code script:

++++++++++++++++++++++

<?php

$mydomain = "www.tekclick.com/search/index.php"; // Set this to your domain

$list = file_get_contents("sites.txt");
$urls = explode ("\n", $list);

ini_set (default_socket_timeout, "12");

echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";

foreach ($urls as $url) {
if (strlen ($url)) {
echo $url . "<B><FONT COLOR=";
if (strpos (file_get_contents($url), $mydomain) != FALSE) {
echo "GREEN> Found";
} else {
echo "RED> Missing";
}
echo "</FONT></B><BR>";
}
}
echo "</FONT>";

?>

ian_ok
Jan 10th 2005, 10:44 am
What a great thread this is...

Tested and works....now going to work on implementing it on my links page, so when someone ask's to link to me it checks the site they are putting my link onto and also add's the site to the text file so for future checking.

If I have any luck I'll post code here.

Ian

Bermy
Jan 10th 2005, 11:00 am
hi, I'm newbie and trying to implement a new fuction in the Shawn's script!

Is there a way to implement a function that we could add a link direct into the .txt file without passing true the ftf program to update the txt file. So we could add link direct from my admin panel? Does someone have a clue?

I try this but still not work it add the new data but doesn't read it:

<?php

$EmailAd = $_POST["email"];
$Subs = $_POST["sub_"];

if ($Subs=="Sub"){

$fp = fopen("sites.txt", "a") or die("Error creating/writing to new file.");
fwrite($fp, "\r\n" . $EmailAd);
fclose($fp);

}

echo "Thank you for subscribing! <a href=\"pagename.php\">Click here to return.";
echo "More text...";

?>

Trance-formation
Jan 12th 2005, 6:34 am
Hi everyone,

I just start in PhP writting and I try the script of Shawn's everything goes ok with 2 links but when I put more than 2 it found the first and last link but all the middle link does find it! What's wrong? All the links below as been check and link back but the script does'nt find it all!!! Could someone help me? Thanks

Is this a consistent result? Does it happen each time you run the script?

Have you tried increasing the default time out value?

Trance-formation
Jan 12th 2005, 6:36 am
hi, I'm newbie and trying to implement a new fuction in the Shawn's script!

Is there a way to implement a function that we could add a link direct into the .txt file without passing true the ftf program to update the txt file. So we could add link direct from my admin panel? Does someone have a clue?

I try this but still not work it add the new data but doesn't read it:


I would suggest using a mySQL database rather than a text file. I've adapted the script in a similar way (subscribers to my www.training-directory.org.uk site input the location of their link back and the script pulls that from the database to check) and I reckon it's far more user friendly than reading and writing text files :)

Bermy
Jan 12th 2005, 12:40 pm
I've adapted the script in a similar way ... and I reckon it's far more user friendly than reading and writing text files

Ok, so I did you do that? Could you help me to adapt the script so I could use a mySQL database rather than a text file? I'm suggest starting in PHP so any help will be welcome!

ferret77
Jan 12th 2005, 3:27 pm
I got mine working

feel free to test it out www.travelpromote.us/addsite.php

checks links
trade on mulitple sites
trade multiple sites wiht multiple sites
have your sites be hosted on another servers and run all the links pages of one central db

just goes and get the html of the link page and parses thru it

the problem I had was not looking for varations of urls wiht "/" on the end

also I need to fix the regex to not only look for "a href" but like a * href

or something becasue people put the css classs definition between the a href sometimes, that and some people don't enclose the url in quotes

I don't that other version works becasue the

echo file_get_contents('http://www.cnn.com');

doesn't seem to work on all urls

Trance-formation
Jan 12th 2005, 5:00 pm
Ok, so I did you do that? Could you help me to adapt the script so I could use a mySQL database rather than a text file? I'm suggest starting in PHP so any help will be welcome!
OK how familiar are you with mySQL... I'll happily send across any scripts I'vewritten, but its useful to knopw where I need to begin (and hey... I'm making this shit up from the online manuals:))

Bermy
Jan 13th 2005, 7:30 am
Thanks Trance-formation, you ask me OK how familiar are you with mySQL... I'm just at the beginning, I understsand how it work and how to install a PHP script but dont ask me to find a mistake are to write a PHP script. By the way, Thanks ferret77I I add try your script and It look great. how does it work? I understand that it read a excel (CSS) fill but for the rest how did you adapt the Shawn's script... could you send me the PHP script that you adapt. It could help me! I have try so many thing on the net! You could go on my directory at http://www.tekclick.com/search/index.php and tell me if it is possible to adapt your script to my directory. Many Thanks!

Regard

ferret77
Jan 15th 2005, 1:54 pm
my script uses the snoopy class which just contains a bunch of functions for "scraping" webpages

the file_get_contents function didn't work for me on some urls

I don't really know why

my script stores all the info in a mysql db also

dfsweb
Feb 5th 2005, 4:36 am
What a great thread this is...

Tested and works....now going to work on implementing it on my links page, so when someone ask's to link to me it checks the site they are putting my link onto and also add's the site to the text file so for future checking.

If I have any luck I'll post code here.

Ian

Hi,
I gave it a quick shot (attached file). It's working for me, although I haven't edited it to get fancy error messages etc. Plus, I am sure you can code this with only half the code, instead of the duplicate code but I just can't be asked at 1:16am in the morning!! It works fine though and sends an email to the user as well as the webmaster. It doesn't automatically add the URL to sites.txt though (although this is not too tough to add) as I prefer to check my links before I add them to my site or the "sites.txt" file. This script is working on my site too, here:
Website submission page (http://links-directory.newzealandphotography.co.nz/submit-your-website.php)


Change the following things to make this work:

Replace "www.newzealandphotography.co.nz" by your URL.

Replace "http://links-directory.newzealandphotography.co.nz/submit-your-website.php" by your links page's full URL

Change listings@newzealandphotography.co.nz to your email address

Customise the emails for your own use, change my signature to yours etc.

You will see that the email that is sent to the webmaster automatically contains the text for the "sites.txt" file, you can cut and paste this text into the file

It also contains the HTML code for creating the link, you can copy and paste this into your web page. Hope this helps! (I am going to bed now)

Oh, and the most important step of all:
Create a link from your home page to my website :D Just kidding!!

carowan
Feb 8th 2005, 8:32 am
This is awesome! I just manually checked my links page last week for the first time and over 50% of my outbound links on a PR5 page weren't reciprocated any longer. Moving forward I will use a tool to check weekly.

dchoe
Feb 8th 2005, 10:26 pm
I kinda made my own link checker and have it so it'll automatically check once a week for reciprocation and will remove unreciprocating links

sabreakway
Feb 11th 2005, 5:16 am
Possible anyone have a similar ASP script? Not familiar with PHP.

Would be appreciated!!

dead-links
Mar 14th 2005, 3:39 pm
As this thread is about reciprocal link checker, I would like to point one that also checks the page rank, tells the number of links, shows a web thumbail, and also shows you the anchor text!

http://www.recip-links.com

TheWebJunkie
Mar 29th 2005, 11:07 am
Ive seen shawn posted his code, and alot of ppl had errors and a few mods where made.

Is someone willing to rebuild all the code into 1 nice script ?

alias420
Mar 29th 2005, 11:15 am
Does anyone know about a program that automatically crawls a site looking for links back to a certain site? I'm not looking to check reciprocation, I want to make sure the one way links I pay for are always linking and can't be bothered to code my own right now. Anyone know something that would help?

mrdjkcool
Mar 30th 2005, 8:42 am
If you want a software program try www.cyberspacehq.com and get ADDWEB. Its quite helpful for this.

sharpweb
Jul 5th 2005, 8:08 pm
Well, none of the solutions really worked for me so I went ahead and made my own. I got a little carried away and have basically set it up so that my clients can use it as well. I've also decided to set it up so anyone can use it. So yup, i'm offering it for FREE to anyone that wants to check it out. Even if you're just curious have a look and let me know what you think.

Sharp Link Manager is FREE software that makes keeping your links page upto date easy. Unlike the bigger link directory solutions, Sharp Link Manager is targeted towards small websites with simple needs.Here is what it features:
# Writes a links page based on the links you create
# Allows you to search for sites that are willing to link to yours
# Allows you to create three different types of links

* Link to another site only
* Link Exchange
* Link to your site only

# Lets you check to make sure a site links back to yours
# Lets you search their site to find a link to yours
# Lets you send custom emails to their website to inquire about your link


http://www.sharpwebservice.com/link_manager/index.php

Thanks,
Chris

swoop
Jul 8th 2005, 1:54 pm
Well, none of the solutions really worked for me so I went ahead and made my own. I got a little carried away and have basically set it up so that my clients can use it as well. I've also decided to set it up so anyone can use it. So yup, i'm offering it for FREE to anyone that wants to check it out.Thank you Chris, and also to everyone else who created these tools!

SixDeep
Sep 1st 2005, 7:55 pm
Hi everyone, I know this is an old thread, but I wanted to share this script and how I have modified it for mysql instead of a flat file. I set this up so it works like this;

On some php encoded page, you have a link to view your link partners record. You need to have an existing mysql table. To make the link, do something like this

require "../dbconnect.php";//db connection script or your standard db connection commands
$result = mysql_query("SELECT * FROM table");
$row = mysql_fetch_array($result);
echo "<a href="siteview.php?link='.$row['table id'].'">View link</a>";

The page "siteview.php" will need to have 2 things going on right off the bat. 1 is to establish a connection to your db in this manner

require "../dbconnect.php";//db connection script or your standard db connection commands
$result = mysql_query("SELECT * FROM table WHERE id = '$link'");
$row = mysql_fetch_array($result);

Ok, the 2nd thing youre going to want to do is set up a hidden field somewhere on the page. Some people say its not necessary, but I just do it so if I need to troubleshoot, I can just echo it somewhere on my page and I can verify that the correct record id is being displayed thus telling me that the variable passed correctly. So throw this somewhere on your page;

<input type=hidden name="con_id" value="<?php echo $link; ?>">

Now within your table, have a field dedicated to storing the specific URL where the linking partners page and where your link can be found. For the sake of argument, we'll call this field linkback. Now onto the actual script;


$siteurl = $row['linkback']; // this is the webpage the link should be found on
$recip = "http://www.whatever.com"; // Your URL
if (backlinkCheck($siteurl, $recip)) {
echo "Backlink is ACTIVE";
} else {
echo "Backlink is INACTIVE";
}

function backlinkCheck($siteurl, $recip) {
$arrText = file($siteurl);
for ($i=0; $i<count($arrText); $i++) {
$text = $text . $arrText[$i];
}
if (eregi($recip, $text)) {
return true; // set true if there is a backlink
} else {
return false; // set false if backlink is missing
}
}

Have fun!

WilliamC
Sep 1st 2005, 9:23 pm
Thanks for posting the script, not bad at all, however one flaw is that it seems nowadays, a Lot of webmasters are getting downright dirty and using hidden links. This will not tell you when this is the case. The code also needs to make sure that your recp is even a link and not just text or hidden text on the page. I think it is sad that we even have to consider such things, but thats the web today.

SixDeep
Sep 2nd 2005, 6:49 pm
Very true and agreed. It used to be so much simpler. Then we all fell into our love/hate relationships with google and their constantly evolving algorithms and SEO requirements. Webmasters will do just about anything now to maintain their advantage over the competition and their SERP's and it puts their linking partners on the backburner.

The code also needs to make sure that your recp is even a link and not just text or hidden text on the page.

Yea I thought about that in advance and made it so I have a sign up form on my site for link exchange and they have to put the exact link I supply to them and they have to input the exact page URL where my link is located. I have a whole link checking system I just completed that is pretty stingent about this. If the script detects something out of character, it emails me and them an alert if the linkback is bad or missing.


Once I get some more things on it laid out, I will probably open up a demo version for people to check out. Don't know if I'm gonna charge for it... maybe I should just charge them by forcing them to do a 1-way link back to me in exchange for the system LOL :D

tandac
Sep 2nd 2005, 11:38 pm
Here's the code I use. It checks for links and makes sure that the link is not within a comment tag:

$URL="http://".$url['host']."/";
$CHECK="<a href=\"http://www.bbconnector.com\"";

$html = implode('', file($URL));
$pos = strpos($html, $CHECK);
$badLink=TRUE;
if ($pos > 0) {
$badLink=FALSE;
$comment=strpos($html,"<!--");
while (($comment > 0) && ($comment < $pos) && ($badLink === FALSE)) {
$cend=strpos($html,"-->", $comment);
if (($cend > $pos) || ($cend === false)) {
$badLink=TRUE;
}
$comment=strpos($html,"<!--",$cend);
};
}

loyalmart
May 17th 2006, 4:05 am
I would like to thank all. i have got a lot today from this forum..
thanks.
i was using ARLIEs for company sites but don't have something for myself.... thanks thanks a million.. i will try and keep on posting the results for newbees..

WilliamC
May 17th 2006, 8:52 am
Here's the code I use. It checks for links and makes sure that the link is not within a comment tag:

$URL="http://".$url['host']."/";
$CHECK="<a href=\"http://www.bbconnector.com\"";


Nice bit of fast code, however I would suggest using

$CHECK="href=\"http://www.bbconnector.com\"";

rather than the <a href version as some people make links like <a name= href= or maybe <a style= href= which would break your system.

MrBounce
May 17th 2006, 11:19 pm
found this thread at exactly the right time. thanks alot

seoBear
May 24th 2006, 2:01 am
Nice bit of fast code, however I would suggest using

$CHECK="href=\"http://www.bbconnector.com\"";

rather than the <a href version as some people make links like <a name= href= or maybe <a style= href= which would break your system.

what if it is written
<input type="hidden" "href="http://www.bbconnector.com"/>
on the page?

then your approach will be useless :(

natureday
Jun 2nd 2006, 2:22 pm
I was looking for some software, and not a program, but I think I am going to try this. THanks you guys:)

WilliamC
Jun 4th 2006, 4:34 pm
what if it is written
<input type="hidden" "href="http://www.bbconnector.com"/>
on the page?

then your approach will be useless :(

very true, so adding a few extra checks would be a good idea.

letsjoy
Jun 15th 2006, 2:23 pm
thanx buddies fot script

softgroups
Jun 15th 2006, 3:24 pm
It's very easy to make one in PHP ... and it won't take more then 15 minutes to do it... but I am to lazy :p

biziboy
Jun 22nd 2006, 9:40 am
oh man... when i read a post like this with all the PHP flying around... im reminded of how bright the ppl in this community are... :)
i learnt BASIC and HTML pretty early and recently C++ in college.... looks like i should get back into the game and learn php.. its what the bigboys are using :)

ericeric
Jun 29th 2006, 2:39 pm
i think addweb tool will be fine...

tarun1979
Jul 19th 2006, 5:08 am
it realy good man...

feha
Sep 15th 2006, 8:02 am
Backlink checker:
www . vision.to/

enjoy
as this stupid forum does not allow me to write links :-(

seovault
Sep 16th 2006, 2:11 pm
Why don't You just make your "Link Partners" site use PHP Link Directory from phplinkdirectory.com ? It gots all it needs and v 2.0 is free.

picobello
Sep 16th 2006, 2:18 pm
What do you think about this tool?

http://www.linktemple.com

I found it pretty cool ... only works for a reasonable amount of links

maxhammer
Sep 17th 2006, 1:30 am
I have tried webconfs.com a few times and its a great tool you may also check it out.

pablo
Feb 12th 2007, 5:09 am
hi all,

Does anyone have a suggestion of a "contact form" link checker script.
As in I tell people I will link to their site, if they add a link to mine, all they have to do is to provide a reciprocal link.
my form
========
Your name:
E-mail:
Website title:
Website URL:
URL with reciprocal link:

Website description:
===========
And before the link is submitted to me it would check the "URL with reciprocal link" for my string.

crag
Apr 26th 2007, 8:26 am
Hi all,

Found this script just intime.
The only problem I ran into was that my hoster has disabled file(), get_file_contents() for files on different server. I can use these for local files but not for external. However, the hoster has got cURL installed.

I had to modify the script for cURL in my case:

function BacklinkCheck($url, $mydomain){
$ch = curl_init();
curl_setopt ($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_HEADER, 0);
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
$contents = curl_exec ($ch);
curl_close ($ch);
$arrText = array();
$arrText = explode("\n", $contents);
if (strpos ($contents, $mydomain) != FALSE) {
return true;
} else {
return false;
}
}

Then call it from submission form with:

$backlink=BacklinkCheck($_POST["backlink_url"], "directory.nkytravel.com");
if($backlink===false){
echo "URL not found!";
}else{
/// Complete submitting url to directory
}

It workds perfectly fine for me. Feel free to test it out and add your sites to my directory:

http://directory.nkytravel.com

SellLinks
Apr 30th 2007, 9:19 am
ManageYourLinks.com has a good tool as well. Its free to use and works for reciprocals as well as bought links.

It also gives stats about those links that you can track.

rubencb28
Dec 9th 2007, 1:02 pm
The best is yahoo explorer

ibnuasad
Dec 10th 2007, 8:49 pm
A few days ago, I found a software called Link Verify. It's pretty neat and should cater the needs for most webmasters.

I blogged about it at http://www.seotier.com/201/free-reciprocal-link-exchange-verifier-software/

Check out the software at http://www.rankexec.com/linkverifydwnld.htm

jluyt
Dec 12th 2007, 2:06 pm
hi all,

WOW, this thread has taken some turns. thanks to all that have put in their contributions. Now I want to stick a spanner in the wheel :-)

I need a script to take a list of URL's (in a txt file or in a form pasted)... check the url's to see if my link indeed exists on that page... if it does, get me the PR of that page and return it also.

I am not a coder, so if there is any of you willing to work with me, I will be very grateful. I want to run a link building contest next year and need a little tool to check if my link exist on the URL that the contestants say it is... then check the PR to ensure they are all not PR 0's.

Any help will be greatly appreciated.

justin

tarun1979
Apr 11th 2008, 5:24 am
Hi
Can this be summirised so that one need not to hop from pages to pages?

shacow
Nov 6th 2008, 5:33 am
What do you mean?

serenoo
Mar 2nd 2009, 4:01 am
I can suggest you this Reciprocal link checker (http://www.frelic.com) It is free, you do not need to download and install software, and it controls for you your link exchanges.

OkiAGr
Oct 28th 2009, 6:57 am
backlink-tool.com is the best tool for this. You can manage unlimited campaigns and check for your links on unlimited partner sites.