Log in or Sign up
Digital Point
Home
Forums
>
Development
>
Site & Server Administration
>
robots.txt
Find help with setting up your robots.txt file on your web site.
Page 4 of 19
< Prev
1
←
2
3
4
5
6
→
19
Next >
Sort by:
Title
Start Date
Replies
Views
Last Message ↓
Robot.txt block my major part
russel_shuvo2
,
Jun 11, 2012
Replies:
2
Views:
3,061
atxsurf
Jul 3, 2012
Idea for robots.txt selective restrictions [done easy]
iGeekSoftware
,
Jun 14, 2012
Replies:
1
Views:
3,030
atxsurf
Jul 3, 2012
Need advice on how to block certain page using robots.txt
mariush
,
Aug 12, 2006
Replies:
7
Views:
10,489
learn2success
Jun 6, 2012
How to stop crawling of multi language site
hvwebseo
,
Jun 5, 2012
Replies:
1
Views:
2,658
RoseHosting
Jun 5, 2012
Blocking .php from google in robots.txt
matthecool
,
Jun 4, 2012
Replies:
1
Views:
2,710
digitalpoint
Jun 4, 2012
Help regarding robots.txt file for my website
AlisaRozzy
,
May 19, 2012
Replies:
1
Views:
2,820
war_machine
Jun 3, 2012
What is robots.txt ?
riteshvyas52
,
May 4, 2012
Replies:
5
Views:
3,121
JFSG
Jun 3, 2012
How to Stop Web Robot from Engines other than G and Y and MSN
gdtechind
,
Oct 27, 2005
Replies:
9
Views:
8,217
Spearheadltd
Jun 1, 2012
robot.txt to allow everything
joerudy1988
,
May 3, 2012
Replies:
3
Views:
3,433
joerudy1988
May 17, 2012
How we use robot.txt file for our site pages?
satish nandanwar
,
May 9, 2012
Replies:
1
Views:
2,893
bsdstr
May 17, 2012
How do you get archiver to READ my robots?
TheSyndicate
,
Mar 31, 2012
Replies:
6
Views:
3,306
TheSyndicate
Apr 27, 2012
I want to block folder /Portals/ and /portals/
kshama
,
Apr 16, 2012
Replies:
1
Views:
2,971
blacknet
Apr 17, 2012
robots.txt correct or not?
sumitsaurabhmca
,
Apr 3, 2012
Replies:
7
Views:
3,008
ryan_uk
Apr 12, 2012
What this robot.txt will do ? Please help !!
Rajnish357
,
Jan 23, 2012
Replies:
2
Views:
3,465
carlhenson
Apr 11, 2012
does my robots.txt block my URLs?
wijasenna
,
Apr 9, 2012
Replies:
3
Views:
3,625
carlhenson
Apr 11, 2012
Noindex, nofollow on a wordpress blog
roynetwork7
,
Mar 26, 2012
Replies:
2
Views:
3,231
roynetwork7
Apr 10, 2012
Robots.txt Allow/ Disallow Dynamic Pages
sameerseo
,
Mar 26, 2012
Replies:
1
Views:
3,562
tiffanywilliams12i2
Apr 10, 2012
blocking directory certain part of url from robots.txt
matthecool
,
Oct 20, 2011
Replies:
3
Views:
4,297
tiffanywilliams12i2
Apr 10, 2012
how to change the robots.txt file in open cart
world pharmacare
,
Dec 31, 2011
Replies:
1
Views:
4,712
tiffanywilliams12i2
Apr 10, 2012
robots.txt error when allowing all
godsgift
,
Jan 9, 2012
Replies:
6
Views:
4,542
tiffanywilliams12i2
Apr 10, 2012
Robot directory
TheSyndicate
,
Jan 24, 2012
Replies:
1
Views:
3,212
tiffanywilliams12i2
Apr 10, 2012
Is there a way to make the bots respect the robots.txt file at all times?
qwikad.com
,
Jan 31, 2012
Replies:
2
Views:
3,196
tiffanywilliams12i2
Apr 10, 2012
Query about robots.txt function in wordpress?
aniket123
,
Feb 1, 2012
Replies:
3
Views:
3,450
tiffanywilliams12i2
Apr 10, 2012
yes it is important to keep robots.txt
varsha reddy
,
Feb 1, 2012
Replies:
1
Views:
3,141
tiffanywilliams12i2
Apr 10, 2012
Robot.txt Kicking My A$$ Please Help!
rjd1265
,
Feb 2, 2012
Replies:
2
Views:
2,912
tiffanywilliams12i2
Apr 10, 2012
how to get more yahoo and bing like google? [photo]
stilv
,
Mar 3, 2012
Replies:
2
Views:
2,738
tiffanywilliams12i2
Apr 10, 2012
Use of robot.txt file
AlisaRozzy
,
Mar 23, 2012
Replies:
2
Views:
3,046
tiffanywilliams12i2
Apr 10, 2012
thumbnail does not appear
arivin29
,
Mar 26, 2012
Replies:
1
Views:
2,267
tiffanywilliams12i2
Apr 10, 2012
Is it normal that the /robots.txt is the most downloaded item from Server stats
TheSyndicate
,
Mar 29, 2012
Replies:
11
Views:
2,683
TheSyndicate
Apr 9, 2012
What is robot.txt flie?
sofiaisabella01
,
Feb 19, 2012
Replies:
19
Views:
3,363
mbitsol
Apr 7, 2012
Question Re: Robots.txt
NewComputer
,
Jun 12, 2004
Replies:
4
Views:
4,405
anna30
Apr 3, 2012
How to block certain pages with url parameters from crawler's access using robots.txt
mpchekuri
,
Feb 29, 2012
Replies:
4
Views:
3,109
pindians007
Mar 26, 2012
Hello, I am new, and need some help on robots.txt
abrahamgold
,
Oct 21, 2005
Replies:
14
Views:
9,106
SPA assurance
Mar 8, 2012
How to create robots.txt file
sarahashlin
,
Nov 28, 2011
...
2
Replies:
22
Views:
7,334
madison37
Mar 6, 2012
Remove this stupid robots.txt
netboy
,
Feb 22, 2008
Replies:
17
Views:
17,775
Rituja
Feb 15, 2012
Hi friends i want to disallow only this type of page in robot.txt
DeepakDwivedi
,
Feb 9, 2012
Replies:
2
Views:
2,551
DeepakDwivedi
Feb 13, 2012
Robot.txt Troubles...again
rjd1265
,
Feb 2, 2012
Replies:
0
Views:
2,017
rjd1265
Feb 2, 2012
Webmaster Tools- Crawl errors Restricted by robots.txt (14)
pla gilbert
,
Jan 14, 2012
Replies:
2
Views:
2,973
Cristina001
Jan 26, 2012
google webmaster tool crawl error "Restricted by robots.txt (473)"
waleed.khaliqi
,
Jan 11, 2012
Replies:
1
Views:
2,490
umerplz
Jan 25, 2012
robots.txt and images
ademmeda
,
Sep 11, 2011
Replies:
9
Views:
4,641
WFgirls
Jan 14, 2012
Robot.txt file
iluvm
,
Nov 30, 2005
...
2
Replies:
20
Views:
12,550
Emily Stephens
Jan 3, 2012
Analyze These Robots.txt which one is better?
e-marketing guru
,
Jun 23, 2008
Replies:
1
Views:
2,908
TheSyndicate
Dec 21, 2011
Amazon AWS Services - Cloudfront - FRA What to do with these?
TheSyndicate
,
Dec 21, 2011
Replies:
0
Views:
2,895
TheSyndicate
Dec 21, 2011
Problem with timed out and unreacheable crawl error in google
lok123
,
Dec 1, 2011
Replies:
2
Views:
2,739
onlinegame6
Dec 17, 2011
is this robot.txt good enough?
wijasenna
,
Oct 25, 2011
Replies:
7
Views:
3,625
xDiglett
Dec 16, 2011
Quick Disallow Question for Gallery2 items
mjindustry
,
Nov 24, 2011
Replies:
0
Views:
2,451
mjindustry
Nov 24, 2011
What is the best robot.txt for Wordpress a 2011
TheSyndicate
,
Nov 15, 2011
Replies:
0
Views:
3,394
TheSyndicate
Nov 15, 2011
Robots.txt Disallow: / function
aniket123
,
Nov 1, 2011
Replies:
3
Views:
2,985
tripbuilder
Nov 14, 2011
What is everyone's favourite robot?
mbpalmer87
,
Nov 9, 2011
Replies:
0
Views:
2,378
mbpalmer87
Nov 9, 2011
Please help me understanding robots.txt file
MyArtGallery
,
Sep 6, 2011
Replies:
9
Views:
3,775
pr0t0n
Nov 8, 2011
Showing threads 151 to 200 of 911
Thread Display Options
Sort threads by:
Last message time
Thread creation time
Title (alphabetical)
Number of replies
Number of views
First message likes
Order threads in:
Descending order
Ascending order
Loading...
(You must log in or sign up to post here.)
Show Ignored Content
Page 4 of 19
< Prev
1
←
2
3
4
5
6
→
19
Next >
Log in with Facebook
Your name or email address:
Do you already have an account?
No, create an account now.
Yes, my password is:
Forgot your password?
Stay logged in
Digital Point
Home
Forums
>
Development
>
Site & Server Administration
>
Log in to view your Analytics, AdSense & PayPal stats
Home
Forums
Search Forums
Recent Posts
Spy
Search Engines
Google
AdSense
Guidelines / Compliance
Placement / Reviews / Examples
Reporting & Stats
Payments
AdWords
Analytics
Google+
Sitemaps
Google API
Shopping
Yahoo
Publisher Network
Search Marketing
Yahoo API
Bing
Bing Ads
All Other Search Engines
Directories
Solicitations & Announcements
ODP / DMOZ
Business & Marketing
General Business
General Marketing
Search Engine Optimization
Keywords
Microdata
Payment Processing
PayPal
Social Networks
Facebook
Facebook API
Twitter
Google+
Link Development
Legal Issues
Domain Names
Appraisals
Copywriting
Article Marketplace
eCommerce
Pay Per Click Advertising
Digital Point Ads
Google AdWords
Yahoo Search Marketing
Bing Ads
Affiliate Programs
Affiliate Program Management
Commission Junction
Google
eBay
Amazon
ClickBank
Chitika
Design
HTML & Website Design
CSS
Graphics & Multimedia
Photoshop
Reviews
Content Management
Blogging
WordPress
Drupal
Joomla
XML & RSS
Scripts
Development
Programming
PHP
JavaScript
jQuery
C#
Ruby
Site & Server Administration
Apache
Nginx
Security
Traffic Analysis
Google Analytics
robots.txt
Forum Management
XenForo
vBulletin
phpBB
Cluster Computing
Google Sitemaps
Web Hosting
Outages
Advertising
Databases
MySQL
Buy, Sell or Trade
Sites
Filter Sites For Sale
Domains
Filter Domains For Sale
Design Contests
Advertising
Secondhand Licenses
Services
Content Creation
Design
Programming
Traffic
Web Hosting
Plug-ins/Add-ons
Templates/Styles
Scripts
Designs
eBooks
Articles
The Digital Point
Introductions
General Chat
Movies, Music & TV
Games
Sports
Hardware
Politics & Religion
Products & Tools
Keyword Tracker
Cookie Search
Better Analytics
Legacy
Co-op Advertising Network
Optigold ISP
Reviews
Websites
Design
SEO
Support & Feedback
Advertising
Keyword Tracker
Cookie Search
The Underground
Area 51
Sphinx Search Support
XenForo Search Support
Tools
Most used tools...
Rank Checker
Cookie Search
Site Search Engine
Marketplace
Sites
Domains
Plugins/Add-ons
Scripts
Templates/Styles
Graphic Designs
eBooks
Articles
Advertising
Buy Ad Space
Sell Ad Space On Your Sites
Advertise on digitalpoint.com
Members
Notable Members
Current Visitors
Recent Activity
User Map
Directory
New Profile Posts
Menu
Search
Search titles only
Posted by Member:
Separate names with a comma.
Newer Than:
Search this forum only
Display results as threads
Useful Searches
Recent Posts
More...