Results 1 to 10 of 10

Thread: Keeping my site off of search engines.

  1. #1
    Join Date
    Jan 2007
    Location
    San d'Oria, Vana'diel (FFXI Online)
    Posts
    1,182
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default Keeping my site off of search engines.

    I know all about the robots.txt file and I have one in the root of my site like I'm suppose to but all it seems to be doing is preventing search engines from downloading info from my site but not preventing them from indexing it. I've tried to find a way to contact Google to get my site removed but I can't find any contact info that will help. Every menu on the phone number I found keeps refering me to their site. That's not the worst of it. A search robot labled Echo! on my site stats seems to be ignoring the robots.txt file and is downloading data in the KB off of my web site (80KB total last checked) while all the other robots that have hit my site haven't even downloaded 200bytes. What do I have to do to keep my site a secret before it's too late?
    Haldrie's World
    (My official web site.)

    My YouTube Channel

  2. #2
    Join Date
    Mar 2007
    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    http://bitesizestandards.com/bites/h...ing-your-pages
    http://www.antezeta.com/avoid-search...-indexing.html

    these web pages might be of help... i found em with google.... so is it realy a bad idea to let a spyder/crawler have a peek at your page? what is your page anyways?

  3. #3
    Join Date
    Oct 2005
    Location
    RP
    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    I know all about the robots.txt file and I have one in the root of my site like I'm suppose to but all it seems to be doing is preventing search engines from downloading info from my site but not preventing them from indexing it. I've tried to find a way to contact Google to get my site removed but I can't find any contact info that will help. Every menu on the phone number I found keeps refering me to their site. That's not the worst of it. A search robot labled Echo! on my site stats seems to be ignoring the robots.txt file and is downloading data in the KB off of my web site (80KB total last checked) while all the other robots that have hit my site haven't even downloaded 200bytes. What do I have to do to keep my site a secret before it's too late?

    Download Links:
    Links are hidden from guests. Please register to be able to view these links.
    Last edited by Leerz25; 21st-March-2007 at 16:36.

  4. #4
    Join Date
    Jan 2007
    Location
    San d'Oria, Vana'diel (FFXI Online)
    Posts
    1,182
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    Well I have my robots.txt file set to disallow all robots from the site however I checked out those links and the meta noindex tag might do the trick at keeping search engines from indexing my site.
    Haldrie's World
    (My official web site.)

    My YouTube Channel

  5. #5
    Join Date
    Oct 2005
    Location
    RP
    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    btw I got another idea, block / disallow all pages and folders except for one WITH LOTS AND LOTS OF TAGS about your website

  6. #6
    Join Date
    Jan 2007
    Location
    San d'Oria, Vana'diel (FFXI Online)
    Posts
    1,182
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    ....I think you missed the point. The idea was to keep my site from being indexed. As in to NOT let it show up on search engines. I'm just not ready for that kind of traffic. The meta tag seems to be doing the trick as I'm already seeing some indexes disappearing off of Google.
    Haldrie's World
    (My official web site.)

    My YouTube Channel

  7. #7
    Join Date
    Oct 2005
    Location
    RP
    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    ahh, right I overlooked it, disallowing all folders should do it, [i think]
    if you really wanna kick out indexing from search engines, you can make a request [i think] from google

    [kinda like what sharman did with klite] delete all references pointing to klite

  8. #8
    Join Date
    May 2004
    Location
    NY
    Posts
    4,658
    Thanks
    1
    Thanked 14 Times in 4 Posts
    EP Points
    85

    Default

    You seem paranoid. You wont get that kind of traffic overnight, trust me

  9. #9
    Join Date
    Jan 2007
    Location
    San d'Oria, Vana'diel (FFXI Online)
    Posts
    1,182
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    I'm not paranoid I just don't want search engine hits to be part of my traffic. Right now the only traffic I need on it are for the pics I host and from links in my sig and profile.
    Haldrie's World
    (My official web site.)

    My YouTube Channel

  10. #10
    Join Date
    Oct 2005
    Location
    RP
    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    I'm not paranoid I just don't want search engine hits to be part of my traffic. Right now the only traffic I need on it are for the pics I host and from links in my sig and profile.
    actually as an individual, you really won't get much hits from indexing engines.

    even if the site has stayed for 2-3 years, if you blocked those sites, really.
    you can have a webspace with just files and no pages [kinda like what I have] I also store stuff [siggies/avatars] and docs there as well.

    You wont get that kind of traffic overnight, trust me
    indeed

Similar Threads

  1. Big Roms Site!! 15+ Gigs **need Expert Php Maker**
    By promo0503 in forum Coders and Webmasters Corner
    Replies: 6
    Last Post: 1st-June-2005, 16:26
  2. Working N64, and GB Roms (NOTE: The site is not in English)
    By ((KvN)) in forum ROM & ISO Requests
    Replies: 19
    Last Post: 5th-April-2004, 07:13
  3. Site with Megaman roms and ISO's
    By Boxer Boy in forum ROM & ISO Requests
    Replies: 39
    Last Post: 3rd-August-2003, 16:31
  4. Wow! The new site is wicked!
    By Magus in forum Free 4 All
    Replies: 12
    Last Post: 8th-July-2001, 20:29

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
About Us

We are the oldest retro gaming forum on the internet. The goal of our community is the complete preservation of all retro video games. Started in 2001 as EmuParadise Forums, our community has grown over the past 18 years into one of the biggest gaming platforms on the internet.

Social