Remove Ad, Sign Up
Register to Remove Ad
Register to Remove Ad
Remove Ad, Sign Up
Register to Remove Ad
Register to Remove Ad
Register
Signup for Free!
-More Features-
-Far Less Ads-
☷ Vizzed.com Play Retro Games Vizzed Board Video Games Game Music Market Minecraft Radio Widgets Virtual Bible
☷ Register   Login  
All Threads New Posts Contribution Points Your Threads News and Updates Active Users User Ranks
About   Users   Help
Users & Guests Online
On Page: 1
Directory: 152
Entire Site: 7 & 1205
Page Staff: pennylessz, pokemon x, Barathemos, tgags123, alexanyways, supercool22, RavusRat,
04-19-24 04:28 PM

Forum Links

Adjusted Bot Crawl Delay
This has increased the site speed greatly during the early hours
Related Threads
Coming Soon

Thread Information

Views
491
Replies
4
Rating
3
Status
CLOSED
Thread
Creator
Davideo7
11-17-16 04:21 AM
Last
Post
Pokemonfan1000
11-17-16 05:28 PM
Additional Thread Details
Views: 307
Today: 0
Users: 19 unique
Last User View
11-17-16
Lexatom

Thread Actions

Thread Closed
Order
 

Adjusted Bot Crawl Delay

 

11-17-16 04:21 AM
Davideo7 is Online
Link
| ID: 1314967 | 135 Words

Davideo7
Level: 351


POSTS: 41053/45320
POST EXP: 3474068
LVL EXP: 811447191
CP: 191263.8
VIZ: 121500527

Likes: 3  Dislikes: 0
The site gets hit by a lot of bots (especially during the real early hours) and that's usually good but it unfortunately slows down the site, especially when its getting hit by 100s per a minute. I've updated the robots.txt file of Vizzed and with that I've told certain bots to only crawl the site every certain number of seconds.

Here are the affected bots and their crawl delay:
Yandex 2 seconds
Baiduspider 2 seconds

I also told the following bot to never crawl the site:
AhrefsBot

I've left Google bots alone since those are the most valuable bots to have going through the site. I also left the Bing bot alone since that's not really causing any issues.

So far it seems like the site's speed during the early hours has greatly improved
The site gets hit by a lot of bots (especially during the real early hours) and that's usually good but it unfortunately slows down the site, especially when its getting hit by 100s per a minute. I've updated the robots.txt file of Vizzed and with that I've told certain bots to only crawl the site every certain number of seconds.

Here are the affected bots and their crawl delay:
Yandex 2 seconds
Baiduspider 2 seconds

I also told the following bot to never crawl the site:
AhrefsBot

I've left Google bots alone since those are the most valuable bots to have going through the site. I also left the Bing bot alone since that's not really causing any issues.

So far it seems like the site's speed during the early hours has greatly improved
The Owner
Owner, Developer, Advertiser, etc
Founder, Mod, Investor


Affected by 'Laziness Syndrome'

Registered: 12-06-04
Location: Wisconsin
Last Post: 1 day
Last Active: 4 min.

Post Rating: 3   Liked By: Lexatom, Mynamescox44, Nksor,

11-17-16 07:44 AM
Eniitan is Offline
Link
| ID: 1314996 | 41 Words

Eniitan
Level: 174


POSTS: 8836/10522
POST EXP: 959649
LVL EXP: 70481019
CP: 55215.8
VIZ: 2613215

Likes: 0  Dislikes: 0
Davideo7 : Nice to know....we wouldn't want anything to happen now to do with those bots. Its always great to fix well the small things such as this which is needed. Since we know anything can disturb vizzed in a way.
Davideo7 : Nice to know....we wouldn't want anything to happen now to do with those bots. Its always great to fix well the small things such as this which is needed. Since we know anything can disturb vizzed in a way.
Vizzed Elite
Number 1 Sailor Moon, Final Fantasy And Freedom Planet Fan On Vizzed!


Affected by 'Laziness Syndrome'

Registered: 08-16-12
Last Post: 566 days
Last Active: 54 days

11-17-16 09:40 AM
Pokemonfan1000 is Offline
Link
| ID: 1315017 | 23 Words

Pokemonfan1000
Level: 58


POSTS: 329/957
POST EXP: 48442
LVL EXP: 1549144
CP: 2097.1
VIZ: 2100

Likes: 0  Dislikes: 0
Davideo7 : Quick question. Does this affect the wayback machine at all? I'm assuming it does since you mentioned crawling but am not sure.
Davideo7 : Quick question. Does this affect the wayback machine at all? I'm assuming it does since you mentioned crawling but am not sure.
Perma Banned
The only user so far in the 309 and 563 area codes currently active on any acmlm based board (save for smwcentral.net and Lespna1) If you want to dispute this claim, feel free to PM me.


Affected by 'Laziness Syndrome'

Registered: 10-20-16
Location: Quad Cities
Last Post: 2488 days
Last Active: 2488 days

11-17-16 04:13 PM
Davideo7 is Online
Link
| ID: 1315119 | 17 Words

Davideo7
Level: 351


POSTS: 41059/45320
POST EXP: 3474068
LVL EXP: 811447191
CP: 191263.8
VIZ: 121500527

Likes: 0  Dislikes: 0
Pokemonfan1000 : The wayback bots don't do very much crawling so this update doesn't affect them at all.
Pokemonfan1000 : The wayback bots don't do very much crawling so this update doesn't affect them at all.
The Owner
Owner, Developer, Advertiser, etc
Founder, Mod, Investor


Affected by 'Laziness Syndrome'

Registered: 12-06-04
Location: Wisconsin
Last Post: 1 day
Last Active: 4 min.

11-17-16 05:28 PM
Pokemonfan1000 is Offline
Link
| ID: 1315143 | 37 Words

Pokemonfan1000
Level: 58


POSTS: 335/957
POST EXP: 48442
LVL EXP: 1549144
CP: 2097.1
VIZ: 2100

Likes: 0  Dislikes: 0
Davideo7 : Ok. Did you get my summon to a post in the Help forum? From my standing it could be a very urgent situation and should be fixed ASAP if you think it may be an exploit.
Davideo7 : Ok. Did you get my summon to a post in the Help forum? From my standing it could be a very urgent situation and should be fixed ASAP if you think it may be an exploit.
Perma Banned
The only user so far in the 309 and 563 area codes currently active on any acmlm based board (save for smwcentral.net and Lespna1) If you want to dispute this claim, feel free to PM me.


Affected by 'Laziness Syndrome'

Registered: 10-20-16
Location: Quad Cities
Last Post: 2488 days
Last Active: 2488 days

Links

Page Comments


This page has no comments

Adblocker detected!

Vizzed.com is very expensive to keep alive! The Ads pay for the servers.

Vizzed has 3 TB worth of games and 1 TB worth of music.  This site is free to use but the ads barely pay for the monthly server fees.  If too many more people use ad block, the site cannot survive.

We prioritize the community over the site profits.  This is why we avoid using annoying (but high paying) ads like most other sites which include popups, obnoxious sounds and animations, malware, and other forms of intrusiveness.  We'll do our part to never resort to these types of ads, please do your part by helping support this site by adding Vizzed.com to your ad blocking whitelist.

×