Remove Ad, Sign Up
Register to Remove Ad
Register to Remove Ad
Remove Ad, Sign Up
Register to Remove Ad
Register to Remove Ad
Register
☷ Vizzed.com Play Retro Games Vizzed Board Video Games Game Music Market Minecraft Radio Widgets Virtual Bible
☷ Register   Login  
Your Threads Contribution Points All Threads New Posts News and Updates Post Search Active Users Online Users User Ranks
About   Users   Help
Users & Guests Online
On Page: 1
Directory: 153
Entire Site: 7 & 1401
Page Staff: tgags123, pokemon x, tgags123, supercool22, SonicOlmstead, Barathemos, Furret, geeogree,
07-12-26 10:08 AM

Forum Links

Adjusted Bot Crawl Delay
This has increased the site speed greatly during the early hours
Related Threads
Coming Soon

Thread Information

Views
749
Replies
4
Rating
3
Status
CLOSED
Thread
Creator
Davideo7
11-17-16 04:21 AM
Last
Post
Pokemonfan1000
11-17-16 05:28 PM
Additional Thread Details
Views: 465
Today: 0
Users: 19 unique
Last User View
11-17-16
Lexatom

Thread Actions

Thread Closed
Order
 

Adjusted Bot Crawl Delay

 

11-17-16 04:21 AM
Davideo7 is Online
Link
| ID: 1314967 | 135 Words

Davideo7
Level: 358


POSTS: 41053/45866
POST EXP: 3551991
LVL EXP: 872380815
CP: 200614.2
VIZ: 129619306

Likes: 3  Dislikes: 0
The site gets hit by a lot of bots (especially during the real early hours) and that's usually good but it unfortunately slows down the site, especially when its getting hit by 100s per a minute. I've updated the robots.txt file of Vizzed and with that I've told certain bots to only crawl the site every certain number of seconds.

Here are the affected bots and their crawl delay:
Yandex 2 seconds
Baiduspider 2 seconds

I also told the following bot to never crawl the site:
AhrefsBot

I've left Google bots alone since those are the most valuable bots to have going through the site. I also left the Bing bot alone since that's not really causing any issues.

So far it seems like the site's speed during the early hours has greatly improved
 
The site gets hit by a lot of bots (especially during the real early hours) and that's usually good but it unfortunately slows down the site, especially when its getting hit by 100s per a minute. I've updated the robots.txt file of Vizzed and with that I've told certain bots to only crawl the site every certain number of seconds.

Here are the affected bots and their crawl delay:
Yandex 2 seconds
Baiduspider 2 seconds

I also told the following bot to never crawl the site:
AhrefsBot

I've left Google bots alone since those are the most valuable bots to have going through the site. I also left the Bing bot alone since that's not really causing any issues.

So far it seems like the site's speed during the early hours has greatly improved

 
The Owner
Owner, Developer, Advertiser, etc
Founder, Mod, Investor


Affected by 'Carpal Tunnel Syndrome'

Registered: 12-06-04
Location: Wisconsin
Last Post: 21 hours
Last Active: 3 min.

Post Rating: 3   Liked By: Lexatom, Mynamescox44, Nksor,

11-17-16 07:44 AM
Eniitan is Offline
Link
| ID: 1314996 | 41 Words

Eniitan
Level: 179


POSTS: 8836/10522
POST EXP: 959649
LVL EXP: 76912346
CP: 55531.6
VIZ: 2643586

Likes: 0  Dislikes: 0
Davideo7 : Nice to know....we wouldn't want anything to happen now to do with those bots. Its always great to fix well the small things such as this which is needed. Since we know anything can disturb vizzed in a way.
Davideo7 : Nice to know....we wouldn't want anything to happen now to do with those bots. Its always great to fix well the small things such as this which is needed. Since we know anything can disturb vizzed in a way.

--------------------
During the whole of a dull, dark, and soundless day in the autumn of the year, when the clouds hung oppressively low in the heavens, I had been passing alone, on horseback, through a singularly dreary tract of country; and at length found myself, as the shades of the evening drew on.
Vizzed Elite
Number 1 Sailor Moon, Final Fantasy And Freedom Planet Fan On Vizzed!


Affected by 'Laziness Syndrome'

Registered: 08-16-12
Last Post: 1380 days
Last Active: 483 days

11-17-16 09:40 AM
Pokemonfan1000 is Offline
Link
| ID: 1315017 | 23 Words

Pokemonfan1000
Level: 60


POSTS: 329/957
POST EXP: 48442
LVL EXP: 1764386
CP: 2101.6
VIZ: 2550

Likes: 0  Dislikes: 0
Davideo7 : Quick question. Does this affect the wayback machine at all? I'm assuming it does since you mentioned crawling but am not sure.
And the Hy-Vee Heros game goes to wait for it, wait for it!
Davideo7 : Quick question. Does this affect the wayback machine at all? I'm assuming it does since you mentioned crawling but am not sure.

--------------------
THE IOWA HAWKEYES!!!!
Perma Banned
The only user so far in the 309 and 563 area codes currently active on any acmlm based board (save for smwcentral.net and Lespna1) If you want to dispute this claim, feel free to PM me.


Affected by 'Laziness Syndrome'

Registered: 10-20-16
Location: Quad Cities
Last Post: 3302 days
Last Active: 3302 days

11-17-16 04:13 PM
Davideo7 is Online
Link
| ID: 1315119 | 17 Words

Davideo7
Level: 358


POSTS: 41059/45866
POST EXP: 3551991
LVL EXP: 872380815
CP: 200614.2
VIZ: 129619306

Likes: 0  Dislikes: 0
Pokemonfan1000 : The wayback bots don't do very much crawling so this update doesn't affect them at all.
 
Pokemonfan1000 : The wayback bots don't do very much crawling so this update doesn't affect them at all.

 
The Owner
Owner, Developer, Advertiser, etc
Founder, Mod, Investor


Affected by 'Carpal Tunnel Syndrome'

Registered: 12-06-04
Location: Wisconsin
Last Post: 21 hours
Last Active: 3 min.

11-17-16 05:28 PM
Pokemonfan1000 is Offline
Link
| ID: 1315143 | 37 Words

Pokemonfan1000
Level: 60


POSTS: 335/957
POST EXP: 48442
LVL EXP: 1764386
CP: 2101.6
VIZ: 2550

Likes: 0  Dislikes: 0
Davideo7 : Ok. Did you get my summon to a post in the Help forum? From my standing it could be a very urgent situation and should be fixed ASAP if you think it may be an exploit.
And the Hy-Vee Heros game goes to wait for it, wait for it!
Davideo7 : Ok. Did you get my summon to a post in the Help forum? From my standing it could be a very urgent situation and should be fixed ASAP if you think it may be an exploit.

--------------------
THE IOWA HAWKEYES!!!!
Perma Banned
The only user so far in the 309 and 563 area codes currently active on any acmlm based board (save for smwcentral.net and Lespna1) If you want to dispute this claim, feel free to PM me.


Affected by 'Laziness Syndrome'

Registered: 10-20-16
Location: Quad Cities
Last Post: 3302 days
Last Active: 3302 days

Links

Page Comments

Dove4JS - 12-12-20 05:26 AM
no image
joldboy70 - 07-10-20 11:13 AM
test
joldboy70 - 07-10-20 11:12 AM
test
savage23157 - 04-08-20 01:33 PM
Hi im new vizzed
zokuza - 11-18-19 09:08 AM
final got playstaion games unlock yes baby digimon world here i com
yoshirulez! - 02-10-17 08:45 PM
MAY MAYS
yoshirulez! - 02-10-17 08:45 PM
maymays
yoshirulez! - 02-07-17 11:13 PM
OwO what's this?
yoshirulez! - 02-07-17 11:13 PM
OwO what's this?
yoshirulez! - 02-07-17 11:13 PM
OwO what's this?

Adblocker detected!

Vizzed.com is very expensive to keep alive! The Ads pay for the servers.

Vizzed has 3 TB worth of games and 1 TB worth of music.  This site is free to use but the ads barely pay for the monthly server fees.  If too many more people use ad block, the site cannot survive.

We prioritize the community over the site profits.  This is why we avoid using annoying (but high paying) ads like most other sites which include popups, obnoxious sounds and animations, malware, and other forms of intrusiveness.  We'll do our part to never resort to these types of ads, please do your part by helping support this site by adding Vizzed.com to your ad blocking whitelist.

×