Webmaster's Blog

Moderator: Moderators

Do you think the site and forum are moving in the right direction

Yes
10
100%
No
0
No votes
 
Total votes: 10

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

The DB will now restart if it crashes at worst after 5 minutes. I think this is an alright mitigation strategy. If the DB falls over everything will 5XX for a bit until they back off and then it should start up again after they've buggered off. My only concern is if something is writing to DB and it corrupts. It's a low likelihood since I doubt anyone will get served while it's being hammered and the forum software is smart enough to use in-memory locks for writing. Worst case we lose a day of forum activity, which isn't great but isn't that bad either.

User avatar
ClanFever
Executive Officer - MR2OCNZ
Posts: 2197
Joined: Tue Sep 11, 2012 11:25 pm
Stomping Ground: Wellington
Prime Mover: SW20
First name: Olaf
Contact:

Re: Webmaster's Blog

Post by ClanFever »

Best to lose a days worth than a lifes worth, I understand if hourly backups aren't cost effective enough. Good job finding and blocking the worst of the crawlers
Ex-President & Wellington Area Coordinator & Lower North MR2 Leader
Current: 1992 Toyota MR2 G-Limited with Gen 4 3S-GTE + CT20B (APEXED), 2005 Toyota IST, 2008 Toyota Vanguard - 2GR!
Past: 1990 Toyota MR2 G-Limited, "Semi Parts Car" 1991 Toyota MR2 G-Limited, '91 G-Limited, '89 G-Limited, '91 NZ New MR2, '91 G-Limited, '91 GT (Parts Car), '99 Altezza 3SGE, '98 Altezza 1GFE, '88 Corolla, '96 Curren, '94 Ceres Corolla, '94 Levin, '90 Hiace Super Custom 4x4, '91 Mirage, '93 MX-6 J-Spec, '91 Familia, '91 Galant, '90 Navara, '96 Commodore, '94 Pajero, '89 Lancer, '93 Pajero, '92 Pajero, '89 Mirage, '92 Terrano, '87 Familia, '03 Colt, '91 Pajero, '91 Pajero, '97 Carib, '96 Carina, '02 Turbo Forester

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

ClanFever wrote:
Sun May 03, 2020 3:52 pm
Best to lose a days worth than a lifes worth, I understand if hourly backups aren't cost effective enough. Good job finding and blocking the worst of the crawlers
We've got rolling 1-hour backups since the DB is tiny. There's a disk image at the infrastructure level once every 24 hours.

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

Changed signup to reCAPTCHA (forum update supports v2) + basic riddle and auto-activate on email confirmation. This should mean more people can start using the forum instantly. Still have to manually add them to the right events group though.

User avatar
Crawls
Executive Officer - MR2OCNZ
Posts: 330
Joined: Wed Jan 11, 2017 10:23 pm
Stomping Ground: Hawkes Bay
Prime Mover: SW20
First name: Keith

Re: Webmaster's Blog

Post by Crawls »

Would recapture stop bots from roaming the forum?
Keith "Crawls" Crawley
Membership Officer & Hawkes Bay Area Coordinator
90 SW20 n/a (Repairing)
18 Fortuner (Current)
92 SW20 (Current)
https://www.instagram.com/keith_crawley

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

Crawls wrote:
Sun May 03, 2020 5:07 pm
Would recapture stop bots from roaming the forum?
Nah, that's just for forum signup. We have a setup that allows Google, Bing, and a few others to index the site and forum.

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

Ugh, really another time the DB fell over. It should have rebooted. Let me check the logs

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

Return of aspiegelbot. I'll try another method of blocking them. Really stupid to write such a hammering bot if you're not going to get anything because it's full of 5XX :roll: probably coded by some intern. No, that's unfair, interns have done better than this

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

Apologies for the disrupted service. I had to get very aggressive and IP range block all of 114.119.0.0/16

I wish I didn't have to, but they left me no choice

User avatar
*84vvt
Life Member - MR2OCNZ
Posts: 2557
Joined: Sun Jun 06, 2004 11:44 am
Stomping Ground: Wellington
Prime Mover: AW11
First name: Colin

Re: Webmaster's Blog

Post by *84vvt »

Thank you for your time on this
Most greatly appreciated .
Boosted cars are like hot women.
A little edgy, every guy wants one,
some guys can't handle them,
and if you throw a little alcohol in them they'll rock your world.

Image

User avatar
Benckj
Forum Moderator - MR2OCNZ
Posts: 7161
Joined: Thu Nov 24, 2005 12:44 pm
Stomping Ground: Otago
Prime Mover: More than one MR2
First name: Jim

Re: Webmaster's Blog

Post by Benckj »

Good to see your working behind the scenes to keep forum alive. Well appreciated.
Jim Benck
90 rev 1 parts car
98 rev 5 GT- all the mods

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

So got SSL/TLS cert sussed on the email webapp, fixed SPF, did some other things to help avoid the forum emails from getting filtered. Just waiting on openhost to see if I can't get some other things fixed (mainly I can't set the actual mail server's cert using the plesk nor their own UI).

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

Well no go, but can provide the real domain name for the email server and there's a cert on that

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

There's a bug in the latest version of the forum software that prevents us from being able to delete private messages. It's due to be fixed in the next update. If anyone is running out of space send me a message

mknz
Site Admin - MR2OCNZ
Posts: 1188
Joined: Thu Apr 03, 2014 1:17 am
Stomping Ground: Auckland
Prime Mover: More than one MR2
First name: Michael
Contact:

Re: Webmaster's Blog

Post by mknz »

The AWS free first 12-months is up and just waiting on our order for a reserved instance (server) to be fulfilled. Paying upfront saves us quite a bit of cash. There'll be a 5-minute downtime while switching

Post Reply