this post was submitted on 14 Sep 2023
430 points (97.6% liked)

Programmer Humor

32410 readers
1 users here now

Post funny things about programming here! (Or just rant about your favourite programming language.)

Rules:

founded 5 years ago
MODERATORS
 
all 20 comments
sorted by: hot top controversial new old
[–] Bishma@discuss.tchncs.de 46 points 2 years ago (3 children)

Im my experience, if your logs are growing that fast for a reason, you'll get to see it again... and again... and again. And show it to people going, "WTF, have you ever seen anything like this before?"

[–] seahorse@midwest.social 23 points 2 years ago (1 children)

In my case docker didn't have a default max size that logs would stop at, so they just grew and grew exponentially. I also had the highest log level turned on to debug something so it was constantly logging a bunch of data.

[–] marcos@lemmy.world 28 points 2 years ago (1 children)

exponentially

Are logging the content of your log files?

[–] agent_flounder@lemmy.one 12 points 2 years ago
[–] FlaminGoku@reddthat.com 7 points 2 years ago

You'll also have management breathing down your neck about the costs if it's not absolutely necessary.

[–] Djtecha@lemm.ee 3 points 2 years ago

Built a centralized logging system to handle logging like this. Fun project but very much the result of bad logging hygiene.

[–] thisbenzingring@lemmy.sdf.org 29 points 2 years ago (1 children)

Once I had a customer report that her computer was giving her out of disk space errors. This was weird because we script their My Documents and Desktop to network file shares. Like wtf could be using up the disk? While walking to their system I figured the drive was going bad. Nope.

Just a 250+GB log file from a chat program that they used. Like OMG that was amazing

[–] kionite231@lemmy.ca 7 points 2 years ago (1 children)

Can you mention which "chat program" was that?

[–] thisbenzingring@lemmy.sdf.org 3 points 2 years ago

it was an early version of Pidgin

[–] TipRing@kbin.social 20 points 2 years ago (1 children)

Just add
: > logfile
to crontab and run it once a minute, problem solved.

[–] quylaa@lemmy.ml 48 points 2 years ago (2 children)

Yeah I centralize all my server logs, they point to a nifty location called /dev/null. It's so good at collection and compression, it never grows in size!

[–] DarkenLM@artemis.camp 5 points 2 years ago

The Void consumes all.

[–] kionite231@lemmy.ca 4 points 2 years ago

Infinite compression ratio O.O

[–] ICastFist@programming.dev 17 points 2 years ago (2 children)

I've had that happen with database logs where I used to work, back in 2015-6.

The reason was a very shitty system that, for some reason, threw around 140 completely identical delete queries per millisecond. When I say completely identical, I mean it. It'd end up something like this in the log:

2015-10-22 13:01:42.226 = delete from table_whatever
      where id = 1
          and name = 'Bob'
          and other_identifier = '123';
2015-10-22 13:01:42.226 = delete from table_whatever
      where id = 1
          and name = 'Bob'
          and other_identifier = '123';
2015-10-22 13:01:42.226 = delete from table_whatever
      where id = 1
          and name = 'Bob'
          and other_identifier = '123';
-- repeated over and over with the exact same fucking timestamp, then repeated again with slightly different parameters and different timestamp

Of course, "no way it's our system, it handles too much data, we can't risk losing it, it's your database that's messy". Yeah, sure, I set up triggers to repeat every fucking delete query. Fucking morons. Since they were "more important", database logging was disabled.

[–] stealthnerd@lemmy.world 12 points 2 years ago (1 children)

Having query logging enabled on a production database is bonkers. The duplicate deletes are too but query logging is intended for troubleshooting only. It kills performance.

[–] ICastFist@programming.dev 13 points 2 years ago

Take a wild guess as to why it had to be enabled in the first place, and only for Delete queries.

[–] mostlypixels@programming.dev 8 points 2 years ago

I saw php error logs cause a full disk in a few minutes (thankfully on a shared dev server), thanks to an accidental endless loop that just flooded everything with a wall of notices...

And, working with a CMS that allows third-party plugins that don't bother to catch exceptions, aggressive web crawlers are not a good thing to encounter on a weekend... 1 exception x 400000 product pages makes for a loooot of text.

[–] jherazob@beehaw.org 4 points 2 years ago

Meanwhile sysadmins: