andygates: (Default)
I've just discovered Philip Reeve's Mortal Engines, shameless YA steampunk centred around vast moving cities roaming a war-and-ecotastrophe-blasted Earth scavenging old tech and preying on each other for resources.  While not anything like as filling a meal as Pulman's His Dark Materials, it's a grand ripping yarn.  Rubber coats and class strife and goggles and infernal weapons and airships... and Shrike.  "It will take a lot more than being run over by a couple of towns to finish Shrike."  I am already a Shrike fanboy.

leach on the Wii - from Kotaku.comChina's internet authorities continue to be both egregious and inscrutable: they have ordered World of Warcraft skeletons to cover up.  Quite why skeletons must but zombies don't have to is beyond my paltry reasoning capacity. 

And in Wii news (yes, yes, I'll bring it along to the next surf weekend just for the bowling) Lego Star Wars look to be having conceptual problems wii-ifying - no, we don't want to waggle our arms furiously, we want meaningful movement - but Sega might have a winner with their fighter based on the Bleach manga.  Semi-cel-shaded always works for me, and from the looks of it it's meaningful combos to execute moves, rather like Eye Toy's Antigrav.  One to watch.
andygates: (Default)
So it comes to pass (thick with irony) that I'm involved in the organisation's web logs and all that jazz. These logs are currently dumping out as text files from the proxy servers, three in all, so each day I get about 1.5Gb (no, really) of logs.

Currently I'm manually importing them into a MSSQL database and, for reasons of management's own, each day's logfile ends up in a separate table, ideal for difficult and tedious analysis. Clearly, I'll be automating that in just a few days' time.

But I mean, a gig and a half daily? That's half a terabyte in a year! I know we're enterprise-class, but that's a stuposterously humungous wodge of data. It's particularly unwieldy when (as has happened) I'm asked to mine it for, say, J Random User's access to see if he's been doing "anything naughty".

It strikes me that there's a trick we're missing. We need historical logs, because evidence of naughtiness is a long-term thing. But a terabyte database in a thousand tables is daft. How do real organisations handle this?

Profile

andygates: (Default)
andygates

April 2017

S M T W T F S
      1
2345678
9 101112131415
16171819202122
23242526272829
30      

Syndicate

RSS Atom

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Aug. 19th, 2025 06:25 pm
Powered by Dreamwidth Studios