code logs -> 2014 -> Thu, 04 Sep 2014< code.20140903.log - code.20140905.log >
--- Log opened Thu Sep 04 00:00:21 2014
00:07 RchrdB [0x2ba22e11@Nightstar-qe9.aug.187.81.IP] has quit [Operation timed out]
00:49 Derakon[AFK] is now known as Derakon
02:14 macdjord|slep is now known as macdjord
02:15 * macdjord compresses a large volume of highly repetative log files using 7-zip at max settings, gets a ~500:1 compression ratio
02:16
<&McMartin>
Yyyep
02:20
<@macdjord>
Downside, of course, is the 2.5 hour compression time for ~9GB of files.
02:22
<&McMartin>
Heh
02:24 Turaiel[Offline] is now known as Turaiel
02:24
<~Vornicus>
On the other hand, those 9gb of files now download in under a second!
02:25
<~Vornicus>
(instead of 42 minutes, at my typical 3.5MB/s download speed from Steam)
02:26
<@macdjord>
... 917 MB input -> 1MB output.
02:26
<@Alek>
...
02:27
<@macdjord>
And that ratio is only going to get /better/, since the first few hundred k were the dictionary.
02:27
<~Vornicus>
I thought that 95%+ compression we got on some raw sql inserts was batshit
02:28
<@macdjord>
Vornicus: These are /highly/ repetative, I should point out. I could probably get a 50:1 compression just by storing each one as a diff against the previous version.
02:28
<~Vornicus>
damn, son
02:30 thalass [thalass@Nightstar-cssru1.bigpond.net.au] has joined #code
02:30 mode/#code [+o thalass] by ChanServ
02:30
<@macdjord>
(If this were a Linux based system, I'd convert the folder into a git repo. But since it's Windows, the 'logging' function is actually a Python script that runs every 5 minutes and makes a new backup copy of the files in question when the proper conditions are met.
02:35
<~Vornicus>
Heh
02:37 thalass [thalass@Nightstar-cssru1.bigpond.net.au] has quit [Ping timeout: 121 seconds]
02:41 Checkmate [Z@Nightstar-484uip.cust.comxnet.dk] has quit [Ping timeout: 121 seconds]
02:42 thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has joined #code
02:42 mode/#code [+o thalass] by ChanServ
02:46
<@macdjord>
3300 MB -> 2 MB
02:47
<~Vornicus>
dang
02:47
<@macdjord>
1650:1 is pretty good, yes.
02:47
<~Vornicus>
so far you're at, uh
02:47
<~Vornicus>
that.
02:48
<&ToxicFrog>
Who says you can't git on windows?
02:49
<~Vornicus>
That too.
02:49
<~Vornicus>
I usually run tortoisegit
02:50
<@macdjord>
ToxicFrog: You can, but it requires setup. And I have /no/ idea how I'd tie my backup script into it so it commits automatically every time the new version is dropeed in.
02:51
<~Vornicus>
eh.
02:51
<~Vornicus>
git commit simply errors out if you don't have any changes
02:51
<~Vornicus>
I use it on a couple things on a 15 minute cron at work
02:53
<@macdjord>
Vornicus: And sometimes the files will /not/ have changed their content at all, and I need to record this fact as well.
02:58 macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has quit [Ping timeout: 121 seconds]
02:59 macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has joined #code
03:00 mode/#code [+o macdjord] by ChanServ
03:06 thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has quit [Ping timeout: 121 seconds]
03:22 macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has quit [Ping timeout: 121 seconds]
03:23 macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has joined #code
03:23 mode/#code [+o macdjord] by ChanServ
03:40
<@macdjord>
Final score: 9381 MB -> 5843 KB.
03:40
<~Vornicus>
Hot dang
03:41 thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has joined #code
03:41 mode/#code [+o thalass] by ChanServ
03:43
<~Vornicus>
just 99.94% compression
03:46 Reiv [NSwebIRC@Nightstar-q8avec.kinect.net.nz] has joined #code
03:46 mode/#code [+o Reiv] by ChanServ
03:46
<@macdjord>
Aaaand now to delete the 9.16 GB of files~
03:46 Harlow [harlow@Nightstar-pq0497.il.comcast.net] has joined #code
03:48
<@macdjord>
Which was surprisingly fast!
03:48
<@macdjord>
... I should check whether my secure erase utility is actually running. :-/
03:48
<@Reiv>
Please
03:49
<@Reiv>
NSA crippled those *long* ago
03:53 * macdjord uses PGP Desktop for that
03:53
<@macdjord>
Hrm.
03:54
<@macdjord>
It was not set to run automatically.
03:54
<@macdjord>
On the other hand, I've only got 10 GB of free space on my main disk; now is an excellent time to run the Shred Free Space function.
03:57
< Harlow>
is there any simple way to check if any bit in a number is 1 and return just 1 all in one line without logical operators? (using C) The way I'm about to do it is going to suck, and involves taking apart an int into 32 pieces bit shifting each col into the last col respectively and then using a bitwise or on them.
03:57
<~Vornicus>
um
03:57
<~Vornicus>
If any bit in a number is 1
03:57
<~Vornicus>
then the number isn't 0
03:57
<~Vornicus>
End of story.
03:58
< Harlow>
yeah, kicker here, can't use comparisons.
03:58
<@macdjord>
Ah.
03:58
<~Vornicus>
Got constants and some spare space?
03:59
< Harlow>
well basically if there is a number and it has bits that are not 0 then this function will have to return just 1. yeah i have spare space, these constraints are just weird though.
04:00
< Harlow>
I just feel awkward doing this many bitwise ops to achieve something that would be so elementary. with a logical ==
04:00
<@macdjord>
Harlow: N = N | N >> 1; N = N | N >> 2; N = N | N >> 4; ...; N = N | N >> 16;
04:00
<@macdjord>
Assuming N is a uint32_t.
04:00
< Harlow>
yeah it is.
04:01
< Harlow>
thats very similar to what i have.
04:01
< Harlow>
i guess that will have to suffice.
04:01
< Harlow>
ffff.
04:01
<@macdjord>
Oh, wait - I missed the last step: n & 1;
04:01
<@macdjord>
Why can't you use any comparators?
04:01
< Harlow>
Program stipulation, Thanks Professor...
04:02
< Harlow>
lol
04:02
<@macdjord>
(N ? 1 : 0) would be so much easier...
04:02
< Harlow>
i know.
04:02
< Harlow>
but thats logical.
04:02
<@macdjord>
In both senses of the word~
04:04
<~Vornicus>
b = (a & 0x0000ffff) | ((a & ffff0000) >> 16); c = (b & 0x00ff) | ((b & 0xff00) >> 8); d = (c & 0x0f) | ((c & 0xf0) >> 4) ...
04:05
< Harlow>
Yeah thats what i had.
04:05
< Harlow>
basically macdjord's is a hell of a lot simpler.
04:05
<~Vornicus>
In the other direction and using addition it's a half-decent (though not as good as table lookup) bit counter
04:09
<&ToxicFrog>
macdjord: re automatic commits: git add . && git commit --allow-empty -m "Automatic commit at $(date)"
04:10
<@macdjord>
ToxicFrog: Yes, that's what I'd do if I were on *nix and using a proper command shell. I'm on Windows, using a hacked together Python script.
04:11
<~Vornicus>
as though you can't schedule a batch to fire every few minutes
04:14
<@macdjord>
Gaaaaaah...
04:15
<@macdjord>
FF crashed hard, and my sessionstore file got overwritten with all nulls.
04:16
<@macdjord>
When I relaunched FF, it discarded the invalid sessionstore file and started a clean session - /yet it still overwrote sessionstore.bak, which had previously held a perfectly valid, day old session, with this useless document of nulls./
04:18 * macdjord mournfully restores a month-old seesion file that he has lying around
04:19 Vornicus [vorn@ServerAdministrator.Nightstar.Net] has quit [[NS] Quit: Leaving]
04:26 thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has quit [Ping timeout: 121 seconds]
04:48 Turaiel is now known as Turaiel[Offline]
04:50 VirusJTG [VirusJTG@Nightstar-6i5vf7.sta.comporium.net] has quit [[NS] Quit: Program Shutting down]
05:05 Derakon is now known as Derakon[AFK]
05:35 Kindamoody[zZz] is now known as Kindamoody
05:39 celticminstrel [celticminst@Nightstar-ak6p6n.dsl.bell.ca] has quit [[NS] Quit: And lo! The computer falls into a deep sleep, to awake again some other day!]
06:20 Harlow [harlow@Nightstar-pq0497.il.comcast.net] has quit [[NS] Quit: sleep]
07:57 Erik [8f610223@Nightstar-obfcgl.mibbit.com] has joined #code
07:57
< Erik>
I'm having a bit of an existential moment here today.
07:57
< Erik>
I get an email saying that I've been granted access to a new workspace.
07:58
< Erik>
I'm confused, can't remember what I was supposed to do with this workspace. Ask boss. Boss is confused too. Ask person who sent me the access. Person says I filed the request, but I remember none of this.
07:58
< Erik>
Ask contractor I've been hired out to. Nope, not their workspace.
07:58
< Erik>
Try to inspect workspace. I can view it but not do anything there, so I'd need more access to do my job here.
07:58
< Erik>
Why...?
08:08
<@macdjord>
... who are you again?
08:08 macdjord is now known as macdjord|slep
08:15
< Erik>
:D
08:48 thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has joined #code
08:48 mode/#code [+o thalass] by ChanServ
09:06 Syka [the@Nightstar-d16r4u.vividwireless.net.au] has quit [Connection closed]
09:06 Syka [the@Nightstar-d16r4u.vividwireless.net.au] has joined #code
10:13 Orthia [orthianz@Nightstar-k7q.die.224.119.IP] has quit [Ping timeout: 121 seconds]
10:16 thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has quit [Ping timeout: 121 seconds]
10:19 Orthia [orthianz@Nightstar-2p8.9pc.184.203.IP] has joined #code
10:19 mode/#code [+o Orthia] by ChanServ
10:28 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code
10:28 mode/#code [+o RchrdB] by ChanServ
10:44 Checkmate [Z@Nightstar-484uip.cust.comxnet.dk] has joined #code
10:44 mode/#code [+o Checkmate] by ChanServ
10:47 thalass [thalass@Nightstar-q1cp31.bigpond.net.au] has joined #code
10:47 mode/#code [+o thalass] by ChanServ
11:02 thalass [thalass@Nightstar-q1cp31.bigpond.net.au] has quit [Ping timeout: 121 seconds]
11:10 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving]
11:14 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code
11:14 mode/#code [+o RchrdB] by ChanServ
11:24 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving]
11:26 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code
11:26 mode/#code [+o RchrdB] by ChanServ
11:28 Erik [8f610223@Nightstar-obfcgl.mibbit.com] has left #code []
11:41 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving]
11:41 VirusJTG [VirusJTG@Nightstar-6i5vf7.sta.comporium.net] has joined #code
11:42 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code
11:42 mode/#code [+o RchrdB] by ChanServ
12:42
<@Azash>
https://www.youtube.com/watch?v=MOXQo7nURs0
12:48
<@TheWatcher>
I do believe someone is taking the piss
12:48
<@Azash>
It's a clever ad
13:23
<@RchrdB>
Space splitting in shells is THE TERRIBLE SECRET OF UNIX.
13:40 Kindamoody [Kindamoody@Nightstar-180u8i.tbcn.telia.com] has quit [Ping timeout: 121 seconds]
13:59 Kindamoody [Kindamoody@Nightstar-180u8i.tbcn.telia.com] has joined #code
13:59 mode/#code [+o Kindamoody] by ChanServ
15:08 Kindamoody is now known as Kindamoody|afk
15:34 celticminstrel [celticminst@Nightstar-ak6p6n.dsl.bell.ca] has joined #code
15:34 mode/#code [+o celticminstrel] by ChanServ
17:14 Kindamoody|afk is now known as Kindamoody
17:20
< Syka>
Azash: ahaha
17:30 Orthia [orthianz@Nightstar-2p8.9pc.184.203.IP] has quit [Ping timeout: 121 seconds]
17:34 Orthia [orthianz@Nightstar-vvh.c65.224.119.IP] has joined #code
17:34 mode/#code [+o Orthia] by ChanServ
18:17 Turaiel[Offline] is now known as Turaiel
18:43 Turaiel is now known as Turaiel[Offline]
19:13 RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving]
20:20 Kindamoody is now known as Kindamoody[zZz]
20:33 gnolam [lenin@Nightstar-sanfmp.cust.bredbandsbolaget.se] has quit [[NS] Quit: No Ping reply in 180 seconds.]
20:36 gnolam [lenin@Nightstar-sanfmp.cust.bredbandsbolaget.se] has joined #code
20:36 mode/#code [+o gnolam] by ChanServ
20:36 Reiver [quassel@Nightstar-ksqup0.co.uk] has quit [[NS] Quit: No Ping reply in 180 seconds.]
20:38 Reiver [quassel@Nightstar-ksqup0.co.uk] has joined #code
20:38 mode/#code [+ao Reiver Reiver] by ChanServ
23:31 Vornicus [vorn@ServerAdministrator.Nightstar.Net] has joined #code
23:31 mode/#code [+qo Vornicus Vornicus] by ChanServ
--- Log closed Fri Sep 05 00:00:37 2014
code logs -> 2014 -> Thu, 04 Sep 2014< code.20140903.log - code.20140905.log >

[ Latest log file ]