--- Log opened Thu Sep 04 00:00:21 2014 |
00:07 | | RchrdB [0x2ba22e11@Nightstar-qe9.aug.187.81.IP] has quit [Operation timed out] |
00:49 | | Derakon[AFK] is now known as Derakon |
02:14 | | macdjord|slep is now known as macdjord |
02:15 | | * macdjord compresses a large volume of highly repetative log files using 7-zip at max settings, gets a ~500:1 compression ratio |
02:16 | <&McMartin> | Yyyep |
02:20 | <@macdjord> | Downside, of course, is the 2.5 hour compression time for ~9GB of files. |
02:22 | <&McMartin> | Heh |
02:24 | | Turaiel[Offline] is now known as Turaiel |
02:24 | <~Vornicus> | On the other hand, those 9gb of files now download in under a second! |
02:25 | <~Vornicus> | (instead of 42 minutes, at my typical 3.5MB/s download speed from Steam) |
02:26 | <@macdjord> | ... 917 MB input -> 1MB output. |
02:26 | <@Alek> | ... |
02:27 | <@macdjord> | And that ratio is only going to get /better/, since the first few hundred k were the dictionary. |
02:27 | <~Vornicus> | I thought that 95%+ compression we got on some raw sql inserts was batshit |
02:28 | <@macdjord> | Vornicus: These are /highly/ repetative, I should point out. I could probably get a 50:1 compression just by storing each one as a diff against the previous version. |
02:28 | <~Vornicus> | damn, son |
02:30 | | thalass [thalass@Nightstar-cssru1.bigpond.net.au] has joined #code |
02:30 | | mode/#code [+o thalass] by ChanServ |
02:30 | <@macdjord> | (If this were a Linux based system, I'd convert the folder into a git repo. But since it's Windows, the 'logging' function is actually a Python script that runs every 5 minutes and makes a new backup copy of the files in question when the proper conditions are met. |
02:35 | <~Vornicus> | Heh |
02:37 | | thalass [thalass@Nightstar-cssru1.bigpond.net.au] has quit [Ping timeout: 121 seconds] |
02:41 | | Checkmate [Z@Nightstar-484uip.cust.comxnet.dk] has quit [Ping timeout: 121 seconds] |
02:42 | | thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has joined #code |
02:42 | | mode/#code [+o thalass] by ChanServ |
02:46 | <@macdjord> | 3300 MB -> 2 MB |
02:47 | <~Vornicus> | dang |
02:47 | <@macdjord> | 1650:1 is pretty good, yes. |
02:47 | <~Vornicus> | so far you're at, uh |
02:47 | <~Vornicus> | that. |
02:48 | <&ToxicFrog> | Who says you can't git on windows? |
02:49 | <~Vornicus> | That too. |
02:49 | <~Vornicus> | I usually run tortoisegit |
02:50 | <@macdjord> | ToxicFrog: You can, but it requires setup. And I have /no/ idea how I'd tie my backup script into it so it commits automatically every time the new version is dropeed in. |
02:51 | <~Vornicus> | eh. |
02:51 | <~Vornicus> | git commit simply errors out if you don't have any changes |
02:51 | <~Vornicus> | I use it on a couple things on a 15 minute cron at work |
02:53 | <@macdjord> | Vornicus: And sometimes the files will /not/ have changed their content at all, and I need to record this fact as well. |
02:58 | | macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has quit [Ping timeout: 121 seconds] |
02:59 | | macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has joined #code |
03:00 | | mode/#code [+o macdjord] by ChanServ |
03:06 | | thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has quit [Ping timeout: 121 seconds] |
03:22 | | macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has quit [Ping timeout: 121 seconds] |
03:23 | | macdjord [macdjord@Nightstar-7rac1r.mc.videotron.ca] has joined #code |
03:23 | | mode/#code [+o macdjord] by ChanServ |
03:40 | <@macdjord> | Final score: 9381 MB -> 5843 KB. |
03:40 | <~Vornicus> | Hot dang |
03:41 | | thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has joined #code |
03:41 | | mode/#code [+o thalass] by ChanServ |
03:43 | <~Vornicus> | just 99.94% compression |
03:46 | | Reiv [NSwebIRC@Nightstar-q8avec.kinect.net.nz] has joined #code |
03:46 | | mode/#code [+o Reiv] by ChanServ |
03:46 | <@macdjord> | Aaaand now to delete the 9.16 GB of files~ |
03:46 | | Harlow [harlow@Nightstar-pq0497.il.comcast.net] has joined #code |
03:48 | <@macdjord> | Which was surprisingly fast! |
03:48 | <@macdjord> | ... I should check whether my secure erase utility is actually running. :-/ |
03:48 | <@Reiv> | Please |
03:49 | <@Reiv> | NSA crippled those *long* ago |
03:53 | | * macdjord uses PGP Desktop for that |
03:53 | <@macdjord> | Hrm. |
03:54 | <@macdjord> | It was not set to run automatically. |
03:54 | <@macdjord> | On the other hand, I've only got 10 GB of free space on my main disk; now is an excellent time to run the Shred Free Space function. |
03:57 | < Harlow> | is there any simple way to check if any bit in a number is 1 and return just 1 all in one line without logical operators? (using C) The way I'm about to do it is going to suck, and involves taking apart an int into 32 pieces bit shifting each col into the last col respectively and then using a bitwise or on them. |
03:57 | <~Vornicus> | um |
03:57 | <~Vornicus> | If any bit in a number is 1 |
03:57 | <~Vornicus> | then the number isn't 0 |
03:57 | <~Vornicus> | End of story. |
03:58 | < Harlow> | yeah, kicker here, can't use comparisons. |
03:58 | <@macdjord> | Ah. |
03:58 | <~Vornicus> | Got constants and some spare space? |
03:59 | < Harlow> | well basically if there is a number and it has bits that are not 0 then this function will have to return just 1. yeah i have spare space, these constraints are just weird though. |
04:00 | < Harlow> | I just feel awkward doing this many bitwise ops to achieve something that would be so elementary. with a logical == |
04:00 | <@macdjord> | Harlow: N = N | N >> 1; N = N | N >> 2; N = N | N >> 4; ...; N = N | N >> 16; |
04:00 | <@macdjord> | Assuming N is a uint32_t. |
04:00 | < Harlow> | yeah it is. |
04:01 | < Harlow> | thats very similar to what i have. |
04:01 | < Harlow> | i guess that will have to suffice. |
04:01 | < Harlow> | ffff. |
04:01 | <@macdjord> | Oh, wait - I missed the last step: n & 1; |
04:01 | <@macdjord> | Why can't you use any comparators? |
04:01 | < Harlow> | Program stipulation, Thanks Professor... |
04:02 | < Harlow> | lol |
04:02 | <@macdjord> | (N ? 1 : 0) would be so much easier... |
04:02 | < Harlow> | i know. |
04:02 | < Harlow> | but thats logical. |
04:02 | <@macdjord> | In both senses of the word~ |
04:04 | <~Vornicus> | b = (a & 0x0000ffff) | ((a & ffff0000) >> 16); c = (b & 0x00ff) | ((b & 0xff00) >> 8); d = (c & 0x0f) | ((c & 0xf0) >> 4) ... |
04:05 | < Harlow> | Yeah thats what i had. |
04:05 | < Harlow> | basically macdjord's is a hell of a lot simpler. |
04:05 | <~Vornicus> | In the other direction and using addition it's a half-decent (though not as good as table lookup) bit counter |
04:09 | <&ToxicFrog> | macdjord: re automatic commits: git add . && git commit --allow-empty -m "Automatic commit at $(date)" |
04:10 | <@macdjord> | ToxicFrog: Yes, that's what I'd do if I were on *nix and using a proper command shell. I'm on Windows, using a hacked together Python script. |
04:11 | <~Vornicus> | as though you can't schedule a batch to fire every few minutes |
04:14 | <@macdjord> | Gaaaaaah... |
04:15 | <@macdjord> | FF crashed hard, and my sessionstore file got overwritten with all nulls. |
04:16 | <@macdjord> | When I relaunched FF, it discarded the invalid sessionstore file and started a clean session - /yet it still overwrote sessionstore.bak, which had previously held a perfectly valid, day old session, with this useless document of nulls./ |
04:18 | | * macdjord mournfully restores a month-old seesion file that he has lying around |
04:19 | | Vornicus [vorn@ServerAdministrator.Nightstar.Net] has quit [[NS] Quit: Leaving] |
04:26 | | thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has quit [Ping timeout: 121 seconds] |
04:48 | | Turaiel is now known as Turaiel[Offline] |
04:50 | | VirusJTG [VirusJTG@Nightstar-6i5vf7.sta.comporium.net] has quit [[NS] Quit: Program Shutting down] |
05:05 | | Derakon is now known as Derakon[AFK] |
05:35 | | Kindamoody[zZz] is now known as Kindamoody |
05:39 | | celticminstrel [celticminst@Nightstar-ak6p6n.dsl.bell.ca] has quit [[NS] Quit: And lo! The computer falls into a deep sleep, to awake again some other day!] |
06:20 | | Harlow [harlow@Nightstar-pq0497.il.comcast.net] has quit [[NS] Quit: sleep] |
07:57 | | Erik [8f610223@Nightstar-obfcgl.mibbit.com] has joined #code |
07:57 | < Erik> | I'm having a bit of an existential moment here today. |
07:57 | < Erik> | I get an email saying that I've been granted access to a new workspace. |
07:58 | < Erik> | I'm confused, can't remember what I was supposed to do with this workspace. Ask boss. Boss is confused too. Ask person who sent me the access. Person says I filed the request, but I remember none of this. |
07:58 | < Erik> | Ask contractor I've been hired out to. Nope, not their workspace. |
07:58 | < Erik> | Try to inspect workspace. I can view it but not do anything there, so I'd need more access to do my job here. |
07:58 | < Erik> | Why...? |
08:08 | <@macdjord> | ... who are you again? |
08:08 | | macdjord is now known as macdjord|slep |
08:15 | < Erik> | :D |
08:48 | | thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has joined #code |
08:48 | | mode/#code [+o thalass] by ChanServ |
09:06 | | Syka [the@Nightstar-d16r4u.vividwireless.net.au] has quit [Connection closed] |
09:06 | | Syka [the@Nightstar-d16r4u.vividwireless.net.au] has joined #code |
10:13 | | Orthia [orthianz@Nightstar-k7q.die.224.119.IP] has quit [Ping timeout: 121 seconds] |
10:16 | | thalass [thalass@Nightstar-9afvpg.bigpond.net.au] has quit [Ping timeout: 121 seconds] |
10:19 | | Orthia [orthianz@Nightstar-2p8.9pc.184.203.IP] has joined #code |
10:19 | | mode/#code [+o Orthia] by ChanServ |
10:28 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code |
10:28 | | mode/#code [+o RchrdB] by ChanServ |
10:44 | | Checkmate [Z@Nightstar-484uip.cust.comxnet.dk] has joined #code |
10:44 | | mode/#code [+o Checkmate] by ChanServ |
10:47 | | thalass [thalass@Nightstar-q1cp31.bigpond.net.au] has joined #code |
10:47 | | mode/#code [+o thalass] by ChanServ |
11:02 | | thalass [thalass@Nightstar-q1cp31.bigpond.net.au] has quit [Ping timeout: 121 seconds] |
11:10 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving] |
11:14 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code |
11:14 | | mode/#code [+o RchrdB] by ChanServ |
11:24 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving] |
11:26 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code |
11:26 | | mode/#code [+o RchrdB] by ChanServ |
11:28 | | Erik [8f610223@Nightstar-obfcgl.mibbit.com] has left #code [] |
11:41 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving] |
11:41 | | VirusJTG [VirusJTG@Nightstar-6i5vf7.sta.comporium.net] has joined #code |
11:42 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has joined #code |
11:42 | | mode/#code [+o RchrdB] by ChanServ |
12:42 | <@Azash> | https://www.youtube.com/watch?v=MOXQo7nURs0 |
12:48 | <@TheWatcher> | I do believe someone is taking the piss |
12:48 | <@Azash> | It's a clever ad |
13:23 | <@RchrdB> | Space splitting in shells is THE TERRIBLE SECRET OF UNIX. |
13:40 | | Kindamoody [Kindamoody@Nightstar-180u8i.tbcn.telia.com] has quit [Ping timeout: 121 seconds] |
13:59 | | Kindamoody [Kindamoody@Nightstar-180u8i.tbcn.telia.com] has joined #code |
13:59 | | mode/#code [+o Kindamoody] by ChanServ |
15:08 | | Kindamoody is now known as Kindamoody|afk |
15:34 | | celticminstrel [celticminst@Nightstar-ak6p6n.dsl.bell.ca] has joined #code |
15:34 | | mode/#code [+o celticminstrel] by ChanServ |
17:14 | | Kindamoody|afk is now known as Kindamoody |
17:20 | < Syka> | Azash: ahaha |
17:30 | | Orthia [orthianz@Nightstar-2p8.9pc.184.203.IP] has quit [Ping timeout: 121 seconds] |
17:34 | | Orthia [orthianz@Nightstar-vvh.c65.224.119.IP] has joined #code |
17:34 | | mode/#code [+o Orthia] by ChanServ |
18:17 | | Turaiel[Offline] is now known as Turaiel |
18:43 | | Turaiel is now known as Turaiel[Offline] |
19:13 | | RchrdB [0x2ba22e11@Nightstar-952.jvr.168.194.IP] has quit [[NS] Quit: Leaving] |
20:20 | | Kindamoody is now known as Kindamoody[zZz] |
20:33 | | gnolam [lenin@Nightstar-sanfmp.cust.bredbandsbolaget.se] has quit [[NS] Quit: No Ping reply in 180 seconds.] |
20:36 | | gnolam [lenin@Nightstar-sanfmp.cust.bredbandsbolaget.se] has joined #code |
20:36 | | mode/#code [+o gnolam] by ChanServ |
20:36 | | Reiver [quassel@Nightstar-ksqup0.co.uk] has quit [[NS] Quit: No Ping reply in 180 seconds.] |
20:38 | | Reiver [quassel@Nightstar-ksqup0.co.uk] has joined #code |
20:38 | | mode/#code [+ao Reiver Reiver] by ChanServ |
23:31 | | Vornicus [vorn@ServerAdministrator.Nightstar.Net] has joined #code |
23:31 | | mode/#code [+qo Vornicus Vornicus] by ChanServ |
--- Log closed Fri Sep 05 00:00:37 2014 |