| Time |
Nick |
Message |
| 00:37 |
|
mtcarlsoz joined #evergreen |
| 03:20 |
|
bshum joined #evergreen |
| 06:36 |
|
dbs joined #evergreen |
| 07:23 |
|
gmcharlt_ joined #evergreen |
| 08:07 |
|
rsinger joined #evergreen |
| 08:52 |
|
Dyrcona joined #evergreen |
| 08:52 |
Dyrcona |
Here's a fun one! |
| 08:52 |
Dyrcona |
Using MARC::Charset from the repo on SourceForge on both machines. |
| 08:53 |
Dyrcona |
One machine processes the file of MARC records with no problems. |
| 08:53 |
Dyrcona |
The other blows up on record 19 067. |
| 08:53 |
Dyrcona |
The files are identical. |
| 08:54 |
Dyrcona |
no mapping found at position 17 in Phép lạ của sự tỉnh thức. at /usr/local/share/perl/5.14.2/MARC/Charset.pm line 296. |
| 08:54 |
Dyrcona |
It is the i with the whatever-that-is above it. |
| 08:55 |
Dyrcona |
Records are UTF-8 and say so in leader 09. |
| 08:57 |
Dyrcona |
Vietnamese, again. :( |
| 08:58 |
jcamins |
Dyrcona: when you say the records are UTF-8, is that "actually UTF-8" or "say UTF-8"? |
| 08:59 |
Dyrcona |
jcamins: Actually UTF-8 and say UTF-8, I converted them with yazmardump. |
| 08:59 |
Dyrcona |
Maybe I should just try processing the original files. |
| 09:00 |
jcamins |
Dyrcona: okay, with MARC, you can never be too careful. |
| 09:00 |
Dyrcona |
jcamins: Right, MARC is a picky bastard. |
| 09:00 |
jcamins |
Same version of Perl on both machines? |
| 09:00 |
* Dyrcona |
kicks MARC where it hurst. |
| 09:00 |
Dyrcona |
jcamins: Yes, but I'll double check right now. |
| 09:01 |
Dyrcona |
Yep. 5.14.2 with 56 registered patches, installed from packages. |
| 09:02 |
jcamins |
Does one of the machines have EG, and one not? |
| 09:02 |
Dyrcona |
Nope, both have EG. One runs it as a server, the other uses the libs as a client. |
| 09:03 |
Dyrcona |
Also, to be clear, I'm using a patched version of MARC::Charset that has corrections Galen made based on these records. |
| 09:03 |
Dyrcona |
I wonder if I'm getting the right MARC::Charset on the one machine, though it prints the "correct" version if I ask it. |
| 09:04 |
jcamins |
Hm. That's where I was going... I was wondering if one had dependencies installed through CPAN and one via package manager. |
| 09:05 |
Dyrcona |
Well, both had MARC::Charset originally installed through package manager and then installed from source. |
| 09:05 |
Dyrcona |
However, one might have had a package update done via CPAN and the other not. |
| 09:05 |
Dyrcona |
Hmm.... |
| 09:07 |
Dyrcona |
I'm going to upgrade everything via CPAN on the one machine and see what happens. |
| 09:08 |
* Dyrcona |
is really starting to hate distros and packages for special purpose machines. |
| 09:08 |
Dyrcona |
Linux from Scratch! |
| 09:09 |
jcamins |
Heh. |
| 09:09 |
Dyrcona |
jcamins: We should collaborate on Koha in a Box and Evergreen in a Box. |
| 09:10 |
jcamins |
Dyrcona: the problem is keeping it up to date. |
| 09:10 |
jcamins |
What we need is a shared chef architecture. |
| 09:10 |
Dyrcona |
Mort! Mort! :) |
| 09:10 |
jcamins |
knife koha -> working Koha server |
| 09:11 |
jcamins |
knife evergreen -> working EG server. |
| 09:12 |
Dyrcona |
I wonder why they chose knife instead of cook or bake or something like that? |
| 09:13 |
jcamins |
I think because knife is the tool, so you run `knife [whatever]` to cook your server up. |
| 09:13 |
* jcamins |
isn't a chef expert, though. |
| 09:14 |
Dyrcona |
I would think you'd use your knife to prepare the ingredients, i.e. prerequisites, but anyway. It doesn't have to make sense to me. |
| 09:15 |
* Dyrcona |
waits as CPAN upgrades nearly everything. |
| 09:16 |
jcamins |
Heh. That'll take a while. |
| 09:25 |
Dyrcona |
Well, I'm certain that I did not upgrade everything via CPAN on the machine that works, but something related must have been updated there. |
| 09:25 |
jcamins |
Fixed it? |
| 09:27 |
Dyrcona |
Ah. I think on the machine where it works, I upgraded MARC::Charset via CPAN before installing it from source. |
| 09:27 |
Dyrcona |
Still updating everything... |
| 09:34 |
Dyrcona |
Well, the upgrade finished with some errors, but nothing that looks relevant to MARC::Charset. |
| 09:34 |
Dyrcona |
So, I'll know in a few hours. It takes a while to parse 19 000 MARC records and do some database lookups. |
| 09:35 |
jcamins |
You can't split out a file with just the problem record? |
| 09:35 |
Dyrcona |
jcamins: Yeah, I can, but I still need to process the whole file. |
| 09:35 |
Dyrcona |
;) |
| 09:35 |
jcamins |
Ah. |
| 09:36 |
Dyrcona |
Actually, I'll pull out the problem record for this test. |
| 09:37 |
Dyrcona |
grep -m 19067 -n '</record>' mvlcmarc.xml |
| 09:39 |
jcamins |
Hey, any suggestions for what I can do with a whole bunch of lychee? |
| 09:39 |
Dyrcona |
sed -e '1651638,1651713 w record.xml' -i mvlcmarc.xml |
| 09:39 |
Dyrcona |
Easy peasy. |
| 09:40 |
jcamins |
They're not quite filling enough for a meal when eaten plain. |
| 09:40 |
Dyrcona |
never cooke with lychee. Always got it as a dessert, usually canned with syrup. |
| 09:40 |
jcamins |
They're delicious, but have approximately no substance whatsoever. |
| 09:40 |
Dyrcona |
These are fresh, I take it? |
| 09:40 |
jcamins |
Yeah. |
| 09:41 |
jcamins |
I feel like I should be able to come up with something to do/serve with them that would result in a nice filling breakfast. |
| 09:41 |
Dyrcona |
Put them in oatmeal, maybe with some mint? |
| 09:41 |
Dyrcona |
Chop 'em up first, I guess. |
| 09:43 |
jcamins |
Yeah, probably my best bet. |
| 09:44 |
Dyrcona |
Grr... still busted on that record. |
| 09:44 |
jcamins |
Hm. I like the sound of stuffed lychee. |
| 09:44 |
Dyrcona |
Or lychee stuffing. |
| 09:44 |
Dyrcona |
Bet that would be good on a butternut squash. |
| 09:44 |
jcamins |
Ooooh. Yes. |
| 09:45 |
Dyrcona |
Or that green kind with the orange innards. Wish I could think of the name. |
| 09:47 |
jcamins |
Or I could make lychee rice pudding. |
| 09:47 |
jcamins |
Shari would like that. |
| 09:48 |
|
fparks_ joined #evergreen |
| 09:49 |
|
sseng_ joined #evergreen |
| 09:51 |
|
rri joined #evergreen |
| 09:54 |
|
bshum_ joined #evergreen |
| 09:54 |
|
mtcarlson_away joined #evergreen |
| 09:55 |
Dyrcona |
Acorn Squash, that's it. |
| 09:57 |
Dyrcona |
All right. Guess I'll cut the 240$a and 500$a from that record that are causing me problems. |
| 09:57 |
Dyrcona |
marc-- |
| 09:57 |
Dyrcona |
@whocares MARC |
| 09:57 |
pinesol_green |
bshum, jcamins and rfrasur hate MARC |
| 09:57 |
Dyrcona |
@hate MARC |
| 09:57 |
pinesol_green |
Dyrcona: The operation succeeded. Dyrcona hates MARC. |
| 09:58 |
Dyrcona |
lychee rice pudding sounds delicious. |
| 09:58 |
Dyrcona |
I'm coming over for some of that! ;) |
| 10:05 |
Dyrcona |
It bothers me that I get different results on these two computers are supposedly identical, both running Ubuntu 12.04 with the latest updates. |
| 10:07 |
jcamins |
Yeah, that's really weird. |
| 10:07 |
jcamins |
Ooh. |
| 10:08 |
jcamins |
Wait. |
| 10:08 |
jcamins |
Idea. |
| 10:08 |
jcamins |
Are you reading it in with one script then piping the results to another? |
| 10:09 |
Dyrcona |
No. |
| 10:09 |
jcamins |
Well, it was an idea. |
| 10:10 |
jcamins |
Kind of scratching the bottom of the idea barrel, but oh well. |
| 10:12 |
pastebot |
"Dyrcona" at 204.193.129.146 pasted "What I run." (17 lines) at http://paste.evergreen-ils.org/10 |
| 10:16 |
jcamins |
Does MARC::Charset depend on iconv? Is it possible you're missing a locale? |
| 10:20 |
Dyrcona |
They have the same iconv packages installed and apt doesn't see any problems when checking them. |
| 10:20 |
Dyrcona |
I wonder... They have different yaz packages, I think. |
| 10:21 |
jcamins |
Hey... I see a difference in those commands. The directories are different. Is it possible your PERL5LIB includes a relative path which is causing the broken one to not find the new MARC::Charset? |
| 10:22 |
jcamins |
Or a "use lib('../..');" or something like that. |
| 10:23 |
Dyrcona |
PERL5LIB on the one that works points to a non-existent directory. |
| 10:24 |
jcamins |
And on the one that doesn't work? |
| 10:24 |
Dyrcona |
On the other machine it points to a directory with the following packages: Backstage JSONPrefs.pm OILS.pm Utils.pm |
| 10:25 |
jcamins |
Hrm. Are any of those included? |
| 10:25 |
Dyrcona |
Nope. |
| 10:28 |
pastebot |
"Dyrcona" at 204.193.129.146 pasted "match_dbi.pl" (161 lines) at http://paste.evergreen-ils.org/11 |
| 10:31 |
Dyrcona |
CPAN tells me that all modules are up to date on both machines and they use the same mirror. |
| 10:31 |
Dyrcona |
I hate this sort of thing. |
| 10:31 |
Dyrcona |
Maybe I'll go do the dishes for a break. |
| 10:31 |
jcamins |
Sounds like a good idea. |
| 10:31 |
* jcamins |
is sauteeing lychees. |
| 10:35 |
jcamins |
Alas, the breading all came off. |
| 10:35 |
jcamins |
Probably because one does not bread and sautee fruit. |
| 10:35 |
jcamins |
Unless one is me. :D |
| 10:36 |
Dyrcona |
Breaded fruit should probably be fried. |
| 10:36 |
Dyrcona |
Y'know, like sautee only hotter. :p |
| 10:37 |
jcamins |
Dyrcona: it started out as frying. |
| 10:37 |
jcamins |
Unfortunately, apparently lychee will soak up an *astonishing* amount of oil. |
| 10:40 |
jcamins |
The good news is, it's starting to brown now. |
| 10:50 |
Dyrcona |
Updating to the same yaz makes no difference. |
| 10:52 |
jcamins |
Is that update_dbi script part of EG? |
| 10:53 |
jcamins |
match_dbi, rather. |
| 11:03 |
jcamins |
@like lychee crumble |
| 11:03 |
pinesol_green |
jcamins: Try restarting apache. |
| 11:03 |
jcamins |
Ummm... |
| 11:04 |
jcamins |
@love lychee crumble |
| 11:04 |
pinesol_green |
jcamins: The operation succeeded. jcamins loves lychee crumble. |
| 11:04 |
jcamins |
@whocares lychee crumble |
| 11:04 |
pinesol_green |
jcamins loves lychee crumble |
| 11:25 |
Dyrcona |
jcamins: No, match_dbi.pl is something that I wrote. |
| 11:26 |
jcamins |
Dyrcona: Hm. |
| 11:26 |
jcamins |
I was thinking I'd take a look at the script, see what it did. |
| 11:27 |
jcamins |
But not if it's not in EG. :) |
| 11:29 |
Dyrcona |
I pasted it earlier. |
| 11:29 |
jcamins |
Oh, so you did. |
| 11:29 |
Dyrcona |
At 10:28:16. |
| 11:30 |
jcamins |
I was busy cutting lychees. |
| 11:32 |
Dyrcona |
I have installed MARC::Charset from here on both computers: git://git.code.sf.net/p/marcpm/code |
| 11:33 |
jcamins |
What happens if you open the file with :utf8 and pass MARC::Batch the file handle? |
| 11:34 |
jcamins |
I have trouble believing there would be a problem with the way MARC::Batch opens the file, but... |
| 11:35 |
Dyrcona |
Well, guess what.... |
| 11:36 |
Dyrcona |
It works with the change you suggested. |
| 11:36 |
jcamins |
You already tried it? |
| 11:36 |
jcamins |
Oh. |
| 11:36 |
jcamins |
Woohoo! |
| 11:36 |
Dyrcona |
I just checked LANG on both machines: en_US.UTF8. |
| 11:36 |
Dyrcona |
I'm still stumped as to the problem. |
| 11:36 |
Dyrcona |
Or, the difference that causes this problem. |
| 11:36 |
jcamins |
Are you using screen in one? |
| 11:37 |
Dyrcona |
Screen in both. |
| 11:37 |
jcamins |
Could one have been started with -U and one without? |
| 11:37 |
Dyrcona |
MARC::Batch has no version, so I can't really check if they are the same. |
| 11:38 |
Dyrcona |
I never use -U. |
| 11:38 |
jcamins |
Huh. |
| 11:38 |
jcamins |
I always use -U. |
| 11:38 |
jcamins |
Well, actually, now I use tmux. |
| 11:38 |
jcamins |
So I use -u. But when I used screen, I always used -U. Otherwise irssi went all wonky. |
| 11:39 |
Dyrcona |
I use tmux on my *BSD machines. On GNU/Linux I tend to use screen. |
| 11:40 |
Dyrcona |
I've considered switching to tmux, though, because I use it to debug threaded perl programs without needing X. |
| 11:40 |
Dyrcona |
I'm going to try with tmux. |
| 11:40 |
jcamins |
How do you use tmux to debug threaded Perl programs? |
| 11:43 |
Dyrcona |
http://search.cpan.org/dist/Debug-Fork-Tmux/ |
| 11:44 |
Dyrcona |
perl -MDebug::Fork::Tmux -d script |
| 11:44 |
Dyrcona |
It opens a new tmux window for forked processes. |
| 11:44 |
jcamins |
Wow, that's really cool! |
| 11:46 |
Dyrcona |
Well, I'm going to go with the filehandle version of match_dbi.pl. |
| 11:47 |
Dyrcona |
Thanks jcamins! |
| 11:47 |
Dyrcona |
jcamins++ |
| 11:47 |
jcamins |
Yay! |
| 11:47 |
jcamins |
You're welcome. |
| 11:50 |
Dyrcona |
Bizarre. I must have messed something up the first time. |
| 11:50 |
Dyrcona |
It actually doesn't fix the problem. |
| 11:50 |
Dyrcona |
It was a good suggestion, though. |
| 11:53 |
Dyrcona |
Yeah, I used the wrong ARGV index so it processed nothing when it appeared to work. |
| 11:53 |
jcamins |
Drat. |
| 11:54 |
jcamins |
Double drat. I forgot the mount the new drive before downloading several gigabytes onto its mount point. |
| 11:55 |
jcamins |
Oops. |
| 11:55 |
Dyrcona |
Oops.... |
| 12:29 |
Dyrcona |
Too many different communications media! |
| 12:35 |
Dyrcona |
Doh! I should turn in my git card..... |
| 12:37 |
Dyrcona |
jcamins: Wrong branch! |
| 12:37 |
* Dyrcona |
hangs his head in shame. |
| 12:37 |
jcamins |
Dyrcona: oh no! |
| 12:37 |
jcamins |
But just think how many things you learned about other stuff! |
| 12:37 |
Dyrcona |
I forgot to checkout wip/nfd-from-utf8-to-marc8. |
| 12:39 |
Dyrcona |
It is always the little things.... |
| 12:41 |
jcamins |
Of course. |
| 13:45 |
Dyrcona |
bshum: You missed all the fun this morning. |
| 13:45 |
bshum |
Dyrcona: Sounds like it. |
| 13:49 |
jcamins |
bshum: don't worry. I'm about to try loading ERIC into a MySQL database. It'll be lots of fun! |
| 14:02 |
|
stevenyvr2 joined #evergreen |
| 14:02 |
|
stevenyvr2 left #evergreen |
| 14:20 |
jcamins |
9400 links loaded. We're blazing along! |
| 15:21 |
Dyrcona |
Whee! Not making as much progress as I would have liked so far today. |
| 15:21 |
jcamins |
Dyrcona: I have loaded the first file incorrectly about six times now. |
| 15:22 |
Dyrcona |
I had hoped to be able to get to patron data today, but I'm still working on issues with MARC records. |
| 15:23 |
Dyrcona |
Yeah, I know how that goes.... |
| 15:23 |
Dyrcona |
Loading files incorrectly, almost never get it quite right the first time. |
| 15:24 |
jcamins |
Now, I don't actually *have* to load all... ummm... 3.8GB of data, but I want to see what will happen. |
| 15:25 |
jcamins |
(most probable result: server crash) |
| 15:30 |
Dyrcona |
That's the kind of thing that I'd start in a screen session and check on every couple of days. ;) |
| 15:31 |
jcamins |
Dyrcona: that's my plan... once I've gotten it work. |
| 15:31 |
jcamins |
And clearly I haven't yet. |
| 15:38 |
Dyrcona |
Turns out that I have 5 records out of 19 679 that have bad UTF8 in 028$b. Now, I just have to find out which 5. |
| 16:05 |
* jcamins |
just learned a valuable fact about asynchronous programming. |
| 16:05 |
jcamins |
If you open a lot of large files asynchronously in a for loop, you *will* trigger an OOM killer. |
| 18:19 |
|
jboyer-home joined #evergreen |
| 18:23 |
|
jboyer-tIRC joined #evergreen |
| 19:12 |
|
rfrasur joined #evergreen |
| 20:25 |
|
jboyer-home joined #evergreen |
| 20:38 |
|
davk joined #evergreen |
| 20:39 |
davk |
hello |
| 20:41 |
davk |
I am going through the install of Opensrf + Evergreen and where it wants me to use srfsh I am getting a Unable to bootstrap client for requests. opensrf services are started without errors and same with ejabberd. Any ideas? |
| 20:55 |
|
stevenyvr2 joined #evergreen |
| 20:55 |
|
stevenyvr2 left #evergreen |
| 21:12 |
|
stevenyvr2 joined #evergreen |
| 21:12 |
|
stevenyvr2 left #evergreen |
| 23:04 |
|
stevenyvr2 joined #evergreen |
| 23:04 |
|
stevenyvr2 left #evergreen |
| 23:42 |
|
rfrasur joined #evergreen |
| 23:49 |
|
Rish joined #evergreen |
