Evergreen ILS Website

IRC log for #evergreen, 2015-07-07

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat

All times shown according to the server's local time.

Time Nick Message
01:35 Mark__T joined #evergreen
01:46 sbrylander joined #evergreen
05:04 pinesol_green Incoming from qatests: Test Success - http://testing.evergreen-ils.org/~live/test.html <http://testing.evergreen-ils.org/~live/test.html>
06:51 TaraC joined #evergreen
07:37 jboyer-isl joined #evergreen
07:38 gsams joined #evergreen
07:55 rjackson_isl joined #evergreen
08:13 ericar joined #evergreen
08:21 Dyrcona joined #evergreen
08:32 mrpeters joined #evergreen
08:33 _bott_ joined #evergreen
08:33 rfrasur joined #evergreen
08:38 bshum csharp: Curious how https://bugs.launchpad.net/evergreen/+bug/1469758 went.
08:38 pinesol_green Launchpad bug 1469758 in Evergreen "Simplified Pull List Interface query is very slow" (affected: 1, heat: 6) [Undecided,Triaged]
08:39 bshum Last round you were changing stats setting, wondering if that worked out better.
08:39 bshum If so, I might consider closing that bug with a note to check PostgreSQL configs. And not make it an Evergreen bug per say.
08:40 Dyrcona joined #evergreen
08:41 mmorgan joined #evergreen
08:54 akilsdonk joined #evergreen
08:58 csharp bshum: no success yet - I'll update it once I determine what the problem is
08:59 csharp it's still greatly overestimating the number of rows for hold_request_current_copy_before_cap_idx
09:00 csharp that's after upping the stats target to 1000 across the board and upping the stats on action.hold_request.current_copy to 10,000
09:01 * Dyrcona just figured this one out: DBI connect('dbname=eg_main;host=172.17​.3.49;port=5432','egreporter',...) failed: could not connect to server: No route to host
09:02 * Dyrcona can't use a private IP of a private network that he's not on. :)
09:02 csharp hooray for simple solutions!
09:03 Dyrcona So, backstage runs on a different server next time, though I might question why authority_control_fields.pl want to use the reporter configuration, since that might point to something other than the main database server.
09:03 csharp Dyrcona: it uses it to gather the IDs so as not to tax the master DB with a potentially resource-intensive SELECT
09:04 csharp I had the same question when I first started looking into it ;-0
09:05 Dyrcona I see...
09:06 Dyrcona For the logs, it is using OpenSRF calls and a CStoreEditor to do the actual update work.
09:19 bshum csharp: well that sucks. Vacuum analyze didn't change it at all after the stats change?
09:19 * bshum contemplates
09:22 csharp bshum: correct :-/
09:27 yboston joined #evergreen
09:41 jeff @coffee everyone
09:41 * pinesol_green brews and pours a cup of Kenya Githiru, and sends it sliding down the bar to everyone
09:41 everyone jeff: thanks!
09:42 yboston jeff: gracias
09:49 RoganH joined #evergreen
09:49 * mmorgan sips. Thanks jeff!
09:57 Stompro csharp, have you tried a vacumm full to blow away all the old stats, and reset them?  I was just reading that normal vacuum analyze just averages/merges in it's stats, it doesn't fully replace what is there.  So if it way off, it takes a while to get to the correct stats..  but I cannot find info to back that up from the manual, the post that states that is from 2013, so fairly recent.
10:05 kmlussier jeff: Thank you!
10:13 kmlussier I'm looking at bug 1441301 and wondering how you delete a metarecord. Is it by deleting the last title that is linked to the metarecord?
10:13 pinesol_green Launchpad bug 1441301 in Evergreen "Deleting Metarecords breaks hold interfaces" (affected: 1, heat: 6) [Undecided,New] https://launchpad.net/bugs/1441301
10:21 bshum kmlussier: That seems to make sense, on paper.
10:33 maryj joined #evergreen
10:47 pdot2 awesome! I'm mostly up and running! my noob question is what the default credentials for the staff client?
10:48 kmlussier pdot2: Congrats!
10:48 bshum pdot2: So, those are usually set when you run the database creation command.  That's where the "admin-user" and "admin-pass" flags get used.
10:48 pdot2 ah perfect, still in my notes even :)
11:15 csharp Stompro: I haven't tried that, but I'm definitely willing to - thanks!
11:16 jwoodard joined #evergreen
11:18 Newziky left #evergreen
11:55 bmills joined #evergreen
11:58 jihpringle joined #evergreen
12:03 buzzy joined #evergreen
12:13 _robbat2|irssi joined #evergreen
12:13 _robbat2|irssi bshum, tsbere: hi, dbs suggested I pick your brain about handling many vhost configs for EG
12:14 _robbat2|irssi Sitka presently has 192 vhosts
12:14 _robbat2|irssi and i'm looking at ways to condense that down without losing functionality
12:14 _robbat2|irssi I a 99% solution, but the last piece is missing
12:15 dbs Conifer is small enough that we just use a single static config; I figured you guys would have come up with a much better / fancier solution :)
12:15 _robbat2|irssi the biggest trick is using SetEnvIfExpr/SetEnvIf
12:15 _robbat2|irssi detecting the hostname and setting apache environment variables based on that
12:16 _robbat2|irssi here's a catchall-example:
12:16 _robbat2|irssi SetEnvIf Request_Protocol ".*" physical_loc=1202 prov=mb orgid=1202 skin=SIRL shortname=MTSIR
12:16 bshum _robbat2|irssi: So I'm following tsbere's lead with use of Apache RewriteMap to define lots of different variables for our various hostnames.
12:16 _robbat2|irssi the bit that is eluding me is this:
12:16 _robbat2|irssi PerlAddVar OILSWebTemplatePath "/srv/openils/var/skins/SIRL"
12:17 _robbat2|irssi i want to change that last path component
12:17 * jeff comes up for air
12:17 bshum _robbat2|irssi: We don't employ use of skin template overrides in our templates.  We just have one standard skin for the whole consortium, but then use apache variables to control certain aspects of that main template, like which logo pic to use, etc.
12:18 bshum But I imagine that one could use a variable for the template path
12:19 _robbat2|irssi yeah, for the images from the above, we have:
12:19 _robbat2|irssi RewriteRule ^/eg/opac/images/(.*)$ /srv/openils/var/skins/%{ENV:skin}/opac/images/$1 [L]
12:20 _robbat2|irssi PerlAddVar is evaulated at server startup time, while SetEnvIf/RewriteRules with expressions are evaluated at request runtime
12:20 _robbat2|irssi i can't find anything like PerlAddVar that fires at request runtime
12:21 jeff There isn't a SetEnvIf equivalent for PerlAddVar, but in theory you could modify EGWeb.pm to push an ENV var as the "first" template path if it was set. Other than usual testing, I'd also look to make sure that such a change wasn't going to break the new template caching.
12:26 _robbat2|irssi hmm
12:26 _robbat2|irssi tell me more of this template caching quickly, as that would be a concern
12:27 _robbat2|irssi i'd also have to make sure that it took the Env from the request, and not spinning up a perl interpreter earlier
12:27 * jeff nods
12:28 jeff best info on the caching i can give you would be the four most recent commits on Open-ILS/src/perlmods/lib/OpenILS/WWW/EGWeb.pm
12:29 bbqben joined #evergreen
12:29 jeff and the relevant (referenced) bugs may have some more info
12:32 jeff it might be safe if you 1) only set the proposed env variable based on hostname and 2) favor a full apache restart if you make changes to the proposed env var
12:32 jeff but i'm not confident enough in that theory to claim it as fact yet. :-)
12:33 _robbat2|irssi err, restart all of apache for it?
12:33 _robbat2|irssi considering I want to do this evalation per-request
12:34 jeff sorry, i mean if you change your conditional statement -- not just if the value of the variable changes.
12:34 _robbat2|irssi oh, that i'm fine with
12:35 jeff i looked at this briefly a while back, but not so much that i had a working branch (that i can FIND, at least), and it was before the TT processor and template caching was added
12:37 jeff but if your SetEnvIf were keying off of something other than the hostname, i'd expect more things to potentially break.
12:40 tsbere _robbat2|irssi: What kind of template changes are you making? Sweeping ones? More style-related?
12:41 tsbere _robbat2|irssi: If it is mostly little things you may be able to get away with just setting an ENV var for "which vhost are we on?" and using includes based on that ENV to pull in customizations.
12:41 tsbere (the includes in the .tt2 files themselves, in this case)
12:43 dbs #evergreen_brains++
12:43 dbs jeff++
12:43 dbs bshum++
12:43 dbs tsbere++
12:50 _robbat2|irssi tsbere: sitka has 84 skins, some are small changes, others are very extensive
12:55 _robbat2|irssi btw, what started this, was working on deploying all of the sitka apache configs with Puppet
12:55 _robbat2|irssi and finding that the puppet-apache module scales badly
12:55 _robbat2|irssi when you have many vhosts
12:56 _robbat2|irssi like >500ms per vhost
12:56 _robbat2|irssi just to compile the puppet catalog, and worse to apply it
12:57 _robbat2|irssi so the catalog compile times went from 2 seconds to >100 seconds, and apply times 30s -> 500s :-(
12:58 _robbat2|irssi and i was thinking, why can't we just trim it down anyway
13:16 tsbere _robbat2|irssi: I think it would be trivial to make an ENV var for the template path and teach EGWeb to load from that *first* if set on requests. Without a major issue from template caching later.
13:19 _robbat2|irssi tsbere: i need to check which scope it takes the env var from (startup vs per-request)
13:19 _robbat2|irssi but i'll do that soon, just on an upgrade status/planning call for our 2.8 upgrade
13:42 pdot2 joined #evergreen
13:43 pdot2 Hi all, possible newb question, but how do I change the theme for a logged in user?
13:45 pdot2 assuming I've created my own css/colors, and updated /openils/var/web/opac/locale/en-US/opac.dtd
13:49 jeff pdot2: I don't think I understand your question. What interface are you trying to customize, and based on what criteria?
13:50 pdot2 I'm attempting to customize the theme of openils a bit (getting that forest green into organization colours, changing out the top left logo
13:51 jeff pdot2: public catalog? staff client? web staff client?
13:52 pdot2 ah, the public catalog
13:52 jeff ah, i'll point you here to start: http://docs.evergreen-ils.org/2​.8/_designing_your_catalog.html
13:52 pdot2 cool, thanks!
13:52 pdot2 this is a lot to get going, I've got about a week :)
13:52 ericar_ joined #evergreen
13:55 RoganH Is there any way to tell the overlay / merge profile "only add this tag if the indicator is x" ?
14:14 csharp Stompro: bshum: interestingly, the same bad stats issue happens on a pg_restore-d database (indicating that vacuum full wouldn't help here) (re: bug 1469758)
14:14 pinesol_green Launchpad bug 1469758 in Evergreen "Simplified Pull List Interface query is very slow" (affected: 1, heat: 6) [Undecided,Triaged] https://launchpad.net/bugs/1469758
14:25 jboyer-isl csharp: I've gotten the impression that freshly restored databases aren't necessarily all that fresh in the statistics department. (i.e. I've had serious issues with speed on dev machines clear up after a full vacuum on a fairly recently restored db)
14:27 csharp yeah, I did a vacuum analyze just after restoring
14:27 csharp though I learned at PGCon that an analyze is all that's needed since pg_restore creates a pristine copy with no dead rows
14:31 dbs csharp: you might be running into some combination of stats + your planner cost estimates + your mem config that results in a bad plan for just your special case :/
14:31 Callender joined #evergreen
14:32 dbs seq_page_cost vs. random_page_cost are fun vars to try to balance out (for some definition of "fun")
14:32 Dyrcona "That should never happen" happens all the time. :(
14:34 akilsdonk_ joined #evergreen
14:44 kmlussier RoganH: No, I don't think you can do that.
14:44 RoganH kmlussier: I didn't think so but I was hoping someone knew a trick.  :(
14:45 RoganH kmlussier: question, do your libraries with shared catalogs load Overdrive records?
14:46 Dyrcona RoganH: We do, but someone does those by hand.
14:47 kmlussier RoganH: Yes, we load Overdrive records. But many of those records are available for use by the entire consortium.
14:47 RoganH Dyrcona: I was afraid you'd say that.  :)
14:47 Dyrcona And, yes, ours are usable by the whole consortium.
14:47 Dyrcona You could do what you want with a custom load program. I know that's not quite helpful, but....
14:47 RoganH Yeah, I'm trying to see what I can work out when many of us have separate accounts.  I'm starting to hit the point of saying they'll either have to be done by hand or we'll need to do development.
14:47 kmlussier I think one consortium may be loading them with the MARC stream importer, but I'm not sure. I know they generally do ebook titles that way.
14:48 RoganH I can think of ways of doing it on the backend but part of the goal is to put it in the catalogers' hands.
14:48 Dyrcona I could be wrong, but I don't think the marc stream importer can do anything that vandelay doesn't.
14:48 kmlussier Dyrcona: No, it can't.
14:49 pdot2 so, MARC records appear to be overkill for the few hundred books I'm looking at, I'm assuming I can't get by with brief records for catalogs / circulation?
14:49 RoganH pdot2: if you have a small collection and you need marc you can use something like the amazon 2 marc tool
14:50 RoganH pdot2: http://chopac.org/cgi-bin/tools/az2marc.pl
14:50 kmlussier pdot2: Brief MARC records? Sure. But  you might want to make sure all of the fixed field information is there so that format icons and filters work properly.
14:50 kmlussier +1 to the amazon 2 marc tool
14:51 Dyrcona pdot2: You could also try grabbing records via z39.50, but +1 to amazon 2 marc.
14:51 * Dyrcona goes back to fixing last night's mess.
14:57 pdot2 amazon marc tool is pretty cool
14:59 kitteh__ joined #evergreen
15:01 pdot2 bit of background, I'm a *nix sysadmin that has never seen the inside of a professionally run library
15:01 pdot2 (from a backend prospective anyway)
15:05 jlitrell joined #evergreen
15:12 sandbergja joined #evergreen
15:28 miker RoganH: are you trying to add a $9 to the 856 from overdrive?
15:29 RoganH miker: no, that's the later issue and I don't think will be a problem
15:29 miker gotcha
15:29 RoganH miker: this has to do with the multiple 856 entries overdrive loads and not wanting to add the junk generic ones while keeping the one that reflects the actual library holding
15:29 RoganH miker: because of course we don't have consortium wide Overdrive
15:30 miker ah, I see ... so, more stripping than adding?
15:31 RoganH miker: right, but the only way to tell them apart is that the generic entries have the indicators of 4|NULL while the actual resource is 4|0
15:31 miker hrm... nothing in any of the subfield content that you could match on via regex? (you can make a strip rule conditional based on a positive match)
15:31 csharp dbs: thanks for the tip - I'll investigate
15:32 RoganH miker: I didn't know we could use regex in there.  I might be able to make that work.
15:33 RoganH miker: To make sure I'm clear we can use regex in the merge/overlay profiles?
15:35 RoganH miker: or in batch edit?
15:37 RoganH miker: if it's in edit then my concern is that it would strip all the generics when I want to keep one instance, though wiping all of them might be acceptable
15:38 miker can use in either, I believe. the authority propagation code uses that to swap subfields only when $0 contains the correct number
15:39 RoganH miker:  I'll play with it, thanks!
15:40 miker so, something like $d856[3~some text] ... I can look up the exact spelling in a minute
15:47 pdot2 ah, that glorious event: 2001 when attempting to register my first patron
15:47 pdot2 2015-07-07 15:45:57 EDT STATEMENT:  INSERT INTO actor.usr (profile, juvenile, usrname, claims_returned_count, family_name, first_given_name, expire_date, id, claims_never_checked_out_count, net_access_level, ident_type, active, last_xact_id, passwd, barred, master_account)
15:47 pdot2 VALUES ('2', 'f', '21187005375399', '0', 'Derp', 'Herp', '2018-07-07T00:00:00-04:00', '16', '0', '1', '1', 't', '1436298356.88058325.689549189485', '3373', 'f', 'f')
15:50 jeff pdot2: the lack of home_ou violates a database constraint. i suspect you may need to run autogen and restart your staff client, if the user editor is trying to create users without any home library set.
15:55 pdot2 ah, is a depth of 2 required for home branch?
15:58 pdot2 it does state the my default (drop down) values for home library are not valid.
15:58 pdot2 will try a complete db wipe (yay testing) and recreating hirearchy
15:58 jeff have you modified your default org unit types?
15:59 pdot2 yes, and ran autogen.sh, restarted apache2
15:59 pdot2 and restarted my client
16:00 jeff you may have made changes that don't make sense, or you might be trying to assign your user to an org unit type that doesn't have "can_have_users" set to true.
16:01 * Dyrcona wishes he had this feature right about now: http://bugs.koha-community.org/​bugzilla3/show_bug.cgi?id=11876
16:01 Dyrcona Or just a tool to diff marc.
16:02 pdot2 allrighty, thanks Jeff, I'll try that out tomorrow
16:03 miker Dyrcona: looks like a side-by-side view of breaker format, no?
16:05 miker Dyrcona: ah ... reading further, they use a JS dif formatter to highlight differences.  neat
16:09 Dyrcona I'm going through audit.bre_history entries to figure out what records that got replaced last night should be unreplaced.
16:09 Dyrcona Seeing a diff of the changes would be handy, but we're basing it on quality score.
16:11 Dyrcona So, maybe I'll add a wishlist bug later.
16:12 Newziky joined #evergreen
16:15 yboston don't judge me ;)
16:15 yboston I once had to diff some marc inside of two sperate EG servers. I used vimdiff supercat_url1 supercat_url2
16:16 yboston like so...
16:16 yboston vimdiff http://catalog.berklee.edu/opac/extras/​supercat/retrieve/marctxt/record/12481 http://berklee-test.evergreencatalog.com/opac/​extras/supercat/retrieve/marctxt/record/12481
16:16 yboston worked great
16:17 Dyrcona That could almost work in my case.
16:17 Dyrcona yboston++
16:17 Dyrcona Anyway, we've decided to replace MARC on records where the quality dropped by 10 or more.
16:17 jeff yboston++ handy and clever -- doesn't help Dyrcona's scenario, but close! :-)
16:18 yboston :)
16:18 Dyrcona We'll figure out what to do with the others later this week.
16:18 Dyrcona The ones where the quality went up deserve to be looked at, too.
16:19 yboston jeff: BTW, let me know if I can help with clearing those i18n strings
16:19 Dyrcona Well, I restored a dump on my dev machine, would need to finish running upgrade scripts etc, before I could the vimdiff trick.
16:19 miker yboston: I judge you ... clever!
16:19 Dyrcona Ideally, I'd like to be able to diff through the audit tables and what's in bre.
16:20 yboston miker: gracias
16:20 Dyrcona But, yeah, that is a clever trick.
16:20 kmlussier @who is judging yboston?
16:20 pinesol_green ldw is judging yboston.
16:32 ldw kmlussier: I think I need confession now ;)
16:34 kmlussier heh
16:43 dbwells yboston++ nice tip
16:43 miker RoganH: my example above was, actually, spelled correctly.  it says: strip ($d) tag 856 where subfield 3 contains 'some text' [3~some text]
16:44 miker (just verified in vandelay.strip_field() stored proc)
16:44 jeff hrm. the version of mod_perl that ships with jessie does not officially support apache 2.4.
16:44 jeff (might not be a problem, but i just found it interesting)
16:45 miker heh ...
16:45 miker wheezy++
16:45 miker (just sayin')
16:45 jeff heh
16:53 berick has anyone ever seen the MULTIPLE_PAYMENTS_FOR_XACT event occur in the wild? (re bug #1251774).  just wondering if the staff cient handles it gracefully.
16:53 pinesol_green Launchpad bug 1251774 in Evergreen 2.3 "duplicate payments in staff client" (affected: 1, heat: 6) [Undecided,New] https://launchpad.net/bugs/1251774
16:53 RoganH miker: I will definitely play with that, thank you!
16:59 miker np
17:01 _robbat2|irssi tsbere, bshum: the hostnamed-triggered RewriteMap you mentioned, can you share it?
17:03 _robbat2|irssi i have a creative-one-liner modification to EGWeb.pm as you suggested
17:03 _robbat2|irssi @template_paths = split(/:/, $ENV{'OILSWebTemplatePath'}) if defined($ENV{'OILSWebTemplatePath'});
17:03 pinesol_green _robbat2|irssi: What we have here is a failure to communicate.
17:04 _robbat2|irssi pinesol_green: sorry, it's just not the same with your mechanical bot accent
17:04 pinesol_green _robbat2|irssi: Down time is a fact of business when you're a poor 501c3 corporation.
17:04 pinesol_green _robbat2|irssi: I am only a bot, please don't think I'm intelligent :)
17:07 _robbat2|irssi ah, you probably wrote apache_rewrite_tricks.txt which is pretty clos
17:08 mmorgan left #evergreen
17:21 BigRig_ joined #evergreen
17:32 jihpringle joined #evergreen
17:32 BigRig joined #evergreen
17:33 jihpringle joined #evergreen
17:34 BigRig joined #evergreen
17:38 BigRig joined #evergreen
17:38 drigney joined #evergreen
18:56 bmills1 joined #evergreen
19:11 dcook joined #evergreen
19:42 bbqben joined #evergreen
22:35 mmorgan1 joined #evergreen
22:42 mmorgan1 Has anyone done anything with Stackview? http://librarylab.law.harvard.edu/stackview/demo/

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat