Evergreen ILS Website

IRC log for #evergreen, 2014-06-12

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat

All times shown according to the server's local time.

Time Nick Message
06:31 Callender joined #evergreen
07:25 tater-laptop joined #evergreen
07:57 remingtron joined #evergreen
08:16 Dyrcona joined #evergreen
08:23 akilsdonk joined #evergreen
08:29 kmlussier joined #evergreen
08:41 Bmagic joined #evergreen
08:41 mmorgan joined #evergreen
08:42 RoganH joined #evergreen
08:45 ericar joined #evergreen
08:55 jwoodard joined #evergreen
08:58 mrpeters joined #evergreen
09:07 jboyer-isl Has anyone seen symptoms like this on 2.5.x: Staff make edits to patron accounts (usually change barcode, passwd, and alert note - a recently migrated lib) and on saving the changes the staff client pegs a CPU core and locks up? (Post save, it's dying on the refresh)
09:07 gsams joined #evergreen
09:08 jboyer-isl We're really only seeing it at a single location (which implies local networking issues) but I've seen it happen with the same lib's staff + patrons off-site.
09:09 jboyer-isl Sadly, there's nothing in the logs about an error or anything unusual and there's really no way to get anything out of the client at that point. (Good job doing blocking IO on the main thread, xulrunner. :( )
09:11 RoganH That's a new one on me.
09:15 yboston joined #evergreen
09:16 Bmagic We see similar behavior when the library has general packet loss to the server (internet connection)
09:16 jboyer-isl We're assuming it's related to the fact that they're the latest migration, but it's seemingly random (It started out every couple of updates, now it's around once an hour or so) but nothing looks unusual.
09:16 Bmagic Try ping -t google.com for 10 minutes and see how many are lost. It should be 0
09:18 kbeswick joined #evergreen
09:18 jboyer-isl Bmagic: The client goes completely unresponsive in that case? I would have thought we'd have more of that if it was just packet loss causing it.
09:18 jboyer-isl I'll have them try that out though.
09:19 Bmagic The staff client goes unresponsive during packet loss periods
09:19 Bmagic We see that in our libraries as well
09:19 rjackson-isl joined #evergreen
09:19 jboyer-isl Huh. I'll definitely get them on that then. Thanks for the lead.
09:27 jeff that specific interface is a browser element, so it's going to behave a little differently than the xul interfaces when faced with adverse network conditions.
09:28 jeff in a similar fashion to how the checkout functions vs marc import/export (vandelay) functions would react differently to said adverse conditions.
09:33 jboyer-isl I'm looking forward to the web client then. At least when a modern browser is having connection issues you can still close it. ;)
09:44 collum joined #evergreen
09:44 kmlussier joined #evergreen
09:51 mllewellyn joined #evergreen
10:05 tspindler joined #evergreen
10:13 RoganH joined #evergreen
10:14 dluch joined #evergreen
10:52 RoganH joined #evergreen
11:02 Bmagic When using the report template tool, creating a report from the Hold Request base table. Is it even possible to output the author of the item on hold? I have attempted to add this column: bib record link-> Target Bib Record -> Indexed Author Field Entries -> value -> Raw Data. This results in an error:   DBD::Pg::st execute failed: ERROR: table name "bla bla bla" specified more than once
11:13 jboyer-isl Bmagic: You might try simplified record extracts rather than indexed author field entries, but it's hard to say what's going on with that error without the debug output of the report.
11:14 Bmagic The debug output isnt there because the report fails
11:22 Bmagic jboyer-isl: The simplified record extracts worked. I dont know why I didnt see that before!
11:22 Bmagic jboyer-isl++
11:25 jboyer-isl Glad that took care of it. I think it's also possible when using that other link to end up with duplicate rows if there are more than one type of author on a record.
11:43 Bmagic jboyer-isl: now I remember why I has having trouble. It's because i dont want author. I want Item Type (audiobook, electronic, etc) Either from the marc leader or I can settle for the 245$h
11:44 Bmagic s/has/was/g
11:50 kmlussier Reminder: dev meeting at 2 p.m. today. Add agenda items here: http://wiki.evergreen-ils.org/dok​u.php?id=dev:meetings:2014-06-12
11:51 jboyer-isl Well, there's Form and LitForm in Simple Record Extracts under Fixed Field Entry, but I'm not certain they're what you're after.
11:56 dkyle Bmagic: sounds like you want Target Bib Record -> Fixed Field Entry -> Type -> Item Type Code
11:58 Bmagic dkyle: I wish that would work. I just results in that same error again (when creating a report from the template) DBD::Pg::st execute failed: ERROR: table name "93841f606928c6502afb7db0161e4082" specified more than once at /openils/bin/clark-kent.pl line 217.
12:02 dkyle Bmagic: what about using Target Bib Record -> Flattened MARC Fields  -> Tag and Target Bib Record -> Flattened MARC Fields  -> Subfield?
12:05 hbrennan joined #evergreen
12:07 Bmagic dkyle: I don't see that path exactly. I have this: Hold Request -> Bib Record Link -> Target Bib Record -> Flattened MARC Fields ->  Subfield
12:08 Bmagic And of course, when I add that, I get that same error about "specified more than once"
12:14 dkyle Bmagic: I haven't really used reporter in years, but that error sounds kinda familiar, I'd go searching on that at this point
12:27 Bmagic dkyle: Thanks for the lead, I am hammering on this and I will report back with findings
12:29 dkyle Bmagic: u welcome. and take another look at your template, could be just specifying the same table more than once in a filter or such
12:31 Bmagic One thing that doest make sense is: When adding the subfield to the output, is that just all subfields? It doesn't look like I can specify the output of a specific tag and subfield
12:34 jboyer-isl Bmagic: You have to specify the field and subfield in the Basic Filters tab, meaning that you're likely to get results only when a record includes that field/subfield combination.
12:35 RoganH joined #evergreen
12:35 jeff unless you make use of nullability controls to force to a left join.
12:35 jeff but i don't think that lack of that is causing the duplicate table error.
12:49 Bmagic I was able to output what I needed in the report output after I changed the filters. Previously the filters were: Hold Request -> Hold Request Record -> Bibliographic Record -> Call Numbers -> Owning Library. and Hold Request -> Hold Request Record -> Hold Request::Requesting User-> Home Library
12:49 Bmagic Those were bad
12:50 Bmagic Instead I went with Hold Request -> Pickup Library and Hold Request -> ILS User:: Home Library -> Organizational Unit ID
13:14 RoganH joined #evergreen
13:24 ldw joined #evergreen
14:02 kmlussier It's meeting time, but it doesn't look like we have much of an agenda.
14:03 bshum kmlussier: Yeah I'm sorry about that.  I have to add stuff
14:03 bshum Been a busy day
14:03 bshum Mine are more FYI announcement type things though.
14:04 bshum I guess I can run it
14:05 RoganH bshum++
14:05 kmlussier bshum++
14:05 bshum #startmeeting Evergreen Developer Meeting - 2014-06-12
14:05 pinesol_green Meeting started Thu Jun 12 14:05:07 2014 US/Eastern.  The chair is bshum. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:05 pinesol_green Useful Commands: #action #agreed #help #info #idea #link #topic.
14:05 pinesol_green The meeting name has been set to 'evergreen_developer_meeting___2014_06_12'
14:05 bshum #topic Introductions
14:05 bshum #info bshum = Ben Shum, Bibliomation
14:05 DPearl1 #info DPearl1 is Dan Pearl from C/W MARS Inc.
14:05 bshum Let's see who we've got and we'll see what we cover
14:05 kmlussier #info kmlussier = Kathy Lussier, MassLNC
14:05 RoganH #info RoganH = Rogan Hamby, SCLENDS
14:05 dbwells #info dbwells = Dan Wells, Hekman Library (Calvin College)
14:06 remingtron #info remingtron is Remington Steed, Hekman Library (Calvin College)
14:06 bshum #link Agenda:  http://wiki.evergreen-ils.org/dok​u.php?id=dev:meetings:2014-06-12
14:06 bshum I'll add more to it as we go
14:06 dkyle #info dkyle Doug Kyle, Grand Rapids Public Library
14:08 jscott joined #evergreen
14:08 bshum Okie dokie
14:08 bshum So as others fill in, feel free to announce yourselves.  But we'll move forward.
14:09 bshum #topic Past action items from last meeting
14:09 bshum #info eeevil After 2.6.0 is cut, eeevil to publish detailed plan about freezing baseline schemas between EG releases and using deprecates/supersedes in database upgrade scripts. This will go on the mailing list and the thread should structure further discussion of pros and cons of eeevil's plan.
14:09 eeevil #info eeevil = Mike Rylander, ESI
14:09 bshum I assume that's still ongoing, but as a related note on that plan, I think I'd like to take this moment to discuss dbwells' notes on the dev list about upgrade paths.
14:09 eeevil bshum: not yet.  I plan to jump on dbwells' thread
14:09 eeevil heh
14:10 bshum #link dbwells' plan:  http://markmail.org/message/tl5d3tnupq2istx7
14:11 bshum I just linked to the thread dbwells started on the dev list to talk about new approaches for upgrade strategy.
14:11 gmcharlt #info gmcharlt = Galen Charlton, ESI
14:11 bshum I'm tardy with my own reply, but I'm curious to see what we can hammer out as we move forward this summer.
14:12 bshum #help Get more responses and ideas sent to list about future Evergreen upgrade strategy.
14:12 dbwells Anything I do with regards to that thread will be short-term, hopefully.
14:13 bshum Sounds reasonable.
14:13 bshum dbwells++ for getting the ball rolling
14:13 bshum Okay
14:13 bshum #topic OpenSRF release
14:14 bshum gmcharlt: Springing this on you, but do you have any thoughts about 2.4 work?
14:14 gmcharlt bshum: aiming for a release after ALA
14:14 bshum #info gmcharlt aiming for an OpenSRF 2.4 release after ALA
14:15 gmcharlt main thing I'd like at this point is more testing of the websocket work by berick
14:15 bshum #info Get more testing of the websocket work started by berick, see https://bugs.launchpad.net/opensrf/+bug/1268619 and others
14:15 pinesol_green Launchpad bug 1268619 in OpenSRF "WebSockets Gateway and JS Library" (affected: 1, heat: 6) [Undecided,New]
14:16 bshum Sounds like a good thing.
14:17 bshum Okay, we'll follow up on that after ALA, but in the meantime, folks should check out the bug and other announcements to help start testing the upcoming work for OpenSRF.
14:18 bshum Thanks for the update gmcharlt++
14:18 bshum #topic Evergreen maintenance releases
14:19 dbwells #info 2.5.5 and 2.6.1 are out
14:19 bshum The next date on the calendar for that is 6/18, do we want to stick to that or perhaps shift things slightly?
14:20 bshum dbwells++ # doing the release dance
14:21 dbwells I haven't managed to hit the dates yet, but I think pushing it back will just give me a new date to not hit.
14:21 bshum I'm not sure how much review we're able to get done over the next week, but I feel like there's a lot of things on the pullrequest tagged towards 2.6.2
14:22 bshum Oh, fewer than I thought actually
14:22 bshum https://bugs.launchpad.net/evergreen/+bugs?field.​searchtext=&orderby=-importance&search=Se​arch&field.status%3Alist=NEW&field.status​%3Alist=CONFIRMED&field.status%3Alist=TRIAGED​&field.status%3Alist=INPROGRESS&field.sta​tus%3Alist=INCOMPLETE_WITH_RESPONSE&field.sta​tus%3Alist=INCOMPLETE_WITHOUT_RESPONSE&assign​ee_option=any&field.assignee=&field.bug_r​eporter=&field.bug_commenter=&field.subsc​riber=&field.structural_subscriber=&field.
14:22 bshum milestone%3Alist=66077&field.tag=pullrequest+&fie​ld.tags_combinator=ANY&field.has_cve.used=&field.​omit_dupes.used=&field.omit_dupes=on&field.affect​s_me.used=&field.has_patch.used=&field.has_branch​es.used=&field.has_branches=on&field.has_no_branc​hes.used=&field.has_no_branches=on&field.has_blue​prints.used=&field.has_blueprints=on&field.has_no​_blueprints.used=&field.has_no_blueprints=on
14:22 bshum Gah, sorry
14:22 bshum Just 7
14:22 * bshum will try shortening his URLs next time)
14:23 dbwells I think it is best for maintenance releases to come out as on-time as possible, and whatever is in, is in.  A month really isn't that long.
14:23 bshum Okay, so if dbwells, you'd prefer to stick with the current timeline, let's make our best effort to meet that then.
14:23 dbwells sounds good
14:23 dbwells I'll get it right, this time!
14:24 bshum #info Next maintenance releases due out on 6/18/14.  Core committers and other reviewers, please make best effort to look at bugs and sign-off on work.
14:24 bshum Okay
14:25 bshum #topic Evergreen 2.7 update
14:25 dbwells To be clear, I consider 6/18 to be the date when I branch and make the preview build.
14:25 bshum #info Today (6/12) was the new date to assign first milestones for major work to be considered for 2.7.
14:26 bshum I see that we have lots of stuff lined up nicely for 2.next.
14:27 berick i still need to add an LP for a minor-ish thing.  will do so shortly.
14:27 bshum berick: I told myself that I can expect an LP for first web client work whenever you're ready.  I think everybody generally expects that to happen when it happens.
14:28 bshum Hopefully not a surprise ;)
14:28 berick heh, no, not a surprise.  i could use some feedback on how best to structure it though.. one LP first sprint 1 or broken out, etc.
14:29 berick but, yeah, still a good bit of work to do before anything is done-ish
14:30 bshum Hmm, I think one bug per sprint sounds like it might not be unreasonable as a starting point.  We may find that individual bugs may be necessary to track specific issues though?
14:31 bshum I guess it depends on how comfortable you are separating the parts of the sprint into separate bugs
14:31 bshum We could track the whole sprint as a blueprint and link it to each bug separately.
14:31 bshum I guess it's more about how the final code will be presented.
14:32 berick well, for the initial round of testing, i'm considering maintaining maybe a simple list somewhere.  there will be /lots/ of little things.  opening LP's for each would be cumbersome, imo.
14:32 dbs #info dbs, Laurentian University
14:32 berick after that's settled down, though, then we can leverage LP in the usual fashion
14:33 bshum Sounds reasonable to me.
14:34 bshum Any other thoughts for berick at this time?
14:34 bshum berick: Or any specific areas you would like to mention about the web client work?
14:34 bshum berick++ by the way, for sending out regular updates on the ongoing efforts
14:34 bshum (and getting feedback)
14:34 dbs berick++
14:34 RoganH berick++
14:34 berick lately i'm in the trenches, so no super interesting udpates to provide
14:34 kmlussier berick++
14:34 dbwells berick++
14:34 berick just working thorugh UIs
14:35 berick aw, shucks
14:35 jeff berick++
14:35 jeff and greetings.
14:35 berick i am curious if we want to try to roll any of this out with the next release
14:35 berick as a preview type thing
14:35 dbs tpac-style
14:35 bshum Next release meaning 2.7?
14:35 RoganH I'm in favor of that.
14:36 berick it will mean we really need to get in the websockets testing
14:36 dbwells +1 to including as a preview
14:36 bshum +1 to preview
14:36 berick bshum: right, next meaning 2.7
14:36 berick it's pushing it close
14:37 bshum Well, let's see how you feel before beta cutoff then
14:37 berick remind me of the date, plz?
14:37 bshum Which is August 7
14:37 berick thanks
14:37 bshum (had to look it up myself)
14:38 berick fortunately, the code is almost entirely standalone and outside the realm of everday EG code
14:38 bshum Okay, sounds like a reasonable goal to try for ;)
14:38 berick there's a few IDL changes and, IIRC, 1 minor API change
14:38 berick so, the big thing really is just the websockets stuff
14:39 berick as far as disrupting the status quo goes
14:39 hbrennan joined #evergreen
14:39 dbwells berick: Granting you 4 hours of sleep per night, you still have 1000+ hours before the beta cutoff, plenty of time
14:39 jeff dbwells++
14:39 bshum Heh
14:39 hbrennan bshum: Your guidance, nor my actions yesterday, were the cause of the checkout breaking!
14:40 hbrennan *not your guidance
14:40 hbrennan Whatever, stupid english grammar
14:40 * berick takes 100 10-minute naps 60 times
14:41 bshum Okay, anything else for this topic before we move on?  (next up, brief mentions about ongoing activities)
14:41 bshum Okay
14:42 bshum #topic The Hack-A-Way potential location
14:42 RoganH The 2014 Hack-A-Way poll is open until next Friday the 20th at midnight EST.
14:42 RoganH #info hackaway poll http://doodle.com/qzzfem72ixntitnv
14:42 RoganH Right now Rock Hill, SC being sponsored by the York Public Library is in the lead
14:43 RoganH After a location is chosen I will poll attendees to determine the dates.
14:43 RoganH Any questions at this point?
14:43 kmlussier RoganH++
14:43 bshum RoganH++
14:43 berick RoganH++
14:43 krvmga joined #evergreen
14:44 RoganH If it's Rock Hill the hotel will probably be the Holiday Inn (its just been remodeled and is very nice) right off I-77.  Cheap, easy to get to.
14:44 bshum Going beyond the location, I think that it's worth noting that last year's hack-a-way we did have some offsite participants using Google hangout.  But we hope to see as many show up in-person as possible to hack together ;)
14:44 RoganH It's about 20 minutes from the Charlotte Airport.  And York will probably cater lunch 2 or 3 days.
14:45 jeffdavis joined #evergreen
14:45 RoganH Agreed.  And I'm going to look at how we can do more with Google hangout but I don't doubt that being there in person has distinct advantages.
14:45 RoganH Still, I want to be as inclusive as possible with the Hangouts because just not everyone can make the trek.
14:45 jeffdavis joined #evergreen
14:46 bshum We'll see what happens as details unfold.  In the meantime, fill out the poll and spread the word!
14:46 dbs as a hangout participant last time, I thank you :)
14:46 RoganH That was my first real playing with Hangouts.  I've come to love them and think we can do a better job with them this year.
14:46 RoganH I use them a lot now.
14:47 bshum Any other questions for RoganH before we move on (next up, notable mentions, aka some short announcements time)
14:47 berick hackaway will just be us building raspberry pi cameras ;)
14:48 RoganH berick: pre-hackfest event :)
14:48 bshum #topic Other Mentions
14:48 berick it's on!
14:48 bshum #info dbs brought up phabricator as a potential replacement for LP, etc.
14:49 bshum #link Wikimedia blog post about their move:  http://blog.wikimedia.org/2014/0​6/10/on-our-way-to-phabricator/
14:49 dbs fwiw, I consider that a very low priority item, just putting a pin in it for the next time the "GAWD I HATE LAUNCHPAD" discussion swells up
14:49 bshum While I don't have the tuits right now, this has sparked some interest for me, and I wanted it on the notes.
14:50 dbwells I haven't delved deeply, but I think Phabricator looks pretty nice.
14:50 dbwells Other than being PHP, but I can get over it.
14:51 bshum Heh, yeah, well, LP hate comes up every once in awhile ;)
14:51 bshum dbs++ for keeping his eyes open
14:52 dkyle #link change floating back to bool: https://bugs.launchpad.net/evergreen/+bug/1319919. wonder if there is agreement on this?
14:52 pinesol_green Launchpad bug 1319919 in Evergreen "upgrading to 2.5+ can break copy templates" (affected: 6, heat: 32) [Undecided,New]
14:52 RoganH Any idea how cumbersome migrating from LP to Phabricator would be?  Some casual googling brings up a lot of bugzilla to Phabricator links but not much for LP.
14:53 bshum RoganH: That was my first question too, I haven't dug up enough yet.  Maybe we do the LP->bugzilla->Phabricator dance then?  (he says half joking)
14:53 RoganH That's not a -1, just throwing out the question.  Some quick searches don't make an informed opinion on my part :)
14:53 bshum Certainly worth someone looking more closely at when we get more time.
14:54 bshum Anywho, that's all I had for this segment.  The last thing on the actual agenda was talking about new development, but we can take a moment to talk about what dkyle just brought up too.
14:55 bshum Well, actually, let's stick with the time, given what we have left.
14:55 bshum #topic Feedback for New Features under development
14:56 bshum #info Conditional Negative Balances - https://bugs.launchpad.net/evergreen/+bug/1198465
14:56 pinesol_green Launchpad bug 1198465 in Evergreen "Support for Conditional Negative Balances" (affected: 12, heat: 52) [Wishlist,Confirmed]
14:56 kmlussier I don't have much to say on this topic because I know dbwells is planning to take a look at it this week. But I just want to say that it would be great if we could get eyes on this issue so that we can set a path forward.
14:56 kmlussier There are 11 people who have clicked the "me too" link in LP, which is a lot for this community. So it seems like this code is important to a lot of people, and I would hate to note see a solution by the time 2.7 is released.
14:57 kmlussier I'm going to reiterate (again) that I still prefer the original approach and would love to work with Dyrcona to dust off that branch and fix bugs that were found.
14:57 kmlussier But MassLNC is committed to working with the community to get this code working in some fashion. I just want to make sure it's done in a way that doesn't add confusion for the end user or for the sys admins who are troubleshooting problems.
14:57 kmlussier That's all I have to say at the moment. Well under the 2 minutes that bshum just gave me. :)
14:58 * dbs hopes to get back to Dyrcona's RDA bug real soon now too
14:59 dbs Ah, LP 1304462 but it looks like bshum is on that
14:59 pinesol_green Launchpad bug 1304462 in Evergreen "Add 264 tag values to Record Summary" (affected: 3, heat: 18) [Wishlist,In progress] https://launchpad.net/bugs/1304462 - Assigned to Ben Shum (bshum)
14:59 bshum For the record, when this work slipped away during 2.6 due to differing opinions by reviewers, I really hoped to make this a priority for 2.7.  So, speaking for myself as RM, I'd welcome any input on that bug to help forge our path forward.
14:59 RoganH kmlussier: A thought. At this point the LP entry for conditional negative balances is an impressive wall of text.  And I'm guilty of not going through it carefully since the first few posts.
15:00 RoganH kmlussier: Can this be simplified for discussion or does it have enough important nuance that it needs to be dug through?
15:00 kmlussier RoganH: I can certainly simplify it, but I have to admit I'm a bit biased on the whole discussion.
15:01 kmlussier My concern is that this bug ultimately has big impacts on end users, and they aren't really seeing the nuances of the different approaches.
15:01 RoganH kmlussier: I'm willing to read through it all.  I agree it's important.  I'm willing to do so and post about it but with the caveat that I might need correction if I miss a nuance.
15:02 RoganH (Actually that seems likely that I will.)
15:02 kmlussier For end users (not the devs), it might also be useful to have side-by-side screenshots of what happens. But, although I have done numerous screenshots in my last round of testing, I don't have much for what the original approach did.
15:03 shadowspar joined #evergreen
15:03 berick joined #evergreen
15:03 JLDAGH joined #evergreen
15:03 jeffdavis A summary post about it to open-ils-general or open-ils-dev would be useful, I think - dunno if our support folks have looked at the bug so far.
15:03 bshum Oh boy, netsplits.
15:04 kmlussier I'm happy to work on a summary post and even post it here as a check against potential bias.
15:04 kmlussier But it will have to wait until next week. Vacation day tomorrow.
15:04 bshum kmlussier: That sounds reasonable.  Plus it'll give dbwells some time to work on his reply he mentions in the last comment.
15:05 bshum I'm going to add action items for both of you on this and we'll follow up next meeting ;)
15:06 bshum #action dbwells to review and comment on conditional negative balance bug: https://bugs.launchpad.net/evergreen/+bug/1198465
15:06 pinesol_green Launchpad bug 1198465 in Evergreen "Support for Conditional Negative Balances" (affected: 13, heat: 56) [Wishlist,Confirmed]
15:06 bshum #action kmlussier to work on summary of bug to list and gather more feedback to move forward
15:06 dbwells I've said a lot in the thread, and don't want to speak too much for eeevil, but we're taking the approach of preserving/extending the existing functionality rather than replacing.  I know some of the complaints are UI related, but I think that can all be secondary to ironing things out on the conceptual level.
15:08 bshum Okay, we're over our time (though we did start late).
15:08 eeevil dbwells: in short, I agree. however, I'm not going to have the tuits in the short term (you mentioned this or next week) to get heavily involved
15:09 bshum Thanks for sticking with me on this loosely formed agenda.  We'll aim to do better next time.
15:09 eeevil bshum++
15:09 DPearl1 bshum++   You did just fine
15:09 bshum I'm going to close this meeting, but suggest continuing any conversations for those who stick around.
15:09 jeff bshum++ way better than that guy who ran the last few meetings ;-)
15:09 kmlussier bshum++ #Making up your own agenda. :)
15:09 bshum #endmeeting
15:09 pinesol_green Meeting ended Thu Jun 12 15:09:42 2014 US/Eastern.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)
15:09 pinesol_green Minutes:        http://evergreen-ils.org/meetings/evergr​een/2014/evergreen.2014-06-12-14.05.html
15:09 pinesol_green Minutes (text): http://evergreen-ils.org/meetings/evergr​een/2014/evergreen.2014-06-12-14.05.txt
15:09 pinesol_green Log:            http://evergreen-ils.org/meetings/evergree​n/2014/evergreen.2014-06-12-14.05.log.html
15:09 bshum I do want to say something about rec_descriptor
15:10 dbwells bshum++
15:10 bshum And the concept of "preserving functionality" but also being mindful of the potential performance issues.
15:10 bshum I have to write up all the stuff I've gone through this week, but I really think that we need to look more closely at how we fix that area if we want 2.6 to be more successful as more folks upgrade into it.
15:10 dbwells eeevil: No problem, I think we'll all just keep chipping away at it until we get there.
15:11 eeevil bshum: absolutely. your pathological hold case is a good example to look out for. did you try the "wide select clause" route, by chance?
15:12 bshum eeevil: I haven't gotten to dig too deeply at solving it yet.  I just did the horrible hacky thing and ripped it out to get moving more quickly for the moment.
15:12 bshum I think I'm still wrapping my mind around how everything is organized now.
15:13 bshum eeevil: Also, humor me because I'm a novice, but what's a "wide select clause" route look like?  :)
15:13 eeevil sorry, I didn't use that wording before
15:13 eeevil basically,
15:15 eeevil select r.id, (select min(value) from ...flat_attr where attr = 'item_form' and record = r.id) as item_form, ... FROM metabib.record_attr_vector_list r;
15:16 eeevil repeating that select clause subselect for each of the mrd fields
15:17 eeevil (excepting title and author ... I'd just leave those blank for mrd, but you could pull them from metabib.record_sorter)
15:17 bshum metabib.rec_descriptor doesn't currently have title/author in it I think
15:18 eeevil oh? good! :)
15:18 eeevil record_attr did
15:18 dbwells eeevil: bshum: I've been poking at this too, based on bshum's instigation.  I can give that a try as well and report back.
15:18 eeevil dbwells: cool, thanks. should be much faster than view->view->hstore->view
15:19 kmlussier I've been tied up in meetings all week and have just been catching up on this discussion. The rec_descriptor issue that bshum raised, where is that causing performance problems? I know reports was one of the areas bshum was poking at, but I'm confused as how it's related to holds.
15:19 eeevil that's really just for reports, though. step 2 is use attr_flat instead
15:20 jeff kmlussier: it can also slow down the hold permit checks at check when opportunistic hold capture takes place
15:20 eeevil kmlussier: for cases where we have to test 100 holds and find that none will work for this copy, it's adding too much time to checkin.  for normal cases where we only need to test a couple, it's not noticeable
15:20 jeff kmlussier: given an item on a bib with many holds, but the item is not eligible for any of the holds, it can lead to timeouts at checkin
15:21 bshum Well, it's noticeable all the time if you care about milliseconds (like our new library using a SIP sorter for checkins) does.
15:21 kmlussier So this is when the retarget checkin modifier is being used?
15:21 jeff (not eligible due to say, age hold protection and all holds being remote)
15:21 jeff kmlussier: no
15:21 jeff kmlussier: at checkin unless no-op checkin is used
15:21 eeevil bshum / dbwells: a shim we could use in the interim would be an mat-view shaped like mrd, populated at ingest (via a separate, later trigger, for easier removal)
15:21 bshum But yeah, for the majority of items / uses it's not a big deal.
15:21 kmlussier Ah, I see.
15:21 kmlussier And, yikes, that's not good.
15:22 Dyrcona Thing is, we're on the same code as bshum and we don't see it.
15:22 eeevil a mat-view would solve the reports problem too
15:23 bshum eeevil: I wondered if that would help with overall performances.  And wondered if this was a PG 9.3 vs. 9.1 issue with how fast it was reading indexes or whatnot
15:23 bshum I did see that materialized views was something that seemed new to 9.3
15:23 eeevil bshum: it'd be a plan difference, not an index reading thing ... I'd be surprised, but it's possible
15:23 jeff bshum: and before 9.3, you just maintain them with a trigger (there are a few in Evergreen already)
15:24 tater-laptop joined #evergreen
15:24 eeevil oh, and I mean a mat-view that /we/ create. like the copy visibility table
15:24 eeevil not a CREATE MATERIALIZED VIEW thing
15:26 bshum eeevil: Well I don't have conclusive proof of issues with PG 9.3, but it's one of the few things that separate me and Dyrcona right now.
15:26 bshum Though I am starting to wonder about our crazy holds/circ rules
15:26 ldw joined #evergreen
15:26 bshum And maybe just us finally hitting some tip point where it's breaking things.
15:27 eeevil well, dataset size, hardware, tuning, all that will change query plans
15:27 kmlussier Is there anyone else on 2.6 who is seeing this?
15:27 bshum I imagine the number of holds too.
15:27 bshum At least for that particular problem
15:28 eeevil kmlussier: fwiw, bshum is the first report /I/ know of, out of several 2.6's I'm near
15:28 Dyrcona We're on 9.1, that's the biggest difference between and Bibliomation.
15:29 kmlussier eeevil: I'm just concerned because, as you know, we have networks that have circ/hold rules that are probably as crazy as bshum's.
15:29 Dyrcona They also have about 5x times as many hold_matrix_matchpoint entries.
15:29 kmlussier And if there is a potential performance issue, it's going to hit them.
15:29 eeevil it's not the number of rules
15:29 Dyrcona No, I don't think it is, either.
15:29 eeevil it's the number of holds that a copy cannot fill, even though it's on the potentials list
15:29 Dyrcona I was gonna say 7,200 isn't that many earlier.
15:30 kmlussier So the more restrictive you are with your holds policies, the more likely you are to see this problem?
15:30 eeevil so, age protection and transit distance restriction are likely drivers. bshum, do you use either of those?
15:31 eeevil kmlussier: not ... exactly
15:31 eeevil kmlussier: but, parts of "restrictive rule" will contribute to potentially exposing the issue
15:31 bshum eeevil: No to age protection, and as for transit distance, sort of, but I have to do some more investigation on what that's actually doing if anything.
15:32 bshum eeevil: I think we have some rules set with transit distance true and a value of 2 or something in the matrix
15:32 bshum For stuff that was intended to be local pickup only or something.
15:32 bshum Not sure if those were written correctly, actually, now that I'm looking at it again.
15:38 bshum eeevil: This isn't exactly apples, but I did a hold permit test on our old production DB hardware (pre-mvf upgrade scripts, etc.) vs. live and it was something like 12-18 ms vs. 400-800 ms
15:38 bshum When I ripped out the rec_descriptor bits in live, that went down to like 24 ms or so
15:38 bshum So I'm not sure transit range hurt me as much as that did
15:39 eeevil bshum: well, it's not that
15:39 eeevil I'm not saying that the problem isn't mrd
15:40 eeevil what I'm saying is that it only really matters when you have a very long list of holds to test for
15:40 eeevil and none of them pass
15:40 eeevil if the first one passes, we look no further and capture
15:40 eeevil but if we have to roll through all 100, then the difference matters
15:41 eeevil so, if we create a mat-view for mrd, this will likely not be an issue
15:41 eeevil in the case I just described
15:41 eeevil but my point is that 99.9% of the time, you're not in that situation where there are 100+ unfillable holds
15:42 eeevil which, again, is not to say that we shouldn't fix this ... we have several options
15:42 eeevil but just to say that we're not seeing across-the-board 2.6 fail because most of the time it doesn't matter
15:43 eeevil transit range is what can cause all 100+ holds to fail for a given (distant) copy. that's a trigger that can expose a given staff user to this behavior
15:44 eeevil but transit range isn't the cause ... does that make sense?
15:44 kmlussier eeevil: I think that 99.9% number is highly dependent on the Evergreen site. You're probably right when it comes to the networks I work with, but aren't there a fair number of Evergreen sites that rely more heavily on transit distance rules?
15:46 eeevil kmlussier: the transit distance restriction is just how the door opens. it doesn't mean that they will suffer from this
15:46 eeevil they still need tons of /distant/ holds that are at the front of the "queue" (hold sort order)
15:48 eeevil kmlussier: if they sort local holds first, and there are any local holds (which, for a hot item is likely) then they're safe. and most sites use boundaries, not transit distance, for the "don't send it far away" case
15:48 pastebot "dbwells" at 64.57.241.14 pasted "rec_descriptor as wide select" (18 lines) at http://paste.evergreen-ils.org/65
15:48 eeevil boundaries close the door to this issue in the common case
15:48 eeevil well, in all but the most artificially-constructed worst case
15:49 eeevil dbwells: indeed, just so
15:49 dbwells bshum: eeevil: I am getting better plans using the view in the paste above (as described by eeevil).
15:50 eeevil bshum: if that view replacement doesn't go far enough, a mat-view based on that is the next step, and that's as fast as mrd can get (faster than since 1.0, when it was a table)
15:50 dbwells I was testing with dkyle's original query, since it was a handy case for testing, so I'll be interested to see if it also helps bshum's holds case.
15:55 * bshum live tests, because hey, that's just how we roll now
15:55 kmlussier bshum++
15:55 kmlussier bshum: Better you than me. :)
16:04 hbrennan bshum: It's more exciting that way
16:04 bshum hbrennan: Oh, so what happened?
16:05 jeff quaqua/cl
16:05 * jeff cocks his head
16:05 jeff ah.
16:06 hbrennan bshum: Well, turns out that we had a copy LOCATION that was unnamed/blank, so when we went in and messed with the circ policies, it awoke a previous problem
16:07 hbrennan so then the circ policies were looking for things that were blank
16:07 hbrennan and it freaked out
16:07 hbrennan so we really did do everything right
16:07 gsams hbrennan: I actually just had that happen to me
16:07 gsams and was going to suggest that was the case
16:08 gsams someone created a blank shelving location at top level and it auto applied it
16:08 hbrennan yep!
16:08 hbrennan Turns out it was for things that were On Order
16:08 hbrennan currently I have it named Other so that it would stop breaking things
16:08 hbrennan so completely unrelated to what we were doing/poking
16:09 gsams I'm glad that was resolved at least!
16:09 gsams In my case, it was a location that was created by accident, so I was able to just delete it.
16:10 hbrennan on the circ desk... sorry
16:12 hbrennan and today I came in really early, Equinox and I got it figured out
16:12 hbrennan and then, while we were open again.. hehe... I tried out creating circ policies and circ limit sets!
16:12 hbrennan and I didn't break anything!
16:12 gsams woo!
16:13 hbrennan Since all checkout limits were previously being regulated by the penalties we removed, I had to create some new limit sets and circ policies for our different groups
16:13 bshum dbwells: eeevil: Only a preliminary test, but I applied that new paste for the rec_descriptor and asked jventuro to run a test report using a fixed field data element.  It ran successfully.
16:13 hbrennan First time since Equinox set up our policies that anyone has touched them... I didn't even have permission to view them yesterday
16:14 bshum She's going to test another one (the report that we know broke for sure) while I did back out the original find_hold_matrix_matchpoint function to retest my case.
16:14 hbrennan so equinox++ too
16:14 hbrennan since they were humored more than anything by our situation this morning
16:15 gsams hbrennan: that was more or less what I was with mine.  It wasn't the first time I had seen it myself anyway, I have bshum to thank for that one though.
16:16 gsams I think that moment was what made me want to utilize the database more
16:18 hbrennan Yep, some of those screens aren't very user friendly
16:18 hbrennan and I never could seem to sort them the way I wanted
16:18 bshum Well, at least the filtering is better with newer versions.  Some of them anyways.
16:19 bshum Imagine paging 15 at a click through circ/hold rules without filtering when you have thousands of rules :D
16:19 hbrennan true
16:19 bshum That is my life.
16:20 hbrennan I I struggled with printing a page of the policies, because it was cutting off #15 on the list
16:20 hbrennan so I had to screenshot it
16:21 kmlussier But there is filtering on those screens now. Makes them much easier to use.
16:23 bshum dbwells: eeevil:  Yes, the permit hold test is faster now with the new rec_descriptor view in place.  Or at least not above 50 ms, so reasonable.
16:23 eeevil cool ... simple CREATE OR REPLACE VIEW upgrade script, then
16:23 eeevil dbwells++
16:23 eeevil bshum++
16:24 hbrennan kmlussier: In my crazy morning, I didn't notice the Filter option on Circ policies.. That would have been great to narrow down to a particular group.. good to know now!
16:25 hbrennan I think I still just look for a search box
16:29 kmlussier hbrennan: The trick is knowing how to enter a search term if you aren't doing an exact match. Use the "is like" option and surround your search terms with %
16:30 hbrennan kmlussier: Super tip, thanks!
16:30 hbrennan kmlussier
16:31 hbrennan kmlussier++ that is
16:36 ericar joined #evergreen
16:40 tspindler left #evergreen
16:53 hbrennan Dang, just almost had to use our defibrillator! phew.. long day already
16:53 gmcharlt oh dear
16:54 hbrennan seizure in the parking lot
16:54 bmills joined #evergreen
16:54 dluch joined #evergreen
17:05 kmlussier So this is weird. On the advanced search page, there is an x that allows you to remove a search row. I noticed a couple of weeks ago that I don't see those x's on anyone's catalog (I looked at several) using either Firefox or Chrome.
17:05 kmlussier I just discovered that the AdBlock plugin for Firefox and Chrome blocks them.
17:05 * gmcharlt blinks
17:06 bshum Oh that's cool
17:06 bshum And by "cool" I mean, wtf?
17:06 gmcharlt I guess Sesame Street's campaign to promote the letter X is now foiled.  Curses!
17:07 kmlussier It's easy enough to stop the plugin from working on those pages, but, yeah. I wonder how many people are using the plugin and never realized they could remove a search row.
17:07 kmlussier And would they suddenly start removing search rows if they knew they had that power?
17:09 mmorgan left #evergreen
17:11 gsams I'm seeing some odd behavior with some recently setup action/trigger courtesy notices
17:11 gsams -1 days, they seem to be generating properly, but they email out the day the items are due
17:12 gsams which is a bit less than helpful in our case
17:12 gsams I'm not really sure where this would be going wrong though
17:18 berick joined #evergreen
17:19 pinesol_green Incoming from qatests: Test Success - http://testing.evergreen-ils.org/~live/test.html <http://testing.evergreen-ils.org/~live/test.html>
18:47 hbrennan joined #evergreen
19:16 hbrennan joined #evergreen
21:02 GtownJoe joined #evergreen
21:03 GtownJoe @list
21:03 pinesol_green GtownJoe: Admin, Anagram, Assorted2, Blame, Bugtracker, Channel, ChannelLogger, Config, Dessert, Dunno, Encyclopedia, Games, Git, Herald, Insult, Karma, Later, LoveHate, MARC, Math, MeetBot, Misc, Note, Owner, Praise, Quote, RSS, Reply, Seen, Status, Time, Todo, Twitter, User, and Weather
21:06 GtownJoe left #evergreen
22:01 mllewellyn joined #evergreen
22:02 mmorgan1 joined #evergreen

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat