| 10:22 |
sharpsie |
lrwxrwxrwx 1 root root 4 Jul 18 2019 /bin/sh -> dash |
| 10:23 |
sharpsie |
that's on a 20.04 server here |
| 10:24 |
Dyrcona |
sharpsie: The crontabs both do SHELL = /bin/bash |
| 10:25 |
mantis1 |
JBoyer it may be I can give it a shot in our test server then get back to you |
| 10:27 |
sharpsie |
Dyrcona: ah |
| 10:27 |
Dyrcona |
Anyway, that's small potatoes at the moment. I tried replacing our 2-day courtesy notices with a combined template for autorenewals on the "bad" vm last night, and it choked on 62,321 notices.I'll have to dig into the logs, but the a/t runner isn't running and its stuck with 52000+ "collected" events. |
| 10:27 |
sharpsie |
is LYING=true set :-) |
| 10:48 |
sharpsie |
Dyrcona: ah - I've only played with Arch in VMs |
| 10:48 |
sharpsie |
jeff: makes sense |
| 10:49 |
sandbergja |
Dyrcona: I switched to Endeavour OS for my personal laptop recently -- really enjoying it so far. It's been fun to dip my toes into the arch world. |
| 10:49 |
Dyrcona |
sharpsie: It's actually easier to install it on hardware than on a vm, because of the UEFI setup. At least that was my experience. I did a test install on a VM before going "live." |
| 10:50 |
Dyrcona |
Right, so /var/log/syslog.1 looks like it was rotated 3 days ago, and it is also 17GB. Something's off on this vm. |
| 10:53 |
Bmagic |
mantis1: probably opac/parts/record/summary.tt2 |
| 10:54 |
Dyrcona |
sandbergja: I hadn't seen Endeavour OS before. It looks cool. |
| 11:18 |
|
dguarrac joined #evergreen |
| 11:18 |
Dyrcona |
Something is definitely wrong because right cron tries running this job, it says 'No MTA installed, discarding output.' So, cron has a problem before it gets to the job? Redirection to a file isn't working.... |
| 11:23 |
Dyrcona |
All right. We'll see if 'no configuration' works for this. |
| 11:29 |
Dyrcona |
Well, the message about no MTA did not appear in the logs, but still got no output and no mail was delivered to the user, so maybe it worked. There was nothing to do on that vm? I'll test the other with "Local only" mail configuraiton. |
| 11:32 |
Dyrcona |
Really? That's the problem.... |
| 11:39 |
Dyrcona |
And.... Still nothing. |
| 11:41 |
Dyrcona |
OK. eliminated the redirects and its running..... |
| 14:28 |
Dyrcona |
Ha! Never mind! |
| 14:32 |
jeffdavis |
Bmagic: if you are looking into Azure (or other Shibboleth-based SSO) and you are running EG on Ubuntu, you will probably need the changes to OpenSRF and Evergreen from bug 1999823 |
| 14:32 |
pinesol |
Launchpad bug 1999823 in OpenSRF "Name collision causes apache gateway modules to fail when mod_shib is installed" [Medium,Confirmed] https://launchpad.net/bugs/1999823 |
| 14:34 |
jeffdavis |
I'm happy to share the Shibboleth setup that has worked for us in testing as well |
| 14:35 |
Bmagic |
jeffdavis++ |
| 14:42 |
|
shulabear joined #evergreen |
| 14:47 |
Bmagic |
13 minte warning! Dev meeting |
| 15:32 |
Bmagic |
oh |
| 15:32 |
berick |
thanks rfrasur. there will be plenty yet to discuss |
| 15:32 |
Bmagic |
#link https://bugs.launchpad.net/opensrf/+bug/2032835 |
| 15:33 |
Bmagic |
#topic LP#1999823: concurrent changes to EG and OpenSRF required; testing requested |
| 15:33 |
jeffdavis |
I can speak to this |
| 15:33 |
Bmagic |
#link https://bugs.launchpad.net/opensrf/+bug/1999823 |
| 15:33 |
pinesol |
Launchpad bug 1999823 in OpenSRF "Name collision causes apache gateway modules to fail when mod_shib is installed" [Medium,Confirmed] |
| 15:33 |
JBoyer |
Yeah, so, see above about making changes across 2 different but related projects. :D |
| 15:34 |
jeffdavis |
basically some of the C functions in OpenSRF and EG need to be renamed to avoid collisions; it's currently an issue when using Shibboleth for SSO on Ubuntu but I think that's just one potential problem case |
| 15:34 |
jeffdavis |
there are branches for both OpenSRF and EG making the necessary changes, this is a request for some folks besides me and JBoyer to try running those branches and see if anything breaks |
| 15:35 |
Bmagic |
jeffdavis: we might be candidates for testing these branches in the coming months |
| 15:35 |
Dyrcona |
I can have a look without sso enabled. |
| 15:35 |
jeffdavis |
that would be great! and yeah, SSO is not needed to test the branches I think |
| 15:36 |
jeffdavis |
also, once the changes are committed to EG we'll need to update the minimum required version of OpenSRF |
| 15:36 |
JBoyer |
And note, if it helps, you don't necessarily have to setup a whole shibboleth setup to test them, testing them "plain" helps, as does just enabling the modules that shibboleth uses and testing then too. |
| 15:37 |
Dyrcona |
jeffdavis: Mind if I steal the bug from you? |
| 15:37 |
jeffdavis |
Please do! |
| 15:37 |
Bmagic |
jeffdavis: I was thinking that too, which means that the commits will need to take place on a major Evergreen release cycle (not bug fix cycle) |
| 15:39 |
jeffdavis |
FWIW we are hoping to go live with SSO for a few of our libraries this month, so we'll need to deploy the changes on 3.9 |
| 15:40 |
jeffdavis |
we can deal with backporting locally at Sitka but it's a bit of an added version if the changes aren't in EG until 3.12 |
| 15:40 |
jeffdavis |
*added burden |
| 15:40 |
Dyrcona |
Well, I can test with 3.10 as well as main. |
| 15:41 |
Bmagic |
our container setup makes it fairly trivial to stand up a test server with certain patches on OpenSRF/Evergreen. |
| 15:41 |
Dyrcona |
I don't think much has changed in the C code, so a backport should be trivial. |
| 15:41 |
sandbergja |
Would these be considered breaking changes to OpenSRF's C API? If so, should we cut a 4.0.0 of OpenSRF with these changes? |
| 15:42 |
JBoyer |
The Big Fix, that can't be broken by further OS updates, would be to modify our library build process to *only* export certain functions, rather than all of them. :/ |
| 17:08 |
|
mmorgan left #evergreen |
| 17:36 |
|
sandbergja left #evergreen |
| 18:25 |
|
sandbergja joined #evergreen |
| 18:26 |
sandbergja |
Requesting review on bug 2035287 (small PR related to the nightwatch tests). Especially for anybody who hasn't yet run the nightwatch tests and wants to give them a try. :-D |
| 18:26 |
pinesol |
Launchpad bug 2035287 in Evergreen "e2e tests are failing" [Undecided,New] https://launchpad.net/bugs/2035287 |
| 18:52 |
jeffdavis |
We should probably rationalize how we use various parameters for context org in the OPAC someday (locg, loc, search_ou, physical_loc, context_org, etc etc). It's pretty messy. |
| 19:06 |
pinesol |
News from commits: [docs] lp1841635 Adding macros for preferred name. <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=01f36734203007cc0a8f3255952aeecf96f5704d> |
| 19:06 |
pinesol |
News from commits: LP#2030821 - Fix for Acq: Alert Type Drop Down Duplicated <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=52e0db9a33c41f3a990b0dced007aaa3f44f9819> |
| 12:48 |
Dyrcona |
I wonder if systemd-resolvd can do that? I know it can resolv for the localhost. Will it accept outside connections? |
| 12:49 |
* Dyrcona |
decides to save that exercise for later. ;) |
| 12:51 |
* Dyrcona |
remembers having "fun" with dnsmasq back in the day at MVLC. |
| 12:55 |
Dyrcona |
So, the overnight events finally finished at 12:16 pm on the machine running without parallel settings, so that's being undone for the remaining tests. |
| 12:55 |
Dyrcona |
We're likely going to replace our autorenewal template with something similar to the one Stompro++ shared yesterday. Then drop the courtesy notices. |
| 12:56 |
Dyrcona |
I'm going to test with the filter to drop circs with autorenewal from the courtesy notices to compare the difference between the two vms. They have the same data, so it should be a fair comparison. |
| 12:57 |
* Dyrcona |
poofs out to get some lunch. |
| 13:39 |
|
kworstell_isl joined #evergreen |
| 14:36 |
|
jihpringle joined #evergreen |
| 10:17 |
Dyrcona |
I thought about setting them up to send email, then setting param, recipient_email on the events, and flooding my gmail inbox. :) |
| 10:18 |
Dyrcona |
I'm OK with no mail for now. |
| 10:18 |
sharpsie |
yeah, we have some of our servers send external mail for cron, and yes it's a flood |
| 10:19 |
Dyrcona |
yeah. I would also have to make sure that the action_tigger.params, email_recipient, or whatever, works with all of our templates. It's handy for testing. |
| 10:20 |
|
smayo joined #evergreen |
| 10:20 |
Dyrcona |
We generated well over 50,000 events on Tuesday that could have sent email. |
| 10:31 |
* Dyrcona |
tries to figure out a good way to turn 2,250 lines from a spreadsheet into a SQL upsert. Yes, it has to be SQL for ... reasons. I'm not gonna do the inserts via Perl, which makes more sense than writing a program to write SQL. :) |
| 10:51 |
Dyrcona |
Ugh. ON CONFLICT ... DO UPDATE is more complicated than it needs to be.... |
| 10:54 |
Dyrcona |
And, my test data is missing some users, but OK. The syntax is all right now. |
| 10:55 |
|
BrianK joined #evergreen |
| 12:03 |
|
jihpringle joined #evergreen |
| 12:25 |
jeff |
fun hold quirk, probably nothing new (since ~1.2.0.4 I'm guessing): multiple outstanding holds on a title with no available copies, none have a "current copy". normal so far. check in an item, hold capture verification asks if you want to capture the item to fill a hold. say no, item is reshelving. still good/normal/expected... |
| 16:45 |
mmorgan |
Bmagic: maybe the group_application.user permission? |
| 16:46 |
Bmagic |
I'll try that |
| 16:46 |
Bmagic |
that permission is granted already at the consortium level (inherited from the "Staff" parent group) |
| 16:52 |
Bmagic |
I have a clue. I compared the osrfsys.log file when loading the web page as and admin compared to loading the page where it fails to load as my test user. And there is a small difference in the pcrud call: |
| 16:53 |
Bmagic |
CALL: open-ils.pcrud open-ils.pcrud.search.cust.atomic "REDACTED",{"-or":[{"name":["circ.holds_behind_desk","circ.collections.exempt","opac.hold_notify","opac.default_phone","opac.default_pickup_location","opac.default_sms_carrier","opac.default_sms_notify"]},{"name":["circ.send_email_checkout_receipts"]},{"opac_visible":"t"}]},{} |
| 16:53 |
Bmagic |
^^ This is when it works |
| 16:54 |
Bmagic |
the difference is the presence of "circ.send_email_checkout_receipts" in there |
| 16:55 |
Bmagic |
when using my test staff account, the pcrud call doesn't include the email_checkout_receipt call in the pcrud call. And that's what's missing, throwing the error "Empty IN list" |
| 16:56 |
mmorgan |
Bmagic: Just to clarify, are you trying to load a blank new registration page, or load an existing user? |
| 16:56 |
Bmagic |
blank registration |
| 17:01 |
* mmorgan |
just loaded the blank registration screen successfully, and doesn't see the email_checkout_receipt in the pcrud call. |
| 11:54 |
|
Stompro joined #evergreen |
| 12:31 |
|
collum joined #evergreen |
| 12:41 |
|
collum joined #evergreen |
| 12:49 |
Dyrcona |
I am testing my modified fix script on a VM with data from Sunday, so it has plenty of auto-renewals. |
| 12:51 |
Dyrcona |
Thousands of events have gone from "pending" to "collected" state, and the lock file is still there. I guess I can look at the run all pending events code to see when the first response comes back. |
| 12:52 |
Dyrcona |
My use of the same lock file does prevent my fix program from running: Script already running with lockfile /tmp/action-trigger-LOCK.daily at /usr/local/share/perl/5.30.0/OpenILS/Utils/Cronscript.pm line 151. |
| 13:12 |
|
pinesol joined #evergreen |
| 13:41 |
Dyrcona |
Hm.. maybe not "the first." It looks more like after all of the grouped events are 'found'. |
| 13:51 |
|
_collum joined #evergreen |
| 14:12 |
|
eby joined #evergreen |
| 14:16 |
Dyrcona |
I'm also testing that filter on 2-day pre-due courtesy notices that I mentioned last week. On the vm where I'm using it, it's processing about 15,000 fewer of those events than on the other. |
| 14:17 |
Dyrcona |
Guess I'll find something else to do and come back to that in an hour or so. :) |
| 14:52 |
|
berick joined #evergreen |
| 15:00 |
Bmagic |
chromeos impresses me |
| 09:23 |
|
kmlussier joined #evergreen |
| 09:42 |
|
kworstell_isl joined #evergreen |
| 09:55 |
Dyrcona |
Too many git branches.... |
| 09:58 |
Dyrcona |
Also, testing 2-day (pre-due) courtesy notices with month-old data is kind of pointless. There were 6 without the "auto_renewal_remaining: 0" filter and none with it. |
| 10:09 |
Dyrcona |
Guess that's a 100% reduction. :) |
| 10:43 |
|
BrianK joined #evergreen |
| 11:44 |
|
rfrasur joined #evergreen |
| 12:03 |
Dyrcona |
jeff: That's interesting what you point out. I would have expected an error that bar has no column 'id.' |
| 12:08 |
Dyrcona |
I suppose I could try and figure out what data from MARC is being used to build the wide_display_entry title and physical_description fields, or I could just take her word that she want the 300$n, and use 245$a for the title. :) |
| 12:09 |
Dyrcona |
My suspicion is this query will be faster if it drops the join on metabib.wide_display_entry and just grabs the data from MARC via XPath, since biblio.record_entry is already joined. |
| 12:09 |
Dyrcona |
The original is still running against my test database. |
| 12:10 |
jeff |
more detailed example that I just created: https://www.db-fiddle.com/f/9YseNbGnFVuqPkVJK85aew/0 |
| 12:16 |
jeff |
fun when "foo" is something like actor.usr or biblio.record_entry and "bar" is records_to_update or records_to_delete or the like. good reason to qualify your column references even when not forced to by ERROR: column reference "id" is ambiguous |
| 12:21 |
jeff |
I also had a recent fun one that I'll probably pick #postgresql about: I tend to favor WHERE NOT EXISTS (SELECT 1 FROM foo [...]) instead of LEFT JOIN foo ON [...] WHERE foo IS NULL for excluding things, especially if I'm not otherwise joining table foo in the query. I found at least one place where that was extremely detrimental fo my query's performance, ending up with a step where postgresql was |
| 14:09 |
|
kmlussier joined #evergreen |
| 14:13 |
|
kworstell-isl joined #evergreen |
| 15:30 |
|
mantis1 left #evergreen |
| 16:02 |
Dyrcona |
So, the unmodified version of that query has been going for over 3 hours and 12 minutes on a test database. |
| 16:21 |
Dyrcona |
Think I'll stop and try my version. |
| 16:25 |
pinesol |
News from commits: Docs: adding image for Standing Penalties docs <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=bbeeb8d42681f2d5a2419c6ed0683a34566dc832> |
| 16:27 |
|
jihpringle joined #evergreen |
| 12:26 |
|
Guest20 joined #evergreen |
| 12:43 |
|
_collum joined #evergreen |
| 12:50 |
|
jihpringle joined #evergreen |
| 13:41 |
* Dyrcona |
ponders spamming himself with 2-day courtesy notices to test the filter. |
| 13:43 |
Dyrcona |
I suppose that I can test the filter without sending email. |
| 13:47 |
Dyrcona |
Might as well wait until Tuesday, since my test database will be automatically refreshed on Sunday. |
| 14:14 |
|
jihpringle joined #evergreen |
| 14:50 |
Dyrcona |
Running a test of the filter today anyway. Set myself as recipient_email in event_params, just in case one of the vms can actually send email. |
| 15:58 |
|
Dyrcona left #evergreen |
| 15:59 |
|
Dyrcona joined #evergreen |
| 16:03 |
Dyrcona |
My date is so out of date that this test is pretty much meaningless, though the vm/database with the filter does show fewer events than the one without. Tuesday will be better because the data will be from midnight Sunday. |
| 16:03 |
Dyrcona |
My data is out of date, too. :) |
| 16:18 |
|
mantis1 left #evergreen |
| 16:50 |
|
jihpringle joined #evergreen |
| 08:41 |
|
mmorgan joined #evergreen |
| 09:08 |
|
Dyrcona joined #evergreen |
| 09:23 |
|
kworstell-isl joined #evergreen |
| 09:40 |
StomproJ |
I didn't realize bug 1862834 was a thing... we have 88 call number prefixes in use with 250 templates... lets go test that fix out. |
| 09:40 |
pinesol |
Launchpad bug 1862834 in Evergreen 3.11 "regex based url building that can match hostnames" [Medium,Confirmed] https://launchpad.net/bugs/1862834 |
| 09:41 |
StomproJ |
Ooops, bad paste buffer. I mean bug 1983156. |
| 09:41 |
pinesol |
Launchpad bug 1983156 in Evergreen "Allow Call Number attributes in Item Templates option gone" [High,Confirmed] https://launchpad.net/bugs/1983156 - Assigned to Michele Morgan (mmorgan) |
| 09:46 |
StomproJ |
So it needs the bits to save back into the template when updating the template? |
| 09:46 |
mmorgan |
StomproJ: Exactly! |
| 09:47 |
mmorgan |
Also, the standalone template editor under Local Admin DOES allow the call number attrs to get saved in the template - that interface hasn't been angularized yet. |
| 09:48 |
StomproJ |
That makes testing a bit harder, if someone cannot add that info to the prefix.... ah. |
| 09:49 |
* mmorgan |
can add some testing notes to the LP bug. |
| 09:49 |
StomproJ |
I'm seeing two actor.usr_setting types for storing templates, cat.copy.templates and staff_client.copy_editor.templates. |
| 09:49 |
StomproJ |
Is staff_client.copy_editor.templates the old XUL key? |
| 09:50 |
Dyrcona |
One of them is, and I don't remember which. |
| 09:52 |
Dyrcona |
"[T]he standalone template editor under Local Admin" this points to a problem without intending to. |
| 09:53 |
|
Rogan joined #evergreen |
| 09:57 |
StomproJ |
mmorgan, I'm in what I think is the standalong template editor, but there is no item section where the prefix can be set. |
| 10:00 |
mmorgan |
StomproJ: Just posted some testing notes: https://bugs.launchpad.net/evergreen/+bug/1983156/comments/9 |
| 10:00 |
pinesol |
Launchpad bug 1983156 in Evergreen "Allow Call Number attributes in Item Templates option gone" [High,Confirmed] - Assigned to Michele Morgan (mmorgan) |
| 10:00 |
mmorgan |
You need to set preferences in the holdings editor to get those to display. |
| 10:01 |
StomproJ |
Thanks |
| 10:22 |
mmorgan |
Hmm. Shouldn't be, unless I missed something - which is possible :) |
| 10:24 |
StomproJ |
AngularJS volcopy prefs seem to be in cat.copy.defaults - and the "Allow Call Number attributes" sets the ""show_vol_template_controls": true," json value |
| 10:25 |
StomproJ |
Angular seems to use "eg.cat.volcopy.defaults" and sets "show_vol_template_controls": true |
| 10:27 |
mmorgan |
Ok, that makes sense. So it sounds like you DO need to set the preference in the angularjs holdings editor to get the call number attributes to show in the standalone holdings editor. |
| 10:28 |
mmorgan |
Just so you can create a template to test. I can see how this is difficult to test. :-/ |
| 10:29 |
StomproJ |
Yes, but I'm making progress. I'm just adding some Call number suffix entries to make sure I try them also. |
| 10:31 |
mmorgan |
StomproJ++ |
| 10:34 |
pinesol |
News from commits: LP2028088 Fix info, primary, success button colors <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=5186c72cc0d5aa0ab142a8515697735bef6cd1b5> |
| 10:39 |
* mmorgan |
will need to take a look at that. |
| 10:41 |
StomproJ |
mmorgan, false alarm, had to log out and log in for the template change to get read. Could have been a side effect of me doing things in different tabs. |
| 10:42 |
StomproJ |
The Suffix does apply. |
| 10:42 |
mmorgan |
Ok, thanks! I have to admit, in my testing I was mostly focusing on Classification and Prefix, but thought I did try Suffix a few times :) |
| 10:43 |
StomproJ |
We don't use suffix at all either in production, but I don't want to hurt it's feelings by not testing it. |
| 10:44 |
mmorgan |
We have lots of libraries that use Prefix, many fewer that use Suffix, but it needs to work, too! |
| 10:46 |
Dyrcona |
If it is there, someone will use it. :) |
| 10:47 |
StomproJ |
I really hate that template save button being there. Gets me every time. |
| 10:42 |
Dyrcona |
s/Arc/Arch/ |
| 10:42 |
Dyrcona |
Also, busted packages lately on Ubuntu 20.04, but this is off topic. |
| 10:43 |
berick |
Arch is fun. but also, xubuntu++ |
| 10:44 |
Dyrcona |
Arch will test/improve your actual Linux chops. I've come to appreciate systemd. I still don't like, but I don't dislike it as much as I used to. :) |
| 10:58 |
Dyrcona |
I'm trying to install vanilla Gnome on Ubuntu 20.04, but package dependencies are out of sync. |
| 11:02 |
Dyrcona |
I like how apt says "you have held broken packages." But I have no held packages. Neither of the ways to check (aptmark, dpkg) say I have held packages. |
| 11:03 |
berick |
Dyrcona: maybe start w/ a server install so you don't have all that existing Gnome stuff? |
| 12:05 |
|
rfrasur joined #evergreen |
| 12:09 |
Bmagic_ |
StomproJ: I forgot about that! I'll get on it |
| 12:10 |
|
Bmagic joined #evergreen |
| 12:10 |
StomproJ |
Bmagic, it is ok, I have a test system setup now to test it. |
| 12:10 |
Bmagic |
don't need me to do anything? |
| 12:10 |
StomproJ |
Nope, but thank you. |
| 12:11 |
Bmagic |
sorry! I know I said I would do that |
| 13:38 |
kmlussier |
berick++ |
| 13:57 |
jeffdavis |
I'm trying out memcached StorageService for Shibboleth and it's not working. A shib session is being successfully created and there's a shibsession cookie in my browser that corresponds to the session ID stored in memcached, but I'm not actually logged into EG. Is there some extra mod_shib config required? I can't find much in the Shibboleth docs. |
| 14:27 |
JBoyer |
It logs you in as expected with the default backend but not memcached? |
| 14:27 |
jeffdavis |
yes, default backend works fine |
| 14:45 |
jeffdavis |
hmm, this is interesting: I click Login with SSO, enter credentials in the SSO login form, and get bounced back to the OPAC, and I am not logged in. But if I then click Login with SSO again, I *do* get logged in (without being redirected to the SSO login form). |
| 14:46 |
jeffdavis |
whereas with the default backend I'm logged in right away as soon as I'm redirected back to the OPAC |
| 14:53 |
jeffdavis |
this is on a single test server using the same local memcached that EG itself uses |
| 15:23 |
JBoyer |
That sounds vaguely familiar. Something about the target of the login link needing to be specifically /myopac rather than /login or something like that. |
| 15:25 |
|
mantis1 left #evergreen |
| 17:05 |
|
mmorgan left #evergreen |
| 11:09 |
|
kmlussier joined #evergreen |
| 11:36 |
|
collum joined #evergreen |
| 11:52 |
|
Dyrcona joined #evergreen |
| 12:26 |
jeffdavis |
I'll test that EG branch for 1999823 today |
| 12:28 |
Dyrcona |
Lp 1999823 |
| 12:28 |
pinesol |
Launchpad bug 1999823 in OpenSRF "Name collision causes apache gateway modules to fail when mod_shib is installed" [Medium,Confirmed] https://launchpad.net/bugs/1999823 |
| 12:38 |
|
kworstell-isl joined #evergreen |
| 12:46 |
|
kworstell_isl joined #evergreen |
| 13:18 |
|
kworstell_isl_ joined #evergreen |
| 13:19 |
|
kworstell-isl joined #evergreen |
| 13:52 |
jeffdavis |
JBoyer++ # initial testing suggests that mod_idlchunk branch resolves the issue - need to test further before signoff but feeling pretty optimistic. Thanks! |
| 13:54 |
JBoyer |
jeffdavis++ glad to hear it. I'd like to see the rest of the files in both OpenSRF and Evergreen switch to those funcs since neither fix is committed, but at least you should have everything you need to get things going locally. |
| 13:55 |
jeffdavis |
Should I open a new bug about changing the function names everywhere, or do we want to do it as part of this bug? |
| 13:56 |
|
kworstell-isl joined #evergreen |
| 08:24 |
|
Stompro joined #evergreen |
| 08:38 |
|
mmorgan joined #evergreen |
| 08:58 |
|
Dyrcona joined #evergreen |
| 09:16 |
Stompro |
Since the Bug squashing week is coming up... would anyone be willing to name their test systems with the prefix eg to allow this bug #1862834 to be tested. |
| 09:16 |
mmorgan |
@coffee #evergreen |
| 09:16 |
pinesol |
Launchpad bug 1862834 in Evergreen 3.11 "regex based url building that can match hostnames" [Medium,Confirmed] https://launchpad.net/bugs/1862834 |
| 09:16 |
* pinesol |
brews and pours a cup of Hamma Cooperative Yirgacheffe, Fair-Trade Organic, and sends it sliding down the bar to #evergreen |
| 12:03 |
mmorgan |
The library that reported it says it started happening about 2 months ago. I see it in both Chrome and Firefox. |
| 12:04 |
Dyrcona |
I don't use the client or work directly with those who do. You might want to try one of the mailing lists. |
| 12:07 |
|
kworstell-isl joined #evergreen |
| 12:10 |
mmorgan |
Ok, I think I'll wait til Monday on that. I should be clear that it's happening in the angularjs pull list, I don't see the same problem in the Angular pull list. In my 3.9 and 3.11-ish tests, I entered the old url manually: https://<hostname>/eg/staff/circ/holds/pull |
| 12:28 |
|
jvwoolf joined #evergreen |
| 12:49 |
|
kmlussier joined #evergreen |
| 12:50 |
kmlussier |
Hello #evergreen and Happy Friday! |
| 13:09 |
|
jihpringle joined #evergreen |
| 13:29 |
|
bgillap joined #evergreen |
| 13:33 |
Dyrcona |
I always have to spend time in the code to (re)figure out how the hooks work.... |
| 13:39 |
* Dyrcona |
is trying to figure out why a test machine did not generate any of a certain kind of notice last night while production did with similar date. |
| 13:39 |
Dyrcona |
s/date/data/ |
| 13:41 |
Dyrcona |
Doh! It's as simple as that. The default filters were not copied/renamed. |
| 13:42 |
* Dyrcona |
tries an experiment. |
| 15:37 |
JonGeorg |
Thanks. So it's a known issue. I can at least let the libraries know that. |
| 15:39 |
Dyrcona |
JonGeorg: We removed Boost Mobile as an option for SMS in the CW MARS Evergreen installation because their gateway doesn't exist any more. |
| 15:42 |
Dyrcona |
If you're in the USA, this might help: https://en.wikipedia.org/wiki/List_of_United_States_mobile_virtual_network_operators |
| 15:43 |
Dyrcona |
You can sometimes figure out which actual provider to use for a patron's SMS by sending them test texts until one goes through. |
| 15:51 |
Dyrcona |
As for the "magic:" `cd Open-ILS/src; make ./support-scripts/marc_export` |
| 15:51 |
Dyrcona |
Then just cp it into place if you want. |
| 16:03 |
JonGeorg |
Thank you. I do have a few numbers that I keep getting bouncebacks for, but when I search for the number it comes up as not there. |
| 13:29 |
Bmagic |
I was thinking the threshold would tolerate a few log messages but not more than X number in the last hour |
| 13:30 |
Dyrcona |
Well, your filter is a program, so it can track whatever you want. Now that I think about it, it will run as the syslog user, so it would probably have to sudo or something to restart services. I've used this feature before, but not for restarting OpenSRF services. |
| 13:33 |
|
kworstell_isl joined #evergreen |
| 13:43 |
Dyrcona |
We've got some AngularJS grids, namely the holds pull list, where some fields are turning up "null" if you mouse over them or try to print the full grid. This just started after we installed the open-ils.fielder patch, however it doesn't seem to be related because it happens on a test system without the fielder patch. Does this ring a bell for anyone? |
| 13:44 |
Dyrcona |
I've also been told by a reliable source that it isn't Lp 1785260. |
| 13:44 |
pinesol |
Launchpad bug 1785260 in Evergreen "Web Client: Holds Pull List - fields blank when using "Print Full Grid" or "Download Full CSV"" [Undecided,Confirmed] https://launchpad.net/bugs/1785260 |
| 14:13 |
Dyrcona |
This is frustrating. |
| 12:01 |
Dyrcona |
It can't download to gvfs mounted location. |
| 12:03 |
Dyrcona |
I may have to seriously consider switching distros. |
| 12:24 |
Dyrcona |
Maybe I'll switch back to FreeBSD on the desk....erm laptop? |
| 12:33 |
Dyrcona |
3.9.4 is basically ready. I need to test it. |
| 12:38 |
Dyrcona |
Heh, Listening to Def Leppard while doing this takes me back to when I first started programming on Commodore and Apple computers.... |
| 12:42 |
Dyrcona |
@decide new vm or focal |
| 12:42 |
pinesol |
Dyrcona: go with new vm |
| 12:43 |
Dyrcona |
Thanks for your opinion, pinesol, but I'm going to override that answer. :) |
| 13:18 |
* Dyrcona |
wonders if some of our tests still depend on undefined behavior. I find that live_t/29-lp1817645-remoteauth-patron-api.t seems to fail and then succeed later. |
| 13:19 |
Dyrcona |
Hmm cover uploader failed, too. I ran autogen.sh..... |
| 13:20 |
Dyrcona |
Pretty sure that I restarted apache2... I'll try again. |
| 13:26 |
Dyrcona |
Nope: Failed test 'Basic request for external user correctly returned 403' at live_t/29-lp1817645-remoteauth-patron-api.t line 137. got: '502' expected: '403' |
| 13:27 |
Dyrcona |
So, nginx or apache config is botched? |
| 13:29 |
Dyrcona |
OK. figured it out. |
| 13:31 |
Dyrcona |
Forgot to change the ports in the eg.conf VirtualHost entries. |
| 13:35 |
Dyrcona |
I think we neglect the Apache ports in the configuration instructions. |
| 13:38 |
Dyrcona |
And, live_t/30-lp1508208-age-protect-hold-capture.t fails on me for like the first time ever. |
| 13:38 |
* Dyrcona |
mumbles something about Micky Mouse. |
| 13:41 |
Dyrcona |
Meh. Feels like I'm the only one who runs all the tests for releases. I'll "release" it anyway. |
| 14:34 |
|
Dyrcona joined #evergreen |
| 14:35 |
Dyrcona |
So I guess things are missing from the 3.9.4 release notes because things were backported that should not have been. If someone else wants to fix the release notes, feel free. I'm done. |
| 16:30 |
|
sleary joined #evergreen |
| 10:54 |
|
jvwoolf left #evergreen |
| 10:57 |
|
sandbergja joined #evergreen |
| 11:01 |
|
sandbergja joined #evergreen |
| 11:09 |
Bmagic |
testing 3.10.3 tarball |
| 11:36 |
Bmagic |
test is good, making 3.11 now |
| 11:41 |
sandbergja |
Bmagic++ |
| 11:46 |
|
terranm joined #evergreen |
| 11:53 |
sharpsie |
Bmagic++ |
| 12:40 |
sharpsie |
well now you have to admit it! |
| 12:40 |
* mmorgan |
was thinking the same thing! |
| 12:41 |
Dyrcona |
I overwrote the authorized_keys file for a user on a server, but I can probably just copy another user's file on top of it. |
| 12:42 |
sharpsie |
this one time, I removed /usr from a running server - that was a fun test of our backup capabilities |
| 12:43 |
berick |
this one time... in band camp... |
| 12:43 |
sharpsie |
berick: almost said that |
| 12:43 |
sharpsie |
their band camp sounds way more fun that ours was IRL |
| 12:49 |
sharpsie |
Dyrcona++ |
| 12:49 |
Dyrcona |
I was being clever and doing a keyscan on a new host for a vendor, and I redirected the output to the wrong file. |
| 12:50 |
sharpsie |
in other news, joining the MS-ISAC alert lists has made me very glad I'm not administering big proprietary things like Citrix stuff |
| 12:51 |
Bmagic |
testing 3.11.1 |
| 13:19 |
Bmagic |
3.11.11 good, publishing on our site |
| 13:29 |
Bmagic |
ok yall, new tarballs for 3.10.3 and 3.11.1 are on the page, complete with release notes and changelog and readme's. The last step would be to commit the tag branches to the main repo: collab/blake/tags/rel_3_11_1 and collab/blake/tags/rel_3_10_3 . Anyone around to evaluate/push those? |
| 13:31 |
Dyrcona |
Bmagic++ |
| 13:41 |
Dyrcona |
I'll take a look at the tag branches. |
| 13:49 |
Dyrcona |
Has anyone done a release announcement? |
| 14:02 |
terranm |
Trying to wrap my head around the basic concept of creating a new table (student_card.school) that can be edited from the server admin page. I have a script to create it and I've added it to the fieldmapper (class id="scs") and it's appearing, but when I navigate to the page I get an error with this in the logs: "Method [open-ils.pcrud.search.scs] |
| 14:02 |
terranm |
not found for service open-ils.pcrud" -- any thoughts? My test code is here: https://git.evergreen-ils.org/?p=working/Evergreen.git;a=commit;h=56ae78eed93c8dbe7040db543d75e796a1d3737f |
| 14:05 |
Dyrcona |
terranm: I'm pretty sure that an object with a pcrud controller needs a permacrud block, even if it is mostly empty. |
| 14:06 |
terranm |
Ooooh, thanks I'll try that! |
| 14:13 |
terranm |
Dyrcona++ that solved that error, thanks! |
| 08:29 |
|
mmorgan joined #evergreen |
| 08:53 |
|
kworstell-isl joined #evergreen |
| 08:55 |
|
sandbergja joined #evergreen |
| 08:59 |
mantis |
Morning. Tried to start a reingest on our test server with 3.11 installed and got back an error. https://pastebin.com/Kv6tHz4m |
| 08:59 |
mantis |
any advice appreciated |
| 09:00 |
mantis |
ERROR: index row size 3136 exceeds maximum 2712 for index "browse_entry_sort_value_value_key" HINT: Values larger than 1/3 of a buffer page cannot be indexed. Consider a function index of an MD5 hash of the value, or use full text indexi |
| 09:08 |
|
sandbergja joined #evergreen |
| 09:16 |
|
rfrasur joined #evergreen |
| 10:51 |
sharpsie |
so, yeah, the same |
| 10:54 |
sharpsie |
argh - I hate when there's no record of changes - apparently whatever that index is was added out-of-band |
| 10:54 |
mantis |
alright at least we know that |
| 10:55 |
sharpsie |
mantis: nevertheless, eeevil's suggestion should help - basically it's saying "however long the actual value is, truncate it after 1000 chars" |
| 10:56 |
sharpsie |
mantis: is this in a test environment or live? |
| 10:56 |
mantis |
test environment |
| 10:56 |
sharpsie |
good :-) |
| 10:58 |
mantis |
haha |
| 10:58 |
sharpsie |
in a test environment that no one else depends on, you can be cavalier |
| 10:59 |
sharpsie |
the "safe" way to create/drop indexes on a live server is usually to create the new index with "concurrently" which doesn't lock the table and make everyone miserable |
| 11:00 |
sharpsie |
then drop the "old" index (again, with "concurrently") |
| 11:02 |
sharpsie |
in this case though, you can DROP INDEX CONCURRENTLY browse_entry_sort_value_value_key; since it is apparently unnecessary? |
| 11:04 |
sharpsie |
then DROP INDEX CONCURRENTLY browse_entry_sort_value_idx; CREATE INDEX CONCURRENTLY browse_entry_sort_value_idx ON metabib.browse_entry USING BTREE (substring(sort_value from 1 for 1000)); (completely untested, just following substr docs) |
| 11:59 |
sharpsie |
Dyrcona: might be a different bug, but worth looking at for future generations' sakes |
| 12:30 |
|
collum joined #evergreen |
| 12:52 |
|
kworstell-isl joined #evergreen |
| 13:05 |
eeevil |
mantis / sharpsie / Dyrcona / jeff / jeffdavis: sorry, meetings and then lunch! glad you found the old bug, a bell was ringing... berick has a reasonable plan in that older bug, but one key to keep in mind is making sure that we can find duplicates quickly, as that's core to the browse phase of ingest. so, large dataset testing is necessary for this one, and ingest function changes might be needed. the configuration-offered fix of using substr() to |
| 13:05 |
eeevil |
cap the length can retain the existing infrastructure (that's we're confident works) and can be automated in the upgrade script by just applying the normalizer to extant browse fields, but will require thought when adding new browse fields locally as Dyrcona implies via "fix it for everyone". I'd personally prefer avoiding encoding low level implementation restrictions in the indexing, but display-field truncation is something to consider as a trade |
| 13:05 |
eeevil |
off there. |
| 13:26 |
sharpsie |
eeevil: 10-4 |
| 13:29 |
|
Dyrcona joined #evergreen |
| 13:30 |
|
jihpringle joined #evergreen |
| 14:48 |
jeff |
Dyrcona: there are various tricks for doing that, especially if you don't care which row you keep. Most involve using ctid. :-) |
| 14:52 |
|
kworstell_isl joined #evergreen |
| 14:54 |
sharpsie |
like "Circ report (clone) (clone) (clone) (clone) (clone)" |
| 15:09 |
jeffdavis |
wondering if there should be a way for certain users to be able to bypass MFA - like consortial support staff logging in with a Circ Desk Staff account at BR1 for support/testing purposes without having to use whatever second auth factor that would normally require |
| 15:10 |
jeff |
arguably that should be a different account. |
| 15:11 |
jeff |
but yes, that's just one of a pile of questions that remain to be addressed. :-) |
| 15:12 |
jeffdavis |
yeah I'm sure we'll come up with more headaches^Wuse cases to think about |
| 15:14 |
jeff |
including determining some hard guidelines around what requires a user to use MFA to auth (home_ou, any working location requiring MFA, workstation OU? other?), and given a user that does not require MFA, are they prevented from logging in in any scenarios, like with a workstation tied to an org unit that does require MFA, etc? |
| 15:28 |
Dyrcona |
MFA for everyone. |
| 15:30 |
Dyrcona |
jeff: On my delete thing from earlier, I'm just going to delete the 3 rows and then insert the data back once. (That's easy enough.) I'll then add a unique constraint. I've tested it, and it works. |
| 15:48 |
|
mantis left #evergreen |
| 16:23 |
|
jvwoolf joined #evergreen |
| 16:23 |
|
jihpringle joined #evergreen |
| 11:20 |
|
Christineb joined #evergreen |
| 11:36 |
|
sleary joined #evergreen |
| 11:43 |
|
tsadok joined #evergreen |
| 13:33 |
Dyrcona |
Hmm. I seem to be getting random live test failures on Ubuntu 22.04 with user/berick/lp2017941-opensrf-on-redis-v2 and PostgreSQL 15. I ran livecheck, and the neg balances test failed. I ran eg_db_config, restarted things, and ran livecheck again. This time the geosort test failed. |
| 13:34 |
berick |
Dyrcona: i'm assuming stock eg/osrf on pg15 does not have these issues? i mostly tested with pg 14. |
| 13:36 |
Dyrcona |
berick: Well, it didn't have these issues with the same branch last week or the week before. I have seen the neg balance test fail on the first try, and succeed on the second in the past. |
| 13:37 |
Dyrcona |
I.E., the neg balance test has been finicky. |
| 13:38 |
Dyrcona |
I'm going for a 3rd try to see if anything is different. |
| 13:41 |
Dyrcona |
Right. All passed this time. |
| 13:41 |
Dyrcona |
:/ |
| 13:47 |
Dyrcona |
I'll test stock main on a different Ubuntu 22.04 vm talking to the same pg 15 database server. |
| 13:59 |
Dyrcona |
Hm.. This one appears to have frozen up while installing prerequisites. |
| 14:03 |
Dyrcona |
Looks like it finally finished installing prerequisites for OpenSRF. |
| 14:46 |
mantis |
I'm starting a new blog on all the mistakes I'm going to make as a sys admin: openseedsforme.wordpress.com |
| 15:30 |
mmorgan |
If I tried to chronicle all my mistakes, I would never succeed with anything :) |
| 15:31 |
mmorgan |
sharpsie: Your blog is telling me it's open only to invited readers. |
| 15:47 |
* Dyrcona |
used to blog, too, but time.... |
| 15:48 |
Dyrcona |
All right, I finally ran livecheck on stock main with ubuntu 22.04 and pg 15, and a bunch of tests failed. I'm pretty sure I did everything correctly, but I might have missed some setup step. |
| 15:50 |
* Dyrcona |
tries again. |
| 15:54 |
Dyrcona |
I wonder if there's some network issues going on where my VMs are hosted? |
| 15:56 |
Dyrcona |
Ok. I think my apache or some other configuration is busted for the moment. I looked at the output of the auth api test and it's getting 500, not 403, so internal server error. Apache and nginx are running, though. |
| 16:09 |
jeff |
makelivecheck || make undeadcheck |
| 16:09 |
jeff |
er, only without the typo. |
| 16:12 |
sharpsie |
mmorgan: try again if you want |
| 16:12 |
sharpsie |
apparently made it private way back then since I was nervous about people seeing it |
| 16:17 |
mmorgan |
sharpsie++ |
| 16:25 |
Dyrcona |
Hmm... Didn't change anything, and geosort is failing. |
| 16:25 |
Dyrcona |
The tests are being erratic for me today. |
| 16:27 |
Dyrcona |
RE Blogs, here's mine: http://evergreen.sigio.com/ |
| 16:32 |
berick |
and mine :) https://chomp.dev/ |
| 16:36 |
Dyrcona |
And, all tests pass this time.... |
| 17:03 |
|
mmorgan left #evergreen |
| 18:51 |
|
Jaysal joined #evergreen |
| 12:52 |
Dyrcona |
Doesn't xact_begin start a new session if there isn't one? Could the session have gone away, but the drone not know it? |
| 12:56 |
berick |
Dyrcona: that's what i'm thinking. the session timed out while compiling the template, it then tried to send a BEGIN on a disconnected session. |
| 12:57 |
Bmagic |
it almost has to be |
| 12:57 |
berick |
and it didn't know it was disconnected because no recv() / queue_wait calls occurred before the "am I still connected" test in editor's xact_begin() sub. |
| 12:57 |
Dyrcona |
I'd still check the database logs for anything weird around that time. |
| 12:58 |
Bmagic |
db logs don't have anything interesting around that time |
| 12:58 |
Bmagic |
lots of " WARNING: there is no transaction in progress" |
| 12:59 |
Dyrcona |
Well, that's a bummer. |
| 13:00 |
Bmagic |
we do have a clear log that says "No request was received in 6 seconds, exiting stateful session" - so, I wouldn't expect that the postgres service would have expierenced an error |
| 13:06 |
Dyrcona |
Can you tell if that's for the same cstore drone/process? |
| 13:13 |
* Dyrcona |
just added 64 tests to live_t/20-hold-targeter.t. |
| 13:21 |
|
sleary joined #evergreen |
| 13:25 |
* Dyrcona |
wishes there was a decent way to test the pull list from the backend, but the results are not predictable enough. |
| 13:37 |
|
Dyrcona joined #evergreen |
| 13:38 |
Bmagic |
sorry guys, I was pulled away, now, I'm back at it |
| 13:38 |
* Dyrcona |
is switching internet connections. |
| 14:08 |
Bmagic |
It does succeed most of the time |
| 14:08 |
Bmagic |
I was just curious about this time |
| 14:09 |
Dyrcona |
Yeah. It happens more often than one would like. |
| 14:19 |
Dyrcona |
Well, I think that's enough tests. We can always add more later. |
| 14:25 |
berick |
oddly it tries to create the transaction after it's compiled the template. "trigger: writing 3273 bytes to template output" happens after template compilation. |
| 14:26 |
berick |
then cstore sends a bunch of stuff back after the begin. that part I don't get. |
| 14:43 |
Dyrcona |
Eighteen commits rebased down to 1, and I'm ready to share the code... |