| Time |
Nick |
Message |
| 00:21 |
pinesol |
News from commits: LP1411819 stamp upgrade script and add release notes <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=8da533ecb4126fdaa6cd6386a4468fe11550e4da> |
| 00:21 |
pinesol |
News from commits: LP1411819 follow-up: add a pgtap test <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=fd0a11c18fbac315b81d04da359ba062d002d916> |
| 00:21 |
pinesol |
News from commits: LP#1411819: org setting to override PATRON_EXCEEDS_FINES penalty on renewals <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=98ce2c013c295509d530df40bed947279dc3b9f5> |
| 00:51 |
pinesol |
News from commits: LP1953692: release notes <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=18c15f0957fdea5d1213ed137d80f879b9aa7ade> |
| 00:51 |
pinesol |
News from commits: LP1953692 follow-up: missing character <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=6b9a7d9bdf64144b8138025713575d9f79c61650> |
| 00:51 |
pinesol |
News from commits: LP1953692 Angular Catalog Record Summary links should open in new tab <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=781f399afa75a6f9fae4ef164c797f1231821f22> |
| 02:18 |
|
tsadok joined #evergreen |
| 07:42 |
|
collum joined #evergreen |
| 08:07 |
|
BDorsey joined #evergreen |
| 08:25 |
|
rfrasur joined #evergreen |
| 08:34 |
|
mantis1 joined #evergreen |
| 08:35 |
|
mmorgan joined #evergreen |
| 09:03 |
|
mantis2 joined #evergreen |
| 09:28 |
|
Dyrcona joined #evergreen |
| 09:45 |
|
dguarrac joined #evergreen |
| 09:46 |
|
jvwoolf joined #evergreen |
| 09:57 |
mmorgan |
Asked this in the hackaway, but I'll try here, too. |
| 09:57 |
mmorgan |
Trying to build a test vm using ansible and I'm getting this: "Open-ILS/src/extras/Makefile.install:156: recipe for target 'ubuntu-bionic-developer' failed" |
| 09:57 |
mmorgan |
What am I missing? |
| 10:00 |
|
sleary joined #evergreen |
| 10:03 |
Dyrcona |
miker: Getting different behavior with ingest_ctl today after the patch from yesterday. I'm loading the same records that I used last week after a database reload. Updating 378 records worked fine. Inserting 314 has produced 7 errors and after that, it seems to have really slowed down. |
| 10:05 |
Dyrcona |
And, of course, after I mention it here, it picks back up again. |
| 10:06 |
miker |
Dyrcona: did you add the RAISE stuff? should be getting reasons for errors in the PG logs with that applied |
| 10:13 |
Dyrcona |
2022-10-26 09:59:59.263 EDT [178756] evergreen jasontest WARNING: Key (sort_value, value)=(thick of it, The Thick of It) already exists.\nSQL statement "INSERT INTO metabib.browse_entry |
| 10:14 |
Dyrcona |
I have all of the patches from DYM and queued ingest. |
| 10:17 |
Dyrcona |
The rest are all pretty much the same. |
| 10:24 |
Dyrcona |
I processed 1 by hand and it worked. I update fail_time to null and the rest of them worked in parallel. |
| 10:28 |
JBoyer |
mmorgan, regardless of the specific error you'll want to update your testing VM to a later version of Ubuntu; building Evergreen on Bionic from a fresh git checkout is likely to start failing within days. |
| 10:28 |
JBoyer |
see lp 1990969 |
| 10:28 |
pinesol |
Launchpad bug 1990969 in Evergreen "Discontinue Support for Ubuntu 18.04 "Bionic Beaver"" [Wishlist,Confirmed] https://launchpad.net/bugs/1990969 |
| 10:29 |
JBoyer |
OR, if you're running a later version of Ubuntu on your VM it's entirely possible that some package name has changed since bionic and that's what's failing. |
| 10:29 |
mmorgan |
JBoyer: Ok, thanks. I did try first on 20.04 and that failed so I went back to 18.04 |
| 10:30 |
mmorgan |
Trying a fresh one on 18.04. If that fails I'll go back to 20.04 |
| 10:30 |
miker |
Dyrcona: huh... well, hard to blame QI itself for that error. I wonder if my INSERT .. ON CONFLICT change in the browse insert is the problem (or is it not applied on yours?). meeting about to start, but I'll point at that specifically so you can check ASAP |
| 10:43 |
JBoyer |
berick++ |
| 10:44 |
Dyrcona |
miker: I have 1 ON CONFLICT at line 871 of Open-ILS/src/sql/Pg/upgrade/XXXX.schema.queued_ingest.sql |
| 10:56 |
|
jihpringle joined #evergreen |
| 11:17 |
miker |
Dyrcona: so, that change is the only one in that function. if you were to apply the one from 030, and it does not fail any longer, then I think we can file the issue under "Mike delved too deeply, and too greedily" |
| 11:20 |
Dyrcona |
miker: OK. I have a batch of 28,860 records being processed right now. I'll wait until ingest_ctl --stats says they're done before I make any database changes. |
| 11:20 |
miker |
+1, thanks |
| 11:22 |
Dyrcona |
I've had no failures with these so far. It was a smaller batch that had the failures. |
| 11:22 |
Dyrcona |
The coordinator has also stayed running so far. |
| 11:35 |
miker |
well, that's an improvement. also, looking closer, it's entirely unrelated to the error you actually got |
| 11:36 |
miker |
"it" being the change I asked you to revert |
| 11:36 |
|
Christineb joined #evergreen |
| 11:37 |
Dyrcona |
OK. |
| 11:44 |
Dyrcona |
I think we're hitting the usual issue of not being able to update browse entries in parallel. |
| 11:48 |
mmorgan |
berick++ |
| 11:48 |
mmorgan |
Bmagic++ |
| 11:52 |
miker |
which, of course, we'd hit by parallelizing ingest of a batch of records that might be very similar right next to each other. Dyrcona, I think metabib.reingest_metabib_field_entries may need to get the INSERT ON CONFLICT treatment, which will serialize some updates due to row-level locking (exactly, but only, when these errors are happening), but avoid that issue... gimme a minute and I'll update the branch |
| 11:56 |
Bmagic |
mmorgan: I didn't explicitly mention this but, you do need to have docker installed before any of what I demo'ed works |
| 11:59 |
Dyrcona |
miker: I noticed two entries for the same author name back to back, so there's some evidence of that. |
| 12:02 |
mmorgan |
Bmagic: Right. Will look at that when I find some time. |
| 12:14 |
|
Dyrcona joined #evergreen |
| 12:23 |
miker |
Dyrcona: https://pastebin.com/csTYASPu is what I'm proposing. commit coming in a moment |
| 12:45 |
miker |
Dyrcona: 2 new commits on the QI branch now, though just the first is strictly required for the browse ingest conflict. the second is about a long-standing oversight that removes too much data in a "just update this one field" reingest request |
| 12:47 |
miker |
(IOW, you may want to pick and test just the first new commit, but I think the second is needed generally) |
| 12:49 |
|
collum joined #evergreen |
| 12:55 |
|
kworstell-isl joined #evergreen |
| 12:59 |
Dyrcona |
miker: I'll try them both in a bit. |
| 13:45 |
mrtnnbr |
Has anyone have apache fail with "AH00526: Syntax error on line 43 of /usr/local/etc/apache24/eg_vhost.conf: |
| 13:46 |
mrtnnbr |
Invalid command 'OSRFGatewayConfig', perhaps misspelled or defined by a module not included in the server configuration" before? |
| 14:01 |
Bmagic |
mrtnnbr: I've not seen that before |
| 14:02 |
Bmagic |
compare your eg_vhosts.conf file against the git repository copy of that file. I suspect that there is a block ending tag missing or something like that |
| 14:09 |
mrtnnbr |
Bmagic: I just got it. I had to add "LoadModule osrf_json_gateway_module libexec/apache24/osrf_json_gateway.so" to the apache config. |
| 14:18 |
miker |
Dyrcona: please do, though I'm going to look at one more spot that may need INSERT..ON CONFLICT TO NOTHING |
| 14:19 |
miker |
strike that, I won't be doing that, because we'd need a new unique index that we don't want the cost of |
| 14:55 |
|
jihpringle joined #evergreen |
| 15:07 |
Bmagic |
mrtnnbr++ |
| 15:12 |
jeffdavis |
Are there any known outstanding issues with using Postgres 14? I know there were some performance fixes that got into 3.9 (LP#1947595), not sure if there are other lingering problems. |
| 15:16 |
berick |
jeffdavis: had a brief discussion about that yesterday and no issues were known, at least among those in the room |
| 15:16 |
jeffdavis |
great, thanks! |
| 15:32 |
|
jihpringle joined #evergreen |
| 16:45 |
|
jvwoolf left #evergreen |
| 17:03 |
berick |
@dunno add https://www.monsterfro.com/images/seniorpic2.gif |
| 17:03 |
pinesol |
berick: The operation succeeded. Dunno #74 added. |
| 17:03 |
mmorgan |
:) |
| 17:11 |
|
mmorgan left #evergreen |
| 17:49 |
miker |
@later tell Dyrcona jfyi, I pushed a single-commit QI branch to the LP that includes everything, and (after applying 1340 and 1341) can upgrade a master DB using the XXXX sql script: https://git.evergreen-ils.org/?p=working/Evergreen.git;a=shortlog;h=refs/heads/user/miker/lp-1979071-queued-ingest-rebase-and-baseline-2022-10-26 |
| 17:49 |
pinesol |
miker: The operation succeeded. |
| 17:50 |
miker |
that's it for today, folks. thanks for hack-a-way-ing! |
| 19:11 |
|
jihpringle joined #evergreen |
| 19:55 |
|
jihpringle joined #evergreen |
| 20:24 |
pinesol |
News from commits: lp1895706 release notes <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=d345aff2c1f33ccafe7f5ea3c1cf1976475ab65f> |
| 20:24 |
pinesol |
News from commits: lp1895706 - Unarchive Course Button handles correctly <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=f1fe12ee4ca7b3e2dfc8f86b607b6dae0dee9af9> |
| 20:24 |
pinesol |
News from commits: lp1895706 Unarchive Old Courses <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=775e050221bf1c40bf3cbb0524ad19f6797a9204> |
| 20:54 |
pinesol |
News from commits: Add release notes for OS versions <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=626e54cf55f46ef8ec853fa6c0148adf0422113f> |
| 20:54 |
pinesol |
News from commits: LP1990969: Remove Ubuntu Bionic Beaver Installation Prerequisites <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=e24381a20d01118f9d5b13c8aee564a63658e36b> |
| 20:54 |
pinesol |
News from commits: LP1947728: Remove Debian Stretch Prerequisites <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=2a13909655806ba36902e3ba622125193964543e> |
| 20:54 |
pinesol |
News from commits: LP1948946 release notes <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=3c86729489784ed815fb812d37c679b455a8866d> |
| 20:54 |
pinesol |
News from commits: LP1948946 Block transfers on inactive funds <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=b581bd99ae308fa96c34114f7530a5e241aaf0e8> |
| 22:20 |
|
Christineb joined #evergreen |
| 22:20 |
|
troy joined #evergreen |
| 22:20 |
|
tsadok joined #evergreen |
| 22:22 |
|
bshum joined #evergreen |
