06:01 |
pinesol |
News from qatests: Failed Running perl live tests <http://testing.evergreen-ils.org/~live//archive/2022-05/2022-05-20_04:00:03/test.49.html> |
07:14 |
|
rjackson_isl_hom joined #evergreen |
07:34 |
|
collum joined #evergreen |
07:44 |
|
RFrasur joined #evergreen |
08:57 |
|
jvwoolf joined #evergreen |
09:00 |
|
mantis joined #evergreen |
09:05 |
|
Dyrcona joined #evergreen |
09:06 |
Dyrcona |
Hmm. I'm getting memory warnings in Nagios from two drone servers. Maybe I should test patches in production? |
09:09 |
Dyrcona |
Hello, open-ils.storage! |
09:10 |
Dyrcona |
Seven storage drones using about 1.5% of RAM each, which isn't a lot, but it adds up, I guess. |
09:12 |
Dyrcona |
However, 145 actor drones doesn't help either. :( |
09:28 |
Dyrcona |
About 37MB vsz used by the actor drones and listener. Not that much, but I guess it adds up with all of the others. |
09:48 |
Dyrcona |
Hmm. My srfsh requests are timing out on my test vm with production data this morning.... |
09:50 |
Dyrcona |
It's timing out fleshing call numbers and copies, when I remove the flesh option I get the data back in 0.7 seconds. |
09:57 |
Dyrcona |
@monologue |
09:57 |
pinesol |
Dyrcona: Your current monologue is at least 8 lines long. |
10:12 |
Dyrcona |
Also, the pcrud drone cycles out after hitting about 544KB of rsz, and then a new one takes over that doesn't grow in size. |
10:14 |
* gmcharlt |
grabs 1326 |
10:14 |
Dyrcona |
Guess this particular VM/db combo is useless for testing at the moment. |
10:50 |
|
jonadab joined #evergreen |
10:54 |
|
jihpringle joined #evergreen |
11:24 |
pinesol |
News from commits: LP#1857910: (follow-up) fix styling of mandatory class and field comboboxes <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=5ac7fc74b7ac34f684c588c97799ac426f1f4035> |
12:53 |
pinesol |
Launchpad bug 1974195 in Evergreen 3.8 "memory leak when doing fleshed Fieldmapper searches from C DB services" [High,Confirmed] https://launchpad.net/bugs/1974195 |
12:56 |
Dyrcona |
Hm. Spoke too soon. Missed the second drone that got started up. |
13:47 |
jmurray-isl |
Does anyone have any specific recommendations for sending nginx logs to a central rsyslog over TCP? In my research, it seems that nginx's built in syslog function may only work over UDP, not TCP, and recommendations are to output to a named pipe and send that to the central logger. Keeping track of that just seems inelegant, however. I'd welcome any recommendations beyond that. |
13:47 |
Dyrcona |
Yeah, the flesh of call numbers on a single bib is not causing any bloat on my Ubuntu 20.04 test VM. |
13:50 |
Dyrcona |
jmurray-isl: I use UDP with rsyslog for "performance reasons." I'd rather lose a few messages on the central logger than have it bog things down. The missing messages are still logged in /var/log/syslog on the host. That said, I've not configured nginx with syslog because I've not felt the need to look at them. I've made do with the Apache logs so far. |
13:52 |
jmurray-isl |
Dyrcona: Good to know. I've inherited a system that has it over TCP, and it might be time to change that. Thus far, I'm taking things one step at a time as I can to learn Evergreen. |
13:53 |
Dyrcona |
Sure. I think ours was setup with UDP when I got here, but I might have deliberately changed it. That was about 6 years ago, and memory doesn't appear to be serving me right now. :) |
14:17 |
Dyrcona |
gmcharlt++ |
14:41 |
|
pete joined #evergreen |
14:54 |
pinesol |
News from commits: Docs: 3.7.3 Release Notes <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=aa2002eb5b8c3114c3964bd8f73817758a8cf315> |
14:55 |
gmcharlt |
Dyrcona++ # thanks for testing! |
15:24 |
pinesol |
News from commits: Docs: 3.8.1 Release Notes <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=524164a1a5398a0aa472a5802da175ffe70e63a6> |
15:26 |
gmcharlt |
Dyrcona: does CW/MARS use circ limit groups? |
15:33 |
Dyrcona |
gmcharlt: I don't know without looking. I'm not really involved with circ configuration. |
16:50 |
mmorgan |
gmcharlt++ |
16:51 |
jihpringle |
gmcharlt++ |
17:01 |
|
mmorgan left #evergreen |
17:55 |
pinesol |
News from commits: Forward Port 3.7.3 Upgrade Script <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=03485123f1bc148e9371de9e362dec0c7baf1bfe> |
18:01 |
pinesol |
News from qatests: Failed Running perl live tests <http://testing.evergreen-ils.org/~live//archive/2022-05/2022-05-20_16:00:02/test.49.html> |
18:42 |
|
jihpringle joined #evergreen |
20:25 |
pinesol |
News from commits: Forward Port 3.8.1 Upgrade Script <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=15007ec466522c12c51c7ce1844a07a0dd8748bb> |
04:46 |
|
bshum joined #evergreen |
06:01 |
pinesol |
News from qatests: Failed Running perl live tests <http://testing.evergreen-ils.org/~live//archive/2022-05/2022-05-19_04:00:02/test.49.html> |
07:10 |
|
rjackson_isl_hom joined #evergreen |
07:33 |
csharp_ |
hmm - might be hitting bug 1931737 |
07:33 |
pinesol |
Launchpad bug 1931737 in Evergreen 3.8 "Did you mean breaks parallel reingest and causes deadlocks when loading/overlaying bib records in the client" [High,Confirmed] https://launchpad.net/bugs/1931737 |
09:01 |
csharp_ |
miker: FYI, I've applied your fixes for bug 1931737 to PINES production - FYI, I had to alter the XXXX.schema.dym_delayed_reify.sql script to add the creation of the search.symspell_dictionary_updates table |
09:01 |
pinesol |
Launchpad bug 1931737 in Evergreen 3.8 "Did you mean breaks parallel reingest and causes deadlocks when loading/overlaying bib records in the client" [High,Confirmed] https://launchpad.net/bugs/1931737 |
09:02 |
|
mmorgan joined #evergreen |
09:10 |
Dyrcona |
csharp_: I remember having to modify that db upgrade when I tested it on 3.7, but I forget exactly what I did. |
09:13 |
Dyrcona |
Yeah: https://bugs.launchpad.net/evergreen/+bug/1931737/comments/17 |
09:13 |
pinesol |
Launchpad bug 1931737 in Evergreen 3.8 "Did you mean breaks parallel reingest and causes deadlocks when loading/overlaying bib records in the client" [High,Confirmed] |
09:15 |
Dyrcona |
Oh, look! O/S updates! Systemd is updated. I'll probably have to reboot. |
09:15 |
csharp_ |
Dyrcona: thanks for the confirmation |
09:16 |
Dyrcona |
You could test the 3.7 branch if you're testing on 3.7. That might be useful. |
09:16 |
* Dyrcona |
should reboot the laptop. |
09:18 |
|
Dyrcona joined #evergreen |
09:32 |
csharp_ |
miker: upgrade script is also missing search.symspell_dictionary_reify |
13:03 |
mmorgan |
I'm finding penalties out of sync with the actual status of the patron accounts, patrons not blocked when they should be, and worse, patrons blocked when they shouldn't be. |
13:04 |
mmorgan |
Anyone have a reliable way to sync up penalties with reality? |
13:13 |
Dyrcona |
mmorgan: On a patron by patron basis: open-ils.actor.user.penalties.update <auth> <usr.id> |
14:14 |
Dyrcona |
gmcharlt: Do you have any suggestions for pcrud or cstore calls that could be used to test bug 1974193? |
14:14 |
pinesol |
Launchpad bug 1974193 in OpenSRF "memory leak when C apps respond to client" [High,Confirmed] https://launchpad.net/bugs/1974193 - Assigned to Jason Stephenson (jstephenson) |
14:20 |
pinesol |
News from commits: LP#1968082: (follow-up) show progress bar when adding/removing items from bucket <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=d1bb45351ebc585a8f2ace174c63810b4e7a26b4> |
14:20 |
pinesol |
News from commits: LP#1968082: (follow-up) tidy up whitespace <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=5ddd6949c1112920296fb12c220eb84640a0fd2a> |
14:47 |
pinesol |
Launchpad bug 1974195 in Evergreen "memory leak when doing fleshed Fieldmapper searches from C DB services" [High,New] https://launchpad.net/bugs/1974195 |
14:48 |
gmcharlt |
whoops, yeah, that's the one I meant |
14:49 |
jeffdavis |
Would either of those memory leaks present as high memory usage by beam? |
14:49 |
Dyrcona |
I think I meant that I'd test one and then the other bug. Should I test the patches at the same time from the outset? |
14:50 |
|
jihpringle joined #evergreen |
14:51 |
gmcharlt |
no, they can be tested separately |
14:52 |
gmcharlt |
also, thanks for testing! |
14:52 |
Dyrcona |
Ok. I was thinking of testing the OpenSRF one and then adding the Evergreen one after without removing the OpenSRF patch. |
14:52 |
gmcharlt |
+1 |
14:53 |
Dyrcona |
jeffdavis: I don't think so. |
14:56 |
gmcharlt |
agreed, I wouldn't expect a direct connection |
16:13 |
Dyrcona |
It even seems to help with the Evergreen pcrud bug as the drone seems grow more slowly. First time it rocketed right up to 128KB. After 3 or 4 iterations of the pcrud search for id >= -1, it's still below 100KB. |
16:23 |
Dyrcona |
It looks like there's a small memory leak somewhere else, still. With the Evergreen patch applied the drone still grows by 204 bytes per search request, but that's a lot better than what it was doing. |
16:25 |
Bmagic |
Dyrcona++ |
16:29 |
Dyrcona |
I'll test this more tomorrow and make a note of the numbers that I'm seeing for the bug. The patches definitely help! |
16:45 |
* miker |
wonders which struct ends up exactly 204B long and exists once for each session... (but I'll take 200B leak over a "size of every message that's not chunked" leak :) ) |
16:46 |
Dyrcona |
miker: It seems to vary a bit from 180 or so to almost 240 bytes. I had 2 or 3 in a row that were 204 bytes. |
16:46 |
Dyrcona |
I only noticed those and did the math when I said 204 bytes. |
17:13 |
|
pete joined #evergreen |
17:19 |
|
jvwoolf left #evergreen |
17:23 |
csharp_ |
jeffdavis++ |
18:01 |
pinesol |
News from qatests: Failed Running perl live tests <http://testing.evergreen-ils.org/~live//archive/2022-05/2022-05-19_16:00:04/test.49.html> |
18:21 |
pinesol |
News from commits: lp1950507 Providers Admin Screenreader form fix <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=df9000506e75d3331a993c6e27ba6e0278b789ee> |
19:59 |
|
jihpringle joined #evergreen |
20:21 |
pinesol |
News from commits: LP1857910 release note blurb for field doc port <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=0ebada37a652f3e2b316714794391e2a849d5cb6> |
20:21 |
pinesol |
News from commits: LP1857910 add org family selector to field doc UI <https://git.evergreen-ils.org/?p=Evergreen.git;a=commitdiff;h=d0713fac29e96dc7eb5643a13ad796b5bba92a1d> |