Time |
Nick |
Message |
03:46 |
|
JBoyer joined #evergreen |
06:02 |
pinesol |
News from qatests: Testing Success <http://testing.evergreen-ils.org/~live> |
06:22 |
|
rjackson_isl_hom joined #evergreen |
07:14 |
|
rjackson_isl joined #evergreen |
07:31 |
|
rfrasur joined #evergreen |
08:31 |
|
mmorgan joined #evergreen |
08:36 |
|
dguarrac joined #evergreen |
08:41 |
|
dguarrac_ joined #evergreen |
08:45 |
|
mantis joined #evergreen |
08:47 |
|
dguarrac_ joined #evergreen |
08:50 |
|
mantis1 joined #evergreen |
08:52 |
|
Dyrcona joined #evergreen |
09:10 |
|
dguarrac joined #evergreen |
09:18 |
|
alynn26 joined #evergreen |
09:27 |
|
Keith-isl joined #evergreen |
09:35 |
* Dyrcona |
sighs. |
09:36 |
Dyrcona |
cstore, pcrud, and reporter-store all seem to die on me this morning after connecting to the database with nothing useful in the logs on the drone vm. Guess. I'll check the logs for the db server. Fortunately, this is a test set up. |
09:36 |
|
jvwoolf joined #evergreen |
09:36 |
Dyrcona |
NB: This exact same code was working on Friday/Saturday, so I suspect it it caused by load on the db server. |
09:39 |
|
alynn26_away joined #evergreen |
09:42 |
Dyrcona |
Yeahp. It was just taking a long time to init the services because of all the lookups related to setting the IDL or whatever. |
09:42 |
Dyrcona |
I've seen this happen before. |
09:45 |
Dyrcona |
Heh: 09:44:51 up 8 days, 39 min, 1 user, load average: 11.56, 11.01, 9.86 |
09:46 |
Dyrcona |
I think disk usage is probably my bottleneck. Anyway... |
09:50 |
|
tlittle joined #evergreen |
10:31 |
|
collum joined #evergreen |
11:10 |
Dyrcona |
I guess I should wait for the pg_restore to finish on Pg 13 before I try doing much else: 11:09:39 up 8 days, 2:04, 1 user, load average: 16.82, 16.22, 16.13 |
11:48 |
|
jihpringle joined #evergreen |
12:34 |
|
collum joined #evergreen |
12:39 |
|
collum joined #evergreen |
13:55 |
|
jihpringle joined #evergreen |
14:52 |
|
jihpringle joined #evergreen |
14:52 |
|
mmorgan joined #evergreen |
15:13 |
|
jvwoolf1 joined #evergreen |
15:34 |
|
dguarrac_ joined #evergreen |
16:33 |
jeffdavis |
seeing these errors pretty regularly: egweb: Context Loader error: Can't locate object method "retrieve_config_global_flag" via package "OpenILS::Utils::CStoreEditor" at /usr/local/share/perl/5.30.0/OpenILS/WWW/EGCatLoader.pm line 347. |
16:40 |
jeff |
that seems unusual. |
16:40 |
jeff |
no recent changes to IDL? |
16:44 |
jeff |
I suppose you may have failed to create an editor object and that's the first time the editor is used in the context loader. |
16:46 |
jeffdavis |
No recent changes. It's a recurring thing, I think it is something about the overall setup -- autogen producing different results on different servers maybe? some kind of memcached hiccup? |
16:48 |
jeff |
i'm trying to reason what kinds of things would lead to either OpenILS::Utils::CStoreEditor->init; or $self->editor(new_editor()); giving you a non-functional editor. |
16:50 |
jeff |
I don't think memcached would come into play. |
16:50 |
jeff |
When it happens, is it just intermittent and the next attempt works, or do you take an action to resolve it, like restarting apache? |
16:56 |
jeffdavis |
It continues intermittently until Apache is restarted. |
16:56 |
jeffdavis |
some attempts work, some fail in the same way |
17:08 |
jeff |
Might be that once an Apache process experiences that, all subsequent attempts handled by that process fail. |
17:08 |
jeff |
any earlier errors/warnings of note? |
17:18 |
|
mmorgan left #evergreen |
17:18 |
jeffdavis |
a handful of "No AppSession object returned from server_build()" errors about 20 seconds prior to the context loader error |
17:19 |
jeffdavis |
editor[0|0] request error open-ils.cstore.json_query.atomic : {"from":["evergreen.get_locale_name","en_ca"]} : Exception: OpenSRF::EX::Session 2021-07-06T13:09:39 OpenILS::Utils::CStoreEditor /usr/local/share/perl/5.30.0/OpenILS/Utils/CStoreEditor.pm:491 Session Error: Transport::handler(): No AppSession object returned from server_build() |
17:19 |
jeffdavis |
^ for example |
18:00 |
pinesol |
News from qatests: Failed Create Evergreen Database <http://testing.evergreen-ils.org/~live//archive/2021-07/2021-07-06_16:00:02/test.41.html> |
20:02 |
|
Dyrcona joined #evergreen |