Evergreen ILS Website

IRC log for #evergreen, 2022-02-01

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat

All times shown according to the server's local time.

Time Nick Message
05:12 bshum joined #evergreen
05:39 rjackson_isl_hom joined #evergreen
05:46 Christineb joined #evergreen
06:01 pinesol News from qatests: Testing Success <http://testing.evergreen-ils.org/~live>
07:32 rfrasur joined #evergreen
07:50 collum joined #evergreen
08:26 mantis1 joined #evergreen
08:33 alynn26 joined #evergreen
08:35 nfBurton joined #evergreen
08:55 jvwoolf joined #evergreen
09:10 Dyrcona joined #evergreen
10:02 Keith-isl joined #evergreen
10:34 mmorgan joined #evergreen
10:50 miker Dyrcona: a recursive cte could find (or expose) loops, fwiw
10:56 Dyrcona miker: OK. I'm dealing with the aftermath of an out of memory condition on the main database server last night. A server with 768GB of RAM ran out of memory....
10:57 miker ew, gross :(
10:59 miker well, if/when you get back to looking at the pgtde, you might be able to use something like this to spot a loop: with recursive tree as (select id,parent,array[id] as all_parents, 0::int as depth from permission.grp_tree_display_entry where parent is null union all select c.id,c.parent,p.all_parents||c.id, p.depth+1 from permission.grp_tree_display_entry c join tree p on (c.parent = p.id) where depth < 1000) select * from tree;
11:01 Dyrcona miker++ I'll give that a try later.
11:05 csharp_ huh - we have some loops looks like
11:09 csharp_ no - I was misreading the output - looks ok here
11:12 miker csharp_: a loop would like like a 1000 element array in all_parents, with a repeating pattern
11:12 Dyrcona Whee! beam.smp using 260% of CPU.... S'OK, we've got 12 "CPUs"
11:12 miker Dyrcona: huzzah for threads!
11:18 Dyrcona HTT is not as good as a real CPU. When I benchmarked Pg on a HTT server, HTT enabled only added up to a 40% performance boost.
11:20 Dyrcona Also, our thresholds for warning about load are too low. It shouldn't even be a warning until something like CPU count * 2. I've found that a Linux server is pretty responsive until about CPU count * 4 load.
11:26 Dyrcona Anyway, this a utility server. Our db server has way more threads than that.
12:18 jihpringle joined #evergreen
12:52 JBoyer The trouble with load is that it *super* matters what causes the load. If your load is slightly higher than ncpu * 1.5 because of iowait, you're going to have a bad time. It can also be ncpu * 10 and totally responsive if it's totally different.
12:52 JBoyer I've seen load compared to a weather stone: https://www.geograph.org.uk/photo/6019372
12:52 JBoyer The only trouble is that accurately monitoring everything that you need to avoid weather-stone-ness usually means you have someone or someones that just focus on monitoring and what to monitor.
12:54 collum joined #evergreen
13:38 miker (oh, I was referring to the fact that beam uses threads, not HTT ... but yes, a hyperthread is def not as nice as a full core!)
14:16 Dyrcona miker++
14:17 Dyrcona miker: Haven't you heard that processes are the new threads? :)
14:29 Dyrcona miker++ # Again....
14:43 tlittle joined #evergreen
14:47 miker csharp_: still looking good after jeff's patch? (silver lining, this makes me glad that I'm going to be looking at parameter chunking again soon-ish ... I think that would have at least let actor not fall over because then LARGE param handling is done in the drone rather than the listener, and if we've passed a 0.6MB param once, we'll do it again.)
15:58 csharp_ miker: yes - all is good!
16:12 jvwoolf left #evergreen
17:07 mmorgan left #evergreen
18:02 pinesol News from qatests: Testing Success <http://testing.evergreen-ils.org/~live>
20:43 Guest61 joined #evergreen

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat