Evergreen ILS Website

IRC log for #evergreen, 2021-02-04

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat

All times shown according to the server's local time.

Time Nick Message
00:56 mrisher joined #evergreen
03:05 sandbergja joined #evergreen
04:48 alynn26 joined #evergreen
05:41 khuckins joined #evergreen
05:51 khuckins joined #evergreen
05:53 khuckins_ joined #evergreen
07:11 rjackson_isl_hom joined #evergreen
07:57 rfrasur joined #evergreen
08:01 Dyrcona joined #evergreen
08:07 mantis1 joined #evergreen
08:41 mmorgan joined #evergreen
08:58 Dyrcona So, after vacuum full on training it dropped from 476GB to 383GB as reported by df -h. I think we're doing stuff in the database that autovacuum can't keep up with.
08:58 Dyrcona BTW, that's only after 2 weeks of being up and very light use.
08:58 Dyrcona I reloaded the db from a dump around January 20.
09:05 JBoyer I think it's probably necessary to change the autovacuum_*_scale_factor values for our larger tables; the vacuum scale factor defaults to 20% and the analyze to 10%. For something like metabib.* those can be ridiculous.
09:06 JBoyer But they need to be changed on a per-table basis or AV will be running when changing ~51-55 rows in other smaller tables.
09:08 Dyrcona OK. I'll look into that. We have some huge tables.
09:08 Dyrcona Search is working again, so it was that the db needed a vacuum.
09:09 Dyrcona I do see autovacuum working on the hold_request and hold copy map tables in production a lot. They get heavy use throughout the day as people process pull lists and circulations.
09:17 collum joined #evergreen
09:23 JBoyer A quick explanation for the logs: The autovacuum_vacuum_threshold is the number of rows that have to be changed in a table for AV to run on it, and the autovacuum_vacuum_scale_factor is the percentage of the table size that is added to that to come up with the actual threshold.
09:24 JBoyer So a table like money.billing with, lets say, 21770000 rows and default AV settings isn't vacuumed until you change 4354050 or more rows.
09:24 JBoyer That's not great.
09:59 Dyrcona I'm trying to figure out from the database if certain tables/views are used by reports. Has anyone got any magic sauce for that already?
10:00 csharp you mean at the reporter.template level?
10:02 Dyrcona Yeah. I looked at a couple and I think I can search for the field mapper class, but I'm uncertain if that is thorough enough.
10:06 Dyrcona Ayup. This seems to work for one of our custom report views: select id from reporter.template where data ~ 'cash_report_mimic'
10:13 csharp yeah
10:36 malexander joined #evergreen
10:54 Dyrcona Anyone opposed to a commit to add an Emacs modeline to the bottom of the fm_IDL.xml, similar to the vim line that is already there?
10:57 Dyrcona bug 1914625
10:57 pinesol Launchpad bug 1914625 in Evergreen "Add Emacs mode to fm_IDL.xml" [Wishlist,New] https://launchpad.net/bugs/1914625 - Assigned to Jason Stephenson (jstephenson)
10:58 Dyrcona No branch, yet, but will have in a few minutes.
11:14 Dyrcona Actually, looking at the IDL, it seems that it has a mix of tabs and spaces, a.k.a. "smart" tabs. I wonder if that vim line is working or those of using Emacs have hosed it. :)
11:19 berick yeah, and other editors
11:19 berick the vim line is working, can confirm
11:24 csharp drone exhaustion update - applying the patch from bug 1913811 has improved things somewhat, but still seeing high drone counts
11:24 pinesol Launchpad bug 1913811 in Evergreen "Too many parallel open-ils.actor.user.itemsout.notices requests" [High,Confirmed] https://launchpad.net/bugs/1913811
11:24 csharp not having to restart every hour anymore though
11:28 pinesol [evergreen|Bill Erickson] LP1913811 Items out notice summary API batching - <http://git.evergreen-ils.org/?p=​Evergreen.git;a=commit;h=cf2b64e>
11:28 pinesol [evergreen|Jeff Davis] LP1913811 progress dialog on Items Out grid - <http://git.evergreen-ils.org/?p=​Evergreen.git;a=commit;h=faf48f6>
11:29 berick csharp++
11:29 berick csharp: do you have bug 1913458 merged as well?
11:29 pinesol Launchpad bug 1913458 in Evergreen "Record bucket 'Add To Bucket' actions should be batched or serialized." [Undecided,New] https://launchpad.net/bugs/1913458
11:34 csharp berick: as it turns out, we don't!
11:34 csharp applying it now
11:35 berick cool, it addresses a couple of scenarios
11:48 Dyrcona berick++ csharp++
11:49 Dyrcona berick: Should I untabify the IDL as part of this branch?
11:49 mrisher joined #evergreen
11:50 Dyrcona It looks like just setting tab-width in emacs doesn't do the trick. I am looking for the xml offset variable that I need to set.
11:50 berick Dyrcona: i have no strong feeling either way.  not really sure why decided on tabs for fm_IDL.xml to begin with...
11:50 berick maybe it started as tabs and modeline just helped set the width
11:51 csharp "fm_IDL.xml Part II: The Whitespace" coming soon to servers near you
11:53 Dyrcona Well, XML doesn't care about tabs v. spaces. This started because I was cleaning up our custom entries and noticed the indentation was off.
11:55 Dyrcona On "tabs v. spaces," I have personally flip-flopped favoring one or the other every few years, though I think I'm stuck on spaces for good, now. :)
11:55 Dyrcona I'll leave the bug up and figure something out. This is not urgent, obviously.
11:58 Dyrcona "Tabs for indentation. Spaces for alignment." :)
12:02 jihpringle joined #evergreen
12:29 csharp joined #evergreen
12:59 collum joined #evergreen
13:23 khuckins joined #evergreen
13:31 sandbergja_ joined #evergreen
13:32 jihpringle joined #evergreen
13:38 khuckins joined #evergreen
13:40 khuckins left #evergreen
13:41 malexander joined #evergreen
13:44 csharp berick: with both patches in place, I've seen a vast improvement in drone health - thanks!
13:46 berick csharp: nice!
13:52 csharp joined #evergreen
13:57 Guest50176 joined #evergreen
13:59 akilsdonk joined #evergreen
13:59 miker joined #evergreen
13:59 lisacarlucci joined #evergreen
13:59 abneiman joined #evergreen
14:00 rhamby joined #evergreen
14:01 lstratton joined #evergreen
14:17 sandbergja_ joined #evergreen
14:35 Dyrcona gmcharlt: Are you still looking at bug 1890629?
14:35 pinesol Launchpad bug 1890629 in Evergreen 3.5 ""Email checkout receipts by default?" Doesn't Always Display in Patron Self-Registration" [Medium,Confirmed] https://launchpad.net/bugs/1890629
14:45 jvwoolf1 joined #evergreen
14:49 malexander_ joined #evergreen
15:43 malexander__ joined #evergreen
15:52 mantis1 left #evergreen
16:16 jeffdavis open-ils.actor #drones=202/200 101%
16:16 jeffdavis ^ didn't realize that was possible
16:16 csharp jeffdavis: oof
16:58 sandbergja_ joined #evergreen
16:58 mmorgan left #evergreen
17:19 jihpringle joined #evergreen
17:20 Bmagic csharp: the DOS "fix" for us was the nginx limitation on the unapi URL OpenSRF Bug 1913617
17:20 pinesol Launchpad bug 1913617 in OpenSRF "NGINX could use a DOS mitigation example" [Undecided,New] https://launchpad.net/bugs/1913617
18:00 pinesol News from qatests: Testing Success <http://testing.evergreen-ils.org/~live>
18:20 sandbergja_ joined #evergreen
18:34 sandbergja_ joined #evergreen
18:44 sandbergja_ joined #evergreen
19:41 rhamby joined #evergreen
19:41 akilsdonk joined #evergreen
20:58 malexander joined #evergreen

| Channels | #evergreen index | Today | | Search | Google Search | Plain-Text | summary | Join Webchat