| Time |
Nick |
Message |
| 04:21 |
|
pinesol_green` joined #evergreen |
| 06:32 |
pinesol_green` |
News from qatests: Test Success <http://testing.evergreen-ils.org/~live> |
| 07:11 |
|
agoben joined #evergreen |
| 07:59 |
|
collum joined #evergreen |
| 08:05 |
|
kmlussier joined #evergreen |
| 08:08 |
|
rlefaive joined #evergreen |
| 08:19 |
|
rjackson_isl joined #evergreen |
| 08:39 |
|
mmorgan joined #evergreen |
| 09:09 |
|
Dyrcona joined #evergreen |
| 09:18 |
|
yboston joined #evergreen |
| 09:24 |
|
jvwoolf joined #evergreen |
| 09:28 |
|
rlefaive joined #evergreen |
| 09:33 |
|
jvwoolf1 joined #evergreen |
| 10:25 |
|
plux joined #evergreen |
| 10:38 |
|
rlefaive joined #evergreen |
| 10:57 |
plux |
anyone have suggestions re the time to run 1057.schema.copy_vis_attr_cache.sql on and upgrade to 3.1 ? I’m wondering about splitting out the bib records and running muliple processes to get the overall reingest time down |
| 10:59 |
|
Dyrcona joined #evergreen |
| 10:59 |
dbs |
plux: have you heard about pingest.pl? |
| 11:00 |
dbs |
plux: https://github.com/Dyrcona/evergreen_utilities/blob/master/perl/pingest.pl |
| 11:00 |
* Dyrcona |
was just about to paste that. :) |
| 11:00 |
Dyrcona |
dbs++ |
| 11:00 |
Dyrcona |
Well, not that exactly, but close. |
| 11:01 |
dbs |
Dyrcona++ |
| 11:01 |
dbs |
I mean you wrote the thing! |
| 11:01 |
plux |
haven’t used it…..but looks slick |
| 11:01 |
Dyrcona |
There's branch with changes for 3.0. I haven't merged it into master, yet, because I'm not using it myself. |
| 11:02 |
Dyrcona |
https://github.com/Dyrcona/evergreen_utilities/blob/evergreen-3.0-compatibility/perl/pingest.pl |
| 11:02 |
Dyrcona |
If you need the 3.0 features, there it is. |
| 11:05 |
kmlussier |
Did we make the changes to 1057.schema.copy_vis_attr_cache.sql to make it go faster? I remember there was talk of those changes at one point, but I can't recall if they were ever merged. |
| 11:05 |
plux |
thanks! …I’ll take a look through that and give it a go |
| 11:06 |
JBoyer |
kmlussier, plux, yeah, since that script doesn't actually make any edits to the bibs there's no reason to leave all of the triggers active. Disabling most of them took our completion time from never (if it finds 1 invalid marc record it's dead) to about 30 minutes for 2M+ records. |
| 11:08 |
Dyrcona |
I'm not sure it will really help with visibility attrs though. I'm reviewing that upgrade script, now. |
| 11:08 |
Dyrcona |
JBoyer++ |
| 11:09 |
JBoyer |
They don't touch or depend on the marc, where setting any field on bre (for any reason) will cause multiple spin ups of the MARC::XML perl module and be miserable for all parties involved. |
| 11:09 |
JBoyer |
It's something I've been meaning to address at some point, but fires, tuits, turkeys, etc. |
| 11:10 |
Dyrcona |
:) |
| 11:11 |
Dyrcona |
Looks like it drops the old visibility triggers and creates new ones. pingest.pl will help with record ingesting afterward, but not copy visibility. |
| 11:12 |
JBoyer |
Oh and don't misunderstand, you're still going to want to get well acquainted with pingest.pl, just not for that specific script. |
| 11:14 |
kmlussier |
OK, there was bug 1719726, but it looks like it only made the changes to the 2.12 to 3 upgrade script, not to 1057 |
| 11:14 |
pinesol_green |
Launchpad bug 1719726 in Evergreen "updates to monolithic schema update script for 3.0-rc" [Medium,Fix released] https://launchpad.net/bugs/1719726 |
| 11:15 |
kmlussier |
plux: So you might want to look at making the same changes that were made in d388f7019a |
| 11:15 |
pinesol_green |
kmlussier: [evergreen|Galen Charlton] LP#1719726: adjust computation of bre visibility attribute vector - <http://git.evergreen-ils.org/?p=Evergreen.git;a=commit;h=d388f70> |
| 11:17 |
plux |
k….I can give that a try in an hour or so and see how it goes….save pingest for the end |
| 11:17 |
dbwells |
+1 to kmlussier's suggestion |
| 11:17 |
kmlussier |
Oh, and there was also a follow-up commit here d3c57a52 |
| 11:17 |
pinesol_green |
kmlussier: [evergreen|Mike Rylander] LP#1719726: Make sure all relevant triggers are disabled for bib visibility update - <http://git.evergreen-ils.org/?p=Evergreen.git;a=commit;h=d3c57a5> |
| 11:19 |
Dyrcona |
Yeah. Looks like the upgrade script will do some of what you would need pingest for: lines 6,789 to 6,803 in the version upgrade script. |
| 11:21 |
dbs |
#evergreen++ |
| 11:21 |
dbs |
@karma #evergreen |
| 11:21 |
pinesol_green |
dbs: Highest karma: "gmcharlt" (220), "kmlussier" (110), "berick" (100), "Dyrcona" (87), and "dbs" (65). Lowest karma: "comcast" (-26), "systemd" (-10), "oracle" (-7), "ie" (-6), and "^" (-6). You (dbs) are ranked 5 out of 190. |
| 11:22 |
dbs |
'#evergreen'++ |
| 11:22 |
Dyrcona |
That also looks like the only thing that you would need pingest for, too, by the way. |
| 11:22 |
dbs |
@karma '#evergreen' |
| 11:22 |
pinesol_green |
dbs: '#evergreen' has neutral karma. |
| 11:22 |
dbs |
eh |
| 11:24 |
|
_adb joined #evergreen |
| 11:29 |
|
Christineb joined #evergreen |
| 12:03 |
|
dbwells_ joined #evergreen |
| 12:20 |
|
cesardv joined #evergreen |
| 12:34 |
csharp |
comcast-- |
| 12:34 |
csharp |
fcc-- |
| 12:35 |
|
khuckins joined #evergreen |
| 12:42 |
|
jihpringle joined #evergreen |
| 13:09 |
kmlussier |
fcc-- indeed |
| 13:14 |
Dyrcona |
@blame Ajit Pai |
| 13:14 |
pinesol_green |
Dyrcona: It's all Ajit Pai's fault! |
| 13:42 |
|
Stompro joined #evergreen |
| 15:03 |
|
khuckins joined #evergreen |
| 15:17 |
|
hbrennan joined #evergreen |
| 16:01 |
|
khuckins_ joined #evergreen |
| 16:03 |
|
jvwoolf joined #evergreen |
| 16:42 |
phasefx |
kmlussier++ emails crossed |
| 16:43 |
kmlussier |
phasefx++ great minds think alike! |
| 16:45 |
rhamby |
kmlussier++ phasefx++ |
| 17:02 |
|
khuckins__ joined #evergreen |
| 17:04 |
|
mmorgan left #evergreen |
| 18:15 |
|
frank_g joined #evergreen |
| 18:32 |
pinesol_green |
News from qatests: Test Success <http://testing.evergreen-ils.org/~live> |
