Open Source Integrated Library System

Evergreen on IRC

#openils-evergreen Logs for Wednesday, August 13th, 2008

< Tuesday, August 12th, 2008Raw Log FileThursday, August 14th, 2008 >
#TimeNickMessage
#01:21:45Mark__T has joined #openils-evergreen
#04:43:37Mark__T has left #openils-evergreen
#04:44:35Mark__T has joined #openils-evergreen
#08:16:44Slazer has joined #openils-evergreen
#08:18:32kbeswick has joined #openils-evergreen
#09:15:28kgs_away has joined #openils-evergreen
#09:21:22kgs_away is now known as kgs
#09:24:08rsinger_ is now known as rsinger
#09:47:00dbs has joined #openils-evergreen
#09:49:35dbsdan "bleary" scott
#09:56:48miker_me too...
#09:56:51miker_also, biab
#10:09:29kgs is now known as kgs_postoffice
#10:13:49phase_bb has joined #openils-evergreen
#10:24:18Mark__T has left #openils-evergreen
#10:28:59dbsah, marc expert only works on records with copies attached, eh?
#10:35:32miker_eh?
#10:37:35dbsmiker_: just tried a few marc expert searches for stuff like "245 a sudbury" and got no results
#10:38:10dbslooking at the query, it's joining with conditions on asset.copy; and right now, everything is transcendent, so no dice
#10:39:25dbs(opac)
#10:41:33miker_ahh... indeed. that stuff has not been touched in may moons, and I'm not surprised at all. We've found that while it's comforting to have it there, we see 10s of uses of it over the course of a year ... the quick searches above that (and the main searches) serve 99.9999% of use cases. probably 100%, actually, if indexing is appropriately adjusted
#10:44:10dbsmiker_: oh, for sure. it's really only for the librarians, and even then, mostly at demo time when they ask "... but can it search XXX?!!"
#10:44:32csharp_GPLS has joined #openils-evergreen
#10:44:33miker_yeah :) ... which is probably what you did, and then it didn't work
#10:44:36dbsmight get a bit more of a workout in academic libraries, mind you
#10:44:48miker_well, would it/should it?
#10:45:06miker_I mean, if there's something very specific to search, add a classed index def, no?
#10:46:06dbsyes - but there will be lags between our music librarian telling me "I've been using 518a to retrieve venues" and me implementing a music venue index
#10:46:43dbs tries 518a CBGB
#10:46:51miker_"you want to search only on Toc? ok, sec" ... add //*[@tag='520'] as keyword|toc, insert into keyword_field_entry select value from full_rec where tag = 520 and subfield = a;
#10:47:40miker_I mean, I understand ... and it should be fixed (should be easy-ish, too)
#10:47:58dbsAnd understand I'm not complaining! Just realizing.
#10:48:22miker_by all rights, complaints are/would-be valid
#10:49:33miker_dbs: which method is being called these days? (I need to prune metabib.pm ... badly)
#10:49:58dbsneed to work backwards from postgresql log - one sec
#10:50:12miker_heh ... well, does the query have m.metarecord in it?
#10:50:31miker_wel... nevermind ... it won't
#10:51:01csharp_GPLS has left #openils-evergreen
#10:53:11dbsopen-ils.search.biblio.marc
#10:53:45dbsso marc_search
#10:55:15dbsand then open-ils.storage.biblio.full_rec.multi_search
#10:59:22dbsso ultimately biblio_multi_search_full_rec() in Open-ILS/src/perlmods/OpenILS/Application/Storage/Publisher/metabib.pm
#10:59:41dbssee? slow.
#11:05:08skmurphy has joined #OpenILS-evergreen
#11:06:32miker_heh ... no, I couldn't sus it out either ... thus the pruning ;)
#11:08:45miker_hrm ... fix will be non-trivial ... restructuring of the query will be required
#11:11:01dbsyeah - don't worry your pretty little head about it
#11:11:09miker_ha
#11:11:41miker_you know, I wouldn't be entirely against just ripping out the copy visibility parts of those queries altogther
#11:11:57miker_"if you're searching marc directly, you're gonna get exactly what you asked for"
#11:14:38berickmiker_: that's reasonable, IMO
#11:16:02dbsmiker_: or (shudder) make it toggleable?
#11:16:27dbsactually
#11:16:56dbscalling open-ils.storage.biblio.full_rec.multi_search.staff rips out the copy visibility
#11:18:03miker_sure ... and we /could/ use that in the public opac, I guess
#11:18:18miker_arg ... meeting
#11:18:21miker_biab
#11:18:22dbsgo go
#11:21:47pmurray_away is now known as pmurray
#11:46:08miker_dbs: does the expert search do what you want from within the staff client?
#11:46:29dbs-= THIS MESSAGE NOT LOGGED =-
#11:46:49miker_k
#11:47:35miker_btw, I like the idea of a switch ... have a "filter on copy visibility" checkbox, defaulting to checked, and use the .staff version if it's unchecked
#11:50:56dbsthat's exactly what I was thinking
#11:51:34miker_see? now I'm the slow one
#12:01:32dbsbbiab - long lunch time
#12:01:59dbsSlazer / kbeswick : have you guys got any code to show for the last week or so?
#12:02:06SlazerNope.
#12:02:08dbsshow and tell, folks
#12:02:14dbsboo
#12:02:24kbeswicki have code to show!!!!!
#12:02:30kbeswickwell
#12:02:34kbeswickthere is code
#12:02:48kbeswickthat somewhat works.
#12:02:49dbsI'll be back around 1:30, likely
#12:02:51kbeswickhaha
#12:02:55SlazerDojo i18n ... doesn't seem to want to work for me....even after following a two different tutorials.
#12:04:04miker_Slazer: there's a working example in the code now
#12:04:05miker_sec
#12:04:45miker_Open-ILS/web/js/dojo/openils/widget/TranslatorPopup.js
#12:04:50miker_in trunk
#12:05:01berickone thing that came out of my acq meeting yesterday... they really want a column-picker like the staff client in the acq interfaces
#12:05:18berickwill need to build some generic dojo-grid-column-picker-widget
#12:05:31miker_hail
#12:05:39miker_or use xul ;)
#12:06:15bericki bet djfiander would get on board with that ;)
#12:06:34miker_hrm.. I gues it's a matter of creating the widest possible layout, and then dynamically modifying a copy and switiching it out as columns are added and removed
#12:06:52miker_that doesn't sound too terrible, actually
#12:07:01berickand they'll need to be sticky
#12:07:25berick rewrites acq as an FF plugin
#12:07:25miker_tell this picker deally where the layout is, and it can do the rest
#12:07:36miker_berick: non-expiring cookie? :)
#12:07:42berickyeah
#12:19:02phasefxthe killer feature of xul trees is their ability to consume RDF :-) :-) :-)
#12:21:46miker_yeah, the feature that will kill them ;)
#12:22:49phasefxthe thing that kills is the pain of styling them.. you have to do some combination of CSS and properties
#12:25:30miker_can't set flex via css?
#12:25:36miker_flex, et al
#12:29:09bericksboyette: echo -e "#\n#LoadModule mod_placeholder /usr/lib/apache2/modules/mod_placeholder.so" \
#12:29:12berick >> /etc/apache2/httpd.conf; \
#12:31:03berick laments the lack of min-width for columns in dojo grids
#12:45:09rsinger_ has joined #OpenILS-Evergreen
#12:59:48rsinger has quit IRC
#13:04:48rsinger_ is now known as rsinger
#13:09:31Slaze1 has joined #openils-evergreen
#13:16:44kbeswick_ has joined #openils-evergreen
#13:18:23kgs_postoffice is now known as kgs
#13:24:19Slazer has quit IRC
#13:24:47berickui_dev--
#13:24:52kbeswick has quit IRC
#13:28:01kbeswick_ is now known as kbeswick
#13:28:11Slaze1 is now known as Slazer
#13:28:26sboyettekbeswick++ # got it working :)
#13:28:37kbeswicksboyette++
#13:31:21bericksboyette: http://rafb.net/p/Jzn2aB62.html
#13:35:28miker_sboyette: is that in a make file?
#13:35:34miker_makefile
#13:36:41sboyettei have the echo part, but not the enclosing if. except my echo echoes to `apxs2 -q SYSCONFDIR`/httpd.conf
#13:36:51sboyettewhich i'm currently trying to figure out how to merge into the if
#13:37:58miker_dang ol' make and it's "no, really, just one line per shell command, srsly" ways
#13:38:37miker_how about `test [...] && echo "blah"` ?
#13:38:49miker_or is that too bash-y
#13:52:11dbsdb has joined #openils-evergreen
#13:52:53dbsdbSlazer: tutorials? Bah, they're always out of date. Did you try the dojo i18n test?
#13:53:25SlazerI looked at it...but got confused how it worked.
#13:54:37dbsdbah - in that case, tutorials can be good for concepts, and working tests show you how those concepts actually work in practice :)
#13:55:30dbsdbmiker_: http://dwarf.cs.uoguelph.ca/ still seems slow, but is definitely better
#13:57:11miker_dbsdb: better after what? ...
#14:03:58dbsdbmiker_: better after postgresql tuning
#14:04:01dbsdbupping effective_cache_size to 9GB (it's a 16 GB machine, free -m is actually showing about 15GB cached)
#14:04:16dbsdbupping max_fsm_pages to 750000
#14:04:25dbsdband maintenance_work_mem to 1GB
#14:05:29dbsdbstill - day one after loading 4 million records, I'm sure there's lot of tweaking to do (and testing... oh lord, the testing)
#14:06:17miker_and the cold cache ;)
#14:06:30miker_it's full of the bare SQL files (or COPY files)
#14:06:40dbsdbbut first - I must investigate a mystery in this support ticket: "our scanner has been slow for the last two days, please investigate"
#14:06:44dbsdbplease kill me NOW
#14:07:26miker_haha
#14:07:31miker_"reboot windows"
#14:07:57dbsdbindeed it is. maybe a little curl script for a cache-warmer would be a useful utility
#14:08:45dbsdbcrazy postgresql and its reliance on fs caching... :)
#14:08:54miker_ha
#14:09:14miker_cat /var/postgres/base/102021/* >/dev/null
#14:09:39dbsdbhah!
#14:09:42miker_(though on a 16G machine, it would be good to be more table and index specific for that)
#14:11:47dbsdbyeah, db is around 55GB at the moment. I don't think we're going to be able to pull a UPEI on this and hold it all in-memory
#14:14:26miker_that's about PINES-2006 size (about 75G now) so not unmanageable, and your circs will not be near the scale of PINES, I would imagine
#14:14:43dbsdbI can guarantee you that.
#14:15:19dbsdbStill have to load patrons and holdings, mind you
#14:22:52Slazerwoohoo... I'm getting it to work finally. *hugs firebug* I need to use this more
#14:28:20dbs_ has joined #openils-evergreen
#14:30:41dbsdbyay!
#14:37:49dbs has quit IRC
#14:55:36berickanyone who has access to the ACQ box, please don't break anything for the next hour or so :)
#14:58:10bradlhaha
#15:14:49Slazer has quit IRC
#15:30:40peanutb has quit IRC
#15:42:39kbeswick has quit IRC
#15:58:58dbsdb has quit IRC
#17:18:29pmurray is now known as pmurray_away
#17:46:44kgs is now known as kgs_workout
#18:02:16dbs_ has quit IRC
#18:28:13phase_bb has quit IRC
#18:57:14kgs_onroad has joined #openils-evergreen
#18:58:16kgs_onroad is now known as kgs_
#19:01:04agJohnAnyone know why I'd be getting a "the attempt to query the DB failed" message when I try to save a new bib record, but I can edit existing ones?
#19:01:06agJohnThe storage_unix.log reports this (multiple times): Use of uninitialized value in join or string at /openils/lib/perl5/OpenSRF/Application.pm line 101, <STDIN> line 1.
#19:01:07agJohnThe "stacktrace" value is: /openils/lib/perl5/OpenILS/Utils/CStoreEditor.pm:540 (eval 625):1 (eval 625):1 -- which looks like a message handler, so not much help (at least not to me)...
#19:01:09agJohnThe "textcode" is DATABASE_QUERY_FAILED
#19:01:43agJohnOops, take that back. The Application.pm line 101 is the message handler....
#19:02:42berickagJohn: check the postgres log
#19:06:09agJohnERROR: duplicate key violates unique constraint "record_entry_pkey"
#19:06:11agJohnI'm going to guess that the sequence on that column has not been updated after inserts with a key included....
#19:06:37berick is thinking *bingo*
#19:07:45agJohnGot it.
#19:09:34agJohnSlicker than socks on a chicken! Thanks, berick--I should'a looked there w/o the suggestion. Little by little, I'm getting it, I hope.
#19:35:57kgs_ has quit IRC
#20:13:23kgs_ has joined #openils-evergreen
#20:47:39kgs__ has joined #openils-evergreen
#20:57:13kgs__ has quit IRC
#21:04:59kgs_ has quit IRC
#22:43:32kgs_ has joined #openils-evergreen
< Tuesday, August 12th, 2008Raw Log FileThursday, August 14th, 2008 >