Open Source Integrated Library System

Evergreen on IRC

#openils-evergreen Logs for Monday, December 1st, 2008

< Sunday, November 30th, 2008Raw Log FileTuesday, December 2nd, 2008 >
#TimeNickMessage
#02:16:51EGUEST526 has joined #openils-evergreen
#02:18:14EGUEST526 has quit IRC
#02:20:28Mark__T has joined #openils-evergreen
#04:21:02mib_eyjt4c has quit IRC
#04:22:06mib_eyjt4c has joined #openils-evergreen
#04:44:07mib_eyjt4c has quit IRC
#04:49:15mib_eyjt4c has joined #openils-evergreen
#04:54:05BenO has joined #openils-evergreen
#04:54:57BenO has quit IRC
#04:56:08BenO has joined #openils-evergreen
#05:16:56mib_eyjt4c has quit IRC
#05:25:19mib_eyjt4c has joined #openils-evergreen
#07:33:46brendan_g has joined #openils-evergreen
#08:02:16Mark__T has quit IRC
#08:04:25Mark__T has joined #openils-evergreen
#08:36:18kgs_ has quit IRC
#08:54:07kgs has joined #openils-evergreen
#09:20:25wlayton_work has joined #openils-evergreen
#09:21:17dbs has joined #openils-evergreen
#09:48:08rsinger has joined #OpenILS-Evergreen
#10:14:31mrpeters-isl has joined #openils-evergreen
#10:14:40mrpeters-islhey guys....is there a list of all of the "fine stopped reasons" anywhere?
#10:15:35berickmrpeters-isl: in psql, \d action.circulation .. i think it has a constraint on the column
#10:17:09mrpeters-islk thanks!
#10:23:06Mark__T has left #openils-evergreen
#10:31:48dbs_ has joined #openils-evergreen
#10:37:55dbs has quit IRC
#10:38:21gmcharlt has joined #OpenILS-Evergreen
#11:24:40wlayton_workI'm looking at Vandelay and want to export all of my bib records from Evergreen in MARC21 format. Is creating a Record Bucket the quickest/easiest way to do this?
#11:26:31wlayton_workIf yes, my second question is: Is it possible to quickly add all records to a Record Bucket in the SC? I'm looking at the "Record Query" interface and I'm not sure how to go about adding them all.
#11:31:58dbs_ was off shovelling again
#11:34:42dbs_wlayton_work: other en-CA words to keep in mind: "check/cheque" (actually very nice for disambiguation) and "humor/humour"
#11:35:21wlayton_workdbs_: Ah. Will check for those, too.
#11:35:29dbs_I also cleaned up a ton of fuzzies and wrong translations in lang.dtd for en-CA - not sure if those were from the old en-CA "translation"
#11:36:30dbs_also - it may be best to work from rel_1_4 for the translations, as backporting PO work from trunk to rel_1_4 is harder than I would like it to be
#11:45:17mrpeters-islcolor / colour too!
#11:50:06wlayton_workdbs_: If you mean that the file that I gave you is very fuzzy, then I think I didn't run the "make updatepo" for en-CA or something. Hang on - I'll send you another patch for rel_1_4 which will hopefully work.
#11:51:01dbs_wlayton_work: no, I meant the one from a few days back
#11:51:27dbs_anyways, I checked in the updated version
#11:52:04dbs_(into trunk)
#11:55:06wlayton_workdbs_: Thanks.
#11:59:08dbs_wlayton_work: no no - thank you!
#11:59:23dbs_mrpeters-isl: yep, wlayton_work caught color/colour already :)
#12:01:51wlayton_workdbs_: Just to make sure I've got this right: Before I start updating PO files, I should do a "make newpot" / "make LOCAL=fr-CA updatepo" / "make LOCAL=fr-CA install" ?
#12:02:01wlayton_workI think I've been goofing this up.
#12:02:03phasefx_wlayton_work: the Record Query interface isn't quite finished (has a cap on results that you can't get around, for example), but buckets may not be suitable for what you want to do either
#12:02:43dbs_wlayton_work: if you're working in trunk, yes; if you're working in rel_1_4, then those steps shouldn't be necessary
#12:03:46phasefx_I haven't played with Vandelay yet, so if I were tasked with dumping all MARC records, I'd be using the database. \o filename.marc.xml select marc from biblio.record_entry where marc <> ''; \o
#12:03:52wlayton_workdbs_: Okay. I wasn't doing them in either. I really should've gone back to read the i18n info in the DokuWiki. Hopefully that hasn't messed too much up.
#12:05:08brendan_g has quit IRC
#12:05:08dbs_wlayton_work: well, the i18n info in the wiki probably needs simplification for the plain old translation case
#12:06:02dbs_wlayton_work: normally you declare a "string freeze" for an upcoming release (like 1.4) and generate the POT files that the translators can then use to create their own translations
#12:06:30dbs_trying to keep in sync with trunk is a much trickier (and probably frustrating) proposition
#12:07:36wlayton_workdbs_: Ah - good to know. Working with i18n is new for me.
#12:08:16wlayton_workphasefx: Thanks for the info!
#12:11:13wlayton_workactually, is it possible to export directly to MARC21, or only in MARCXML?
#12:11:20wlayton_work(not a big deal - I can run yaz-marcdump)
#12:12:44phasefx_marcxml is the format used in the database, so not possible unless you there is some stored procedure somewhere that can munge marc
#12:12:45eby- has joined #OpenILS-Evergreen
#12:12:59wlayton_workphasefx: Ok - not a problem.
#12:13:00dbs_or you could poke and see what vandelay is doing.
#12:13:51phasefx_my bet is on the middle layer doing that, but could be a stored procedure
#12:14:35dbs_Open-ILS/src/perlmods/OpenILS/WWW/Exporter.pm is where the bulk of the action is at
#12:16:04dbs_line 199 is the loop that generates marc21 from the in-db marcxml, for a given list of records
#12:22:17eby has quit IRC
#12:25:17BenO has quit IRC
#12:34:59kgs has quit IRC
#12:36:01dbs_my mission for today: create a brand new clean schema. import one record via marc2bre.pl et al. dump schema. then reproduce, with srfsh-based ingest step added. compare and contrast.
#12:38:16dbs_ is now known as dbs
#12:53:11dbsdid someone whack sboyette? or did miker_ just abscond with him in some dark data-munging corner?
#12:53:34dbs was hoping to see the EG Perl modules get the same treatment as sboyette gave to the OpenSRF modules
#12:53:41berick chuckles
#12:54:03bericki was just lementing how multi-box bricks need new treatment because of the perl modules move about
#12:54:13berickcan't just nfs mount /openils anymore
#12:54:18dbsberick: hah / bah
#12:54:59bericki wonder if you can tell nfs to share symlink'd files
#12:55:33mib_eyjt4c has quit IRC
#12:56:09dbsI'm supposed to look into making Conifer a multi-brick architecture for our uptime / redundancy goals
#12:57:40dbsis a minimal brick two or three servers? (Web server on one, apps on another, jabber on a third - and memcache co-existing on the web or app server?)
#12:58:02dbs needs to stop being sick
#12:59:10berickwe usually do box-1: apache/ejabberd/settings-server box-2/box-3 all other services ... with a dedicated memcache server on a different machine for all bricks to share
#12:59:14berickand a dedicated syslog server
#12:59:23berickand dedicated utility server (holds processing, etc.)
#12:59:28bericksome can be condensed, of course
#12:59:56berickso, 3-box bricks, adding more bricks as necessary
#13:00:30dbsberick: very helpful, thanks
#13:19:02eby has joined #OpenILS-Evergreen
#13:31:43kgs has joined #openils-evergreen
#13:32:33eby- has quit IRC
#13:40:19mrpeters-islhey guys...looking to write a report that will list all of the ILS User > Main Permission Group > Group Name's and then a count of how many registered in each group....probably a "count distinct" on barcode
#13:40:38mrpeters-islthe issue im having is, i cant see how i can do 1 report to show all of this...the only way i can see is to do a report for each group name as a filter
#13:45:22mrpeters-islsomeone doesnt want to go through 20+ profile types to get a count of how many patrons belong to each profile group...i hope im not forced to do so
#13:56:25phasefx_mrpeters-isl: look on demo.gapines.org as admin/open-ils, under Templates -> Test, jason/mrpeters profile/patron count
#13:57:00dbs thinks that would normally fall into the domain of a GROUP BY in a SQL stmt
#13:57:46dbs also wonders whether importing problems reported by peeps might be a case of parallel_pg_loader vs. pg_loader, as pg_loader test with one record worked perfectly
#13:57:53dbsnow trying a 5000 record test
#14:00:33mrpeters-isl@phasefx_ actually figured out a way to do it
#14:00:33pinesolmrpeters-isl: Error: "phasefx_" is not a valid command.
#14:00:49mrpeters-islphasefx_: actually got it working
#14:00:58mrpeters-isllist Group Name text
#14:01:14mrpeters-islthen a 2nd column with Library Card Barcode as count distinct
#14:04:09phasefx_I did it similarly, but with User ID as the thing being counted (involves less tables)
#14:04:41mrpeters-islthat makes sense
#14:06:46dbswlayton_work: btw - https://bugs.launchpad.net/ubuntu/+source/perl/+bug/303765
#14:08:30mrpeters-islwhere would i find the tables for all of the circ modifiers?
#14:08:40mrpeters-islto list them all, and count # of items belonging to them
#14:09:23mrpeters-islCN Volume > Copies > Circ Modifier (text)? or is that using too many tables
#14:10:21phasefx_mrpeters-isl: the circ modifiers aren't in a table until 1.4
#14:10:24wlayton_workdbs: ack
#14:10:45dbswlayton_work: was surprised nobody had run into that problem before
#14:10:53dbs(well, or reported it)
#14:10:54phasefx_mrpeters-isl: though you could certainly group a set of items by circ modifier
#14:11:03mrpeters-islphase...how best to do it then?
#14:11:24phasefx_mrpeters-isl: similar to the way you did users and profiles... display the circ modifier, and do a distinct count on item id
#14:11:45phasefx_all in one table
#14:13:14mrpeters-islah, item id
#14:13:23mrpeters-islbut you said circ modifiers werent in?
#14:13:28dbsin other news - pg_loader vs parallel_pg_loader works identically & well in trunk on Ubuntu Intrepid (with pgsql 8.3 no less)
#14:13:54phasefx_circ modifiers aren't normalized in 1.2.. they exist as a freetext string on the item table.. they're defined in a config file for the purpose of the item attribute editor
#14:15:20mrpeters-islhmm
#14:15:23mrpeters-islgetting no results with that
#14:15:33mrpeters-islobviuously using Copy ID rather than Item Id (since i cant find that?)
#14:19:46phasefx_see jason/mrpeter item circmod count in Templates -> Test on demo.gapines.org
#14:33:37mrpeters-islnot seeing a shared folder for test
#14:34:06phasefx_it's not shared
#14:34:15phasefx_ tries that
#14:34:20mrpeters-islwhat login is it tied to then
#14:35:30phasefx_admin/open-ils
#14:35:48mrpeters-islah
#14:35:50mrpeters-islthat helps
#14:35:52phasefx_should be shared now
#14:36:46mrpeters-islyeah, identical to what i had on production
#14:36:48mrpeters-island i get no results
#14:36:59mrpeters-islonly other thing is im filtering on shortname
#14:37:12phasefx_that report on demo does get results.. hrmm
#14:37:33mrpeters-islyeha, very strange
#14:37:35phasefx_item -> circ lib -> shortname?
#14:37:40mrpeters-isllet me double check everything
#14:37:48phasefx_try using item -> circ lib -> id (in list)
#14:37:57mrpeters-islok
#14:38:10phasefx_that'll get you a selection widget where you can pick the libraries, instead of having to enter a shortname to compare against
#14:38:19mrpeters-islright, thats what i usually do
#14:42:20mrpeters-islbeautiful
#14:42:28mrpeters-islmust have been the filter for the library
#14:49:41melissa_ has joined #OpenILS-Evergreen
#15:02:49mrpeters-islit would be sweet to somehow have a "shared" report repository for the entire community so different consortia could share templates with each other
#15:03:09mrpeters-isli think these would be helpful to others, along with many from the past and in the future...something to consider :)
#15:03:21dbsmrpeters-isl: I have asked the same question on the list
#15:03:36mrpeters-islyeah, i think its something everyone wants just a matter of time/priority
#15:03:59mrpeters-islwould be sweet to just download a "definition" file that EI would load and would attach it your staff client user id for you to report with
#15:07:41jeff_it would be useful to just have an easy way to import/export templates :)
#15:07:50mrpeters-islor better yet, these are just sql queries....maybe if there were a way to view the SQL string (if thats the right term) and share that in plain text, then allow the user to paste it in or modify as needed to run a report based on that SQL string
#15:08:44mrpeters-islmaybe jason can shed some light on if that is actually how this works....but i assume these templates are just a graphical way of generating a string to tell the SQL database what information you want to view
#15:09:46phasefx_I'm not really sure how the templates are implemented, but I've been wanting an import/export mechanism for them too :)
#15:10:31mrpeters-isli bet that a "create template from SQL" option would do the trick
#15:10:41mrpeters-islthen you could paste in the string, and run the report
#15:10:58mrpeters-islthat might be a great short term solution, instead of coding an import/export mechanism which might be more in depth
#15:12:07mrpeters-islKoha, does something similar: SELECT biblioitems.marcxml FROM items LEFT JOIN biblioitems on (items.biblioitemnumber=biblioitems.biblioitemnumber) LEFT JOIN biblio on (biblioitems.biblionumber=biblio.biblionumber) WHERE items.itype='VIDEO' AND items.holdingbranch='MADISONPL' AND items.homebranch='MADISONPL'
#15:12:22mib_a2ykyi has joined #openils-evergreen
#15:12:31mrpeters-islnot something i have the brain to do, but its an idea :)
#15:14:25phasefx_I think all the logic is one-way.. sql ultimately gets generated, but you can't take sql and re-populate the template editor
#15:22:20mrpeters-isli see
#15:28:04phasefx_looking at the data field in reporter.template, it seems like the biggest obstacle is the reference to md5sum's (which I think map to dynamically created tables)
#15:28:39phasefx_so, for example, the profile/patron count template I created on demo starts off like this... {"version":2,"core_class":"au","select":[{"alias":"Group Name","column":{"colname":"name","transform":"Bare","transform_label":"Raw Data"},"path":"au-profile-pgt-name","relation":"36cbae28efe27cc2b3a89bcfe8043584"}
#15:29:01phasefx_but I don't think "36cbae28efe27cc2b3a89bcfe8043584" could be transported to another instance of EG and mean anything
#15:29:34miker_phasefx_: sure it can. look in the from:{...} chunk of that same field
#15:30:02miker_that md5sum is specific to that template, and references a named table in the from tree
#15:30:36phasefx_ peers
#15:31:51phasefx_so "alias":"blah" is where that value is defined?
#15:31:57miker_yeah
#15:32:01phasefx_gotcha
#15:32:17phasefx_so how easy is it to make an import/export template mechanism? :)
#15:33:17phasefx_ brings dbs, mrpeters-isl, and jeff_ into a huddle around miker_
#15:33:20miker_depends on what you want that mechanism to actually do ... the variable bits between EG installations will be the owner and folder (and, of course, any custom IDL-described views or tables)
#15:33:22dbsand what is its priority in comparison to testing and finishing off in-db circ or acq?
#15:33:39miker_dbs: low :) (IMO)
#15:33:54dbs votes for miker_ to focus on in-db circ or acq or serials stuff and let peons like me worry about template import / export
#15:34:10miker_ha!
#15:34:13phasefx_:D
#15:35:20miker_fine by me. I'd rather see a "show me the SQL for this template+report" function, and separately but related, a "add this SQL as a virtual source" function
#15:35:28miker_the former would be just good all around
#15:35:54phasefx_pretty printed
#15:35:55miker_the latter would be awesome for custom reporting
#15:36:18miker_phasefx_: it's more or less done, it just isn't wrapped up in a service
#15:37:25miker_see http://svn.open-ils.org/trac/ILS/browser/trunk/Open-ILS/examples/reporter-sql-builder-test.pl
#15:38:10miker_the tiny chunk of code at the bottom just needs to be wired up to a "fetch template and report" thing
#15:39:58mrpeters-isl:)
#15:40:02mrpeters-islgood to know
#15:41:02dbsmiker_++
#15:41:03miker_it's something that I want to do SOOO BAD but I'm trying really hard not to let slip ahead of other stuff
#15:41:39dbsmiker_++ # keep up the good fight
#15:42:11miker_so, if someone were to pick it up and turn it into method inside open-ils.reporter, well, that would be immensely rad
#15:42:51mrpeters-islwish that didnt look like greek to me
#15:55:39mrpeters-islanother tricky reporitng question
#15:55:49mrpeters-isli need a base filter filtering out all patrons less than 18 years of age
#15:57:21mrpeters-islwhat is the operator to get the option to do less than 1 xxxx ago
#15:57:34mrpeters-isl1 month, or 1 year, or 50 years...i know there is a widget for this
#15:59:53melissa_ has quit IRC
#15:59:56mrpeters-islso filter between "18 years and over", between "17 years 364 days and 13 years" and finally between "12 years 364 days and 1 day"
#16:02:01jeff_ has quit IRC
#16:08:12dbsmiker_: any objection to a unique key on (owning_lib, name) for asset.copy_location?
#16:08:43dbsI've created duplicate locations for a given OU every time I step away from imports for > 1 week due to my own stupidity
#16:09:40miker_dbs: hrm... I thought that was there already
#16:10:10miker_but ... it seems not
#16:10:12dbsmiker_: maybe in your installs :)
#16:10:14miker_no objection
#16:10:20miker_no, it's not...
#16:10:20dbscool
#16:15:53jeff has joined #openils-evergreen
#16:45:13brendan_g has joined #openils-evergreen
#16:59:30wlayton_work has quit IRC
#17:09:00jeff_ has joined #openils-evergreen
#17:09:14jeff has quit IRC
#17:20:03brendan_g has quit IRC
#17:21:02jamesrf has joined #openils-evergreen
#17:21:33jamesrfdbs++
#17:22:16dbsjamesrf: heh, stubbed your toe on that occasionally too?
#17:22:54jamesrfeh?
#17:23:27jamesrfi like the aggregator, but our RSS feed is broken so we can't add it
#17:24:06jamesrfhttp://sitka.bclibraries.ca/news/RSS
#17:24:33jamesrfi don't know what's going on and i don't have access to fix it, but i think it might be fixed one day
#17:24:43jamesrfit seems to be displaying this backwars
#17:25:36dbsjamesrf: yeah, I tried to add it and then realized it was b0rked :)
#17:26:14berickwhere's the aggregator?
#17:26:18dbscould add a filter to planet-venus to resort things, I guess, but that would be kinda ugly
#17:26:19berick pulls head from sand for .43 seconds
#17:26:29dbsberick: there's a demo at planet-evergreen.coffeecode.net
#17:26:47berickrad, thanks
#17:35:28mib_a2ykyi has quit IRC
#17:44:34kgs has quit IRC
#17:47:13dbsjust updated the import_demo package for 1.4
#17:47:23EGUEST458 has joined #openils-evergreen
#17:51:04EGUEST458 has quit IRC
#18:00:07jamesrf has quit IRC
#18:05:55jamesrf has joined #openils-evergreen
#18:08:05jfournie has joined #openils-evergreen
#18:29:59jamesrf has quit IRC
#18:30:15jfournie has quit IRC
#18:35:03eby has quit IRC
#19:37:04djfiander has joined #OpenILS-Evergreen
#20:19:09dbs has quit IRC
#20:30:55brendan_g has joined #openils-evergreen
#20:39:15jamesrf has joined #openils-evergreen
#20:42:53brendan_g has quit IRC
#20:47:16mrpeters-isl has quit IRC
#20:47:46skmurphy has joined #openils-evergreen
#20:54:35eby has joined #OpenILS-Evergreen
#21:29:01wlayton has joined #OpenILS-Evergreen
#21:38:38djfianderapparently I am to assume that a quarterly is identified by season: Spring, Summer, Autumn Winter.
#21:53:42djfiander has quit IRC
#22:01:07dbs has joined #openils-evergreen
#22:04:01jamesrf has quit IRC
#22:30:54eby has quit IRC
#22:38:00dbs is pleased to discover that virtualbox pretty happily loads vmware images
#22:54:07wlayton has quit IRC
#23:12:49dbs has quit IRC
< Sunday, November 30th, 2008Raw Log FileTuesday, December 2nd, 2008 >