Open Source Integrated Library System

Evergreen on IRC

#evergreen Logs for Wednesday, February 15th, 2012

< Tuesday, February 14th, 2012Raw Log FileThursday, February 16th, 2012 >
#TimeNickMessage
#01:00:34jeff grins at "which is clearly not optimal behavior" in bug 932540
#01:00:34pinesol_greenLaunchpad bug 932540 in Evergreen "Indexing multiple ISSNs in a single bib results in identifier|issn lookup failure" (affected: 1, heat: 6) [Undecided,New] https://launchpad.net/bugs/932540
#01:31:56enhancin_Hm...I've got my Amazon book covers configured correctly but none of them are showing up...same thing is happening with google preview..
#01:41:34enhancin_ has quit IRC
#01:41:44enhancin_ has joined #evergreen
#01:42:15enhancin_I have two servers running, both with the same added content configuration and one of them has book covers while the other doesn't...
#02:05:57youdonotexist has joined #evergreen
#03:18:17youdonotexist has quit IRC
#03:48:16_bott_ has quit IRC
#03:48:57_bott_ has joined #evergreen
#05:19:46woodbridge has quit IRC
#05:19:54woodbridge has joined #evergreen
#07:55:49collum has joined #evergreen
#08:06:02shopkins has joined #evergreen
#08:13:28Dyrcona has joined #evergreen
#08:16:35akilsdonk has joined #evergreen
#08:33:42gdunbar has joined #evergreen
#08:42:51tspindler has joined #evergreen
#08:54:53j_scott has joined #evergreen
#09:01:46kmlussier has joined #evergreen
#09:12:59Meliss has joined #evergreen
#09:14:30j_scottgood morning - does anyone have a suggestion on how best to take an existing bib record and attatch volume and copy info using sql only?
#09:15:21tsbereinsert into asset.call_number with the record row set to the bib's id
#09:15:32tsbereThen insert into asset.copy with the call number field set to your new call numbers?
#09:15:38Dyrconayep...
#09:16:01tsberes/record row/record field/ <_<
#09:16:05tsbere is confusing his terminology
#09:16:17tsbereToo early for me, I guess.
#09:16:54jeffj_scott: tsbere has pointed you in the right direction, but I'll also ask -- do you have the volume and copy data in some existing format already, like semi-standard "local holdings" 852 fields in the bib records?
#09:17:10j_scottyes!
#09:17:27j_scottnot really in marc - pseudo ncip msg
#09:17:39j_scottbut I can transform
#09:18:13j_scottand then import marc .. have been trying to do homework = reviewing http://svn.open-ils.org/trac/ILS-Contrib/wiki/ImportDemo
#09:19:01j_scotttsbere++
#09:19:26j_scottlooking at comm2 now and trying to do via sql login
#09:19:39jeff"Adding copies to bibliographic records in Evergreen
#09:19:45Dyrconaj_scott: I'd write a whole new interface to import via ncip, personally.
#09:19:50jeff" on this page may have some helpful bits: http://open-ils.org/dokuwiki/doku.php?id=evergreen-admin:importing:bibrecords
#09:20:00jeffas well as http://evergreen-ils.org/dokuwiki/doku.php?id=importing:holdings:import_via_staging_table
#09:20:01Dyrcona wouldn't try doing it through sql.
#09:20:04j_scottDrycona++
#09:20:13j_scottwould like to contrib this back to eg
#09:20:15jeffeither or both of those may be somewhat out of date -- direct_ingest is old, iirc.
#09:20:32j_scottbut want to do it the right way - defined by this comm
#09:20:54tater-laptop has joined #evergreen
#09:21:23Dyrconaj_scott: I'd suggest trying to write something in perl that uses the existing open-ils calls to create bibs, volumes and copies.
#09:21:27tsberej_scott: You could look into using fieldmapper/cstore calls via perl for more direct creation (without logins) or look at the open-ils.cat service for authenticated calls.
#09:21:55j_scotthave ncip initiator (basic) and responders (basic)
#09:22:15j_scottis there a best repo to put up examples?
#09:22:42j_scottfor review & extension?
#09:22:47Dyrconaj_scott: depends.... tsbere can set you up a repo on evergreen-ils.org.
#09:23:14tsberej_scott: Are you working with a fork of Evergreen or a new project similar to how SIPServer works?
#09:23:15Dyrconai use github for 1 evergreen-related project.
#09:23:26j_scottcurrently working : lookupuser, requestitem , lookupitem
#09:24:22j_scottah - github makes perfect sense - is it kosher to post link to github via the list once it is up?
#09:24:49Dyrconaj_scott: sure is. you can also include github in any launchpad bugs you create.
#09:25:25jeffj_scott: are you aware of the work that Library Technology Consultants may be doing with regard to NCIP and Evergreen? http://mcls.org/blog/?p=1587
#09:25:42Dyrconaif you're working on something that will be added to Evergreen itself and not a separate package, then you might want a repo on evergreen-ils.org at some point.
#09:25:51j_scottcheck -I am working with them + eXtensible Catalog people (when I can)
#09:26:02jeffgood to hear!
#09:26:18Dyrconaeven if it is a separate project, you might want a repo on evergreen-ils.org just the same.
#09:26:39j_scotttying to harmonize btw all parties - want this to be elegant and useful for all going forward
#09:26:47jeffj_scott++
#09:27:42j_scottLTC is doing iii (dcb) to eg - going well
#09:28:33j_scottlast piece is the acceptitem service =~ the bib, volume, copy record issue
#09:28:49jeffgood to hear. i haven't seen much from them, so i wanted to make sure you were aware of them -- which you were. :-)
#09:29:34j_scotteou / beth longwell also has OCLC nre to eg working for first 3 services
#09:29:45Dyrcona wondered if we were ever going to hear anything about those ncip projects.
#09:30:21jeffcool. lots of stealth ncip work going on. i'm glad y'all are at least talking to each other. :-)
#09:30:31j_scottI would be very happy to share everything that I know
#09:30:58j_scottfeel like the perl written so far was rapid prototype stuff - not worthy of review
#09:31:54Dyrconaj_scott: If you want something quick and dirty that shows how to create bibs, volumes & copies via perl, check this out: https://github.com/Dyrcona/issa
#09:32:39Dyrconaspecifically, the create_copy subroutine in issa.pl
#09:32:39j_scottwow ... very cool
#09:32:49j_scottDyrcona++
#09:33:45j_scottperfect!
#09:34:42jeffDyrcona++
#09:34:50jeff(for not waiting to share)
#09:35:13Dyrcona wrote issa last summer under contract for MassLNC.
#09:35:37jeffthat was for a different non-ncip statewide resource sharing system, correct?
#09:35:48Dyrconayes. for an old version of URSA.
#09:36:10Dyrconaworks as a simple command line client, too.
#09:36:27jeff*nod*
#09:36:37j_scottwould a comparable iii to eg ncip be of use to many here?
#09:38:31jeffi don't recall how many evergreen installs are in areas with existing iii inn-reach systems, but we're one. we don't currently participate in the statewide michigan system, but better support in the ils would be one step in the right direction.
#09:38:51Dyrconaj_scott: can't really say if it would be useful to us in MA, but you never know...
#09:38:53jeffi'm mis-using "recall" there. i simply don't know.
#09:41:48j_scottthought ncip framwork would be a good way to sync systems too - bib, patron, etc records - to allow ILSx to try eg alongside
#09:42:13jeffspeaking of "mis-using" -- quick and dirty "do any of these records have duplicate 901 tags (assumes all have a 001)": yaz-marcdump tadl-yaz.marc | grep -E '^001|^901' | awk '{print $1}' | uniq -d | sort | uniq -c | sort -rn
#09:58:44j_scottneed to confirm GNU on all scripts + put headers in + separate nre/oclc and iii/dcb connectors but here is where they will live for now : github.com/jonscott/iNCIPit
#09:59:06jenny1 has joined #evergreen
#09:59:49jeffj_scott++
#10:03:09jeffah yes. need a trailing space on those patterns: grep -E '^001 |^901 '
#10:09:25denialsj_scott: you could also look at the end of concerto.sql (in Open-ILS/tests/datasets) for how to create call numbers and copies (and parts, and conjoined bibs) via SQL. Totally fake data of course, but same principles apply.
#10:11:12j_scottdenials++ ty! another good point
#10:35:37enhancin_hm, so my Amazon book covers stopped working on one of our systems..they're configured to be the same way but one of them isn't grabbing the book covers correctly apparently
#10:36:46denials thinks the metabib.record_attr updating chunk of the biblio ingest trigger should probably get pulled out into a separate function so it can be invoked without issuing fake updates on biblio.record_entry - if possible
#10:37:40denials has a weird situation where bib has no metabib.record_attr entries but has metabib.*_field_entry and other metabib bits filled in
#10:49:52eeevildenials: I think everything should be sharded out of that func, actually
#10:50:07eeevilsays the guy what wrote most of it...
#10:51:44jeffenhancin_: i don't have recent experience with the amazon book covers handler, sorry. have you tried examining the opensrf logs, potentially with them cranked up to debug level (beware)? another option would be to use a packet capture tool on each system to compare what is being sent to amazon, and what comes back.
#10:52:09jeffenhancin_: also, simple things like a difference in dns servers that the working and non-working systems are using?
#10:52:12tsbereI have a desire to re-work all 19 ".override" calls. Anyone have objections to making them a little less likely to override things you never intended to override?
#10:52:42j_scottjeff++
#10:52:47jefftsbere: can you provide an example?
#10:53:29tsberejeff: I basically want to change it so that everything requesting an override passes in an extra parameter for *what* it is overriding. So that if you override event A that was hiding B you aren't silently overriding B too.
#10:53:46jeffgot it.
#10:54:24hopkinsju has joined #evergreen
#10:57:46frank__ has joined #evergreen
#10:59:28wolf29 has joined #evergreen
#11:03:01hopkinsjuCan anyone share their strategy for adding ebooks(etc) to the catalog? We've got the library adding them with a source set to transcend - so now they show in the catalog but aren't scoped. This is ok for now but doesn't seem sustainable as more libraries are added to the system.
#11:03:59mrpeters-islhopkinsju: do they have the 856$9 ?
#11:04:05hopkinsjuIdeally we'd add items for them, but I'm not sure what the best way is to add barcodes.
#11:04:25hopkinsjumrpeters-isl: nope
#11:04:30jeffhopkinsju: there is a feature called "located uris" that you would benefit from.
#11:04:31mrpeters-islthats your problem :)
#11:04:38mrpeters-islsorry i didnt tell you about that
#11:05:00hopkinsjumrpeters-isl: No doubt. I believe you did, but that's why we set them to transcend.
#11:05:08hopkinsjujeff: I'll look that up.
#11:05:09mrpeters-islLocated URI visibility: Located URIs (856 fields with a subfield $9 specifying the shortname of the owning library) now show up in a search with a context library of its owning library or below. For example, a Located URI with an owner of SYS1 will cause its record to show up in a search with a context OU of BR1 or SYS1, regardless of depth scoping.
#11:05:22jeffhopkinsju: http://docs.evergreen-ils.org/1.6/draft/html/electronicresourcesvisible.html has a very quick overview
#11:05:29enhancin_jeff: one was using google's public dns and the other was using the dedi server provider's dns..that shouldn't randomly break it but let me test it out
#11:05:52jeffthe visibility of 'located' 856 tags changed in/around evergreen 2.1
#11:06:14mrpeters-isljeff: 2.1 i think, that bit i pasted was from 2.1 release noets
#11:06:58jeffsee http://docs.evergreen-ils.org/2.1/html/releasenotes.html for a note on "Located URI visibility"
#11:08:02hopkinsjuSo adding an 856$9 will keep transcendent records from appearing outside of that scope?
#11:08:18mrpeters-islyep
#11:08:46hopkinsjuOh, ok. That's exactly what I was looking for. You *should* have told me that mrpeters-isl ;)
#11:08:56mrpeters-isli think we have a little manual on how to handle Overdrive e-books. Let me see if I can get my hands on it.
#11:09:04hopkinsjuSweet, thanks.
#11:09:23Dyrconacan anyone point me at code in the client that actually uses streaming requests from the server? I haven't found any.
#11:09:35gerlevi has joined #evergreen
#11:10:21jeffhopkinsju: i believe transcendent bibs will always show, regardless of 856 tags -- but the point is with 856 tags (with those proper indicator / subfield / etc) will cause non-transcendent bibs to show in searches just as if you had created "fake" copies at the libraries in question.
#11:11:25hopkinsjujeff: I'll do some testing and report back.
#11:12:03DyrconaI keep getting this from the client: http://pastebin.com/VkaFrbpz
#11:12:04jeffDyrcona: Browse Holdshelf interface in the staff client would be one example -- i think.
#11:15:16denialshopkinsju: located uris are the way to go, at least with the latest fixes (not in a release yet I think); you just push the marc into biblio.record_entry and in-db ingest does all the rest
#11:15:49denialss/marc/marcxml/
#11:16:46Dyrconaheh....just noticed that I was restarting acq and not cat..... maybe that explains my error. backend code changes not picking up.....
#11:17:48jeff11:19: restate my assumptions...
#11:22:59gerleviHello everybody, we are testing our new installation of evergeen (2.0.2) but we have troubles with the e-mail courtesy notices
#11:23:20gerleviit just sends the 3 day courtesy notice that comes as default
#11:24:12mrpeters-islgerlevi: sounds like you will need to do some reading about Action/Trigger events
#11:24:14gerleviwe cloned it and modified to send notifications 2 and 1 day before the item's due date, but it does not send the e-mail
#11:24:28mrpeters-islhttp://docs.evergreen-ils.org/2.0/draft/html/actiontriggers.html
#11:26:05eeevilhopkinsju: re "So adding an 856$9 will keep transcendent records from appearing outside of that scope?", no. trancendent recors /always/ show up /everywhere/
#11:26:57eeeviladding 856$9 allows records without copies to show up where appropriate
#11:27:14gerlevimrpeters-ils: thank you for your help, i will read the manual again and see if we find the solution
#11:27:16hopkinsjueeevil: Thanks for the clarification.
#11:27:42eeeviland .... then I read what jeff said, which is exactly that
#11:27:54eeeviljeff++
#11:28:14jeffheh
#11:28:18jeffeeevil++
#11:28:39jeff(for confirming my weak "i believe" statement)
#11:28:41mrpeters-islhopkinsju: sorry for bad info...i thought trancend AND 856$9 was required
#11:29:15hopkinsjuNo worries
#11:29:24hopkinsjumrpeters-isl++
#11:29:26hopkinsjujeff++
#11:29:28hopkinsjueeevil++
#11:29:47hopkinsjuGet on board the karma train :)
#11:33:04Dyrconagrrr.
#11:33:22Dyrcona@hate the staff client
#11:33:22pinesol_greenDyrcona: The operation succeeded. Dyrcona hates the staff client.
#11:33:27Dyrcona@hate javascript
#11:33:27pinesol_greenDyrcona: The operation succeeded. Dyrcona hates javascript.
#11:36:44youdonotexist has joined #evergreen
#11:41:08DyrconaSo, I can't figure out what to do about my streaming opensrf service returning an error to the client.
#11:41:34DyrconaIt seems the client always looks for 1 more request and then bang! response is null.
#11:42:00Dyrconashould I call client->complete before returning on the backed?
#11:42:57jefffrom the top of my head, yes.
#11:43:07jeffbut i haven't looked at that in a while.
#11:43:24Dyrconathanks, jeff, I've edited my code. will report what happens after I reload the cat service.
#11:46:38Dyrconanope.
#11:46:52DyrconaI'm going to throw my branch up if anyone could take a look, I'd appreciate it.
#11:47:15DyrconaI had the backend working fine with a perl client, but now I'm making staff client changes and it isn't working for me.
#11:47:28Dyrconadid I mention I don't like working in the staff client code?
#11:48:54Dyrconahttp://git.mvlcstaff.org/?p=jason/ILS.git;a=shortlog;h=refs/heads/lp921812
#11:48:59Dyrconastupid commit messages and all.
#11:54:37mrpeters-islI'm trying to generate a listing of bib records that have attached volumes, but no attached copies. I'm trying - http://pastie.org/3388726 - but it's giving me back bibs that have copies attached at the library I'm filtering out (ou=4). Any SQL experts have any ideas for how I can accomplish this?
#11:56:54mrpeters-islhopkinsju: http://www.in.gov/library/files/EI_Procedures_Guide_Chapter_2_Copy_Cataloging_Work_Flow.pdf (Overdrive cataloging)
#11:58:48Dyrconadeleted is false?
#11:59:10Dyrconait will return for deleted copies at circ_lib 4, is that what you want?
#11:59:55mrpeters-isli don't want it to consider deleted copies
#12:00:25Dyrconayou don't want it to consider *any* copies from circ_lib 4, right?
#12:00:28mrpeters-isljust want it to look at volumes owned by 4, that have no copies at 4 attached
#12:00:38mrpeters-islno, i do
#12:00:58mrpeters-islthis is really confusing, i know. i guess their goal is to find volume that have been abandoned and delete them
#12:01:48mrpeters-islthe goal is to only look at volumes owned explicitly by 4, same for copies
#12:02:44Dyrconawhy do you need bibs if you're worried about volumes?
#12:02:54Dyrconaare you trying to delete the bibs, too?
#12:03:51mrpeters-islthey asked for the bib id and tcn
#12:04:00mrpeters-isli dont know what they're doing. just trying to give them what they requested.'
#12:04:41enhancin_hm...on the same server for some reason the information at the bottom of a record is blank. The table that shows what library, call number, location, actions, available, etc is what I'm talking about...
#12:05:35enhancin_and then it says "* There are no copies in this location"...hmm
#12:06:37jeffmrpeters-isl: this is how i'd do it: http://paste.lisp.org/display/127786
#12:07:13mrpeters-islinteresting. ok, ill give it a shot.
#12:07:14denialsPushed user/dbs/record_attrs_split into working as step one of the split-out record_attrs ingest function
#12:08:38DyrconaBetter to give them what they want than what they ask for. I found usually they don't ask for what they want around here, just what they think they want.
#12:08:47mrpeters-islhere's the real question, jeff, do you think that could be pulled off in a report?
#12:09:38jeffmaybe. i haven't tried in a while. we're doing most of our reports with sql now.
#12:09:48mrpeters-islyeah, so much easier sometimes
#12:10:03mrpeters-islmaybe ill write a little page you can go to and punch in your org_unit and get results
#12:10:20jeffsometimes. reporter is still nice for ad-hoc things, but we don't have much ad-hoc need from folk that don't already know sql.
#12:10:39mrpeters-islhow do you deliver your results?
#12:10:45jeffjasperserver
#12:10:52mrpeters-isloh thats right
#12:11:13jeffhope to have a demo up at some point, otherwise watch for my session at the conference. ;-)
#12:12:38jeffkeep in mind if the only thing being done with these volumes is having staff delete them, you could offer to do that for them. ;-)
#12:13:17jeffsomething like delete from asset.call_number where id in (a slightly modified version of that query)
#12:23:46luisb has joined #evergreen
#12:33:04youdonotexist has quit IRC
#12:38:10tsbere waits for his meeting notes to make it through the greylister so he has them off of his phone
#12:40:02tsbereOh, hey, there they are. :D
#12:42:12tsbereSo, right now our circ people are apparently very unhappy that libraries can bar a different library's patrons. I found BAR_PATRON and UNBAR_PATRON....only hooked into the old user editor. I am considering adding those checks to the current patron editor, and including BAR_OWN_PATRON/UNBAR_OWN_PATRON that you would need to have at the patron's home library. Any thoughts?
#12:42:40mrpeters-isljeff: they say that worked perfect, thanks!
#12:57:42luisb has quit IRC
#12:58:47luisb has joined #evergreen
#13:05:05bericktsbere: you could determine the scope of your barring based on where you have the BAR* permissions. iow, i don't think another perm is needed
#13:08:17tsbereberick: Which would mean forcing the check to always happen at the patron's home library, rather than at the current workstation OU (which is where the previous editor appeared to check for it)
#13:08:58jeffmrpeters-isl: yay!
#13:09:01tsbere was trying to keep the previous behavior from the old interface and introduce the new behavior at the same time
#13:09:25tsbereBut if we want to throw out the old and go with just the new I am ok with that. Less code to fight with, and no upgrade script!
#13:10:07berickin that case, i'd argue the way the previous UI did it was wrong
#13:10:49tsbereI didn't read the entire javascript file, I could be mistaken as to where it checked, but I am willing to run with that interpretation
#13:33:54plux has joined #evergreen
#13:35:20plux has joined #evergreen
#13:36:38artunit has quit IRC
#13:40:57phasefx_wanted to throw these out there in case anyone wanted to polish them up, make use of them, etc. http://nox.esilibrary.com/~jason/procedures.sql
#13:41:07phasefx_stored procedures like test.add_bib()
#13:44:38pluxhit an error on a fresh install from master today…running the make install breaks at this error …libtool: install: error: cannot install `liboils_utils.la' to a directory not ending in /openils//lib
#13:44:59pluxother libraries seemed to have gone in fine to that point
#14:12:16Dyrcona had no problem building master this morning, so cannot help.
#14:16:30pluxthanks… that's a help…. must be on this end
#14:55:51gerlevi has quit IRC
#15:06:05j_scottis anybody here using evergreen.instance in combination with oai repositories as target for metadata harvesting ? worldcat digitalgateway targeting evergreen instances? would that be too much of a cheat for an ils.discovery solution?
#15:08:57eeevilj_scott: other discovery layers are sitting atop evergreen instances, but not worldcat AFAIK
#15:09:53j_scottwith the supported datatypes - marc 21 etc - it seems a local (static) xml doc could be served as a target
#15:10:20j_scottor exported realtime, if the collection was small
#15:10:34enhancin_hm.i'm missing a lot of ISBN numbers..has anyone heard of an ISBN fixer cleaner type script? they all ahve the (OCoLC) numbers...that could help i hope.
#15:12:18j_scottxisbn service?
#15:14:12enhancin_hmm that looks promising. thanks :) I'll lookg into this and see if it can do what i need
#15:16:19j_scotthttp://xisbn.worldcat.org/xisbnadmin/xoclcnum/index.htm
#15:17:50j_scotthttp://xisbn.worldcat.org/webservices/xid/oclcnum/604329191
#15:21:26shopkins has quit IRC
#15:22:26j_scotthttp://xisbn.worldcat.org/webservices/xid/oclcnum/604329191?method=getEditions&format=xml&fl=lccn,isbn,owi
#15:39:00plux has quit IRC
#15:39:32tsbereberick: http://git.evergreen-ils.org/?p=working/Evergreen.git;a=shortlog;h=refs/heads/user/tsbere/bar_patron is what I came up with. Any thoughts?
#15:40:01tspindler has quit IRC
#15:46:04bericktsbere: for the JS pieces, I'd suggest following the same pattern as checkClaimsReturnCountPerm(), checkClaimsNoCheckoutCountPerm(), and checkCollectionsExemptPerm(). in particulary, they'll update as the home_ou of the patron is changed
#15:46:22bericker, in particular
#15:47:11tsbereberick: But I only care about the home_ou changes on create. Otherwise I want to know what the home_ou *was*....and I suspect that *creating* barred patrons at "not here" is rare enough to warrant avoiding extra checks.
#15:47:12bericklooks good, though. ML_checks++
#15:47:30tsbereor not warrant them
#15:47:31tsberebah
#15:47:32tsbere<_<
#15:48:42tsbere should have written the ML checks first, because he then had no good way to test them and had to disable his new client side code
#15:49:11frank__ has quit IRC
#15:49:43enhancin_j_scott some of these that have oclcnums don't even have isbn numbers...not on amazon either. i might have to try to use that for the ones that hve it and then use the rest of them and search by title or something
#15:50:09enhancin_http://xisbn.worldcat.org/webservices/xid/oclcnum/00502313?method=getMetadata&fl=*
#15:51:06bericktsbere: yeah, i see your point. in that case, I think this makes sense.
#15:55:17j_scottare they issns? or other?
#15:58:30Meliss has quit IRC
#16:01:03tsbereberick: Found your old bug! https://bugs.launchpad.net/evergreen/+bug/871948
#16:01:04pinesol_greenLaunchpad bug 871948 in Evergreen "User editor does not honor (UN)BAR_PATRON permission" (affected: 1, heat: 6) [Undecided,New]
#16:02:34bericktsbere: wow, i.. wow. that wasn't even that long ago
#16:02:58tsbereNo, it wasn't
#16:03:05tsbereStill old as in existing but forgotten, though ;)
#16:03:38berickindeed. glad you found it
#16:05:37Dyrconait's a three dialog night!
#16:07:24Dyrcona@love git
#16:07:24pinesol_greenDyrcona: The operation succeeded. Dyrcona loves git.
#16:07:34Dyrcona@log the staff client
#16:07:34pinesol_greenDyrcona: Error: You don't have the owner capability. If you think that you should have this capability, be sure that you are identified before trying again. The 'whoami' command can tell you if you're identified.
#16:07:43Dyrcona@love the staff client
#16:07:43pinesol_greenDyrcona: But Dyrcona already hates the staff client!
#16:07:59DyrconaYeah, you dummy, I have a love/hate relationship with it.
#16:08:41Dyrcona has learned more about the staff client than he ever though he'd to know today.
#16:12:27tsbere hates getting these in cron emails: "Attempting to build a client session as a server Session ID"
#16:21:26enhancin__ has joined #evergreen
#16:21:34tsbereberick: Got a perl listener stuck in a bad file descriptor loop. Want any output? (supercat, in this case)
#16:22:25bericktsbere: strace would be good. what opensrf version/patches are you running?
#16:22:54tsbereberick: I installed your latest work there last night to try and keep our cat listener from falling over daily.
#16:23:33berickk. so, supercat is looping, as in spinning at 100% cpu?
#16:23:51tsbereyea
#16:24:11berickhuh
#16:24:28tsbereGrabbed strace, did an lsof for fun, restarted it. <_<
#16:24:44enhancin_ has quit IRC
#16:26:03tsberedamnit, I think search just decided to start
#16:26:53tsbereLooks like it is doing the exact same thing. Won't bother with strace/lsof for it. <_<
#16:30:14akilsdonk has quit IRC
#16:33:29bericktsbere: i have a theory and (shortly) a small patch if you want to test..
#16:34:52tsbere is leaving a lot of this testing to Dyrcona
#16:34:58tsbereI just do the research when things go wrong ;)
#16:37:00denialsberick: it could be bunnies?
#16:38:09berickhttp://paste.lisp.org/display/127789
#16:38:16berickdenials: that goes without saying
#16:38:55berickDyrcona: if you're up for some more opensrf testing :)
#16:39:09berickDyrcona++ tsbere++
#16:39:17Dyrconalay it on me. any particular scenario you want me to try?
#16:40:01Dyrconaall right.... I'll try that patch.
#16:40:15berickDyrcona: this may be one of those situations where you patch it and a week later you can say, "looks like that worked"
#16:40:26Dyrconaok
#16:40:29berickIOW, it needs traffic and time and a little luck to reproduce
#16:42:42tsbereberick: In that case, I may install it in production tomorrow night. Not tonight, our members dislike us doing that kind of patching too often.
#16:43:02luisb has quit IRC
#16:43:13denialspatch early, patch often
#16:43:35gmcharlt has quit IRC
#16:43:35gmcharlt has joined #evergreen
#16:44:44collum has quit IRC
#16:45:09Dyrconaapplied in dev and everything restarted just fine. I'm about to do a smallish batch delete.
#16:47:16berickfor the record, this is a different problem than the large-message-lockup problem, if I'm diagnosing it correctly.
#16:47:59tsbereLooked it
#16:58:34luisb has joined #evergreen
#17:11:58kmlussier has quit IRC
#17:12:45hopkinsju has quit IRC
#17:20:26hopkinsju has joined #evergreen
#17:23:40wolf29 has quit IRC
#17:24:36Dyrcona has quit IRC
#17:48:05jenny1 has quit IRC
#18:02:38hopkinsju has quit IRC
#18:08:38luisb has quit IRC
#18:35:43artunit has joined #evergreen
#19:00:59enhancin__If I make changes to a .pm file, do I need to restart anything in order for those changes to make effect (perl noob)
#19:03:00jeffenhancin__: yes, you do. in some cases, restarting apache will be enough. in other cases, you will need to restart the opensrf services.
#19:03:34enhancin__hm. I'm modifying the AddedContent things, such as AddedContent.pm and Amazon.pm
#19:03:46jeffenhancin__: due to the way apache handles processes, you will sometimes see things take effect without having initiated a restart of apache, but it will be spotty and unreliable.
#19:05:02jeffenhancin__: a restart of apache should be sufficient, unless you modified OpenILS::Application::Search::AddedContent in addition to OpenILS::WWW::AddedContent
#19:05:31enhancin__no only WWW::AddedContent
#19:05:59enhancin__cool, thanks Jeff.
#19:06:03enhancin__er..jeff ;)
#19:06:24jeffshould be enough to restart apache. keep in mind also that the AddedContent bits typically cache lookup results for a time in memcached. depending on what you're changing, you may want to force those things out of the cache.
#19:06:31luisb has joined #evergreen
#19:06:55enhancin__ahhh..do that by restarting memcached or is there a more easier way, some command I can do? I tried autogen.sh but that didn't really do it I don't think
#19:07:10jeff(or, it may not matter -- sometimes it is easier to just do a search on a different term to get different records so that you're not loading images you loaded last time you tried what you're working on)
#19:07:56jeffyou can use memcdump to list keys and memcrm to remove them.
#19:08:05jeffor you can restart memcached before you restart apache.
#19:08:18jeffthat may require a fuller restart of opensrf services.
#19:08:26enhancin__i figured osrf required restart if i did that =/
#19:08:30jeffand it will force expire things like active logins to evergreen.
#19:08:47enhancin__cool
#19:09:20jeffi'll bet something like memcdump | grep some_addedcontent_pattern | xargs memcrm would be useful.
#19:09:29jeffyou need to provide a server list to the memcache tools.
#19:09:51enhancin__yeah, i'm getting a WRITE FAILURE hm
#19:10:02jeffone sec
#19:11:14jeffbooting a dev vm to test a quick one-liner
#19:11:43enhancin__might have to do a restart anywqays, memcached is claiming to be empty I think
#19:14:55enhancin__yep showing empty
#19:17:41enhancin__hm..it's still not taking the changes after the full restart but at least memcached isn't showingempty..
#19:17:56jeffinteresting.
#19:18:11enhancin__I put a line in Amazon.pm to log when it grabbed the url and it's not..logging
#19:18:50jeffis the log line using the opensrf logging methods, and if so is it logging at a level sufficient to BE logged per your loglevel?
#19:19:01luisb has quit IRC
#19:19:05jeffalternately, if you're just printing, i think some of those will show in apache's error log.
#19:19:13jeff(which i wouldn't recommend)
#19:19:27enhancin__$logger->info("Fetching amazon thing for $key.")
#19:19:29enhancin__that's right, right?
#19:19:34enhancin__i grepped the other files to see how they logged
#19:19:37enhancin__;
#19:19:48jeffyes, though you'd want a semicolon -- ah, there it is!
#19:19:57enhancin__haha.
#19:20:16jeffdo you have other INFO lines in the osrfsys.log, or wherever you have your opensrf logs going?
#19:20:19enhancin__hm, but yeah it's not showing up. It's logging from AddedContent.pm
#19:20:20enhancin__yeah
#19:20:24enhancin__the one where it shows the actual amazon URL
#19:20:34jeffyeah. hrm.
#19:21:07enhancin__sub get_url{ line 151 has a logger->info that is showing up
#19:21:20enhancin__is Amazon.pm not used or soemthing? it looks like it is because of the other code in there
#19:21:31enhancin__but i'm looking through addedcontent to try to see where it calls it
#19:23:39jeffin opensrf.xml there is an added_content element with a <module> child -- that should have a perl-style modile name like OpenILS::WWW::AddedContent::Something
#19:24:02enhancin__yeah that's there. some of the book covers work
#19:25:22enhancin__the big thing that I'm trying to accomplish is to check for 13-digit ISBN's for amazon and convert them to 10
#19:26:49enhancin__I've added this to Amazon.pm: use Business::ISBN; at the top and this in sub fetch_response: if(length(str $key) > 10) $key = $key->as_isbn10();
#19:26:58enhancin__and a ciouple log lines in there
#19:27:28enhancin__if I knew where that got called I might could put it there instead
#19:28:07jeffsimple things... ensure that you are editing the perl file that is actually being loaded... for me that's /usr/local/share/perl/5.10.1/OpenILS/WWW/AddedContent/Amazon.pm
#19:28:19enhancin__Ahhhhh
#19:28:30jeffand ensure that your web browser hasn't cached the images you're loading
#19:28:31enhancin__i should check those..I just assumed it was using /openils/lib/perlblah
#19:28:47enhancin__I used to be in web hosting, I know how important the cache is hahaha
#19:28:53jeff:-)
#19:29:07jeffafk a few. good luck, let us know how it goes. i'll be around later.
#19:29:39enhancin__alright for sure, i'll put any changes I make so that it may help someone else in the future
#19:50:59enhancin__hm, I'm starting to get broken images
#19:51:07enhancin__it seems as if things aren't loading in memcached very well
#20:03:00jeffi ended up using this to quickly clear just the ac keys from memcache:
#20:03:01jeffmemcdump --servers=localhost | grep ^ac\\. | xargs memcrm --servers=localhost
#20:03:27jeffwhat makes you think you're having issues writing to memcached?
#20:13:53enhancin__over 2000 connections, but there is hardly anything stored after tons of searches...i dunno it's probably fine
#20:14:50enhancin__for some reason I can print in the log saying the log is 17, but when I run the if statement on the next line it doesn't trigger..the log doesn't show at least
#20:32:01enhancin__so I got it working, let me put it in a launchpad bug because it kind of seems like one
#20:35:28enhancin__nevermind already one...bug 870171
#20:35:28pinesol_greenLaunchpad bug 870171 in Evergreen 2.0 "Book images on Amazon need 10-digit ISBN" (affected: 1, heat: 2) [Undecided,Fix committed] https://launchpad.net/bugs/870171
#20:35:42enhancin__but I don't see that fix in my Amazon.pm
#20:40:11enhancin__I've posted a comment on there
#20:40:47jeffalso, tools like memcdump are documented to be not guaranteed to show you all keys -- quirk of how memcache/memcached are implemented. the only sure way to find out if a key exists is to ask for it. :-)
#20:41:11enhancin__Yeah. I just figured I'l ignore that and not worry about it.
#20:41:20enhancin__I'm gonig to be looking into improving the google preview code tonight as well
#20:41:23enhancin__we're having issues with that
#20:41:26enhancin__afk for now
#20:51:29enhancin__alright. I could probably make it more compact but i'm not well versed in perl so I don't know what's good to do
#21:06:49enhancin__the other issue i'm having now is with the google book preview. some of them have the link in the overall search but inside the result overview it doesn't show the button to see the preview
#21:10:48jeffi believe that some books do not have preview available.
#21:10:59jeffthat would be the first thing to check
#21:12:35enhancin__yeah, i'm hoping that will be okay I'm going to look through a bunch of them tomorrow to see if there are any inconsistencies
#21:12:40enhancin__sometimes it links to the book and not the eBook on google
#21:12:45enhancin__so it has no preview, but the eBook does..lol
#21:13:24enhancin__jeff: how does the Amazon.pm fix look though? is there anything I can do to improve that section of code?
#21:19:13hopkinsju has joined #evergreen
#21:20:01enhancin__i'll check back on all this stuff tomorrow I guess. getting later
#21:23:28Yanch0 has quit IRC
#22:17:38trobertson has joined #evergreen
#22:18:05trobertsonhi
#22:19:11trobertsoni'm trying to figure out who is currently on the evergreen oversight board, but can't easily find the answer
#22:19:50hopkinsju has quit IRC
#22:20:40trobertsonah, found minutes from a january meeting: http://open-ils.org/dokuwiki/doku.php?id=governance:minutes:2012-01-17 but are there other people?
#22:22:50jefftrobertson: http://evergreen-ils.org/dokuwiki/doku.php?id=governance:list_of_people_who_will_sign_the_fiscal_sponsorship_agreement
#22:23:43jefftrobertson: my understanding is that that is the list of people on the governance board currently, and the governance:structure wiki page says "One of the first requirements of the Rules of Governance is for this initial set of Evergreen Oversight Board members to define a mechanism for electing Board members in future years."
#22:24:45rangicage match?
#22:24:55jeffI believe the first election will be held at the upcoming 2012 conference in Indianapolis.
#22:25:08trobertsonthanks
#22:25:41jeffsomeone who is currently on the board may have corrections to what i said.
#22:26:21trobertsonjeff: http://www.tararobertson.ca/evergreen-unsung-heros-an-invitation-to-participate/ if you don't send me a photo, i'm going to come next door and take one...
#22:28:21jeff laughs
#22:28:38jeffi'm happy to remain unsung. as for next door, you may be thinking of another jeff.
#22:29:21trobertsonoops, i thought you were jeff davis
#22:29:45jeffthat's what i would have guessed.
#22:29:56jeff == Jeff Godin, TADL -- Traverse City, MI
#22:30:13trobertsondoh
#22:31:27jeffcan't miss jeff davis, he usually goes by the less ambiguous nick of "jeffdavis".
#22:36:24hopkinsju has joined #evergreen
#22:52:33tater-laptop has quit IRC
#23:08:29j_scott1 has joined #evergreen
#23:08:54trobertson has quit IRC
#23:10:15j_scott has quit IRC
#23:12:24j_scott has joined #evergreen
#23:14:14j_scott has left #evergreen
#23:14:19j_scott1 has quit IRC
< Tuesday, February 14th, 2012Raw Log FileThursday, February 16th, 2012 >