DEPRECATED THIS PROCEDURE IS NO LONGER UPDATED
Scope: This procedure provides instructions for running automated import, export, cleanup, reporting and various related jobs using scripts found in LS Tools web site and other tools created by the Library Systems Office and LTS Batch Processing staff. For issues surrounding the scheduling of large batch loads, please consult Bulk Loading: Scheduling (#46d). Unless otherwise noted, the items listed below are descriptions of scripts and tools found on LS Tools. Jobs may include scripts known as "mod jobs" run from a staff member's individual LS Tools folder, as opposed to scripts that are accessible directly from the LS Tools web interface. Non-LS Tools jobs are most commonly referred to as "manual" jobs. For information on staff batch job assignments, please refer to the Bulk Loading: List of Jobs (#46c).
Contact: Gary Branch Jenn Colt
Unit: Batch Processing and Metadata Management
Date last updated: 07/23/2018
Date of next review: July 2019
Note: Access to LS Tools is limited to trained technical services staff, divided into several levels, depending upon the degree of complexity and the impact of the tools accessible at each level.
...
Basic Access Group (See Access Description)
Bulk Loading: Batch Processing Scripts & Tools (LTS Procedure #46b) CLAMMS
Advanced Access Group (See Access Description)
Batch Processing/Heads/Expert-Level Access Group (See Access Description)
Administrative Group (See Access Description)
...
...
Anchor basic basic
Basic Access Group
| basic | |
| basic |
I. “General Update” Section of LS ToolsAnchor GU GU
...
m. National Film Board of Canada (Not in LS Tools): Vendor load of streaming video records, run manually by Batch Processing staff.
n. Naxos (Not in LS Tools): Vendor load of e-book records. Files are downloaded from the vendor website.
o. NBER (Not in LS Tools): Vendor load of e-book records. Records are imported from the NBER website. Run as needed.
p. NPAC-LC Jakarta (Not in LS Tools): Vendor load of e-book records, uses .pl script to extract LCCNs from Jakarta and batch search Voyager for missing records, edit and load into Voyager.
...
F. Prepare a Vendor Print Load: Acquisitions bulk import of vendor supplied MARC records with or without purchase order creation via embedded order data. Selection of this button in LS Tools gives a choice of various pre-scripted jobs connecting to a folder on the vendor’s website or locally on a server.Anchor VPRT VPRT
a. Andinos (VPR22): Vendor Print load for Andinos/Booksur. Staff member retrieves and places .mrc files in vendor record folder.
b. AuxAmateurs Approvals: Choose from AuxAmateurs FineArts Print (VPR10), AuxAmateurs ILR Print (VPR11), AuxAmateurs Olin Print (VPR12) or AuxAmateurs Olin2 Print (VPR19). Loads print records from vendor AuxAmateurs that were retrieved via FTP.
c. Bach (
...
VPR33): Vendor print record load
...
.
d.Berenguer Approvals(VPR01): Similar to Yankee as it connects to our libfiles server, but it this case loads a vendor supplied preliminary record. Files are received via email attachment.
e. Cambeiro Print (VPR23): Vendor print load. Staff member retrieves and places .mrc files in vendor record folder.
f. Casalini Approvals (VPR02): Loads print records from Casalini, which are retrieved via FTP.
g. Chinese Approvals (Not in LS Tools): This is a two-step task. We receive a file of MARC records for Chinese blanket order books that is loaded as "On Order" while the books are in shipment. We then reload the file on arrival, creating a second holdings record. We batch delete the original holdings and do editing as appropriate for Oversize, accompanying material, and multi-volume works.
h. Coutts PDP (VPR08): Loads patron directed print records from Coutts, which were retrieved via FTP.
i. Coutts Approval (VPR09): Extracts ISBNs from Yankee file, searches OCLC, prepares file of best available Bibs, bulk imports them into Voyager.
j Derex Print (VPR03):
k. Eastview Print (VPR13): Loads acquisitions-level print records from vendor.
l.Euyloo(Not in LS Tools): In this manual job, the staff member takes a tab-delimited file of data from the vendor, converts it into MARC records using MarcEdit, and loads it into Voyager.
m. Harrasowitz Music Records (VPR05)
n. Harrassowitz Full Print (VPR06): Selecting this will load full level Harrassowitz MARC records and create purchase orders. Connects directly to the Harrassowitz vendor’s server and pulls in the file (via FTP) for processing.
o. Harrassowitz Regular Print (VPR04): Same as Harrassowitz Full Print, but does not have full level records.
p.Icelandic Firm Orders(Not in LS Tools): The selector for the Icelandic collection sends a .mrc file of acquisition level records to the cts-bulk email list; these records are then edited by .pl script and loaded into Voyager.
q. Itturiaga Print (VPR21):
r.Korean Print(Not in LS Tools): Vendor-supplied records processed manually by inputting staff member.
s. Kozmenko Print (VPR13)
t. Leila (VPR18): Vendor-supplied records are edited using an LS Tools modification job kept in a staff member's LS Tools folder.
u. LC Cairo Arabic Records (VPR31): Vendor load of print records. Files are delivered via email; statistics and local fields are added and records are loaded into Voyager.
v. Lexicon (VPR16): Vendor print load of preliminary records. Files are received via email.
w. MIPP Print (VPR14): Loads preliminary-level vendor records.
x. PanMun (Not in LS Tools): In this manual job, the staff member takes a tab-delimited file of data from the vendor, converts it into MARC records using MarcEdit, and loads it into Voyager.
y. Retta Print (VPR07):
z. Serbica (VPR17): Vendor print load of preliminary records. Files are received via email.
aa. SofiaBooks Print (VPR15): Loads preliminary print ordering records from the vendor. Records are received via email attachment.
bb. Vietnamese Print(Not in LS Tools): In this manual job, the staff member takes a tab-delimited file of data from the vendor, converts it into MARC records using MarcEdit, and loads it into Voyager.
II. “Voyager Harvest” Section of LS ToolsAnchor #VHarvest #VHarvest
...
D. Extract MARC Records from Voyager (CGI13): Extracts MARC Records from Voyager using a list of BIB or MFHD id's.
...
III. “CLAMMS subsystem” (CGI28): Also known as the Automated Media Shelflisting System, this tool allows catalogers to determine the proper accession number for videos and microforms. Access is given only to those individual catalogers who need to use it. Anchor CLAMMS CLAMMS
Anchor ADV ADV
Advanced Access Group
| ADV | |
| ADV |
I. “Voyager Update Utilities” Section of LS ToolsAnchor VUU VUU
...
g. PDC Building Plans at the Annex (Not in LS Tools): Each month Cornell's Planning, Design and Construction Department sends us an email with a spreadsheet of barcodes for design plans that are headed to the Library Annex. We use a script to add item records to suppressed records for each barcode with a roll number in the enumeration. Those plans are then sent to the Annex for processing.
B. Execute a Privileged Production Procedure: Location for more advanced reports and record loads with higher stakes if mistakes happen.Anchor PRIVPROD PRIVPROD
...
h. General Bib field Cleanup (CRN27): This script searches for invalid fields, subfields, and indicators in BIB records, and reports out the errors for manual cleanup.i. Icelandic BIB Cleanup (Not in LS Tools): This job adds a 710 "Fiske Icelandic Collection" to Icelandic records, and is run from a "modify" job in the LS Tools folder of a staff member.
j. Initial Article and Title Tag Cleanup (PR327): Looks at previous month’s cataloging for errors in indicators relating to articles in title fields.
...
b. OCLC Unresolved Records (Not in LS Tools): Receive email announcements of our daily cataloging export results. Any coded as unresolved appear in a MARC file which is downloaded from OCLC Product Services website. Our holdings for these records were not added to WorldCat due to MARC errors. Staff member must manually examine each record in Connexion to correct error(s) and add our holdings to OCLC.
...
Anchor EXPERT EXPERT
Batch Processing/Heads/Expert-Level Access Group
| EXPERT | |
| EXPERT |
I. “ALL LS Tools Production” Section of LS ToolsAnchor AllProd AllProd
...
c. Send e-mails to book requesters and purge 981, 980$s (CRN20): Harvest requestors’ email from day’s purchase order line items and sends emails to patron informing them that the title has been ordered for them. Removes requestor information from bib found in 981 subfield n.
d. General MFHD field field cleanup (CRN24)
e. Cleanup 008 Single Date (CRN25) and Cleanup 008 Multi Date (CRN26): Compares date in 260 or 264 to contents of 008/07-14, corrects content to make fields "congruent.”
...
i. Replace Harvard POOF Vendor Matrix (Not in LS Tools): Infrequent manual job - Updates tables for automated ordering for vendors.
...
Anchor ADMIN ADMIN
Administrative Access Group
| ADMIN | |
| ADMIN |
I. “Administer LS Tools Itself” Section of LS ToolsAnchor AdLSTools AdLSTools
...
f. Configure JOB CONTROL (Families) (CGI38)
...