*** This version of Confluence is for testing only and contains a copy of content from June 29th 2026. No changes will be preserved. ***
...
- Project Initiation
- Requires personal contact with lab director
- Charlotte or Sharon sets up project in redmine
- Sample submission: client goes to http://sorghumdiversity.maize.cornell.edu/ to get the required steps, and upload their information to attempt to get approved to send DNA samples
- Client sends DNA samples to the lab
- Client sets up customer registration at https://cores.lifesciences.cornell.edu/userdev/newuser.php
- DNA samples tested and if okay, Charlotte sets up a cost issue in redmine so Theresa knows what to bill.
- Customer is invoiced
- DNA samples begin moving through various lab steps; redmine updated at various steps
- SampTrac is used to update HTS database entries and create barcodes for DNA and library plates.
- Libraries are submitted for sequencing (sometimes more than once)
- Raw Data -> Data Files
- QC scripts run
- Pipelines change can be Tassel, or Fei Li's pipeline
- Data Interpretation
- need to know Biology / skilled analyst
- Data Distribution
- Data storage for X period of time
Current Components
Overview
GBS Database Schema
sample submission interface fields and database schema
QC Scripts
"SampTrack" C# windows program to interface with GBS for setting up pools etc.
- manual SQL queries (supplement "samptrack")
- desire to have functionality build in
- SampTrack screenshots and notes
redmine project management
- Project initiation
- create project in redmine
- Individual plate tracking
- Can note if a plate failed somewhere in the process and link it to the redone plate.
- Can link billing information so we know if the plate has been paid for
- I don't like:
- Having to click through so many screens to get to the next sample in a project
- Hard to look at samples in groups, like all of the samples on a flowcell
Data Distribution
- manual
- either "hapmap table" by email, or dropbox or physical hard drive if client wants raw data
billing
*invoicing handled through LSCLC cores LIMS
Theresa's comments on GBS billing issues
Misc operations
- Configure new adapter plate configurations
Specification for new implementation
...
- not clear if redmine is the right solution, but it has its place now. would need similar functionality, probably with better integration with other components.
- What we like about redmine- A really nice way to see the history of a particular plate of DNA or project:
- Project summary: enzyme to use, contact information, expected sample number, comments for data analysis
- Project workflow where we can check off status and note if something did not go as expected
- Links that cross-reference. I link all costs to plates so I know what has been paid for. We also can link redo plates with the original preps.
- Upload submission sheet, quantification, experion files (.pdf)
- Note payment status
- Track optimization results and R&D
- Would be great if we could check in samples are received when we print the barcode and automatically notify sender that they have arrived.
GBS Database Schema
- May not need full implementation, especially most of "passport" info.
- should be extended for Stat and QC management. right now the tables for "stat" and "qc" are really just placeholders.
...
- Currently I have to enter sample information onto the Core Facility website by hand. Automation of this would be complicated by my need to assign billing to different accounts. In addition, after Tom has made the flowcell I go onto Wikilims to get the flowcell name and lane assignments for the samples I submitted.
- If it is a 384-plex I make a new name for the sample submitted that is not recorded anywhere (could be written in redmine, but I don't always remember). The database lane_id is also appended to the name so there is a numerical way to check back, but people like a human readable name that correlates to the project.
- If samples are going to be sequenced off site then, in addition to the above steps I need to create additional emails and packing slips.
QC Scripts
- QC Scripts
- Comments and request changes for QC output
- Besides the changes I listed above, but the biggest bug is that the scripts look for the cut site overhang and then the barcode. Barcodes containing the cut-site overhang are not recognized and we see it as 0 reads. The data pipeline does barcode and cut-site recognition simultaneously and so you still get data for these barcodes.
- Am excited by the possibility of pulling reports off the Illumina machines to further our QC. I was also introduced to a Java based program, FastQC, which may be helpful for us.
- Assuming qc reports are pulled into minilims and parsed, how flexible can we do queries to find statistics over time and although each report is by lane, it contains plate information. slice and dice
Data Distribution
- no changes required at this time ???
- possibly change SOP to record that data was released
- Our current scope does not include any changes to data distribution, which is currently done manually via dropbox or hard drive.
- detailed specification for the information/format of data and metadata distribution:
- Rob Elshire will be producing a standard for information (In my mind I think of it like MIAME or MIAPE standards).
there may be different definitions for different classes of customers- customers that receive only sequence data and metadata about panel in the form of a "Key File".
- customers for whom the facility has produced genotypes. they may or may not also want the sequence data.
- Rob Elshire will be producing a standard for information (In my mind I think of it like MIAME or MIAPE standards).
- build a distribution mechanism that defines the contents of an archive file that can be accessed via web link, including programmatically (curl or wget) and suitable notification
- could be modelled on the distribution that our sequencing facility produces
- note use of "cntrl" parameter which is a keycode so that anyone with that link that includes that parameter can download the file without explicit authentication. Since it could be brute forced it nags at me a little bit, but it does make programmatic downloads easier and security by obscurity should be sufficient enough for this purpose.
- CLC will provide storage available to minilims from which files can be served. whoever runs the pipeline analysis will assemble archive and place in filesystem
data distribution spec:
- could be modelled on the distribution that our sequencing facility produces
...
- minilims will provide a "dashboard" page
- dashboard info from Theresa Theresa will define the information on this page. I'm not sure what "level" of view she needs. per project, per sample, per order?
- minilims can make a RESTful query to CLC LIMS/Billing System and return existing invoice information per project (or sample or order)
- minilims page will provide functionality to open an existing invoice (in new window?)
- minilims page will provide functionality to submit an HTTP GET or POST to RESTful interface in the CLC LIMS/Billing System that will
- provide an order or invoice number (available to minilims at time order is placed), a line item(s) description, price, quantity
- service will create an invoice and return a reference to the invoice so that it can be opened from minilims
Misc operations
- Configure new adapter plate configurations
- self service interface/upload?
...