htsworkflow.git
15 years agoForgot to add count_reads.pm script
Tim Reddy Tim [Tue, 16 Dec 2008 17:55:32 +0000 (17:55 +0000)]
Forgot to add count_reads.pm script

15 years agoUpdated read counts to give information about aligment percent, and adapter percent.
Tim Reddy Tim [Tue, 16 Dec 2008 17:49:12 +0000 (17:49 +0000)]
Updated read counts to give information about aligment percent, and adapter percent.

15 years agoSmall edits to make code nicer.
Tim Reddy Tim [Fri, 12 Dec 2008 15:36:26 +0000 (15:36 +0000)]
Small edits to make code nicer.

15 years agoInitial checkin of code to evaluate known snps from dbsnp in solexa sequencing
Tim Reddy Tim [Fri, 12 Dec 2008 00:34:23 +0000 (00:34 +0000)]
Initial checkin of code to evaluate known snps from dbsnp in solexa sequencing

15 years agoFinal installation of methylseq analysis.
Tim Reddy Tim [Fri, 12 Dec 2008 00:33:50 +0000 (00:33 +0000)]
Final installation of methylseq analysis.

15 years ago(no commit message)
Tim Reddy Tim [Fri, 12 Dec 2008 00:33:29 +0000 (00:33 +0000)]

15 years agoAdded hg18 known genes file from ucsc
Tim Reddy Tim [Mon, 8 Dec 2008 20:28:32 +0000 (20:28 +0000)]
Added hg18 known genes file from ucsc

15 years agoBug fixes to bring up methylseq analysis Tasks
Tim Reddy Tim [Mon, 8 Dec 2008 14:40:24 +0000 (14:40 +0000)]
Bug fixes to bring up methylseq analysis Tasks

15 years agoAdded framework for methylseq analysis.
Tim Reddy Tim [Mon, 8 Dec 2008 14:17:52 +0000 (14:17 +0000)]
Added framework for methylseq analysis.

15 years agoBug-fixes in sequence repository code and projects code
Tim Reddy Tim [Wed, 3 Dec 2008 00:55:36 +0000 (00:55 +0000)]
Bug-fixes in sequence repository code and projects code

15 years agoadded checking on parser Status check: if !='OK' print err message and skip the count...
Rami Rauch [Tue, 2 Dec 2008 21:29:48 +0000 (21:29 +0000)]
added checking on parser Status check: if !='OK' print err message and skip the count printing

15 years agoadded checking on parser Status check: if !='OK' print err message and skip the count...
Rami Rauch [Tue, 2 Dec 2008 21:29:25 +0000 (21:29 +0000)]
added checking on parser Status check: if !='OK' print err message and skip the count printing

15 years agoadded exception catching to the parser and a simple Status (Msg property) to the...
Rami Rauch [Tue, 2 Dec 2008 21:28:02 +0000 (21:28 +0000)]
added exception catching to the parser and a simple Status (Msg property) to the handler

15 years agochanged Tasks&Projects Server to illumin-mac.stanford... and put that in a global...
Rami Rauch [Mon, 1 Dec 2008 18:41:17 +0000 (18:41 +0000)]
changed Tasks&Projects Server to illumin-mac.stanford... and put that in a global var in settings.py

15 years agominor typo.
Tim Reddy Tim [Tue, 25 Nov 2008 21:23:10 +0000 (21:23 +0000)]
minor typo.

15 years agoSmall change to handle the odd case when no alignment is performed.
Tim Reddy Tim [Tue, 25 Nov 2008 20:26:28 +0000 (20:26 +0000)]
Small change to handle the odd case when no alignment is performed.

15 years agoMinor typeo fix
Tim Reddy Tim [Tue, 25 Nov 2008 20:21:16 +0000 (20:21 +0000)]
Minor typeo fix

15 years agoRe-factored the repository to automatically calculate QC on every flowcell. I also...
Tim Reddy Tim [Tue, 25 Nov 2008 19:53:23 +0000 (19:53 +0000)]
Re-factored the repository to automatically calculate QC on every flowcell. I also split the library code form the flowcell_qc code into two different makefiles to make things cleaner.

15 years agoMajor analysis server update. Had to switch to a new server, and used the opportunity...
Tim Reddy Tim [Tue, 25 Nov 2008 19:15:40 +0000 (19:15 +0000)]
Major analysis server update. Had to switch to a new server, and used the opportunity to move 100% to running from repository code.

15 years agoAdded script front-end for primer-design code
Tim Reddy Tim [Tue, 25 Nov 2008 01:26:35 +0000 (01:26 +0000)]
Added script front-end for primer-design code

15 years agoAdded qPCR Validation design code
Tim Reddy Tim [Tue, 25 Nov 2008 01:23:20 +0000 (01:23 +0000)]
Added qPCR Validation design code

15 years agoAdd validation primer code to MACS source
Tim Reddy Tim [Mon, 24 Nov 2008 23:29:53 +0000 (23:29 +0000)]
Add validation primer code to MACS source

15 years agoMoving QC functionalty into repository so we can run outside of the pipeline.
Tim Reddy Tim [Mon, 24 Nov 2008 22:37:37 +0000 (22:37 +0000)]
Moving QC functionalty into repository so we can run outside of the pipeline.

15 years agoRemoved from hard-coded directories. Starting to bring the QC into the sequence repos...
Tim Reddy Tim [Mon, 24 Nov 2008 20:06:07 +0000 (20:06 +0000)]
Removed from hard-coded directories. Starting to bring the QC into the sequence repository.

15 years agoChanges the install line to be a copy instead of a move
Tim Reddy Tim [Mon, 24 Nov 2008 18:52:30 +0000 (18:52 +0000)]
Changes the install line to be a copy instead of a move

15 years agoconverts the HTSW align format (derived from Eland format) into ENCODE 'TagAlign...
Rami Rauch [Wed, 19 Nov 2008 19:01:53 +0000 (19:01 +0000)]
converts the HTSW align format (derived from Eland format) into ENCODE 'TagAlign' format

15 years agoadded: if peak score < zero put zero
Rami Rauch [Wed, 19 Nov 2008 18:45:58 +0000 (18:45 +0000)]
added: if peak score < zero put zero

15 years agoProgress Reports Generator
Rami Rauch [Fri, 7 Nov 2008 00:44:40 +0000 (00:44 +0000)]
Progress Reports Generator

15 years ago(no commit message)
Rami Rauch [Fri, 7 Nov 2008 00:43:20 +0000 (00:43 +0000)]

15 years agoAdded a LibInfo folder
Rami Rauch [Wed, 8 Oct 2008 19:44:20 +0000 (19:44 +0000)]
Added a LibInfo folder

15 years ago(no commit message)
Rami Rauch [Wed, 8 Oct 2008 19:43:55 +0000 (19:43 +0000)]

15 years agoadded updLibInfo function
Rami Rauch [Wed, 8 Oct 2008 19:37:58 +0000 (19:37 +0000)]
added updLibInfo function

15 years agoadded case for calling updLibInfo
Rami Rauch [Wed, 8 Oct 2008 19:37:39 +0000 (19:37 +0000)]
added case for calling updLibInfo

15 years agoupdate imports for runfolder and eland_makebed for location in htswdataprod.
Diane Trout [Tue, 7 Oct 2008 22:47:01 +0000 (22:47 +0000)]
update imports for runfolder and eland_makebed for location in htswdataprod.

15 years agoAdded a display column (not DB) to show the total count of alligned reads for each...
Rami Rauch [Tue, 7 Oct 2008 21:56:06 +0000 (21:56 +0000)]
Added a display column (not DB) to show the total count of alligned reads for each library record

15 years agoI moved more of options in settings.py to the .htsworkflow.ini
Diane Trout [Tue, 7 Oct 2008 21:15:42 +0000 (21:15 +0000)]
I moved more of options in settings.py to the .htsworkflow.ini
In this case, the list of admin users were moved to a [admins]
section in the ini file as well as the allowed_ips to [allowed_hosts]
and allowed_analys_ips to [allowed_analysis_hosts].

Currently localhost is always allowed.

15 years agoI modified the admin base site login page slightly to be less
Diane Trout [Tue, 7 Oct 2008 21:15:41 +0000 (21:15 +0000)]
I modified the admin base site login page slightly to be less
stanford specific. It would be nice if there was someway of
passing variables to the admin site templates so we could
provide per site branding without having to commit the site
customization to the repository

15 years agoupdate imports in srf for htsw directory structure
Diane Trout [Tue, 30 Sep 2008 23:43:26 +0000 (23:43 +0000)]
update imports in srf for htsw directory structure

15 years agoPull tool to make srf files from trunk (depends on
Diane Trout [Tue, 30 Sep 2008 23:43:25 +0000 (23:43 +0000)]
Pull tool to make srf files from trunk (depends on
util/queuecommands.py)

15 years agosolexa2srf likes to produce output, so my trick of watching the
Diane Trout [Tue, 30 Sep 2008 23:43:23 +0000 (23:43 +0000)]
solexa2srf likes to produce output, so my trick of watching the
sockets to block until when the process ends didn't work.

This patch inserts a simple sleep(1) (second) into the code that
waits for the jobs to finish to prevent the queue manager from rapidly
spinning.

It should probably be fixed with a better way of monitoring for when
a process finishes

MERGED from trunk (the hard way)

15 years agoadd setuptools setup.py scripts for the modules I need to be able to use
Diane Trout [Tue, 30 Sep 2008 22:49:47 +0000 (22:49 +0000)]
add setuptools setup.py scripts for the modules I need to be able to use

15 years agoconverts QuEST peakcalls output file into narrowPeak ENCODE format
Rami Rauch [Mon, 22 Sep 2008 22:33:19 +0000 (22:33 +0000)]
converts QuEST peakcalls output file into narrowPeak ENCODE format

15 years agoRemoved all Antibody related fields from the Library search_fields list. The Library...
Rami Rauch [Mon, 8 Sep 2008 21:12:49 +0000 (21:12 +0000)]
Removed all Antibody related fields from the Library search_fields list. The Library search for some reason fails to retrieve these records that have NULL in Antibody FK value.

15 years agoremoved affiliation field from the search_fields option
Rami Rauch [Thu, 4 Sep 2008 20:02:39 +0000 (20:02 +0000)]
removed affiliation field from the search_fields option

15 years ago(no commit message)
Rami Rauch [Thu, 4 Sep 2008 20:01:59 +0000 (20:01 +0000)]

15 years ago(no commit message)
Rami Rauch [Thu, 4 Sep 2008 19:18:10 +0000 (19:18 +0000)]

15 years agoUpdates to profile reads to be more general in how chromosomes are handled
Tim Reddy Tim [Wed, 3 Sep 2008 14:32:09 +0000 (14:32 +0000)]
Updates to profile reads to be more general in how chromosomes are handled

15 years agoAdded installation notes
Tim Reddy Tim [Sat, 30 Aug 2008 00:02:32 +0000 (00:02 +0000)]
Added installation notes

15 years agoAdded MACS source
Tim Reddy Tim [Fri, 29 Aug 2008 21:44:58 +0000 (21:44 +0000)]
Added MACS source

15 years agoChange the django settings.py file to get configuration settings from
Diane Trout [Fri, 29 Aug 2008 19:57:49 +0000 (19:57 +0000)]
Change the django settings.py file to get configuration settings from
an ini-like file. Currently it searches, ~/.htsworkflow and
/etc/htsworkflow.ini.

Currently I only implemented the most basic settings overrides needed to
run a django server in development mode.

15 years agoMinor typos fixes
Tim Reddy Tim [Fri, 29 Aug 2008 18:27:42 +0000 (18:27 +0000)]
Minor typos fixes

15 years agoMerge in all of my testing code from trunk.
Diane Trout [Fri, 29 Aug 2008 17:40:14 +0000 (17:40 +0000)]
Merge in all of my testing code from trunk.

Added a master runtest.sh script that deals with the annoying problem
caused by nesting each package in its own source tree.

I moved in my eland to bed file code (which might still need to be
renamed).

I resolved all the import errors in my illumina specific parsing
code (thanks to the test code)

15 years agomerge in my changes from trunk
Diane Trout [Fri, 29 Aug 2008 17:19:52 +0000 (17:19 +0000)]
merge in my changes from trunk

15 years agoTemplate loading fix.
Brandon King [Fri, 29 Aug 2008 17:07:15 +0000 (17:07 +0000)]
Template loading fix.
 * Relative path was slightly off.

15 years agoIgnore *.py[co~] files
Diane Trout [Fri, 29 Aug 2008 04:04:17 +0000 (04:04 +0000)]
Ignore *.py[co~] files

15 years agoreturn the project xml config file as text/plain so you can read it in
Diane Trout [Fri, 29 Aug 2008 00:27:04 +0000 (00:27 +0000)]
return the project xml config file as text/plain so you can read it in
your browser.

15 years agoupdate the url matching to provide proper access to the
Diane Trout [Fri, 29 Aug 2008 00:20:47 +0000 (00:20 +0000)]
update the url matching to provide proper access to the
analys_track/getProject url

15 years agoFirst complete Projects/Tasks build.
Tim Reddy Tim [Thu, 28 Aug 2008 23:39:33 +0000 (23:39 +0000)]
First complete Projects/Tasks build.

15 years agoActually the an_urls.py was importing the views, if we remove that
Diane Trout [Thu, 28 Aug 2008 22:54:59 +0000 (22:54 +0000)]
Actually the an_urls.py was importing the views, if we remove that
we can remove the views file

15 years agoAdd queuecommand to htswcommon,
Diane Trout [Thu, 28 Aug 2008 22:17:56 +0000 (22:17 +0000)]
Add queuecommand to htswcommon,
add tests for ethelp and queuecommand, though nose will only work
if run from within the htswcommon directory

15 years agocleaned the code a bit: put the method in utils.py
Rami Rauch [Thu, 28 Aug 2008 21:22:02 +0000 (21:22 +0000)]
cleaned the code a bit: put the  method in utils.py

15 years agoremoved views url
Rami Rauch [Thu, 28 Aug 2008 21:19:35 +0000 (21:19 +0000)]
removed views url

15 years ago(no commit message)
Rami Rauch [Thu, 28 Aug 2008 21:19:03 +0000 (21:19 +0000)]

15 years agoDjango really wanted a view in analys_track, it was periodically
Diane Trout [Thu, 28 Aug 2008 16:51:44 +0000 (16:51 +0000)]
Django really wanted a view in analys_track, it was periodically
tossing an import error.

I inserted a fairly basic views.py, which seemed to make things better.

15 years agoAdded a program to help compare libraries
Tim Reddy Tim [Thu, 28 Aug 2008 16:46:59 +0000 (16:46 +0000)]
Added a program to help compare libraries

15 years agoadded Affiliation FK to Libarary + Affiliation table to associate each library record...
Rami Rauch [Thu, 28 Aug 2008 16:41:01 +0000 (16:41 +0000)]
added Affiliation FK to Libarary + Affiliation table to associate each library record to a project/lab/contact etc..

15 years agoI think this was missing... manage.py is fairly useful. =o)
Brandon King [Thu, 28 Aug 2008 05:21:05 +0000 (05:21 +0000)]
I think this was missing... manage.py is fairly useful. =o)

15 years agoadded Affiliation table and linked to Library in a ManyToMany relathionship
Rami Rauch [Mon, 25 Aug 2008 22:13:01 +0000 (22:13 +0000)]
added Affiliation table and linked to Library in a ManyToMany relathionship

15 years agosmall GUI change
Rami Rauch [Thu, 21 Aug 2008 22:01:48 +0000 (22:01 +0000)]
small GUI change

15 years agoTasks functionality added. Lots of cleanup to do, but a good start. It remains to...
Tim Reddy Tim [Thu, 21 Aug 2008 00:47:41 +0000 (00:47 +0000)]
Tasks functionality added. Lots of cleanup to do, but a good start. It remains to test and set up the Projects aspect of the code, which includes reporting html pages on a webserver somewhere.

15 years agoAdded align_to_bed script. Used to turn MACS output into a bed file
Tim Reddy Tim [Wed, 20 Aug 2008 21:22:26 +0000 (21:22 +0000)]
Added align_to_bed script. Used to turn MACS output into a bed file

15 years ago(no commit message)
Rami Rauch [Wed, 20 Aug 2008 20:53:07 +0000 (20:53 +0000)]

15 years ago(no commit message)
Rami Rauch [Wed, 20 Aug 2008 20:52:07 +0000 (20:52 +0000)]

15 years agoAdded wiggle fiole generation
Tim Reddy Tim [Wed, 20 Aug 2008 20:39:21 +0000 (20:39 +0000)]
Added wiggle fiole generation

15 years agominor updates
Rami Rauch [Wed, 20 Aug 2008 19:43:29 +0000 (19:43 +0000)]
minor updates

15 years agominor url updates
Rami Rauch [Wed, 20 Aug 2008 19:41:54 +0000 (19:41 +0000)]
minor url updates

15 years agothe only used function here is makeFCSheet. the other are used for testings.
Rami Rauch [Wed, 20 Aug 2008 19:41:22 +0000 (19:41 +0000)]
the only used function here is makeFCSheet. the other are used for testings.

15 years agominor adjastments
Rami Rauch [Wed, 20 Aug 2008 19:39:37 +0000 (19:39 +0000)]
minor adjastments

15 years agoadded Replicate filed in Library table. added as well a 'Short Name' field in Antibod...
Rami Rauch [Wed, 20 Aug 2008 19:34:09 +0000 (19:34 +0000)]
added Replicate filed in Library table. added as well a 'Short Name' field in Antibody table, to store antigene 'nickname'

15 years agoQuest_2_bed conversaion added.
Tim Reddy Tim [Wed, 20 Aug 2008 00:47:27 +0000 (00:47 +0000)]
Quest_2_bed conversaion added.

15 years agoAdded auxillliary programs needed to run projects
Tim Reddy Tim [Tue, 19 Aug 2008 19:13:20 +0000 (19:13 +0000)]
Added auxillliary programs needed to run projects

15 years agoSmalle bug fix
Tim Reddy Tim [Tue, 19 Aug 2008 19:09:44 +0000 (19:09 +0000)]
Smalle bug fix

15 years agoadded comm module of communication.
Tim Reddy Tim [Tue, 19 Aug 2008 18:01:43 +0000 (18:01 +0000)]
added comm module of communication.

15 years agoAdded communitaion between projects and lims
Tim Reddy Tim [Tue, 19 Aug 2008 18:00:36 +0000 (18:00 +0000)]
Added communitaion between projects and lims

15 years agoInitial attempt to get Projects and Tasks framework brought into repository. Lots...
Tim Reddy Tim [Tue, 19 Aug 2008 17:48:28 +0000 (17:48 +0000)]
Initial attempt to get Projects and Tasks framework brought into repository. Lots of work needs to be done gettign directories hooked up and general. Might make sense to start a config files somewhere.

15 years agoadded search interface to the Task and Project entities. Now, for example, you can...
Rami Rauch [Tue, 19 Aug 2008 00:01:01 +0000 (00:01 +0000)]
added search interface to the Task and Project entities. Now, for example, you can search all Projects by LibraryId

15 years agoMajor bug-fix where some probes in the in-silico qPCR were not working.
Tim Reddy Tim [Mon, 18 Aug 2008 20:12:41 +0000 (20:12 +0000)]
Major bug-fix where some probes in the in-silico qPCR were not working.

15 years agoSmall change to fix directory structure problem
Tim Reddy Tim [Mon, 18 Aug 2008 20:12:04 +0000 (20:12 +0000)]
Small change to fix directory structure problem

15 years agoThese are the template directories and files.
Rami Rauch [Fri, 15 Aug 2008 22:56:06 +0000 (22:56 +0000)]
These are the template directories and files.

15 years agoReplaced 'gaworflow' with 'htsworkflow'; updated settings.py, urls.py etc... Tested...
Rami Rauch [Fri, 15 Aug 2008 22:50:00 +0000 (22:50 +0000)]
Replaced 'gaworflow' with 'htsworkflow'; updated settings.py, urls.py etc... Tested: site load sucessfully from /htsworkflow

15 years agoMigrating Rami's frontend changes from stanford branch to htsworkflow branch.
Brandon King [Fri, 15 Aug 2008 21:43:43 +0000 (21:43 +0000)]
Migrating Rami's frontend changes from stanford branch to htsworkflow branch.

15 years agoThis text file includes step by step SQL commands to convert your DB into our schema...
Rami Rauch [Thu, 14 Aug 2008 20:19:34 +0000 (20:19 +0000)]
This text file includes step by step SQL commands to convert your DB into our schema. If used the new htsw_frontend models.py your web site should be able to load your data on the new model.

15 years agoFixed another directory problem: the libraries repo had an assumed location relative...
Tim Reddy Tim [Thu, 14 Aug 2008 19:03:26 +0000 (19:03 +0000)]
Fixed another directory problem: the libraries repo had an assumed location relative to the cwd that is not necessarily true.

15 years agoFixed directories to be more general and easy to set via the environment variable:
Tim Reddy Tim [Thu, 14 Aug 2008 18:59:40 +0000 (18:59 +0000)]
Fixed directories to be more general and easy to set via the environment variable:

HTSW_ANALYSIS_DIR

15 years agoFixed bug that bailed on empty alignment files. (weird exception case)
Tim Reddy Tim [Thu, 14 Aug 2008 18:29:52 +0000 (18:29 +0000)]
Fixed bug that bailed on empty alignment files. (weird exception case)

15 years agoTook our some old targets from the Makefile that are going unused.
Tim Reddy Tim [Thu, 14 Aug 2008 18:10:34 +0000 (18:10 +0000)]
Took our some old targets from the Makefile that are going unused.

15 years agoMade changes to add quarterly information to the sequencign summary.
Tim Reddy Tim [Thu, 14 Aug 2008 17:56:50 +0000 (17:56 +0000)]
Made changes to add quarterly information to the sequencign summary.

15 years ago(no commit message)
Rami Rauch [Wed, 13 Aug 2008 23:54:22 +0000 (23:54 +0000)]

15 years ago(no commit message)
Rami Rauch [Wed, 13 Aug 2008 23:53:53 +0000 (23:53 +0000)]

15 years ago(no commit message)
Rami Rauch [Wed, 13 Aug 2008 23:48:04 +0000 (23:48 +0000)]