htsworkflow.git
15 years agoActually the an_urls.py was importing the views, if we remove that
Diane Trout [Thu, 28 Aug 2008 22:54:59 +0000 (22:54 +0000)]
Actually the an_urls.py was importing the views, if we remove that
we can remove the views file

15 years agoAdd queuecommand to htswcommon,
Diane Trout [Thu, 28 Aug 2008 22:17:56 +0000 (22:17 +0000)]
Add queuecommand to htswcommon,
add tests for ethelp and queuecommand, though nose will only work
if run from within the htswcommon directory

15 years agocleaned the code a bit: put the method in utils.py
Rami Rauch [Thu, 28 Aug 2008 21:22:02 +0000 (21:22 +0000)]
cleaned the code a bit: put the  method in utils.py

15 years agoremoved views url
Rami Rauch [Thu, 28 Aug 2008 21:19:35 +0000 (21:19 +0000)]
removed views url

15 years ago(no commit message)
Rami Rauch [Thu, 28 Aug 2008 21:19:03 +0000 (21:19 +0000)]

15 years agoDjango really wanted a view in analys_track, it was periodically
Diane Trout [Thu, 28 Aug 2008 16:51:44 +0000 (16:51 +0000)]
Django really wanted a view in analys_track, it was periodically
tossing an import error.

I inserted a fairly basic views.py, which seemed to make things better.

15 years agoAdded a program to help compare libraries
Tim Reddy Tim [Thu, 28 Aug 2008 16:46:59 +0000 (16:46 +0000)]
Added a program to help compare libraries

15 years agoadded Affiliation FK to Libarary + Affiliation table to associate each library record...
Rami Rauch [Thu, 28 Aug 2008 16:41:01 +0000 (16:41 +0000)]
added Affiliation FK to Libarary + Affiliation table to associate each library record to a project/lab/contact etc..

15 years agoI think this was missing... manage.py is fairly useful. =o)
Brandon King [Thu, 28 Aug 2008 05:21:05 +0000 (05:21 +0000)]
I think this was missing... manage.py is fairly useful. =o)

15 years agoadded Affiliation table and linked to Library in a ManyToMany relathionship
Rami Rauch [Mon, 25 Aug 2008 22:13:01 +0000 (22:13 +0000)]
added Affiliation table and linked to Library in a ManyToMany relathionship

15 years agosmall GUI change
Rami Rauch [Thu, 21 Aug 2008 22:01:48 +0000 (22:01 +0000)]
small GUI change

15 years agoTasks functionality added. Lots of cleanup to do, but a good start. It remains to...
Tim Reddy Tim [Thu, 21 Aug 2008 00:47:41 +0000 (00:47 +0000)]
Tasks functionality added. Lots of cleanup to do, but a good start. It remains to test and set up the Projects aspect of the code, which includes reporting html pages on a webserver somewhere.

15 years agoAdded align_to_bed script. Used to turn MACS output into a bed file
Tim Reddy Tim [Wed, 20 Aug 2008 21:22:26 +0000 (21:22 +0000)]
Added align_to_bed script. Used to turn MACS output into a bed file

15 years ago(no commit message)
Rami Rauch [Wed, 20 Aug 2008 20:53:07 +0000 (20:53 +0000)]

15 years ago(no commit message)
Rami Rauch [Wed, 20 Aug 2008 20:52:07 +0000 (20:52 +0000)]

15 years agoAdded wiggle fiole generation
Tim Reddy Tim [Wed, 20 Aug 2008 20:39:21 +0000 (20:39 +0000)]
Added wiggle fiole generation

15 years agominor updates
Rami Rauch [Wed, 20 Aug 2008 19:43:29 +0000 (19:43 +0000)]
minor updates

15 years agominor url updates
Rami Rauch [Wed, 20 Aug 2008 19:41:54 +0000 (19:41 +0000)]
minor url updates

15 years agothe only used function here is makeFCSheet. the other are used for testings.
Rami Rauch [Wed, 20 Aug 2008 19:41:22 +0000 (19:41 +0000)]
the only used function here is makeFCSheet. the other are used for testings.

15 years agominor adjastments
Rami Rauch [Wed, 20 Aug 2008 19:39:37 +0000 (19:39 +0000)]
minor adjastments

15 years agoadded Replicate filed in Library table. added as well a 'Short Name' field in Antibod...
Rami Rauch [Wed, 20 Aug 2008 19:34:09 +0000 (19:34 +0000)]
added Replicate filed in Library table. added as well a 'Short Name' field in Antibody table, to store antigene 'nickname'

15 years agoQuest_2_bed conversaion added.
Tim Reddy Tim [Wed, 20 Aug 2008 00:47:27 +0000 (00:47 +0000)]
Quest_2_bed conversaion added.

15 years agoAdded auxillliary programs needed to run projects
Tim Reddy Tim [Tue, 19 Aug 2008 19:13:20 +0000 (19:13 +0000)]
Added auxillliary programs needed to run projects

15 years agoSmalle bug fix
Tim Reddy Tim [Tue, 19 Aug 2008 19:09:44 +0000 (19:09 +0000)]
Smalle bug fix

15 years agoadded comm module of communication.
Tim Reddy Tim [Tue, 19 Aug 2008 18:01:43 +0000 (18:01 +0000)]
added comm module of communication.

15 years agoAdded communitaion between projects and lims
Tim Reddy Tim [Tue, 19 Aug 2008 18:00:36 +0000 (18:00 +0000)]
Added communitaion between projects and lims

15 years agoInitial attempt to get Projects and Tasks framework brought into repository. Lots...
Tim Reddy Tim [Tue, 19 Aug 2008 17:48:28 +0000 (17:48 +0000)]
Initial attempt to get Projects and Tasks framework brought into repository. Lots of work needs to be done gettign directories hooked up and general. Might make sense to start a config files somewhere.

15 years agoadded search interface to the Task and Project entities. Now, for example, you can...
Rami Rauch [Tue, 19 Aug 2008 00:01:01 +0000 (00:01 +0000)]
added search interface to the Task and Project entities. Now, for example, you can search all Projects by LibraryId

15 years agoMajor bug-fix where some probes in the in-silico qPCR were not working.
Tim Reddy Tim [Mon, 18 Aug 2008 20:12:41 +0000 (20:12 +0000)]
Major bug-fix where some probes in the in-silico qPCR were not working.

15 years agoSmall change to fix directory structure problem
Tim Reddy Tim [Mon, 18 Aug 2008 20:12:04 +0000 (20:12 +0000)]
Small change to fix directory structure problem

15 years agoThese are the template directories and files.
Rami Rauch [Fri, 15 Aug 2008 22:56:06 +0000 (22:56 +0000)]
These are the template directories and files.

15 years agoReplaced 'gaworflow' with 'htsworkflow'; updated settings.py, urls.py etc... Tested...
Rami Rauch [Fri, 15 Aug 2008 22:50:00 +0000 (22:50 +0000)]
Replaced 'gaworflow' with 'htsworkflow'; updated settings.py, urls.py etc... Tested: site load sucessfully from /htsworkflow

15 years agoMigrating Rami's frontend changes from stanford branch to htsworkflow branch.
Brandon King [Fri, 15 Aug 2008 21:43:43 +0000 (21:43 +0000)]
Migrating Rami's frontend changes from stanford branch to htsworkflow branch.

15 years agoThis text file includes step by step SQL commands to convert your DB into our schema...
Rami Rauch [Thu, 14 Aug 2008 20:19:34 +0000 (20:19 +0000)]
This text file includes step by step SQL commands to convert your DB into our schema. If used the new htsw_frontend models.py your web site should be able to load your data on the new model.

15 years agoFixed another directory problem: the libraries repo had an assumed location relative...
Tim Reddy Tim [Thu, 14 Aug 2008 19:03:26 +0000 (19:03 +0000)]
Fixed another directory problem: the libraries repo had an assumed location relative to the cwd that is not necessarily true.

15 years agoFixed directories to be more general and easy to set via the environment variable:
Tim Reddy Tim [Thu, 14 Aug 2008 18:59:40 +0000 (18:59 +0000)]
Fixed directories to be more general and easy to set via the environment variable:

HTSW_ANALYSIS_DIR

15 years agoFixed bug that bailed on empty alignment files. (weird exception case)
Tim Reddy Tim [Thu, 14 Aug 2008 18:29:52 +0000 (18:29 +0000)]
Fixed bug that bailed on empty alignment files. (weird exception case)

15 years agoTook our some old targets from the Makefile that are going unused.
Tim Reddy Tim [Thu, 14 Aug 2008 18:10:34 +0000 (18:10 +0000)]
Took our some old targets from the Makefile that are going unused.

15 years agoMade changes to add quarterly information to the sequencign summary.
Tim Reddy Tim [Thu, 14 Aug 2008 17:56:50 +0000 (17:56 +0000)]
Made changes to add quarterly information to the sequencign summary.

15 years ago(no commit message)
Rami Rauch [Wed, 13 Aug 2008 23:54:22 +0000 (23:54 +0000)]

15 years ago(no commit message)
Rami Rauch [Wed, 13 Aug 2008 23:53:53 +0000 (23:53 +0000)]

15 years ago(no commit message)
Rami Rauch [Wed, 13 Aug 2008 23:48:04 +0000 (23:48 +0000)]

15 years agoBig steps on getting the library automation going. Small code changes in the qPCR...
Tim Reddy Tim [Wed, 13 Aug 2008 23:45:14 +0000 (23:45 +0000)]
Big steps on getting the library automation going. Small code changes in the qPCR progrm to make output nicer. Then, added a "Makefile" for reference data to get the GenericBackground file used by the qPCR. Lastly, made various changes to correct incorrect paths in the LibrariesMakefile. Stll under testing, but the library system here is becoming funcitonal in the new framework.

15 years agorendered compatible with the updated MPListener
Rami Rauch [Wed, 13 Aug 2008 23:20:54 +0000 (23:20 +0000)]
rendered compatible with the updated MPListener

15 years ago(no commit message)
Rami Rauch [Wed, 13 Aug 2008 23:20:16 +0000 (23:20 +0000)]

15 years agorendered compatible with the new MainPipelineScript, which is now ran from runner bot
Rami Rauch [Wed, 13 Aug 2008 23:19:38 +0000 (23:19 +0000)]
rendered compatible with the new MainPipelineScript, which is now ran from runner bot

15 years agorendered compatible with the new MainPipelineScript, which is now ran from runner bot
Rami Rauch [Wed, 13 Aug 2008 23:19:25 +0000 (23:19 +0000)]
rendered compatible with the new MainPipelineScript, which is now ran from runner bot

15 years agorendered completely runnable from runner bot
Rami Rauch [Wed, 13 Aug 2008 23:18:36 +0000 (23:18 +0000)]
rendered completely runnable from runner bot

15 years ago(no commit message)
Unknown Author [Tue, 12 Aug 2008 23:20:17 +0000 (23:20 +0000)]

15 years ago(no commit message)
Unknown Author [Tue, 12 Aug 2008 23:19:38 +0000 (23:19 +0000)]

15 years agoFinished adding LibraryMakefile related code. Nothing tested yet, but all the necessa...
Unknown Author [Sat, 9 Aug 2008 00:04:26 +0000 (00:04 +0000)]
Finished adding LibraryMakefile related code. Nothing tested yet, but all the necessary source, scripts, and reference data is there. Some parts of LibraryMakefile are commented out until I decide whether to keep them or remove them.

15 years agoInitial Checkin. Not complete package yet, but a starting point. Bringing in lots...
Unknown Author [Fri, 8 Aug 2008 23:44:50 +0000 (23:44 +0000)]
Initial Checkin. Not complete package yet, but a starting point. Bringing in lots of code from various places and making them all talk to each other under a revised directory structure.

15 years agoInitial Checkin
Unknown Author [Fri, 8 Aug 2008 23:43:42 +0000 (23:43 +0000)]
Initial Checkin

15 years agomore dev
Unknown Author [Fri, 8 Aug 2008 00:32:48 +0000 (00:32 +0000)]
more dev

15 years agoNeed the os module.
Brandon King [Thu, 7 Aug 2008 23:17:51 +0000 (23:17 +0000)]
Need the os module.

15 years agoUpdate from gaworkflow package to htswdataprod and htswcommon packages.
Brandon King [Thu, 7 Aug 2008 22:41:24 +0000 (22:41 +0000)]
Update from gaworkflow package to htswdataprod and htswcommon packages.

15 years agoImporting Diane's opener.py from trunk.
Brandon King [Thu, 7 Aug 2008 22:40:26 +0000 (22:40 +0000)]
Importing Diane's opener.py from trunk.

15 years agogaworkflow to htswdataprod package fix.
Brandon King [Thu, 7 Aug 2008 22:37:57 +0000 (22:37 +0000)]
gaworkflow to htswdataprod package fix.

15 years agoPulling in Diane's gerald, bustard, and firecrest modules from trunk.
Brandon King [Thu, 7 Aug 2008 22:36:45 +0000 (22:36 +0000)]
Pulling in Diane's gerald, bustard, and firecrest modules from trunk.

15 years agoAdded a Stanford CollectReads compatibility mode.
Brandon King [Thu, 7 Aug 2008 21:19:19 +0000 (21:19 +0000)]
Added a Stanford CollectReads compatibility mode.
 * Use --compat_mode with --extract-results to trigger this new mdoe.

15 years agoImporting the rest of the code needed for Diane's runfolder.
Brandon King [Thu, 7 Aug 2008 20:24:28 +0000 (20:24 +0000)]
Importing the rest of the code needed for Diane's runfolder.

15 years agoPulling in Diane's runfolder script from trunk.
Brandon King [Thu, 7 Aug 2008 19:55:53 +0000 (19:55 +0000)]
Pulling in Diane's runfolder script from trunk.

15 years agocontinuing the try to make the MainPScript run sucessfully from the bot
Unknown Author [Thu, 7 Aug 2008 00:16:19 +0000 (00:16 +0000)]
continuing the try to make the MainPScript run sucessfully from the bot

15 years agoProgress towards a Stanford runner bot.
Brandon King [Wed, 6 Aug 2008 22:05:44 +0000 (22:05 +0000)]
Progress towards a Stanford runner bot.

15 years agoMigrated exp_track_comm into htswdataprod.exp_track_comm python module.
Brandon King [Wed, 6 Aug 2008 21:33:30 +0000 (21:33 +0000)]
Migrated exp_track_comm into htswdataprod.exp_track_comm python module.

15 years agoMight actually need the runner_s implementation!
Brandon King [Wed, 6 Aug 2008 18:19:06 +0000 (18:19 +0000)]
Might actually need the runner_s implementation!

15 years agoStart of Stanford runner bot... currently stripped down runner.
Brandon King [Wed, 6 Aug 2008 00:19:56 +0000 (00:19 +0000)]
Start of Stanford runner bot... currently stripped down runner.

15 years agoHandles all the data collection at the end of the data pipeline (Perl). All collected...
Unknown Author [Tue, 5 Aug 2008 23:20:59 +0000 (23:20 +0000)]
Handles all the data collection at the end of the data pipeline (Perl). All collected (and formated) data files are put in a (create) folder 'CollectReads' unders the run folder root. The content of CollectReads will be copied - at a later stage - (currently using scp) to a separate analysis server.

15 years ago[dataprod <-> frontend] messaging functions. among others, it gets the run config...
Unknown Author [Tue, 5 Aug 2008 23:16:12 +0000 (23:16 +0000)]
[dataprod <-> frontend] messaging functions. among others, it gets the run config file, reports run status (e.g. bustard finished) etc..

15 years agocommand script that runs [dataprod <-> frontend] messaging functions.
Unknown Author [Tue, 5 Aug 2008 23:15:21 +0000 (23:15 +0000)]
command script that runs [dataprod <-> frontend] messaging functions.

15 years agosub script of MainPipelineScript: counts Image folders and sub folders and return...
Unknown Author [Tue, 5 Aug 2008 23:10:12 +0000 (23:10 +0000)]
sub script of MainPipelineScript: counts Image folders and sub folders and return calculated run cycle for the current run folder.

15 years agoran by the MPListener, at the end. Collects all important data from the pipeline...
Unknown Author [Tue, 5 Aug 2008 23:07:52 +0000 (23:07 +0000)]
ran by the MPListener, at the end. Collects all important data from the pipeline results, converts some formats, then runs some quality control programs (from QC script folder). Creates 2 folders CollectReads and QC. CollectReads's content is then all transfered to the analysis server where down stream analysis part is performed and other data handling stuff.

15 years agosub script of MainPipelineScript: checks finished.txt files and reports back to front...
Unknown Author [Tue, 5 Aug 2008 23:02:10 +0000 (23:02 +0000)]
sub script of MainPipelineScript: checks finished.txt files and reports back to frontend. when gerald finished runs the next sub script, MPCollectData

15 years agoupdated paths
Unknown Author [Tue, 5 Aug 2008 23:00:03 +0000 (23:00 +0000)]
updated paths

15 years agoinotify doesn't work on Mac so we made it optional (on the existance of the package...
Unknown Author [Tue, 5 Aug 2008 22:29:49 +0000 (22:29 +0000)]
inotify doesn't work on Mac so we made it optional (on the existance of the package) to run the disk even monitoring

15 years agoFixing of spoolwatch for hybrid version.
Brandon King [Tue, 5 Aug 2008 21:16:09 +0000 (21:16 +0000)]
Fixing of spoolwatch for hybrid version.

15 years agoMigration of runner bot to new package directories.
Brandon King [Tue, 5 Aug 2008 20:03:40 +0000 (20:03 +0000)]
Migration of runner bot to new package directories.
 * All of htswdataprod/scripts/runner modules have been moved and corrected.
 * copier and spoolwatcher still need to be updated and dependancies imported.

15 years agorrauch taouch
Unknown Author [Tue, 5 Aug 2008 19:17:23 +0000 (19:17 +0000)]
rrauch taouch

15 years agoThe Main Controller to thhe Data production pipeline - Stanford version
Unknown Author [Tue, 5 Aug 2008 19:14:33 +0000 (19:14 +0000)]
The Main Controller to thhe Data production pipeline - Stanford version

15 years agoMigration of bots to new package structure started.
Brandon King [Tue, 5 Aug 2008 19:07:53 +0000 (19:07 +0000)]
Migration of bots to new package structure started.

15 years agoMigrating the bots to hybrid htsworkflow
Brandon King [Tue, 5 Aug 2008 18:59:43 +0000 (18:59 +0000)]
Migrating the bots to hybrid htsworkflow

15 years agoAccidently put runner in the wrong place.
Brandon King [Tue, 5 Aug 2008 18:53:07 +0000 (18:53 +0000)]
Accidently put runner in the wrong place.

15 years agoMigrating to hyrid version of htsworkflow
Brandon King [Tue, 5 Aug 2008 18:51:10 +0000 (18:51 +0000)]
Migrating to hyrid version of htsworkflow

15 years agoAdding a little bit of documentation.
Brandon King [Tue, 5 Aug 2008 18:41:20 +0000 (18:41 +0000)]
Adding a little bit of documentation.

15 years agoFirst attempt at breaking up code into seperately installable packages (experiment).
Brandon King [Tue, 5 Aug 2008 18:11:50 +0000 (18:11 +0000)]
First attempt at breaking up code into seperately installable packages (experiment).

15 years agoStart of Hybrid (merging) of Stanford & Caltech flavors of HTSWorkflow.
Unknown Author [Mon, 4 Aug 2008 23:18:39 +0000 (23:18 +0000)]
Start of Hybrid (merging) of Stanford & Caltech flavors of HTSWorkflow.