Stop copying attributes from library to a submission node
authorDiane Trout <diane@caltech.edu>
Wed, 20 Jul 2011 00:45:01 +0000 (17:45 -0700)
committerDiane Trout <diane@caltech.edu>
Wed, 20 Jul 2011 00:45:01 +0000 (17:45 -0700)
commitff3269caa0d45e10282952b0d4b8030c9b01cfd1
treeaf16b802245226f16c204ec0b2e172aa9f631346
parent7bd6ee3b511385bc823592538575152ccf5112df
Stop copying attributes from library to a submission node
Instead just query the library directly.

This involved updating the sparql query in make_ddf a bit.

Associated with doing that I also changed when I import
data from the RDFa pages, so I only connect to the web server
once per library, instead of once per scanned file per attribute.

That provided a significant performance improvement.
extra/ucsc_encode_submission/ucsc_gather.py
htsworkflow/submission/daf.py
htsworkflow/submission/test/test_daf.py