Diane's World

I take the 5th


Fri, 18 Aug 2006

SciPy 2006 Day 2

  • AutoLigand AutoDock, Rodney Harris

    • Tool for "rational" ligand design
    • computes affinity
  • GpuPy, Benjamin Eitzen, WashU

    • strengths
      • currently improving faster than traditional cpus
    • weaknesses
      • single precision
      • data must be copied to gpu
    • programmability
      • newer gpus can execute programs in "high level" languages Cg GLSL HLSL
      • programs are called shaders
    • how it works
      • GPU executes program once for each pixel that is drawn to screen
      • overrrides default numpy functions, can be transparent
      • some functions are slower on gpu (like simple add or multiply)
      • some get faster with larger N (pow, arccosh)
      • some are just faster (cos, sin)
      • the more complex you can pass over the faster, correlation
      • not hooked up yet, but have edge detection filter
    • possible future work,
      • autoconfig
    • simulation of double with singles hal.ccssd.cnrs.fr/ccsd-00021443
    • htpp://eecs.wsu.edu/~eitzenb/gpupy
  • Boost Graph Library, Douglas Gregor

    • path finding

    • connectivity & clustering

    • network flow

    • coloring

    • layout & visualization

    • motivation

      • python is easier to teach
      • dynamic features of python
      • usabiliy (e.g. c++ error messages)
    • Task: network tolerance

      from boost.graph import * g = read_graphviz("network.dot")

      bicomponent = g.add_edge_property(name='label', type='integer) art_points = biconnected_components(g, bicomponent)

      for v in g.vertices:

      if v in art_points:

    • graph types in python

      • Graph
      • Digraph
      • Graph exploration interface
    • vertex and edge properties

      • attach additional model domain knowledge
        • computer net, vertex(host, ip_addr), edge(bandwidth, latency)
    • Properties in the BGL

      • property map
        • implicity, just access property
        • explicity, allows more specifity, 2 params optional weight = g.add_edge_property(name='weight', type='float')
      • using property maps
        • similar to dictionaries (weight[e], =0.75
        • pass to algorithms dijkstra_shortest_path(g, start_vertex, weight)
      • has visitor model to do something when you hit interesting points in the algorithm. (e.g. debugging, new algorithms)
    • http://www.generic-programming.org/~dgregor/bgl-python/

  • summary of research issues with/Fast multipole Algorithm, Idesbald van den Bosch

    • ship signature reduction
    • lots of details about problem and need for optimization
    • gmsh (mesh generation)
  • Object Oriented Finite Elements, Andrew Reid

    • OOF2,
      • rapid construction of meshes adapted to irregular microstructural geometriesp
  • Parallel PDE solvers in python, Bill Spotz

  • Python imaging tools for reconstructing magnetic resonance images, make trumpis

  • PyRoot, Wim Lavrijsen (pronounced more like vim)

  • QScimpl, Eric Dobbs

    • personal, dobbse.net
    • Tech-X Corporation, txcorp (scientific physics stuff)
    • mostly decided to advertise the advantage of simplicity
  • Genesis SciFlo, Scientific Knowledge Creation on the Grid, Brian Wilson

    • Problem, terabytes of data (years) distributed at several data centers
    • iEarth
    • showed an updating svg diagram showing the execution of their workflow.
      • distributed across many machines via web services
    • data access protocol, retrieve chunks of data over web.
    • used xpath to extract results from amazon soap results
    • software shipped
      • lxml (XPath 1.0)
      • twisted, pyldap, openldap,
      • sleepycat dblxml has xquery and xpath
      • dojo AJAX library
      • openDAP, extract cdf, hdf file
      • globas v4 grid
    • globus v4 is supposed to be soap webservice
    • WSRF (web services resource framework)
    • UDDI universal description discovery and integration, find service
    • grid workflow,
    • rest vs soap, each have advantages/disadvantages
    • UDDI4py from IBM, SOAPpy
    • recommends more XML microformats for "mash ups"
    • publish science algorithms as reusable web services
    • www.opendap.org
  • Python Web & Grid Service Tools, Keith R Jackson

    • Globus toolkit
    • decided to simplify system by standardized into webservices
    • helps organize coordinated usage of resources
    • his mac crashed
    • SOAPpy is officially unsported
    • ZSI is hopefully the "new" better way, though they're more complicated than SOAPpy
    • XML schema scary complicated
    • Mapping tool from WSDL to python (wsdl2py)
    • using m2crypto (they thought it was being supported, unlike pySSL)
    • LIGO used it to ship 50 terabytes of data through pyglobus
    • WSRF supposed to define way to hand stateful connections
    • lifecycle, things will die at some point, though can be refreshed.
    • WS-N another webservices spec
    • seems to actually work, java, C, python call all talk.
    • PyCLST
    • GridFTP, implement extra features to handle transfer over highperformance network
    • Visual programming environment, useful for viewing workflow
    • Userinterface
    • planner, condor, dagman
    • exec manager (CBEI)
    • exec context
    • physical resources
    • pyGlobus, http://dsd.lbl.gov/gtg/projects/pyGlobus/
    • ZSI, http://pywebsvcs.sourceforge.net/zsi.html
    • pyGridWare, http://dsd.lbl.gov/gtg/projects/pyGridWare
    • ViCE, http://dsd.lbl.gov/gtg/projects/vice/
    • PythonCLServiceTool, http://dsd.lbl.gov/gtg/projects/PythonCLServiceTrool
    • everything BSD license
    • eclipse has a nice WSDL interface generator
    • python to wsdl would require static type annotation.
    • webservices, text to do control, then binary for shipping data
    • amazon, uses a very efficient xml binary encoding
  • Seeing through the MIST, Tripp Lilley

    • interesting point about maliable UIs
      • how do you let a user, know theyre changing their world, and revert.
    • super early project, not even screenshots

[18:00] | [/geek] | # | G


Thu, 17 Aug 2006

SciPy 2006 Day 1

  • They'll video tape

  • Cancelations, so some one could move to tomorrow

  • Python3, Guido's Talk

    • Python 2.5, some improvements

    • Python 3000

      • Language update
      • Stroustroup compatibility
        • C++ backwords, add a new keyword, was a major incompatibility
      • Perl 6 other extreme
    • -Q warn about integer errors, // <- integer division

    • Pep 3100 for info, python.org/dev/peps

    • guidos blog, artima.com/weblogs/

    • big changes

      • kill classic classes
      • Exception derive from single root
      • absolute import ( can be turned on in 2.5 )
      • replacement for d.has_key if x in d
      • interating over file is better than xreadlines
    • smaller changes

      • exec, function again

      • x in favor repr(x)

      • except x,y,z as err instead except e,err

      • generator replaces list comprehension * list comprensions currently leak their name into the surrounding

        System Message: ERROR/3 (<string>, line 38)

        Unexpected indentation.

        scope

      • kill raise E, use raise E(arg) (work away from string exception)

      • xrange has a problem with long ints

        • will change range to do xrange things with lon support
    • string type updates

      • string becomes unicode
      • also introduce a byte type, all conversions from byte to strings require specifying conversion
    • new standard i/o stack

      • replace the c stdio with something a bit more inspired by java * unbuffered io * buffered io built on top
      • see sandbox/sio/sio.py for early prototype
    • print becomes a function

      • easier to change print to something
      • 2.x/3 compatibility requires only printing single string
    • dict views instead of lists

    • drop default <, <=, >, >= for classes (currently does memory)

    • Google python sprint next week

  • Understanding NumPy, Travis Oliphant

    • numeric compatibility layer, numpy.oldnumeric
    • dtype object ( defines what the elements of the NumPy array )
      • array scalar ( wraps element returned from cell )
      • dtype code '<i4' (byte order, type, size)
      • isbuiltin, 21 static objects
      • dt.itemsize
      • fields, since array is just chunks of memory, because of alignment issues
      • a.flags ( properties on arrays )
      • a.empty((10,),dtype='int,float,a10') * a.dtype * a.dtype.fields
      • arbitrary structure needed to memmap complicated files
  • Extending NumPy, swig, f2py, pyrex, ctypes,

    • swig, first
    • weave, embed C code in python string, kinda fortran like in variable names
      • compiles on the fly
    • pyrex
      • from c_numpy cimport, ... import_array()
    • ctype, calls shared libraries
      • .argtypes allow specifying type checking for c calls
  • Python for modern scientific algorithm development, Fernando Perez

  • Building a Distributed Component Framework (pyre), Michael Aivazis

  • Enthought tool suite

    • What are traits?
      • notification (considered important)
      • visualization
  • Synthetic Programming with Python

  • 3D visualization with TVTK and MayaVi2, Prabhu Ramachandran

    • Traited VTK
    • MayaVi2 uses enthought exposes lots of objects and gui tools for playing with them
  • Realtime Computing with Python, Andrew Straw

  • Lightening Talks

    • Dude from JPL, Mike Ressler
    • Future of IPython, Brian Granger, Tech-X corp
      • planning on extending to ipython to do distributed programming
      • control remote supercomputers from laptop
      • support multiple parallel types
      • focus on interactive work
      • distributed programming in python
        • multiple processes, threads are limited by GIL
        • non-blocking sockets
        • asynchronous error/fault
    • Travis Oliphant, about PEP
    • Travis Vaught, Enstaller
      • egg package installation manger
      • has post-install scripts
      • build egg from pointing to a directory
      • code.enthought.com/enthon/enstaller.shtml
      • enthought.com/enthought/wiki/Enstaller
    • The Current State of Vision, Michel Sanner
      • Visual programming tools
      • supports nested graph nodes
      • looks written in tk
      • www.scripts.edu/~sanner/software
    • Quick overview of Chaco, Peter Wang
  • SAGE, Alex Clemesha

    • good environment for algebra, number theory, geometry
    • what is it
      • Distribution of math software
      • python library
      • new interface to math software
    • where is it: modular.math.washington.edu/sage
    • their ajax based web notebook looks really impressive
  • Mathematica like plotting for SAGE, Alex Clemesha

  • BioHub, Diane Trout

  • Software Carpentry, Greg Wilson

    • he's a good speaker.
    • debugger for make
    • debugger than can trace back and forth between python & c code
    • Guido pronounced django the web framework.

[18:00] | [/geek] | # | G


menu

About Diane Trout
Blog

calendar

< August 2006 >
SuMoTuWeThFrSa
   1 2 3 4 5
6 7 8 9101112
13141516171819
20212223242526
2728293031  

categories

/ (123)
  geek/ (37)
    debian/ (2)
    programming/ (1)
    t41/ (6)
    voip/ (1)
  government/ (7)
    tac/ (3)
  life/ (8)
    transhuman/ (1)
    vegan/ (2)
      recipes/ (2)
  study/ (49)
    arma/ (1)
    bi188/ (8)
    cs191a/ (6)
    ese166/ (25)
  work/ (21)
    compclust/ (6)
    sigmoid/ (1)
    talks/ (1)