PHBQ_20101210
iPG2P PhytoBISQUE
December, 2010; 3 to 4 pm PST
Present: Nirav Merchant, Edwin Skidmore, Karla Gendler, Kris K., programmer
Notes/Agenda:
- BISQUE can integrate R
- coming out with extended update January 1
- sharing options on images
- integrating tool to support very large images
- Google maps for 5-d images
- analysis on background using condor
- condor work robust
- front end changes
- with condor work, have been able to replicate nodes and talk to single point
- last 3/4 months, working on scaling analysis and front ends (with iPlant in mind)
- Nirav wants BISQUE running for PAG
- Release in October (0.4.8)
- small improvements in usability
- bug fixes
- AI: make sure October's update is installed and can update easily to January release
- with new Jan release there has been work on data ingest portion and unifying to move datasets to BISQUE instances
- to get data in:
- HTTP call to POST
- want to separate ingest from move
- AI: meeting to discuss Shibboleth integration
- current ingest:
- Digital Notebook: C++ program, great batch uploader
- basic upload
- image construction (uses zip files)
- looking at automatic deployment (this was in response to Nirav talking about Atmosphere)
- can dispatch to any condor they want
- within next week, can dispatch multiple images and parallel processing
- BISQUE owns the files
- Nathan Miller excited about using our condor grid
- Plans for moving forward:
- Plan A:
- move ahead with remote registration of modules (Nathan Miller's work)
- Plan B:
- Kris will login and make sure all is good
- need to verify can submit jobs into iPlant's condor grid
- put BISQUE instance on submit node
- Plan A:
- don't expect shared file system
- also have staging mechanism
- easier to send file and algorithms