4-7-15
Complex/Nested data structures: http://stackoverflow.com/questions/635483/what-is-the-best-way-to-implement-nested-dictionaries-in-python
Complex/Nested data structures: http://stackoverflow.com/questions/635483/what-is-the-best-way-to-implement-nested-dictionaries-in-python
"Profiling" - figuring out how fast your scripts are going, at each process.
when running python add '-m cProfile'
Here is an example
python -m cProfile 23me-to-vcf-v2.py hu4D906B.txt
ncalls tottime percall cumtime percall filename:lineno(function) 1 4.030 4.030 323.929 323.929 23me-to-vcf-v2.py:1(<module>) 960614 14.054 0.000 30.183 0.000 23me-to-vcf-v2.py:9(pull_data) 1 0.000 0.000 0.000 0.000 <string>:1(<module>) 1 0.000 0.000 0.000 0.000 {built-in method now} 2 288.603 144.302 288.603 144.302 {cPickle.load} 1 0.000 0.000 0.000 0.000 {method 'disable' of '_lsprof.Profiler' objects} 960614 0.481 0.000 0.481 0.000 {method 'join' of 'str' objects} 956451 3.476 0.000 3.476 0.000 {method 'readline' of 'file' objects} 17353 0.010 0.000 0.010 0.000 {method 'replace' of 'str' objects} 956451 6.109 0.000 6.109 0.000 {method 'seek' of 'file' objects} 1917065 1.133 0.000 1.133 0.000 {method 'split' of 'str' objects} 1 0.001 0.001 0.001 0.001 {method 'strftime' of 'datetime.date' objects} 1921229 0.544 0.000 0.544 0.000 {method 'strip' of 'str' objects} 960619 0.632 0.000 0.632 0.000 {method 'write' of 'file' objects} 967262 4.857 0.000 4.857 0.000 {open}