Error during Testing in File "run_simulation.py
********My code has been working until I got this error message below (I have not done any changes to it) I am not using file input or output in my code******** :
Traceback (most recent call last):
File "run_simulation.py", line 558, in
main(sys.argv[1:])
File "run_simulation.py", line 532, in main
results = simulator()
File "/var/jenkins_home/miniconda/conda-bld/tradesim_1517955372560/_b_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python2.7/site-packages/tradesim/engine.py", line 580, in call
File "/var/jenkins_home/miniconda/conda-bld/tradesim_1517955372560/_b_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python2.7/site-packages/tradesim/engine.py", line 668, in simulate
File "/var/jenkins_home/miniconda/conda-bld/tradesim_1517955372560/_b_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python2.7/site-packages/tradesim/engine.py", line 1679, in setup_simulation_day
File "/var/jenkins_home/miniconda/conda-bld/tradesim_1517955372560/_b_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python2.7/site-packages/tradesim/engine.py", line 853, in create_partial_md_service
File "/var/jenkins_home/miniconda/conda-bld/tradesim_1517955372560/_b_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python2.7/site-packages/tradesim/market.py", line 1521, in init
File "/var/jenkins_home/miniconda/conda-bld/tradesim_1517955372560/_b_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python2.7/site-packages/tradesim/source.py", line 1392, in fundamentals
File "/var/jenkins_home/miniconda/conda-bld/tradesim_1517955372560/_b_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python2.7/site-packages/tradesim/source.py", line 109, in _load_new_fundamentals
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (-------src-dir-------/h5py/_objects.c:2582)
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (-------src-dir-------/h5py/_objects.c:2541)
File "/opt/anaconda/lib/python2.7/site-packages/h5py/_hl/dataset.py", line 238, in value
return self[()]
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (-------src-dir-------/h5py/_objects.c:2582)
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (-------src-dir-------/h5py/_objects.c:2541)
File "/opt/anaconda/lib/python2.7/site-packages/h5py/_hl/dataset.py", line 482, in getitem
self.id.read(mspace, fspace, arr, mtype, dxpl=self._dxpl)
File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (-------src-dir-------/h5py/_objects.c:2582)
File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (-------src-dir-------/h5py/_objects.c:2541)
File "h5py/h5d.pyx", line 181, in h5py.h5d.DatasetID.read (-------src-dir-------/h5py/h5d.c:3128)
File "h5py/_proxy.pyx", line 130, in h5py._proxy.dset_rw (-------src-dir-------/h5py/_proxy.c:1774)
File "h5py/_proxy.pyx", line 84, in h5py._proxy.H5PY_H5Dread (-------src-dir-------/h5py/_proxy.c:1416)
IOError: Can't read data (File read failed: time = thu feb 8 13:57:16 2018
, filename = '/srv/mktdb5/tck/fundamental/2017-01-26.hdf5', file descriptor = 3, errno = 5, error message = 'input/output error', buf = 0x3027f00, total read size = 1785, bytes this sub-read = 1785, bytes actually read = 18446744073709551615, offset = 90112)
Exception during results loading:
account read
log read.
log loaded.
trades read.
trades loaded.
Please help.
Comments
LF, we are experiencing system issues.. we will resolve ASAP.
Thanks for reporting!
Paul
Issue resolved, thanks for reporting!
ok ,thanks Paul, is there a better way to send a message to developers when there a system issue so that we don't try to change our code unnecessary.
LF
In addition to our cloud researchers, we have internal quants and prop traders constantly developing systems so we normally spot issues quite quickly. This was an unusual fail.
If we have an issue that looks like it may persist we always place an alert at the top of the page.
On this occasion, we received a number of complaints from people who had been trying to run overnight so we knew it was not a user issue but a system fault. We immediately pinned it down to a hardware issue on one machine and took that machine out of the backtesting network, resolving the problem.
With every issue that comes up we look at how we could have done better, how we could automate the system to reduce user pain. In this case we are putting some test code in place so that the same issue cannot re-occur.
I am not just a user support person, I actually use the system so I know exactly how frustrating it is to be trying to locate an issue in my code only to find out the error caused was a system issue. This helps me to communicate that pain to the developers.
As always, we appreciate the feedback.