2024-11-03T15:51:59Z INFO __main__ 304: PIPELINE VERSION Version: 1.4.1 Common instrument config version: v0.1.5 PROCESSING VERSIONS Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-11-03T15:51:59Z INFO __main__ 269: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch start_with_unprocessed = True [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1 waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-11-03T15:51:59Z INFO __main__ 300: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 33583 SPICE: [PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241031_002.tm'), PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241102_003.tm')] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.37', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.37', 'version': ['2', '26', '37']}, {'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2024-11-03T15:51:59Z INFO stixcore.io.RidLutManager 154: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20241026/20241125 2024-11-03T15:51:59Z INFO stixcore.io.RidLutManager 163: found 2 entries 2024-11-03T15:52:01Z INFO stixcore.io.RidLutManager 172: write total 33583 entries to local storage 2024-11-03T15:52:01Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.234.08.02.29.322.QKeK@2024.308.14.00.01.921.6.xml') 2024-11-03T15:52:02Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2409152040-63620.fits exists appending data 2024-11-03T15:52:02Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2409152040-63620.fits 2024-11-03T15:52:02Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2410030733-63621.fits exists appending data 2024-11-03T15:52:02Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2410030733-63621.fits 2024-11-03T15:52:02Z INFO __main__ 223: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2409152040-63620.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2410030733-63621.fits')} 2024-11-03T15:52:02Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-11-03T15:52:02Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241031_002.tm 2024-11-03T15:52:03Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241102_003.tm 2024-11-03T15:52:03Z INFO stixcore.io.RidLutManager 174: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-11-03T15:52:04Z WARNING stixcore.products.levelb.binary 322: Incomplete sequence sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 4868 1 783826319 4869 0 783826319 4870 0 783826320 4871 0 783826320 4872 0 783826320 4873 0 783826321 4874 0 783826321 4875 0 783826322 4876 0 783826323 4877 0 783826323 4878 0 783826323 4879 0 783826324 4880 0 783826324 4881 0 783826324 4882 0 783826325 4883 0 783826325 4884 0 783826326 4885 0 783826326 4886 0 783826327 4887 0 783826327 4888 0 783826328 4889 0 783826328 4890 0 783826328 4891 0 783826329 4892 0 783826329 4893 0 783826330 4894 0 783826330 4895 0 783826331 4896 0 783826331 4897 0 783826331 4898 0 783826332 4899 0 783826332 4900 0 783826333 4901 0 783826333 4902 0 783826333 4903 0 783826334 4904 0 783826335 4905 0 783826335 4906 0 783826335 4907 0 783826336 4908 0 783826336 4909 0 783826337 4910 0 783826337 4911 0 783826337 4912 0 783826338 4913 0 783826341 4914 0 783826342 4915 0 783826343 4916 0 783826343 4917 0 783826343 4918 0 783826344 4919 0 783826344 4920 0 783826345 4921 0 783826345 4922 0 783826345 4923 0 783826346 4924 0 783826346 4925 0 783826347 4926 0 783826347 4927 0 783826348 4928 0 783826348 4929 0 783826348 4930 0 783826349 4931 0 783826349 4932 0 783826350 4933 0 783826350 4934 0 783826351 4935 0 783826351 4936 0 783826351 4937 0 783826352 4938 0 783826352 4939 0 783826352 4940 0 783826353 4941 0 783826353 4942 0 783826354 4943 0 783826354 4944 0 783826355 4945 0 783826355 4946 0 783826356 4947 0 783826356 4948 0 783826356 4949 0 783826357 4950 0 783826357 4951 0 783826357 4952 0 783826358 4953 0 783826359 4954 0 783826359 4955 0 783826359 4956 0 783826360 4957 0 783826360 4958 0 783826361 4959 0 783826361 4960 0 783826362 4961 0 783826362 4962 0 783826363 4963 0 783826363 4964 0 783826363 4965 0 783826364 4966 0 783826364 4967 0 783826371 4968 0 783826372 4969 0 783826372 4970 0 783826372 4971 0 783826373 4972 0 783826373 4973 0 783826374 4974 0 783826374 4975 0 783826375 4976 0 783826375 4977 0 783826376 4978 0 783826376 4979 0 783826376 4980 0 783826377 4981 0 783826377 4982 0 783826377 4983 0 783826378 4984 0 783826379 4985 0 783826379 4986 0 783826379 4987 0 783826380 4988 0 783826380 4989 0 783826381 4990 0 783826381 4991 0 783826381 4992 0 783826382 4993 0 783826382 4994 0 783826383 4995 0 783826383 4996 0 783826384 4997 0 783826384 4998 0 783826384 4999 0 783826385 5000 0 783826385 5001 0 783826385 5002 0 783826386 5003 0 783826387 5004 0 783826387 5005 0 783826387 5006 0 783826388 5007 0 783826388 5008 0 783826388 5009 0 783826389 5010 0 783826389 5011 0 783826389 5012 0 783826390 5013 0 783826391 5014 0 783826391 5015 0 783826391 5016 0 783826392 5017 0 783826392 5018 0 783826393 5019 0 783826393 5020 0 783826393 5021 0 783826394 5022 0 783826394 5023 0 783826395 5024 0 783826395 5025 0 783826396 5026 0 783826396 5027 0 783826396 5028 0 783826397 5029 0 783826397 5030 0 783826397 5031 0 783826398 5032 0 783826399 5033 0 783826403 5034 0 783826403 5035 0 783826403 5036 0 783826404 5037 0 783826404 5038 0 783826404 5039 0 783826405 5040 0 783826405 5041 0 783826405 5042 0 783826406 5043 0 783826407 5044 0 783826407 5045 0 783826407 5046 0 783826408 5047 0 783826408 5048 0 783826409 5049 0 783826409 5050 0 783826409 5051 0 783826410 5052 0 783826410 2024-11-03T15:52:17Z ERROR stixcore.processing.LBtoL0 123: Error processing file /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2409152040-63620.fits for 21, 6, 21 Traceback (most recent call last): File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/processing/LBtoL0.py", line 117, in process_tm_type level0 = tmp.from_levelb(comp, parent=file.name) File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py", line 514, in from_levelb data = data[sub_index] File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/astropy/table/table.py", line 2101, in __getitem__ return self._new_from_slice(item) File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/astropy/table/table.py", line 1497, in _new_from_slice newcol = col[slice_] File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/astropy/units/quantity.py", line 1272, in __getitem__ out = super().__getitem__(key) IndexError: index 732 is out of bounds for axis 0 with size 732 2024-11-03T15:52:17Z ERROR stixcore.processing.LBtoL0 126: index 732 is out of bounds for axis 0 with size 732 2024-11-03T15:52:17Z INFO __main__ 227: generated L0 files: [] 2024-11-03T15:52:17Z INFO __main__ 231: generated L1 files: [] 2024-11-03T15:52:17Z INFO __main__ 235: generated L2 files: []