2024-12-18T18:01:26Z INFO __main__ 300: PIPELINE VERSION Version: 1.5.0 Common instrument config version: v0.1.5 PROCESSING VERSIONS Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/ANC/aspect.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-12-18T18:01:26Z INFO __main__ 265: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch sync_tm_at_start = True stop_after_unprocessed = True start_with_unprocessed = True last_processed = TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.184.14.18.45.363.hBFL@2024.200.08.00.00.905.1.xml.out history_db_file = /home/stixcore/soar_pub/processing_history.sqlite [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1, ANC waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-12-18T18:01:26Z INFO __main__ 296: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 33782 SPICE: [(PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm'), 'pred', datetime.datetime(2024, 12, 13, 0, 0)), (PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm'), 'flown', datetime.datetime(2024, 12, 17, 0, 0))] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2024-12-18T18:01:27Z INFO stixcore.io.RidLutManager 158: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20241215/20250114 2024-12-18T18:01:27Z INFO stixcore.io.RidLutManager 167: found 6 entries 2024-12-18T18:01:28Z INFO stixcore.io.RidLutManager 176: write total 33782 entries to local storage 2024-12-18T18:01:28Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.53.20.067.IzBj@2024.351.17.00.04.343.1.xml') 2024-12-18T18:01:28Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-30_0787622400_V02.fits exists appending data 2024-12-18T18:01:28Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-34_0787622400_V02.fits exists appending data 2024-12-18T18:01:28Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-32_0787622400_V02.fits exists appending data 2024-12-18T18:01:28Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411100738-50513.fits 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411109112-50512.fits exists appending data 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787622400_V02.fits 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411109112-50512.fits 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787622400_V02.fits 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787622400_V02.fits 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411103712-50514.fits 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-31_0787622400_V02.fits exists appending data 2024-12-18T18:01:29Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787622400_V02.fits 2024-12-18T18:01:29Z INFO __main__ 218: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411100738-50513.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411103712-50514.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411109112-50512.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787622400_V02.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787622400_V02.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787622400_V02.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787622400_V02.fits')} 2024-12-18T18:01:29Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:01:29Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:01:29Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:01:29Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:01:29Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:29Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:29Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:29Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:29Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:29Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:01:30Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:30Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:01:30Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:30Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:01:30Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:30Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:01:31Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787622400_V02.fits 2024-12-18T18:01:31Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787622400_V02.fits 2024-12-18T18:01:32Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787622400_V02.fits 2024-12-18T18:01:32Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-lightcurve_0787536000_V02U.fits exists appending data 2024-12-18T18:01:32Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-flareflag_0787536000_V02U.fits exists appending data 2024-12-18T18:01:32Z ERROR stixcore.processing.LBtoL0 95: Error processing file /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787622400_V02.fits for 21, 6, 32 Traceback (most recent call last): File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/processing/LBtoL0.py", line 90, in process_tm_type level0 = tmp.from_levelb(levelb, parent=file.name) File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py", line 344, in from_levelb control_indices = control_indices.reshape(-1, 32) ValueError: cannot reshape array of size 728 into shape (32) 2024-12-18T18:01:32Z ERROR stixcore.processing.LBtoL0 97: cannot reshape array of size 728 into shape (32) 2024-12-18T18:01:32Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:01:32Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:33Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-lightcurve_0787622400_V02U.fits exists appending data 2024-12-18T18:01:33Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:33Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:01:33Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-flareflag_0787622400_V02U.fits exists appending data 2024-12-18T18:01:34Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787622400_V02.fits 2024-12-18T18:01:34Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-background_0787536000_V02U.fits exists appending data 2024-12-18T18:01:34Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-background_0787622400_V02U.fits exists appending data 2024-12-18T18:01:37Z WARNING stixcore.products.levelb.binary 322: Incomplete sequence sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 12822 1 787682730 12823 0 787682775 12824 0 787682818 12825 0 787682859 12826 0 787682902 12827 0 787682945 12828 0 787683000 12829 0 787683055 12830 0 787683112 12831 0 787683181 2024-12-18T18:01:37Z INFO __main__ 222: generated L0 files: [PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0784551644-0784573540_V02_2411109112-50512.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787536000_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787622400_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787536000_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787622400_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787536000_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787622400_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0784573252-0784595138_V02_2411100738-50513.fits')] 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:01:38Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0784551644-0784573540_V02_2411109112-50512.fits 2024-12-18T18:01:38Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:01:39Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787536000_V02U.fits 2024-12-18T18:01:39Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787622400_V02U.fits 2024-12-18T18:01:39Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787536000_V02U.fits 2024-12-18T18:01:39Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0784573252-0784595138_V02_2411100738-50513.fits 2024-12-18T18:01:39Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:40Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-flareflag_20241216_V02U.fits exists appending data 2024-12-18T18:01:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:41Z WARNING astropy 235: AstropyDeprecationWarning: Specified hdu=DATA not found, reading in first available table (hdu=1) instead. This will result in an error in future versions! 2024-12-18T18:01:41Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241215_V02U.fits exists appending data 2024-12-18T18:01:42Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241215_V02U.fits exists appending data 2024-12-18T18:01:43Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:45Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241216_V02U.fits exists appending data 2024-12-18T18:01:45Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:45Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:46Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:46Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787622400_V02U.fits 2024-12-18T18:01:46Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241216_V02U.fits exists appending data 2024-12-18T18:01:47Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:47Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:50Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241216_V02U.fits exists appending data 2024-12-18T18:01:51Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:51Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:52Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787622400_V02U.fits 2024-12-18T18:01:53Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241216_V02U.fits exists appending data 2024-12-18T18:01:54Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:54Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:01:54Z ERROR stixcore.processing.L0toL1 77: error concurrent.futures.process._RemoteTraceback: """ Traceback (most recent call last): File "/home/stixcore/.pyenv/versions/3.9.20/lib/python3.9/concurrent/futures/process.py", line 246, in _process_worker r = call_item.fn(*call_item.args, **call_item.kwargs) File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/processing/L0toL1.py", line 89, in process_type l0 = Product(file) File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/product.py", line 235, in __call__ data = read_qtable(file_path, hdu='DATA', hdul=hdul) File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/product.py", line 88, in read_qtable qtable[col.name] = qtable[col.name].astype(dtype) File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/astropy/table/table.py", line 2055, in __getitem__ return self.columns[item] File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/astropy/table/table.py", line 264, in __getitem__ return OrderedDict.__getitem__(self, item) KeyError: 'time' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/processing/L0toL1.py", line 74, in process_fits_files new_files = job.result() File "/home/stixcore/.pyenv/versions/3.9.20/lib/python3.9/concurrent/futures/_base.py", line 439, in result return self.__get_result() File "/home/stixcore/.pyenv/versions/3.9.20/lib/python3.9/concurrent/futures/_base.py", line 391, in __get_result raise self._exception KeyError: 'time' 2024-12-18T18:01:54Z INFO __main__ 226: generated L1 files: [PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/11/10/SCI/solo_L1_stix-sci-xray-spec_20241110T110504-20241110T171000_V02_2411109112-50512.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/15/QL/solo_L1_stix-ql-lightcurve_20241215_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/16/QL/solo_L1_stix-ql-background_20241216_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/15/QL/solo_L1_stix-ql-background_20241215_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/16/QL/solo_L1_stix-ql-lightcurve_20241216_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/11/10/SCI/solo_L1_stix-sci-xray-spec_20241110T170512-20241110T230958_V02_2411100738-50513.fits')] 2024-12-18T18:03:23Z INFO __main__ 304: PIPELINE VERSION Version: 1.5.0 Common instrument config version: v0.1.5 PROCESSING VERSIONS Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/ANC/aspect.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-12-18T18:03:23Z INFO __main__ 269: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch sync_tm_at_start = True stop_after_unprocessed = True start_with_unprocessed = True last_processed = TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.184.14.18.45.363.hBFL@2024.200.08.00.00.905.1.xml.out history_db_file = /home/stixcore/soar_pub/processing_history.sqlite [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1, ANC waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-12-18T18:03:23Z INFO __main__ 300: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 33782 SPICE: [(PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm'), 'pred', datetime.datetime(2024, 12, 13, 0, 0)), (PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm'), 'flown', datetime.datetime(2024, 12, 17, 0, 0))] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2024-12-18T18:03:23Z INFO stixcore.io.RidLutManager 158: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20241215/20250114 2024-12-18T18:03:23Z INFO stixcore.io.RidLutManager 167: found 6 entries 2024-12-18T18:03:24Z INFO stixcore.io.RidLutManager 176: write total 33782 entries to local storage 2024-12-18T18:03:25Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.53.20.067.IzBj@2024.351.17.00.04.343.1.xml') 2024-12-18T18:03:25Z INFO __main__ 495: Opened file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.53.20.067.IzBj@2024.351.17.00.04.343.1.xml 2024-12-18T18:03:25Z INFO __main__ 490: Closed read file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.53.20.067.IzBj@2024.351.17.00.04.343.1.xml 2024-12-18T18:03:25Z INFO __main__ 495: Opened file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.53.20.067.IzBj@2024.351.17.00.04.343.1.xml 2024-12-18T18:03:25Z INFO __main__ 490: Closed read file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.53.20.067.IzBj@2024.351.17.00.04.343.1.xml 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411100738-50513.fits exists appending data 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-30_0787622400_V02.fits exists appending data 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-34_0787622400_V02.fits exists appending data 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-32_0787622400_V02.fits exists appending data 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411100738-50513.fits 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787622400_V02.fits 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787622400_V02.fits 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411109112-50512.fits exists appending data 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-31_0787622400_V02.fits exists appending data 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787622400_V02.fits 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411109112-50512.fits 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787622400_V02.fits 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411103712-50514.fits exists appending data 2024-12-18T18:03:25Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411103712-50514.fits 2024-12-18T18:03:25Z INFO __main__ 223: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411100738-50513.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411103712-50514.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2411109112-50512.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787622400_V02.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787622400_V02.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787622400_V02.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787622400_V02.fits')} 2024-12-18T18:03:25Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:03:25Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:03:25Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:03:25Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:26Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:26Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:26Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:03:26Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:26Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:03:27Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787622400_V02.fits 2024-12-18T18:03:27Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787622400_V02.fits 2024-12-18T18:03:27Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787622400_V02.fits 2024-12-18T18:03:28Z INFO __main__ 495: Opened file: /data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.339.09.53.50.310.gyZG@2024.353.12.00.03.899.3.xml 2024-12-18T18:03:28Z INFO __main__ 490: Closed read file: /data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.339.09.53.50.310.gyZG@2024.353.12.00.03.899.3.xml 2024-12-18T18:03:28Z INFO __main__ 495: Opened file: /data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.339.09.53.50.310.gyZG@2024.353.12.00.03.899.3.xml 2024-12-18T18:03:28Z INFO __main__ 490: Closed read file: /data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.339.09.53.50.310.gyZG@2024.353.12.00.03.899.3.xml 2024-12-18T18:03:28Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-background_0787536000_V02U.fits exists appending data 2024-12-18T18:03:28Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-lightcurve_0787536000_V02U.fits exists appending data 2024-12-18T18:03:29Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-flareflag_0787536000_V02U.fits exists appending data 2024-12-18T18:03:29Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-background_0787622400_V02U.fits exists appending data 2024-12-18T18:03:29Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-18T18:03:29Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:29Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-flareflag_0787622400_V02U.fits exists appending data 2024-12-18T18:03:29Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-lightcurve_0787622400_V02U.fits exists appending data 2024-12-18T18:03:29Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:29Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-18T18:03:30Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787622400_V02.fits 2024-12-18T18:03:30Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-sci-xray-spec_0784551644-0784573540_V02_2411109112-50512.fits exists appending data 2024-12-18T18:03:31Z INFO stixcore.processing.LBtoL0 121: Tried to combine 2 BSD products: sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 12822 1 787682730 12823 0 787682775 12824 0 787682818 12825 0 787682859 12826 0 787682902 12827 0 787682945 12828 0 787683000 12829 0 787683055 12830 0 787683112 12831 0 787683181 2024-12-18T18:03:33Z INFO __main__ 227: generated L0 files: [PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787622400_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787622400_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787536000_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787622400_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787536000_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787536000_V02U.fits')] 2024-12-18T18:03:34Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:34Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:34Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:34Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:34Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:34Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:34Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787622400_V02U.fits 2024-12-18T18:03:34Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787622400_V02U.fits 2024-12-18T18:03:34Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787536000_V02U.fits 2024-12-18T18:03:34Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241216_V02U.fits exists appending data 2024-12-18T18:03:35Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-flareflag_20241216_V02U.fits exists appending data 2024-12-18T18:03:35Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:35Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:35Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:35Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:35Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787536000_V02U.fits 2024-12-18T18:03:36Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787536000_V02U.fits 2024-12-18T18:03:36Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241215_V02U.fits exists appending data 2024-12-18T18:03:37Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241215_V02U.fits exists appending data 2024-12-18T18:03:37Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-flareflag_20241215_V02U.fits exists appending data 2024-12-18T18:03:38Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:39Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:40Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-flareflag_20241216_V02U.fits exists appending data 2024-12-18T18:03:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:41Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241216_V02U.fits exists appending data 2024-12-18T18:03:42Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:42Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:45Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241216_V02U.fits exists appending data 2024-12-18T18:03:46Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:46Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:47Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787622400_V02U.fits 2024-12-18T18:03:48Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241216_V02U.fits exists appending data 2024-12-18T18:03:49Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:49Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-18T18:03:50Z INFO __main__ 231: generated L1 files: [PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/16/QL/solo_L1_stix-ql-lightcurve_20241216_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/15/QL/solo_L1_stix-ql-lightcurve_20241215_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/16/QL/solo_L1_stix-ql-background_20241216_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/15/QL/solo_L1_stix-ql-background_20241215_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/15/QL/solo_L1_stix-ql-flareflag_20241215_V02U.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/16/QL/solo_L1_stix-ql-flareflag_20241216_V02U.fits')] 2024-12-18T18:03:51Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:51Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:51Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-18T18:03:51Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:51Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:51Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241217_001.tm 2024-12-18T18:03:51Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-flareflag FITS files. 2024-12-18T18:03:51Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-flareflag FITS files. 2024-12-18T18:03:52Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-background FITS files. 2024-12-18T18:03:52Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-lightcurve FITS files. 2024-12-18T18:03:53Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-background FITS files. 2024-12-18T18:03:56Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-lightcurve FITS files. 2024-12-18T18:03:56Z INFO __main__ 235: generated L2 files: []