2025-11-02T18:10:08Z INFO __main__ 227: PIPELINE VERSION Version: 1.5.1 Common instrument config version: v0.1.7 PROCESSING VERSIONS Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/ANC/aspect.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 4 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 4 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2025-11-02T18:10:08Z INFO __main__ 192: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch sync_tm_at_start = True stop_after_unprocessed = True start_with_unprocessed = True last_processed = TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.184.14.18.45.363.hBFL@2024.200.08.00.00.905.1.xml.out history_db_file = /home/stixcore/soar_pub/processing_history.sqlite [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1, ANC waiting_period = 42d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal,asp log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2025-11-02T18:10:08Z INFO __main__ 223: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 36030 SPICE: [(PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20251021_001.tm'), 'pred', datetime.datetime(2025, 10, 21, 0, 0)), (PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20251101_001.tm'), 'flown', datetime.datetime(2025, 11, 1, 0, 0))] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2025-11-02T18:10:09Z INFO stixcore.io.RidLutManager 158: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20251021/20251120 2025-11-02T18:10:09Z INFO stixcore.io.RidLutManager 167: found 3 entries 2025-11-02T18:10:10Z INFO stixcore.io.RidLutManager 176: write total 36030 entries to local storage 2025-11-02T18:10:10Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_LTP21_BatchRequest.PktTmRaw.SOL.0.2025.237.07.56.33.017.lkBP@2025.306.13.00.00.560.3.xml') 2025-11-02T18:10:11Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509090773-65144.fits 2025-11-02T18:10:11Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509090773-65144.fits 2025-11-02T18:10:11Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509091030-65143.fits exists appending data 2025-11-02T18:10:12Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509091030-65143.fits 2025-11-02T18:10:12Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509091030-65143.fits 2025-11-02T18:10:12Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509096596-65145.fits 2025-11-02T18:10:12Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509096596-65145.fits 2025-11-02T18:10:12Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509090564-65146.fits 2025-11-02T18:10:12Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509090564-65146.fits 2025-11-02T18:10:12Z INFO __main__ 145: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509090564-65146.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509090773-65144.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509091030-65143.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2509096596-65145.fits')} 2025-11-02T18:10:12Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-11-02T18:10:12Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20251021_001.tm 2025-11-02T18:10:12Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20251101_001.tm 2025-11-02T18:10:12Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2025-11-02T18:10:35Z WARNING stixcore.products.levelb.binary 322: Incomplete sequence sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 8287 1 815284877 8288 0 815284877 8289 0 815284878 8290 0 815284878 8291 0 815284878 8292 0 815284879 8293 0 815284880 8294 0 815284880 8295 0 815284880 8296 0 815284881 8297 0 815284881 8298 0 815284881 8299 0 815284882 8300 0 815284882 8301 0 815284883 8302 0 815284883 8303 0 815284884 8304 0 815284884 8305 0 815284884 8306 0 815284885 8307 0 815284885 8308 0 815284885 8309 0 815284886 8310 0 815284886 8311 0 815284887 8312 0 815284887 8313 0 815284888 8314 0 815284888 8315 0 815284888 8316 0 815284889 8317 0 815284889 8318 0 815284889 8319 0 815284890 8320 0 815284890 8321 0 815284890 8322 0 815284891 8323 0 815284891 8324 0 815284892 8325 0 815284892 8326 0 815284893 8327 0 815284893 8328 0 815284893 8329 0 815284894 8330 0 815284894 8331 0 815284894 8332 0 815284895 8333 0 815284896 8334 0 815284896 8335 0 815284896 8336 0 815284897 8337 0 815284897 8338 0 815284898 8339 0 815284898 8340 0 815284898 8341 0 815284899 8342 0 815284899 8343 0 815284900 8344 0 815284900 8345 0 815284901 8346 0 815284901 8347 0 815284901 8348 0 815284902 8349 0 815284902 8350 0 815284902 8351 0 815284903 8352 0 815284903 8353 0 815284904 8354 0 815284904 8355 0 815284905 8356 0 815284905 8357 0 815284905 8358 0 815284906 8359 0 815284906 8360 0 815284906 8361 0 815284907 8362 0 815284907 8363 0 815284913 8364 0 815284913 8365 0 815284914 8366 0 815284914 8367 0 815284915 8368 0 815284915 8369 0 815284916 8370 0 815284916 8371 0 815284916 8372 0 815284917 8373 0 815284917 8374 0 815284917 8375 0 815284918 8376 0 815284918 8377 0 815284919 8378 0 815284919 8379 0 815284920 8380 0 815284920 8381 0 815284920 8382 0 815284921 8383 0 815284921 8384 0 815284922 8385 0 815284922 8386 0 815284922 8387 0 815284923 8388 0 815284923 8389 0 815284924 8390 0 815284924 8391 0 815284924 8392 0 815284925 8393 0 815284925 8394 0 815284926 8395 0 815284926 8396 0 815284926 8397 0 815284927 8398 0 815284928 8399 0 815284928 8400 0 815284928 8401 0 815284929 8402 0 815284929 8403 0 815284929 8404 0 815284930 8405 0 815284930 8406 0 815284931 8407 0 815284931 8408 0 815284932 8409 0 815284932 8410 0 815284932 8411 0 815284933 8412 0 815284933 8413 0 815284934 8414 0 815284934 2025-11-02T18:10:39Z INFO __main__ 149: generated L0 files: [PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0810727378-0810728276_V02_2509090773-65144.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0810725237-0810726088_V02_2509091030-65143.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0810728276-0810729954_V02_2509096596-65145.fits')] 2025-11-02T18:10:39Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20251021_001.tm 2025-11-02T18:10:39Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20251101_001.tm 2025-11-02T18:10:40Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0810727378-0810728276_V02_2509090773-65144.fits 2025-11-02T18:10:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2025-11-02T18:10:40Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0810725237-0810726088_V02_2509091030-65143.fits 2025-11-02T18:10:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2025-11-02T18:10:40Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0810728276-0810729954_V02_2509096596-65145.fits 2025-11-02T18:10:40Z INFO stixcore.soop.manager 484: Soop found: SOOP 2025-11-02T18:10:40Z INFO __main__ 153: generated L1 files: [PosixPath('/data/stix/out/fits_v1.2.0/L1/2025/09/09/SCI/solo_L1_stix-sci-xray-cpd_20250909T093226-20250909T094636_V02_2509091030-65143.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2025/09/09/SCI/solo_L1_stix-sci-xray-cpd_20250909T102304-20250909T105103_V02_2509096596-65145.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2025/09/09/SCI/solo_L1_stix-sci-xray-cpd_20250909T100806-20250909T102304_V02_2509090773-65144.fits')]