2025-07-01T18:00:05Z INFO __main__ 227: PIPELINE VERSION Version: 1.5.1 Common instrument config version: v0.1.6 PROCESSING VERSIONS Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/ANC/aspect.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 4 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 4 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2025-07-01T18:00:05Z INFO __main__ 274: Pipeline Server started at localhost:12388 2025-07-01T18:00:05Z INFO __main__ 192: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch sync_tm_at_start = True stop_after_unprocessed = True start_with_unprocessed = True last_processed = TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.184.14.18.45.363.hBFL@2024.200.08.00.00.905.1.xml.out history_db_file = /home/stixcore/soar_pub/processing_history.sqlite [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1, ANC waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal,asp log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2025-07-01T18:00:05Z INFO __main__ 223: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 35712 SPICE: [(PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20250701_004.tm'), 'pred', datetime.datetime(2025, 7, 1, 0, 0)), (PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20250701_003.tm'), 'flown', datetime.datetime(2025, 7, 1, 0, 0))] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2025-07-01T18:00:06Z INFO stixcore.io.RidLutManager 176: write total 35712 entries to local storage 2025-07-01T18:00:07Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2025.125.09.34.42.777.VuCw@2025.182.16.00.01.179.4.xml') 2025-07-01T18:00:07Z INFO stixcore.idb.idb 472: Creating IDB reader for: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:07Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:07Z INFO stixcore.idb.idb 472: Creating IDB reader for: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:07Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:07Z INFO stixcore.idb.idb 472: Creating IDB reader for: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:07Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:07Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2506107380-56887.fits 2025-07-01T18:00:07Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2506107380-56887.fits 2025-07-01T18:00:07Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2506096897-56886.fits 2025-07-01T18:00:07Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2506096897-56886.fits 2025-07-01T18:00:08Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2505276283-56892.fits 2025-07-01T18:00:08Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2505276283-56892.fits 2025-07-01T18:00:08Z INFO stixcore.io.fits.processors 480: start writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2505270279-56891.fits 2025-07-01T18:00:08Z INFO stixcore.io.fits.processors 483: done writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2505270279-56891.fits 2025-07-01T18:00:08Z INFO __main__ 145: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2505270279-56891.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2505276283-56892.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2506096897-56886.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2506107380-56887.fits')} 2025-07-01T18:00:08Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:08Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2025-07-01T18:00:08Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20250701_004.tm 2025-07-01T18:00:08Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20250701_004.tm 2025-07-01T18:00:08Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20250701_003.tm 2025-07-01T18:00:08Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2025-07-01T18:00:08Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20250701_003.tm 2025-07-01T18:00:08Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2025-07-01T18:00:10Z WARNING stixcore.products.levelb.binary 322: Incomplete sequence sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 3254 1 804586627 3255 0 804586629 3256 0 804586630 3257 0 804586631 3258 0 804586633 3259 0 804586639 3260 0 804586641 3261 0 804586642 3262 0 804586643 3263 0 804586644 3264 0 804586645 3265 0 804586646 3266 0 804586648 3267 0 804586654 3268 0 804586656 3269 0 804586657 3270 0 804586659 3271 0 804586659 3272 0 804586660 3273 0 804586661 3274 0 804586663 3275 0 804586669 3276 0 804586670 3277 0 804586671 3278 0 804586673 3279 0 804586673 3280 0 804586674 3281 0 804586675 3282 0 804586676 3283 0 804586677 3284 0 804586677 3285 0 804586681 3286 0 804586682 3287 0 804586683 3288 0 804586683 3289 0 804586685 3290 0 804586685 3291 0 804586686 3292 0 804586687 3293 0 804586689 3294 0 804586690 3295 0 804586697 3296 0 804586697 3297 0 804586698 3298 0 804586699 3299 0 804586700 3300 0 804586701 3301 0 804586702 3302 0 804586703 3303 0 804586705 3304 0 804586706 3305 0 804586706 3306 0 804586707 3307 0 804586714 3308 0 804586715 3309 0 804586717 3310 0 804586718 3311 0 804586719 3312 0 804586721 3313 0 804586721 3314 0 804586722 3315 0 804586729 3316 0 804586730 3317 0 804586731 3318 0 804586732 3319 0 804586733 3320 0 804586734 3321 0 804586735 3322 0 804586735 3323 0 804586737 3324 0 804586738 3325 0 804586744 3326 0 804586746 3327 0 804586747 3328 0 804586748 3329 0 804586750 3330 0 804586750 3331 0 804586751 3332 0 804586752 3333 0 804586753 3334 0 804586760 3335 0 804586762 3336 0 804586763 3337 0 804586763 3338 0 804586765 3339 0 804586765 3340 0 804586766 3341 0 804586767 3342 0 804586768 3343 0 804586769 3344 0 804586776 3345 0 804586777 3346 0 804586778 3347 0 804586778 3348 0 804586779 3349 0 804586781 3350 0 804586782 3351 0 804586783 3352 0 804586784 3353 0 804586786 3354 0 804586793 3355 0 804586794 3356 0 804586794 3357 0 804586795 3358 0 804586796 3359 0 804586797 3360 0 804586798 3361 0 804586799 3362 0 804586801 3363 0 804586802 3364 0 804586802 3365 0 804586809 3366 0 804586810 3367 0 804586811 3368 0 804586812 3369 0 804586813 2025-07-01T18:00:37Z INFO __main__ 149: generated L0 files: [PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0801645612-0801667204_V02_2505270279-56891.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0802825508-0802847409_V04_2506096897-56886.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0802847108-0802869024_V04_2506107380-56887.fits')] 2025-07-01T18:00:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20250701_004.tm 2025-07-01T18:00:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20250701_004.tm 2025-07-01T18:00:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20250701_003.tm 2025-07-01T18:00:38Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20250701_003.tm 2025-07-01T18:00:38Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0802825508-0802847409_V04_2506096897-56886.fits 2025-07-01T18:00:38Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0801645612-0801667204_V02_2505270279-56891.fits 2025-07-01T18:00:38Z INFO stixcore.soop.manager 484: Soop found: SOOP 2025-07-01T18:00:38Z INFO stixcore.soop.manager 484: Soop found: SOOP 2025-07-01T18:00:38Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0802847108-0802869024_V04_2506107380-56887.fits 2025-07-01T18:00:38Z INFO stixcore.soop.manager 484: Soop found: SOOP 2025-07-01T18:00:38Z INFO __main__ 153: generated L1 files: [PosixPath('/data/stix/out/fits_v1.2.0/L1/2025/06/09/SCI/solo_L1_stix-sci-xray-spec_20250609T231001-20250610T051503_V04_2506096897-56886.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2025/06/10/SCI/solo_L1_stix-sci-xray-spec_20250610T051002-20250610T111518_V04_2506107380-56887.fits'), PosixPath('/data/stix/out/fits_v1.2.0/L1/2025/05/27/SCI/solo_L1_stix-sci-xray-cpd_20250527T072504-20250527T132456_V02_2505270279-56891.fits')]