2024-12-10T10:31:38Z INFO __main__ 305:
PIPELINE VERSION
Version: 1.5.0
Common instrument config version: v0.1.5
PROCESSING VERSIONS
Prod: Ephemeris
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/ANC/aspect.py
Vers: 2
Prod: MiniReport
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py
Vers: 2
Prod: MaxiReport
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py
Vers: 2
Prod: LightCurve
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py
Vers: 2
Prod: Background
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py
Vers: 2
Prod: Spectra
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py
Vers: 2
Prod: Variance
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py
Vers: 2
Prod: FlareFlag
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py
Vers: 2
Prod: EnergyCalibration
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py
Vers: 2
Prod: TMStatusFlareList
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py
Vers: 2
Prod: RawPixelData
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py
Vers: 2
Prod: CompressedPixelData
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py
Vers: 2
Prod: SummedPixelData
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py
Vers: 2
Prod: Visibility
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py
Vers: 2
Prod: Spectrogram
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py
Vers: 2
Prod: Aspect
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py
Vers: 2
Prod: MiniReport
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py
Vers: 2
Prod: MaxiReport
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py
Vers: 2
Prod: LightCurve
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py
Vers: 2
Prod: Background
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py
Vers: 2
Prod: Spectra
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py
Vers: 2
Prod: Variance
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py
Vers: 2
Prod: FlareFlag
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py
Vers: 2
Prod: EnergyCalibration
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py
Vers: 2
Prod: TMStatusFlareList
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py
Vers: 2
Prod: RawPixelData
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py
Vers: 2
Prod: CompressedPixelData
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py
Vers: 2
Prod: SummedPixelData
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py
Vers: 2
Prod: Visibility
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py
Vers: 2
Prod: Spectrogram
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py
Vers: 2
Prod: Aspect
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py
Vers: 2
Prod: MiniReport
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py
Vers: 2
Prod: MaxiReport
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py
Vers: 2
Prod: LightCurve
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py
Vers: 2
Prod: Background
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py
Vers: 2
Prod: Spectra
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py
Vers: 2
Prod: Variance
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py
Vers: 2
Prod: FlareFlag
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py
Vers: 2
Prod: EnergyCalibration
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py
Vers: 2
Prod: TMStatusFlareList
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py
Vers: 2
Prod: LevelB
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py
Vers: 2
Prod: LightCurve
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py
Vers: 2
Prod: FlareFlag
File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py
Vers: 2
2024-12-10T10:31:38Z INFO __main__ 270:
CONFIG
[Paths]
tm_archive = /data/stix/SOLSOC/from_edds/tm/processing
fits_archive = /data/stix/out/fits_v1.2.0
spice_kernels = /data/stix/spice/kernels
soop_files = /data/stix/SOLSOC/from_soc
[Logging]
stop_on_error = False
[IDLBridge]
enabled = True
gsw_path = /opt/STIX-GSW
batchsize = 30
[Pipeline]
status_server_port = 12388
parallel_batchsize_l0 = 100
parallel_batchsize_l1 = 100
parallel_batchsize_l2 = 100
log_level = INFO
log_dir = /data/stix/out/fits_v1.2.0/logging
error_mail_send = True
error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie
error_mail_smpt_host = lmailer.fhnw.ch
error_mail_smpt_port = 25
error_mail_sender = nicky.hochmuth@fhnw.ch
start_with_unprocessed = True
last_processed = TM_BatchRequest.PktTmRaw.SOL.0.2023.305.15.33.13.852.bBWz@2023.352.21.00.01.039.1.xml.out
history_db_file = /home/stixcore/soar_pub/processing_history.sqlite
[Publish]
db_file = /home/stixcore/soar_pub/published.sqlite
include_levels = L0, L1, ANC
waiting_period = 21d
target_dir = /home/stixcore/from_pub099
report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie
report_mail_send = True
same_esa_name_dir = /data/stix/out/esa_conflicts
rid_lut_file = ./stixcore/data/publish/rid_lut.csv
rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/
batch_size = 20000
fits_dir = /data/stix/out/fits_v1.2.0
target_host = pub026.cs.technik.fhnw.ch
supplement_report = /home/stixcore/soar_pub/supplement_report.csv
include_products = ql,hk,sci,cal
log_dir = /data/stix/out/fits_v1.2.0/logging
[SOOP]
endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api
user = smaloney
password = xxxx
soop_files_download = ./stixcore/data/soop
2024-12-10T10:31:38Z INFO __main__ 301:
SINGLETONS
SOOPManager: /data/stix/SOLSOC/from_soc
RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 33727
SPICE: [(PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm'), 'pred', datetime.datetime(2024, 11, 27, 0, 0)), (PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm'), 'flown', datetime.datetime(2024, 12, 10, 0, 0))]
IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb
Versions:
[{'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}]
Force version: None
History:
IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')])
2024-12-10T10:31:39Z INFO stixcore.io.RidLutManager 158: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20241208/20250107
2024-12-10T10:31:39Z INFO stixcore.io.RidLutManager 167: found 2 entries
2024-12-10T10:31:40Z INFO stixcore.io.RidLutManager 176: write total 33727 entries to local storage
2024-12-10T10:31:40Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.49.08.986.LkVb@2024.345.00.00.03.328.1.xml')
2024-12-10T10:31:40Z INFO __main__ 495: Opened file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.49.08.986.LkVb@2024.345.00.00.03.328.1.xml
2024-12-10T10:31:40Z INFO __main__ 490: Closed read file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.49.08.986.LkVb@2024.345.00.00.03.328.1.xml
2024-12-10T10:31:40Z INFO __main__ 495: Opened file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.49.08.986.LkVb@2024.345.00.00.03.328.1.xml
2024-12-10T10:31:40Z INFO __main__ 490: Closed read file: /data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2024.339.08.49.08.986.LkVb@2024.345.00.00.03.328.1.xml
2024-12-10T10:31:40Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-30_0787017600_V02.fits exists appending data
2024-12-10T10:31:40Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-32_0787017600_V02.fits exists appending data
2024-12-10T10:31:40Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2410306241-50057.fits
2024-12-10T10:31:40Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-31_0787017600_V02.fits exists appending data
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-24_0000000000-9999999999_V02_2410292650-50055.fits exists appending data
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787017600_V02.fits
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787017600_V02.fits
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787017600_V02.fits
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-33_0787017600_V02.fits exists appending data
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-34_0787017600_V02.fits exists appending data
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2410292650-50055.fits
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/33/solo_LB_stix-21-6-33_0787017600_V02.fits
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2410305195-50056.fits
2024-12-10T10:31:41Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787017600_V02.fits
2024-12-10T10:31:41Z INFO __main__ 224: generated LB files:
{PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2410292650-50055.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2410305195-50056.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/24/solo_LB_stix-21-6-24_0000000000-9999999999_V02_2410306241-50057.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787017600_V02.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787017600_V02.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787017600_V02.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/33/solo_LB_stix-21-6-33_0787017600_V02.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787017600_V02.fits')}
2024-12-10T10:31:41Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite
2024-12-10T10:31:41Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite
2024-12-10T10:31:41Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite
2024-12-10T10:31:41Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite
2024-12-10T10:31:41Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:41Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:41Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:41Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:42Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:42Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv
2024-12-10T10:31:42Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:42Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv
2024-12-10T10:31:42Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:42Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv
2024-12-10T10:31:42Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:42Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv
2024-12-10T10:31:43Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/34/solo_LB_stix-21-6-34_0787017600_V02.fits
2024-12-10T10:31:43Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/31/solo_LB_stix-21-6-31_0787017600_V02.fits
2024-12-10T10:31:43Z WARNING stixcore.products.levelb.binary 322: Incomplete sequence <LevelB LB, 21, 6, 24 787103010:44307-787103612:47734>
sequence_count sequence_flag scet_coarse
-------------- ------------- -----------
5744 1 787103010
5745 0 787103070
5746 0 787103135
5747 0 787103199
5748 0 787103255
5749 0 787103308
5750 0 787103366
5751 0 787103414
5752 0 787103458
5753 0 787103501
5754 0 787103554
5755 0 787103612
2024-12-10T10:31:43Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/33/solo_LB_stix-21-6-33_0787017600_V02.fits
2024-12-10T10:31:43Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-variance_0786931200_V02U.fits exists appending data
2024-12-10T10:31:43Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-variance_0787017600_V02U.fits exists appending data
2024-12-10T10:31:43Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-background_0786931200_V02U.fits exists appending data
2024-12-10T10:31:44Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-background_0787017600_V02U.fits exists appending data
2024-12-10T10:31:44Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite
2024-12-10T10:31:44Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:44Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:44Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv
2024-12-10T10:31:44Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite
2024-12-10T10:31:44Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:45Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:45Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv
2024-12-10T10:31:45Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-flareflag_0786931200_V02U.fits exists appending data
2024-12-10T10:31:45Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-flareflag_0787017600_V02U.fits exists appending data
2024-12-10T10:31:45Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787017600_V02.fits
2024-12-10T10:31:45Z INFO stixcore.processing.LBtoL0 84: processing file: /data/stix/out/fits_v1.2.0/LB/21/6/30/solo_LB_stix-21-6-30_0787017600_V02.fits
2024-12-10T10:31:46Z ERROR stixcore.processing.LBtoL0 95: Error processing file /data/stix/out/fits_v1.2.0/LB/21/6/32/solo_LB_stix-21-6-32_0787017600_V02.fits for 21, 6, 32
Traceback (most recent call last):
File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/processing/LBtoL0.py", line 90, in process_tm_type
level0 = tmp.from_levelb(levelb, parent=file.name)
File "/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py", line 344, in from_levelb
control_indices = control_indices.reshape(-1, 32)
ValueError: cannot reshape array of size 1940 into shape (32)
2024-12-10T10:31:46Z ERROR stixcore.processing.LBtoL0 97: cannot reshape array of size 1940 into shape (32)
2024-12-10T10:31:47Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-lightcurve_0786931200_V02U.fits exists appending data
2024-12-10T10:31:48Z INFO stixcore.io.fits.processors 538: Fits file solo_L0_stix-ql-lightcurve_0787017600_V02U.fits exists appending data
2024-12-10T10:31:48Z INFO __main__ 228: generated L0 files:
[PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/33/solo_L0_stix-ql-variance_0787017600_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787017600_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/33/solo_L0_stix-ql-variance_0786931200_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0786931200_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787017600_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0783579042-0783600942_V02_2410305195-50056.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0783557442-0783579342_V02_2410292650-50055.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0786931200_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0786931200_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787017600_V02U.fits')]
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:49Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:49Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/33/solo_L0_stix-ql-variance_0787017600_V02U.fits
2024-12-10T10:31:49Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0787017600_V02U.fits
2024-12-10T10:31:49Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0786931200_V02U.fits
2024-12-10T10:31:49Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0787017600_V02U.fits
2024-12-10T10:31:50Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241209_V02U.fits exists appending data
2024-12-10T10:31:50Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:50Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:31:50Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-variance_20241209_V02U.fits exists appending data
2024-12-10T10:31:50Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241209_V02U.fits exists appending data
2024-12-10T10:31:51Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:51Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:31:51Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/31/solo_L0_stix-ql-background_0786931200_V02U.fits
2024-12-10T10:31:51Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/33/solo_L0_stix-ql-variance_0786931200_V02U.fits
2024-12-10T10:31:51Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-flareflag_20241208_V02U.fits exists appending data
2024-12-10T10:31:51Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:51Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:31:52Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:52Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241208_V02U.fits exists appending data
2024-12-10T10:31:52Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0786931200_V02U.fits
2024-12-10T10:31:53Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:53Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-variance_20241208_V02U.fits exists appending data
2024-12-10T10:31:53Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:54Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-flareflag_20241209_V02U.fits exists appending data
2024-12-10T10:31:54Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:54Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:31:54Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241208_V02U.fits exists appending data
2024-12-10T10:31:55Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-background_20241209_V02U.fits exists appending data
2024-12-10T10:31:55Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/34/solo_L0_stix-ql-flareflag_0787017600_V02U.fits
2024-12-10T10:31:55Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:55Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:31:56Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:31:56Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:31:56Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0783579042-0783600942_V02_2410305195-50056.fits
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 116, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-10-27 00:00:00+00:00, 2024-11-04 00:00:00+00:00>
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<CC6, 111, CC_OFFPOI_STAR, 2024-10-27 05:00:00+00:00, 2024-10-30 05:30:00+00:00>
2024-12-10T10:31:56Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-variance_20241209_V02U.fits exists appending data
2024-12-10T10:31:56Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/24/solo_L0_stix-sci-xray-spec_0783557442-0783579342_V02_2410292650-50055.fits
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 116, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-10-27 00:00:00+00:00, 2024-11-04 00:00:00+00:00>
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<CC6, 111, CC_OFFPOI_STAR, 2024-10-27 05:00:00+00:00, 2024-10-30 05:30:00+00:00>
2024-12-10T10:31:56Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-flareflag_20241209_V02U.fits exists appending data
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:31:56Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:31:59Z INFO stixcore.io.fits.processors 833: Fits file solo_L1_stix-ql-lightcurve_20241209_V02U.fits exists appending data
2024-12-10T10:32:00Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 118, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-02 00:00:00+00:00, 2024-12-09 00:50:58+00:00>
2024-12-10T10:32:00Z INFO stixcore.soop.manager 484: Soop found: SOOP<RF6, 119, R_FULL_LRES_LCAD_RS-Synoptics-High, 2024-12-09 00:00:00+00:00, 2024-12-16 01:19:20+00:00>
2024-12-10T10:32:01Z INFO __main__ 232: generated L1 files:
[PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/09/QL/solo_L1_stix-ql-variance_20241209_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/09/QL/solo_L1_stix-ql-background_20241209_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/09/QL/solo_L1_stix-ql-lightcurve_20241209_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/08/QL/solo_L1_stix-ql-background_20241208_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/09/QL/solo_L1_stix-ql-flareflag_20241209_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/08/QL/solo_L1_stix-ql-flareflag_20241208_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/10/29/SCI/solo_L1_stix-sci-xray-spec_20241029T225500-20241030T050000_V02_2410292650-50055.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/10/30/SCI/solo_L1_stix-sci-xray-spec_20241030T045500-20241030T110001_V02_2410305195-50056.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/08/QL/solo_L1_stix-ql-lightcurve_20241208_V02U.fits'),
PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/12/08/QL/solo_L1_stix-ql-variance_20241208_V02U.fits')]
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:32:01Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:32:01Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-variance FITS files.
2024-12-10T10:32:01Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-flareflag FITS files.
2024-12-10T10:32:02Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-flareflag FITS files.
2024-12-10T10:32:02Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-variance FITS files.
2024-12-10T10:32:02Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-background FITS files.
2024-12-10T10:32:02Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241127_004.tm
2024-12-10T10:32:02Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241210_001.tm
2024-12-10T10:32:02Z WARNING stixcore.processing.L1toL2 99: No L2 product match for product <Spectrogramxray-spec, L1
783557442:45875 to 783579342:26214, 1, 1919
2024-12-10T10:32:02Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-lightcurve FITS files.
2024-12-10T10:32:02Z WARNING stixcore.processing.L1toL2 99: No L2 product match for product <Spectrogramxray-spec, L1
783579042:26214 to 783600942:52428, 1, 3559
2024-12-10T10:32:03Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-background FITS files.
2024-12-10T10:32:04Z INFO stixcore.io.fits.processors 945: no writeout of L2 ql-lightcurve FITS files.
2024-12-10T10:32:04Z INFO __main__ 236: generated L2 files:
[]