2024-10-25T18:47:46Z INFO __main__ 304: PIPELINE VERSION Version: 1.4.1 Common instrument config version: v0.1.5 PROCESSING VERSIONS Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-10-25T18:47:46Z INFO __main__ 269: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch start_with_unprocessed = True [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1 waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-10-25T18:47:46Z INFO __main__ 300: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 33579 SPICE: [PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241023_002.tm'), PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241025_001.tm')] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.37', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.37', 'version': ['2', '26', '37']}, {'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2024-10-25T18:47:46Z INFO stixcore.io.RidLutManager 154: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20241016/20241115 2024-10-25T18:47:46Z INFO stixcore.io.RidLutManager 163: found 8 entries 2024-10-25T18:47:48Z INFO stixcore.io.RidLutManager 172: write total 33579 entries to local storage 2024-10-25T18:47:48Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.184.14.24.04.504.mvXX@2024.299.16.00.02.524.5.xml') 2024-10-25T18:47:52Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408217314-62862.fits exists appending data 2024-10-25T18:47:53Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408217314-62862.fits 2024-10-25T18:47:53Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408207461-62863.fits exists appending data 2024-10-25T18:47:54Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408207461-62863.fits 2024-10-25T18:47:54Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408211230-62861.fits exists appending data 2024-10-25T18:47:55Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408211230-62861.fits 2024-10-25T18:47:55Z INFO __main__ 223: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408207461-62863.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408211230-62861.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408217314-62862.fits')} 2024-10-25T18:47:55Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-10-25T18:47:55Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241023_002.tm 2024-10-25T18:47:55Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241025_001.tm 2024-10-25T18:47:55Z INFO stixcore.io.RidLutManager 174: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-10-25T18:48:18Z INFO stixcore.io.fits.processors 534: Fits file solo_L0_stix-sci-xray-cpd_0777599164-0777599664_V02_2408217314-62862.fits exists appending data 2024-10-25T18:48:18Z INFO stixcore.processing.LBtoL0 121: Tried to combine 2 BSD products: sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 8871 0 782620179 8872 0 782620181 8873 0 782620181 8874 0 782620182 8875 0 782620182 8876 0 782620183 8877 0 782620184 8878 0 782620192 8879 0 782620193 8880 0 782620193 8881 0 782620194 8882 0 782620195 8883 0 782620196 8884 0 782620196 8885 0 782620197 8886 0 782620198 8887 0 782620199 8888 0 782620200 8889 0 782620200 8890 0 782620201 8891 0 782620202 8892 0 782620203 8893 0 782620203 8894 0 782620204 8895 0 782620205 8896 0 782620206 8897 0 782620207 8898 0 782620207 8899 0 782620215 8900 0 782620215 8901 0 782620217 8902 0 782620217 8903 0 782620218 8904 0 782620218 8905 0 782620219 8906 0 782620221 8907 0 782620221 8908 0 782620222 8909 0 782620222 8910 0 782620224 8911 0 782620224 8912 0 782620225 8913 0 782620225 8914 0 782620226 8915 0 782620231 8916 0 782620231 8917 0 782620232 8918 0 782620233 8919 0 782620234 8920 0 782620234 8921 0 782620235 8922 0 782620235 8923 0 782620243 8924 0 782620245 8925 0 782620245 8926 0 782620246 8927 0 782620246 8928 0 782620247 8929 0 782620248 8930 0 782620249 8931 0 782620249 8932 0 782620250 8933 0 782620252 8934 0 782620252 8935 0 782620253 8936 0 782620253 8937 0 782620255 8938 0 782620255 8939 0 782620256 8940 0 782620257 8941 0 782620258 8942 0 782620266 8943 0 782620266 8944 0 782620268 8945 0 782620268 8946 0 782620269 8947 0 782620270 8948 0 782620271 8949 0 782620271 8950 0 782620273 8951 0 782620274 8952 0 782620274 8953 0 782620275 8954 0 782620275 8955 0 782620277 8956 0 782620277 8957 0 782620278 8958 0 782620278 8959 0 782620280 8960 0 782620281 8961 0 782620282 8962 0 782620290 8963 0 782620290 8964 0 782620292 8965 0 782620292 8966 0 782620293 8967 0 782620294 8968 0 782620295 8969 0 782620296 8970 0 782620296 8971 0 782620298 8972 0 782620298 8973 0 782620299 8974 0 782620300 8975 0 782620301 8976 0 782620301 8977 0 782620302 8978 0 782620304 8979 0 782620304 8980 0 782620305 8981 0 782620305 8982 0 782620314 8983 0 782620314 8984 0 782620315 8985 0 782620316 8986 0 782620317 8987 0 782620318 8988 0 782620318 8989 0 782620320 8990 0 782620320 8991 0 782620321 8992 0 782620321 8993 0 782620322 8994 0 782620323 8995 0 782620324 8996 0 782620325 8997 0 782620326 8998 0 782620327 8999 0 782620327 9000 0 782620329 9001 0 782620329 9002 0 782620337 9003 0 782620338 9004 0 782620339 9005 0 782620341 9006 0 782620341 9007 0 782620342 9008 0 782620343 9009 0 782620345 9010 0 782620345 9011 0 782620346 9012 0 782620347 9013 0 782620349 9014 0 782620350 9015 0 782620350 9016 0 782620358 9017 0 782620359 9018 0 782620360 9019 0 782620361 9020 0 782620362 9021 0 782620362 9022 0 782620364 9023 0 782620365 9024 0 782620365 9025 0 782620367 9026 0 782620367 9027 0 782620369 9028 0 782620369 9029 0 782620370 9030 0 782620370 9031 0 782620372 9032 0 782620380 9033 0 782620381 9034 0 782620382 9035 0 782620382 9036 0 782620384 9037 0 782620384 9038 0 782620385 9039 0 782620386 9040 0 782620387 9041 0 782620388 9042 0 782620388 9043 0 782620389 9044 0 782620389 9045 0 782620389 9046 0 782620389 9047 0 782620390 9048 0 782620390 9049 0 782620391 9050 0 782620398 9051 0 782620398 9052 0 782620399 9053 0 782620400 9054 0 782620401 9055 0 782620402 9056 0 782620403 9057 0 782620403 9058 0 782620405 9059 0 782620406 9060 0 782620406 9061 0 782620407 9062 0 782620408 9063 0 782620409 9064 0 782620409 9065 0 782620411 9066 0 782620411 9067 0 782620412 9068 0 782620420 9069 0 782620421 9070 0 782620422 9071 0 782620422 9072 0 782620424 9073 0 782620424 9074 0 782620425 9075 0 782620426 9076 0 782620427 9077 0 782620428 9078 0 782620428 9079 0 782620429 9080 0 782620430 9081 0 782620431 9082 0 782620431 9083 0 782620433 9084 0 782620433 9085 0 782620434 9086 0 782620442 9087 0 782620443 9088 0 782620444 9089 0 782620445 9090 0 782620446 9091 0 782620446 9092 0 782620447 9093 0 782620448 9094 0 782620449 9095 0 782620450 9096 0 782620450 9097 0 782620451 9098 0 782620452 9099 0 782620453 9100 0 782620453 9101 0 782620454 9102 0 782620455 9103 0 782620456 9104 0 782620457 9105 0 782620457 9106 0 782620466 9107 0 782620466 9108 0 782620467 9109 0 782620468 9110 0 782620469 9111 0 782620469 9112 0 782620470 9113 0 782620472 9114 0 782620472 9115 0 782620473 9116 0 782620473 9117 0 782620475 9118 0 782620475 9119 0 782620476 9120 0 782620477 9121 0 782620478 9122 0 782620479 9123 0 782620479 9124 0 782620480 9125 0 782620481 9126 0 782620482 9127 0 782620482 9128 0 782620490 9129 0 782620490 9130 0 782620492 9131 0 782620493 9132 0 782620493 9133 0 782620494 9134 0 782620494 9135 0 782620496 9136 0 782620496 9137 0 782620497 9138 0 782620497 9139 0 782620498 9140 0 782620499 9141 0 782620500 9142 0 782620501 9143 0 782620501 9144 0 782620502 9145 0 782620503 9146 0 782620504 9147 0 782620504 9148 0 782620505 9149 0 782620506 9150 0 782620507 9151 0 782620515 9152 0 782620515 9153 0 782620516 9154 0 782620517 9155 0 782620518 9156 0 782620518 9157 0 782620519 9158 0 782620520 9159 0 782620520 9160 0 782620521 9161 0 782620522 9162 0 782620523 9163 0 782620523 9164 0 782620524 9165 0 782620525 9166 0 782620526 9167 0 782620526 9168 0 782620527 9169 0 782620528 9170 0 782620528 9171 0 782620529 9172 0 782620530 9173 0 782620531 9174 0 782620531 9175 0 782620532 9176 0 782620540 9177 0 782620541 9178 0 782620541 9179 0 782620542 9180 0 782620543 9181 0 782620543 9182 0 782620544 9183 0 782620545 9184 0 782620546 9185 0 782620546 9186 0 782620547 9187 0 782620548 9188 0 782620548 9189 0 782620549 9190 0 782620550 9191 0 782620550 9192 0 782620551 9193 0 782620552 9194 0 782620553 9195 0 782620553 9196 0 782620554 9197 0 782620555 9198 0 782620556 9199 0 782620556 9200 0 782620557 9201 0 782620557 9202 0 782620558 9203 0 782620566 9204 0 782620566 9205 0 782620567 9206 0 782620568 9207 0 782620569 9208 0 782620569 9209 0 782620570 9210 0 782620570 9211 0 782620571 9212 0 782620573 9213 0 782620573 9214 0 782620574 9215 0 782620574 9216 0 782620575 9217 0 782620575 9218 0 782620576 9219 0 782620577 9220 0 782620578 9221 0 782620579 9222 0 782620579 9223 0 782620580 9224 0 782620581 9225 0 782620581 9226 0 782620582 9227 0 782620583 9228 0 782620583 9229 0 782620584 9230 0 782620592 9231 0 782620592 9232 0 782620593 9233 0 782620594 9234 0 782620594 9235 0 782620595 9236 0 782620596 9237 0 782620596 9238 0 782620597 9239 0 782620598 9240 0 782620598 9241 0 782620599 9242 0 782620600 9243 0 782620601 9244 0 782620601 9245 0 782620602 9246 0 782620602 9247 0 782620603 9248 0 782620604 9249 0 782620604 9250 0 782620605 9251 0 782620605 9252 0 782620606 9253 0 782620607 9254 0 782620608 9255 0 782620608 9256 0 782620609 9257 0 782620610 9258 0 782620610 9259 0 782620611 9260 0 782620611 9261 0 782620619 9262 0 782620620 9263 0 782620621 9264 0 782620621 9265 0 782620622 9266 0 782620623 9267 0 782620623 9268 0 782620624 9269 0 782620625 9270 0 782620625 9271 0 782620626 9272 0 782620627 9273 0 782620627 9274 0 782620628 9275 0 782620629 9276 0 782620629 9277 0 782620630 9278 0 782620630 9279 0 782620631 9280 0 782620632 9281 0 782620633 9282 0 782620633 9283 0 782620634 9284 0 782620635 9285 0 782620635 9286 0 782620636 9287 0 782620637 9288 0 782620637 9289 0 782620638 9290 0 782620639 9291 0 782620639 9292 0 782620640 9293 0 782620648 9294 0 782620648 9295 0 782620649 9296 0 782620650 9297 0 782620650 9298 0 782620651 9299 0 782620652 9300 0 782620652 9301 0 782620653 9302 0 782620654 9303 0 782620654 9304 0 782620655 9305 0 782620656 9306 0 782620657 9307 0 782620657 9308 0 782620658 9309 0 782620658 9310 0 782620659 9311 0 782620660 9312 0 782620661 9313 0 782620662 9314 0 782620662 9315 0 782620663 9316 0 782620663 9317 0 782620664 9318 0 782620665 9319 0 782620666 9320 0 782620667 9321 0 782620667 9322 0 782620675 9323 0 782620675 9324 0 782620676 9325 0 782620676 9326 0 782620677 9327 0 782620678 9328 0 782620679 9329 0 782620680 9330 0 782620680 9331 0 782620681 9332 0 782620681 9333 0 782620685 9334 0 782620686 9335 0 782620687 9336 0 782620687 9337 0 782620688 9338 0 782620689 9339 0 782620689 9340 0 782620690 9341 0 782620691 9342 0 782620692 9343 0 782620692 9344 0 782620693 9345 0 782620693 9346 0 782620694 9347 0 782620695 9348 0 782620695 9349 0 782620697 9350 0 782620697 9351 0 782620698 9352 0 782620698 9353 0 782620706 9354 0 782620706 9355 0 782620707 9356 0 782620708 9357 0 782620709 9358 0 782620710 9359 0 782620710 9360 0 782620711 9361 0 782620711 9362 0 782620712 9363 0 782620713 9364 0 782620714 9365 0 782620714 9366 0 782620715 9367 0 782620716 9368 0 782620716 9369 0 782620717 9370 0 782620718 9371 0 782620722 9372 0 782620722 9373 0 782620723 9374 0 782620724 9375 0 782620725 9376 0 782620726 9377 0 782620726 9378 0 782620727 9379 0 782620727 9380 0 782620728 9381 0 782620728 9382 0 782620736 9383 0 782620737 9384 0 782620738 9385 0 782620738 9386 0 782620739 9387 0 782620740 9388 0 782620740 9389 0 782620741 9390 0 782620742 9391 0 782620742 9392 0 782620743 9393 0 782620744 9394 0 782620745 9395 0 782620745 9396 0 782620746 9397 0 782620746 9398 0 782620747 9399 0 782620748 9400 0 782620749 9401 0 782620750 9402 0 782620750 9403 0 782620751 9404 0 782620751 9405 0 782620753 9406 0 782620753 9407 0 782620754 9408 0 782620754 9409 0 782620755 9410 0 782620763 9411 0 782620763 9412 0 782620764 9413 0 782620765 9414 0 782620766 9415 0 782620766 9416 0 782620767 9417 0 782620767 9418 0 782620768 9419 0 782620769 9420 0 782620769 9421 0 782620770 9422 0 782620771 9423 0 782620772 9424 0 782620772 9425 0 782620773 9426 0 782620773 9427 0 782620774 9428 0 782620775 9429 0 782620776 9430 0 782620777 9431 0 782620777 9432 0 782620778 9433 0 782620778 9434 0 782620779 9435 0 782620780 9436 0 782620781 9437 0 782620782 9438 0 782620782 9439 0 782620790 9440 0 782620790 9441 0 782620791 9442 0 782620791 9443 0 782620792 9444 0 782620793 9445 0 782620793 9446 0 782620794 9447 0 782620795 9448 0 782620796 9449 0 782620796 9450 0 782620797 9451 0 782620797 9452 0 782620798 9453 0 782620798 9454 0 782620799 9455 0 782620800 9456 0 782620801 9457 0 782620802 9458 0 782620802 9459 0 782620803 9460 0 782620803 9461 0 782620804 9462 0 782620805 9463 0 782620805 9464 0 782620806 9465 0 782620806 9466 0 782620807 9467 0 782620808 9468 0 782620809 9469 0 782620809 9470 0 782620810 9471 0 782620810 9472 0 782620818 9473 0 782620819 9474 0 782620820 9475 0 782620820 9476 0 782620821 9477 0 782620821 9478 0 782620822 9479 0 782620823 9480 0 782620823 9481 0 782620824 9482 0 782620825 9483 0 782620825 9484 0 782620826 9485 0 782620826 9486 0 782620827 9487 0 782620828 9488 0 782620829 9489 0 782620829 9490 0 782620830 9491 0 782620830 9492 0 782620831 9493 0 782620832 9494 0 782620832 9495 0 782620833 9496 0 782620833 9497 0 782620834 9498 0 782620834 9499 0 782620835 9500 0 782620836 9501 0 782620837 9502 0 782620837 9503 0 782620838 9504 0 782620838 9505 0 782620839 9506 0 782620846 9507 0 782620847 9508 0 782620848 9509 0 782620849 9510 0 782620849 9511 0 782620850 9512 0 782620850 9513 0 782620851 9514 0 782620851 9515 0 782620853 9516 0 782620853 9517 0 782620854 9518 0 782620855 9519 0 782620855 9520 0 782620856 9521 0 782620856 9522 0 782620857 9523 0 782620857 9524 0 782620858 9525 0 782620858 9526 0 782620859 9527 0 782620860 9528 0 782620861 9529 0 782620862 9530 0 782620862 9531 0 782620863 9532 0 782620863 9533 0 782620864 9534 0 782620865 9535 0 782620865 9536 0 782620866 9537 0 782620867 9538 0 782620868 9539 0 782620868 9540 0 782620876 9541 0 782620876 9542 0 782620877 9543 0 782620877 9544 0 782620878 9545 0 782620879 9546 0 782620879 9547 0 782620880 9548 0 782620881 9549 0 782620882 9550 0 782620882 9551 0 782620883 9552 0 782620883 9553 0 782620884 9554 0 782620885 9555 0 782620885 9556 0 782620886 9557 0 782620886 9558 0 782620887 9559 0 782620888 9560 0 782620889 9561 0 782620889 9562 0 782620890 9563 0 782620890 9564 0 782620891 9565 0 782620892 9566 0 782620892 9567 0 782620893 9568 0 782620893 9569 0 782620894 9570 0 782620894 9571 0 782620895 9572 0 782620896 9573 0 782620896 9574 0 782620897 9575 0 782620897 9576 0 782620898 9577 0 782620898 9578 0 782620906 9579 0 782620907 9580 0 782620908 9581 0 782620908 9582 0 782620909 9583 0 782620909 9584 0 782620910 9585 0 782620910 9586 0 782620911 9587 0 782620912 9588 0 782620912 9589 0 782620913 9590 0 782620914 9591 0 782620914 9592 0 782620915 9593 0 782620915 9594 0 782620916 9595 0 782620916 9596 0 782620917 9597 0 782620917 9598 0 782620918 9599 0 782620919 9600 0 782620919 9601 0 782620920 9602 0 782620920 9603 0 782620921 9604 0 782620921 9605 0 782620922 9606 0 782620923 9607 0 782620923 9608 2 782620924 2024-10-25T18:49:27Z INFO __main__ 227: generated L0 files: [] 2024-10-25T18:49:27Z INFO __main__ 231: generated L1 files: [] 2024-10-25T18:49:27Z INFO __main__ 235: generated L2 files: [] 2024-10-28T01:26:24Z INFO __main__ 304: PIPELINE VERSION Version: 1.4.1 Common instrument config version: v0.1.5 PROCESSING VERSIONS Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-10-28T01:26:24Z INFO __main__ 269: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch start_with_unprocessed = True [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1 waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-10-28T01:26:24Z INFO __main__ 300: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 33579 SPICE: [PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241023_002.tm'), PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241027_001.tm')] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.37', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.37', 'version': ['2', '26', '37']}, {'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2024-10-28T01:26:25Z INFO stixcore.io.RidLutManager 154: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20241016/20241115 2024-10-28T01:26:25Z INFO stixcore.io.RidLutManager 163: found 8 entries 2024-10-28T01:26:26Z INFO stixcore.io.RidLutManager 172: write total 33579 entries to local storage 2024-10-28T01:26:26Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.184.14.24.04.504.mvXX@2024.299.16.00.02.524.5.xml') 2024-10-28T01:26:31Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408217314-62862.fits exists appending data 2024-10-28T01:26:31Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408217314-62862.fits 2024-10-28T01:26:31Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408207461-62863.fits exists appending data 2024-10-28T01:26:32Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408207461-62863.fits 2024-10-28T01:26:32Z INFO stixcore.io.fits.processors 444: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408211230-62861.fits exists appending data 2024-10-28T01:26:33Z INFO stixcore.io.fits.processors 475: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408211230-62861.fits 2024-10-28T01:26:33Z INFO __main__ 223: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408207461-62863.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408211230-62861.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2408217314-62862.fits')} 2024-10-28T01:26:33Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-10-28T01:26:33Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241023_002.tm 2024-10-28T01:26:34Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241027_001.tm 2024-10-28T01:26:34Z INFO stixcore.io.RidLutManager 174: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-10-28T01:26:58Z INFO stixcore.io.fits.processors 534: Fits file solo_L0_stix-sci-xray-cpd_0777599164-0777599664_V02_2408217314-62862.fits exists appending data 2024-10-28T01:26:58Z INFO stixcore.processing.LBtoL0 121: Tried to combine 2 BSD products: