2024-12-26T00:07:41Z INFO __main__ 300: PIPELINE VERSION Version: 1.5.0 Common instrument config version: v0.1.5 PROCESSING VERSIONS Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/ANC/aspect.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-12-26T00:07:41Z INFO __main__ 265: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch sync_tm_at_start = True stop_after_unprocessed = True start_with_unprocessed = True last_processed = TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.184.14.18.45.363.hBFL@2024.200.08.00.00.905.1.xml.out history_db_file = /home/stixcore/soar_pub/processing_history.sqlite [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1, ANC waiting_period = 21d target_dir = /home/stixcore/from_pub099 report_mail_receivers = nicky.hochmuth@ateleris.ch, shane.maloney@dias.ie report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-12-26T00:07:41Z INFO __main__ 296: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc RidLutManager: file: stixcore/data/publish/rid_lut.csv update: True size: 33782 SPICE: [(PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm'), 'pred', datetime.datetime(2024, 12, 13, 0, 0)), (PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241225_002.tm'), 'flown', datetime.datetime(2024, 12, 25, 0, 0))] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.38', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38', 'version': ['2', '26', '38']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.38')]) 2024-12-26T00:07:41Z INFO stixcore.io.RidLutManager 158: download publish lut file: https://datacenter.stix.i4ds.net/api/bsd/info/20241215/20250114 2024-12-26T00:07:41Z INFO stixcore.io.RidLutManager 167: found 6 entries 2024-12-26T00:07:42Z INFO stixcore.io.RidLutManager 176: write total 33782 entries to local storage 2024-12-26T00:07:43Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_hourly_req_BatchRequest.PktTmRaw.SOL.0.2024.339.09.54.17.445.aciH@2024.360.18.00.02.974.2.xml') 2024-12-26T00:07:44Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2411082945-51008.fits 2024-12-26T00:07:44Z INFO stixcore.io.fits.processors 448: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2411083225-51007.fits exists appending data 2024-12-26T00:07:45Z INFO stixcore.io.fits.processors 479: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2411083225-51007.fits 2024-12-26T00:07:45Z INFO __main__ 218: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2411082945-51008.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2411083225-51007.fits')} 2024-12-26T00:07:45Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.38/idb.sqlite 2024-12-26T00:07:45Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-26T00:07:45Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241225_002.tm 2024-12-26T00:07:45Z INFO stixcore.io.RidLutManager 178: read rid-lut from stixcore/data/publish/rid_lut.csv 2024-12-26T00:07:46Z WARNING stixcore.products.levelb.binary 322: Incomplete sequence sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 12947 1 788429462 12948 0 788429462 12949 0 788429463 12950 0 788429465 12951 0 788429466 12952 0 788429468 12953 0 788429469 12954 0 788429477 12955 0 788429478 12956 0 788429479 12957 0 788429481 12958 0 788429485 12959 0 788429486 12960 0 788429488 12961 0 788429489 12962 0 788429491 12963 0 788429500 12964 0 788429500 12965 0 788429501 12966 0 788429503 12967 0 788429504 12968 0 788429506 12969 0 788429507 12970 0 788429509 12971 0 788429510 12972 0 788429510 12973 0 788429518 12974 0 788429521 12975 0 788429526 12976 0 788429538 12977 0 788429542 12978 0 788429553 12979 0 788429557 12980 0 788429560 12981 0 788429560 12982 0 788429569 12983 0 788429571 12984 0 788429573 12985 0 788429574 12986 0 788429576 12987 0 788429577 12988 0 788429585 12989 0 788429586 12990 0 788429587 12991 0 788429589 12992 0 788429590 12993 0 788429592 12994 0 788429593 12995 0 788429594 12996 0 788429598 12997 0 788429598 12998 0 788429599 12999 0 788429600 13000 0 788429601 13001 0 788429602 13002 0 788429604 13003 0 788429605 13004 0 788429606 13005 0 788429607 13006 0 788429608 13007 0 788429616 13008 0 788429617 13009 0 788429619 13010 0 788429620 13011 0 788429622 13012 0 788429623 13013 0 788429624 13014 0 788429625 13015 0 788429626 13016 0 788429634 13017 0 788429638 13018 0 788429640 13019 0 788429641 13020 0 788429642 13021 0 788429644 13022 0 788429645 13023 0 788429645 13024 0 788429646 13025 0 788429648 13026 0 788429656 13027 0 788429657 13028 0 788429659 13029 0 788429660 13030 0 788429662 13031 0 788429665 13032 0 788429665 13033 0 788429674 13034 0 788429676 13035 0 788429678 13036 0 788429679 13037 0 788429680 13038 0 788429686 13039 0 788429689 13040 0 788429689 13041 0 788429693 13042 0 788429702 13043 0 788429706 13044 0 788429710 13045 0 788429721 13046 0 788429726 13047 0 788429737 13048 0 788429742 13049 0 788429742 13050 0 788429752 13051 0 788429760 13052 0 788429765 13053 0 788429773 13054 0 788429776 13055 0 788429789 13056 0 788429794 13057 0 788429795 13058 0 788429807 13059 0 788429812 13060 0 788429823 13061 0 788429828 13062 0 788429838 13063 0 788429842 13064 0 788429853 13065 0 788429857 13066 0 788429857 13067 0 788429861 13068 0 788429871 13069 0 788429872 13070 0 788429874 13071 0 788429881 13072 0 788429884 13073 0 788429887 13074 0 788429887 13075 0 788429889 13076 0 788429897 13077 0 788429897 13078 0 788429898 13079 0 788429899 13080 0 788429901 13081 0 788429910 13082 0 788429912 13083 0 788429912 13084 0 788429914 13085 0 788429916 13086 0 788429917 13087 0 788429926 13088 0 788429928 13089 0 788429930 13090 0 788429931 13091 0 788429932 13092 0 788429933 13093 0 788429935 13094 0 788429936 13095 0 788429944 13096 0 788429946 13097 0 788429947 13098 0 788429948 13099 0 788429950 13100 0 788429950 13101 0 788429951 13102 0 788429952 13103 0 788429956 13104 0 788429957 13105 0 788429958 13106 0 788429959 13107 0 788429961 13108 0 788429961 13109 0 788429962 13110 0 788429964 13111 0 788429965 13112 0 788429966 13113 0 788429974 13114 0 788429976 13115 0 788429981 13116 0 788429992 13117 0 788429992 13118 0 788429996 13119 0 788429999 13120 0 788430012 13121 0 788430014 13122 0 788430017 13123 0 788430020 13124 0 788430030 13125 0 788430030 13126 0 788430033 13127 0 788430036 13128 0 788430045 13129 0 788430046 13130 0 788430049 13131 0 788430050 13132 0 788430052 13133 0 788430061 13134 0 788430061 13135 0 788430063 13136 0 788430065 13137 0 788430066 13138 0 788430068 13139 0 788430070 13140 0 788430082 13141 0 788430084 13142 0 788430084 13143 0 788430086 13144 0 788430088 13145 0 788430089 13146 0 788430091 13147 0 788430092 13148 0 788430095 13149 0 788430096 13150 0 788430098 13151 0 788430098 13152 0 788430100 13153 0 788430101 13154 0 788430103 13155 0 788430112 13156 0 788430114 13157 0 788430116 13158 0 788430117 13159 0 788430117 13160 0 788430118 13161 0 788430120 13162 0 788430121 13163 0 788430122 13164 0 788430130 13165 0 788430131 13166 0 788430132 13167 0 788430132 13168 0 788430132 13169 0 788430133 13170 0 788430133 13171 0 788430134 13172 0 788430134 13173 0 788430134 13174 0 788430142 13175 0 788430144 13176 0 788430144 13177 0 788430145 13178 0 788430146 13179 0 788430148 13180 0 788430149 13181 0 788430150 13182 0 788430151 13183 0 788430152 13184 0 788430153 13185 0 788430154 13186 0 788430161 13187 0 788430162 13188 0 788430164 13189 0 788430165 13190 0 788430166 13191 0 788430168 13192 0 788430169 13193 0 788430169 13194 0 788430171 13195 0 788430178 13196 0 788430180 13197 0 788430181 13198 0 788430182 13199 0 788430183 13200 0 788430184 13201 0 788430186 13202 0 788430186 13203 0 788430187 13204 0 788430188 13205 0 788430189 13206 0 788430194 13207 0 788430194 13208 0 788430194 13209 0 788430196 13210 0 788430196 13211 0 788430197 13212 0 788430198 13213 0 788430199 13214 0 788430200 13215 0 788430202 13216 0 788430210 13217 0 788430212 13218 0 788430213 13219 0 788430213 13220 0 788430215 13221 0 788430216 13222 0 788430218 13223 0 788430219 13224 0 788430225 13225 0 788430225 13226 0 788430226 13227 0 788430226 13228 0 788430227 13229 0 788430228 13230 0 788430230 13231 0 788430240 13232 0 788430243 13233 0 788430246 13234 0 788430257 13235 0 788430262 13236 0 788430262 13237 0 788430274 13238 0 788430278 13239 0 788430289 13240 0 788430294 13241 0 788430305 13242 0 788430309 13243 0 788430315 13244 0 788430315 13245 0 788430320 13246 0 788430334 13247 0 788430340 13248 0 788430352 13249 0 788430357 13250 0 788430369 13251 0 788430373 13252 0 788430376 13253 0 788430377 13254 0 788430387 13255 0 788430390 13256 0 788430401 13257 0 788430403 13258 0 788430405 13259 0 788430411 13260 0 788430414 13261 0 788430414 13262 0 788430417 13263 0 788430419 13264 0 788430423 13265 0 788430425 13266 0 788430427 13267 0 788430429 13268 0 788430438 13269 0 788430440 13270 0 788430440 13271 0 788430442 13272 0 788430444 13273 0 788430446 13274 0 788430450 13275 0 788430451 13276 0 788430453 13277 0 788430455 13278 0 788430455 13279 0 788430457 2024-12-26T00:08:17Z INFO __main__ 222: generated L0 files: [PosixPath('/data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0784338941-0784360540_V02_2411083225-51007.fits')] 2024-12-26T00:08:17Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V111_20241213_002.tm 2024-12-26T00:08:17Z INFO stixcore.ephemeris.manager 198: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V111_20241225_002.tm 2024-12-26T00:08:17Z INFO stixcore.processing.L0toL1 90: processing file: /data/stix/out/fits_v1.2.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0784338941-0784360540_V02_2411083225-51007.fits 2024-12-26T00:08:17Z INFO stixcore.soop.manager 484: Soop found: SOOP 2024-12-26T00:08:17Z INFO __main__ 226: generated L1 files: [PosixPath('/data/stix/out/fits_v1.2.0/L1/2024/11/08/SCI/solo_L1_stix-sci-xray-cpd_20241108T000001-20241108T060000_V02_2411083225-51007.fits')]