2023-07-26T09:01:07Z INFO __main__ 253: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.0.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.0.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch start_with_unprocessed = True [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1 waiting_period = 21d target_dir = /home/solsoc/to_soc report_mail_receivers = nicky.hochmuth@ateleris.ch report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.0.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.0.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2023-07-26T09:01:07Z INFO __main__ 270: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc SPICE: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20230725_002.tm IDBManager: /home/stixcore/STIXCore/stixcore/data/idb Versions: [{'label': '2.26.36', 'path': '/home/stixcore/STIXCore/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 4294967295.0, '2.26.36')]) 2023-07-26T09:01:07Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/STIX_TM_11AM_BatchRequest.PktTmRaw.SOL.0.2023.121.21.06.49.605.UXYb@2023.191.11.00.01.069.3.xml') 2023-07-26T09:01:08Z INFO stixcore.io.fits.processors 404: Fits file solo_LB_stix-21-6-32_0742262400_V01.fits exists appending data 2023-07-26T09:01:08Z INFO stixcore.io.fits.processors 404: Fits file solo_LB_stix-21-6-30_0742262400_V01.fits exists appending data 2023-07-26T09:01:08Z INFO stixcore.io.fits.processors 435: Writing fits file to /data/stix/out/fits_v1.0.0/LB/21/6/32/solo_LB_stix-21-6-32_0742262400_V01.fits 2023-07-26T09:01:08Z INFO stixcore.io.fits.processors 435: Writing fits file to /data/stix/out/fits_v1.0.0/LB/21/6/30/solo_LB_stix-21-6-30_0742262400_V01.fits 2023-07-26T09:01:08Z INFO stixcore.io.fits.processors 435: Writing fits file to /data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2305105735-56930.fits 2023-07-26T09:01:08Z INFO __main__ 207: generated LB files: {PosixPath('/data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2305105735-56930.fits'), PosixPath('/data/stix/out/fits_v1.0.0/LB/21/6/30/solo_LB_stix-21-6-30_0742262400_V01.fits'), PosixPath('/data/stix/out/fits_v1.0.0/LB/21/6/32/solo_LB_stix-21-6-32_0742262400_V01.fits')} 2023-07-26T09:01:08Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/stixcore/data/idb/v2.26.36/idb.sqlite 2023-07-26T09:01:08Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/stixcore/data/idb/v2.26.36/idb.sqlite 2023-07-26T09:01:08Z INFO stixcore.ephemeris.manager 160: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20230725_002.tm 2023-07-26T09:01:08Z INFO stixcore.ephemeris.manager 160: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20230725_002.tm 2023-07-26T09:01:08Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/stixcore/data/idb/v2.26.36/idb.sqlite 2023-07-26T09:01:08Z INFO stixcore.ephemeris.manager 160: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20230725_002.tm 2023-07-26T09:01:08Z INFO stixcore.processing.LBtoL0 80: processing file: /data/stix/out/fits_v1.0.0/LB/21/6/32/solo_LB_stix-21-6-32_0742262400_V01.fits 2023-07-26T09:01:08Z INFO stixcore.processing.LBtoL0 80: processing file: /data/stix/out/fits_v1.0.0/LB/21/6/30/solo_LB_stix-21-6-30_0742262400_V01.fits 2023-07-26T09:01:08Z WARNING stixcore.products.levelb.binary 318: Incomplete sequence sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 5498 0 742297038 5499 0 742297039 5500 0 742297047 5501 0 742297049 5502 0 742297050 5503 0 742297051 5504 0 742297052 5505 0 742297054 5506 0 742297054 5507 0 742297056 5508 0 742297056 5509 0 742297058 5510 0 742297067 5511 0 742297067 5512 0 742297069 5513 0 742297069 5514 0 742297071 5515 0 742297071 5516 0 742297073 5517 0 742297074 5518 0 742297076 5519 0 742297084 5520 0 742297084 5521 0 742297087 5522 0 742297087 5523 0 742297089 5524 0 742297090 5525 0 742297091 5526 0 742297092 5527 0 742297094 5528 0 742297095 5529 0 742297096 5530 0 742297104 5531 0 742297105 5532 0 742297107 5533 0 742297107 5534 0 742297110 5535 0 742297110 5536 0 742297111 5537 0 742297114 5538 0 742297114 5539 0 742297116 5540 0 742297116 5541 0 742297124 5542 0 742297125 5543 0 742297127 5544 0 742297127 5545 0 742297129 5546 0 742297131 5547 0 742297131 5548 0 742297133 5549 0 742297134 5550 0 742297142 5551 0 742297142 5552 0 742297144 5553 0 742297144 5554 0 742297146 5555 0 742297148 5556 0 742297149 5557 0 742297151 5558 0 742297151 5559 0 742297152 5560 0 742297153 5561 0 742297162 5562 0 742297162 5563 0 742297167 5564 0 742297169 5565 0 742297169 5566 0 742297171 5567 0 742297171 5568 0 742297173 5569 0 742297174 5570 0 742297175 5571 0 742297176 5572 0 742297184 5573 0 742297186 5574 0 742297186 5575 0 742297188 5576 0 742297188 5577 0 742297190 5578 0 742297190 5579 0 742297192 5580 0 742297192 5581 0 742297194 5582 0 742297203 5583 0 742297203 5584 0 742297204 5585 0 742297205 5586 0 742297207 5587 0 742297207 5588 0 742297209 5589 0 742297209 5590 0 742297211 5591 0 742297213 5592 0 742297213 5593 0 742297215 5594 0 742297215 5595 0 742297223 5596 0 742297224 5597 0 742297226 5598 0 742297226 5599 0 742297227 5600 0 742297229 5601 0 742297230 5602 0 742297231 5603 0 742297232 5604 0 742297233 5605 0 742297234 5606 0 742297235 5607 0 742297236 5608 0 742297244 5609 0 742297245 5610 0 742297246 5611 0 742297247 5612 0 742297248 5613 0 742297249 5614 0 742297250 5615 0 742297251 5616 0 742297251 5617 0 742297253 5618 0 742297255 5619 0 742297255 5620 0 742297263 5621 0 742297263 5622 0 742297264 5623 0 742297265 5624 0 742297266 5625 0 742297267 5626 0 742297268 5627 0 742297270 5628 0 742297270 5629 0 742297272 5630 0 742297272 5631 0 742297274 5632 0 742297274 5633 0 742297275 5634 0 742297276 5635 0 742297283 5636 0 742297285 5637 0 742297286 5638 0 742297287 5639 0 742297287 5640 0 742297289 5641 0 742297289 5642 0 742297291 5643 0 742297291 5644 0 742297292 5645 0 742297294 5646 0 742297294 5647 0 742297296 5648 0 742297296 5649 0 742297304 5650 0 742297305 5651 0 742297306 5652 0 742297307 5653 0 742297308 5654 0 742297310 5655 0 742297310 5656 0 742297312 5657 0 742297312 5658 0 742297313 5659 0 742297314 5660 0 742297315 5661 0 742297315 5662 0 742297317 5663 0 742297325 5664 0 742297325 5665 0 742297327 5666 0 742297327 5667 0 742297328 5668 0 742297328 5669 0 742297330 5670 0 742297330 5671 0 742297332 5672 0 742297333 5673 0 742297334 5674 0 742297335 5675 0 742297335 5676 0 742297337 5677 0 742297337 5678 0 742297338 5679 0 742297339 5680 0 742297347 5681 0 742297348 5682 0 742297349 5683 0 742297350 5684 0 742297350 5685 0 742297352 5686 0 742297352 5687 0 742297354 5688 0 742297354 5689 0 742297355 5690 0 742297356 5691 0 742297357 5692 0 742297358 5693 0 742297359 5694 0 742297360 5695 0 742297360 5696 0 742297369 5697 0 742297369 5698 0 742297370 5699 0 742297372 5700 0 742297372 5701 0 742297374 5702 0 742297374 5703 0 742297375 5704 0 742297375 5705 0 742297377 5706 0 742297377 5707 0 742297378 5708 0 742297380 5709 0 742297380 5710 0 742297382 5711 0 742297382 5712 0 742297390 5713 0 742297390 5714 0 742297391 5715 0 742297392 5716 0 742297393 5717 0 742297394 5718 0 742297395 5719 0 742297396 5720 0 742297396 5721 0 742297398 5722 0 742297398 5723 0 742297399 5724 0 742297400 5725 0 742297401 5726 0 742297402 5727 0 742297403 5728 0 742297410 5729 0 742297411 5730 0 742297412 5731 0 742297412 5732 0 742297414 5733 0 742297414 5734 0 742297415 5735 0 742297416 5736 0 742297417 5737 0 742297418 5738 0 742297418 5739 0 742297420 5740 0 742297420 5741 0 742297421 5742 0 742297422 5743 0 742297423 5744 0 742297424 5745 0 742297424 5746 0 742297432 5747 0 742297432 5748 0 742297434 5749 0 742297434 5750 0 742297435 5751 0 742297436 5752 0 742297437 5753 0 742297438 5754 0 742297439 5755 0 742297440 5756 0 742297440 5757 0 742297442 5758 0 742297442 5759 0 742297443 5760 0 742297443 5761 0 742297444 5762 0 742297446 5763 0 742297446 5764 0 742297457 5765 0 742297457 5766 0 742297459 5767 0 742297459 5768 0 742297460 5769 0 742297461 5770 0 742297462 5771 0 742297463 5772 0 742297463 5773 0 742297465 5774 0 742297465 5775 0 742297467 5776 0 742297467 5777 0 742297468 5778 0 742297468 5779 0 742297470 5780 0 742297471 5781 0 742297471 5782 0 742297479 5783 0 742297479 5784 0 742297480 5785 0 742297481 5786 0 742297482 5787 0 742297483 5788 0 742297484 5789 0 742297485 5790 0 742297485 5791 0 742297486 5792 0 742297487 5793 0 742297488 5794 0 742297488 5795 0 742297490 5796 0 742297490 5797 0 742297491 5798 0 742297492 5799 0 742297493 5800 0 742297494 5801 0 742297495 5802 0 742297502 5803 0 742297503 5804 0 742297504 5805 0 742297504 5806 0 742297506 5807 0 742297507 5808 0 742297507 5809 0 742297508 5810 0 742297508 5811 0 742297510 5812 0 742297510 5813 0 742297511 5814 0 742297512 5815 0 742297513 5816 0 742297514 5817 0 742297514 5818 0 742297516 5819 0 742297516 5820 0 742297517 5821 0 742297518 5822 0 742297525 5823 0 742297526 5824 0 742297527 5825 0 742297528 5826 0 742297528 5827 0 742297530 5828 0 742297530 5829 0 742297531 5830 0 742297531 5831 0 742297532 5832 0 742297533 5833 0 742297534 5834 0 742297535 5835 0 742297535 5836 0 742297536 5837 0 742297537 5838 0 742297538 5839 0 742297539 5840 0 742297540 5841 0 742297540 5842 0 742297541 5843 0 742297549 5844 0 742297549 5845 0 742297550 5846 0 742297551 5847 0 742297552 5848 0 742297552 5849 0 742297554 5850 0 742297554 5851 2 742297554 2023-07-26T09:01:08Z ERROR stixcore.processing.LBtoL0 91: Error processing file /data/stix/out/fits_v1.0.0/LB/21/6/32/solo_LB_stix-21-6-32_0742262400_V01.fits for 21, 6, 32 Traceback (most recent call last): File "/home/stixcore/STIXCore/stixcore/processing/LBtoL0.py", line 86, in process_tm_type level0 = tmp.from_levelb(levelb, parent=file.name) File "/home/stixcore/STIXCore/stixcore/products/level0/quicklookL0.py", line 304, in from_levelb control_indices = control_indices.reshape(-1, 32) ValueError: cannot reshape array of size 1068 into shape (32) 2023-07-26T09:01:08Z ERROR stixcore.processing.LBtoL0 93: cannot reshape array of size 1068 into shape (32) 2023-07-26T09:01:09Z INFO stixcore.io.fits.processors 484: Fits file solo_L0_stix-ql-lightcurve_0742262400_V01.fits exists appending data 2023-07-26T09:01:09Z INFO __main__ 211: generated L0 files: [PosixPath('/data/stix/out/fits_v1.0.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0742262400_V01.fits')] 2023-07-26T09:01:09Z INFO stixcore.ephemeris.manager 160: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20230725_002.tm 2023-07-26T09:01:09Z INFO stixcore.processing.L0toL1 89: processing file: /data/stix/out/fits_v1.0.0/L0/21/6/30/solo_L0_stix-ql-lightcurve_0742262400_V01.fits 2023-07-26T09:01:10Z INFO stixcore.io.fits.processors 772: Fits file solo_L1_stix-ql-lightcurve_20230710_V01.fits exists appending data 2023-07-26T09:01:10Z INFO stixcore.soop.manager 482: No soops found for time: 2023-07-09 23:59:59.814430 - 2023-07-10 10:39:48.181275 2023-07-26T09:01:10Z INFO __main__ 215: generated L1 files: [PosixPath('/data/stix/out/fits_v1.0.0/L1/2023/07/10/QL/solo_L1_stix-ql-lightcurve_20230710_V01.fits')] 2023-07-26T09:01:10Z INFO stixcore.ephemeris.manager 160: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20230725_002.tm 2023-07-26T09:01:11Z INFO stixcore.io.fits.processors 858: no writeout of L2 ql-lightcurve FITS files. 2023-07-26T09:01:11Z INFO __main__ 219: generated L2 files: []