2024-01-09T23:29:11Z INFO __main__ 290: PIPELINE VERSION Version: 1.2.0 PROCESSING VERSIONS Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/housekeepingL0.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/quicklookL0.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level0/scienceL0.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/housekeepingL1.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/quicklookL1.py Vers: 2 Prod: RawPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: CompressedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: SummedPixelData File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Visibility File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Spectrogram File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: Aspect File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level1/scienceL1.py Vers: 2 Prod: MiniReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: MaxiReport File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: Ephemeris File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/housekeepingL2.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Background File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Spectra File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: Variance File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: EnergyCalibration File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: TMStatusFlareList File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/level2/quicklookL2.py Vers: 2 Prod: LevelB File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/levelb/binary.py Vers: 2 Prod: LightCurve File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 Prod: FlareFlag File: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/products/lowlatency/quicklookLL.py Vers: 2 2024-01-09T23:29:11Z INFO __main__ 257: CONFIG [Paths] tm_archive = /data/stix/SOLSOC/from_edds/tm/processing fits_archive = /data/stix/out/fits_v1.2.0 spice_kernels = /data/stix/spice/kernels soop_files = /data/stix/SOLSOC/from_soc [Logging] stop_on_error = False [IDLBridge] enabled = True gsw_path = /opt/STIX-GSW batchsize = 30 [Pipeline] status_server_port = 12388 parallel_batchsize_l0 = 100 parallel_batchsize_l1 = 100 parallel_batchsize_l2 = 100 log_level = INFO log_dir = /data/stix/out/fits_v1.2.0/logging error_mail_send = True error_mail_receivers = nicky.hochmuth@ateleris.ch error_mail_smpt_host = lmailer.fhnw.ch error_mail_smpt_port = 25 error_mail_sender = nicky.hochmuth@fhnw.ch start_with_unprocessed = True [Publish] db_file = /home/stixcore/soar_pub/published.sqlite include_levels = L0, L1 waiting_period = 21d target_dir = /home/solsoc/to_soc report_mail_receivers = nicky.hochmuth@ateleris.ch report_mail_send = True same_esa_name_dir = /data/stix/out/esa_conflicts rid_lut_file = ./stixcore/data/publish/rid_lut.csv rid_lut_file_update_url = https://datacenter.stix.i4ds.net/api/bsd/info/ batch_size = 20000 fits_dir = /data/stix/out/fits_v1.2.0 target_host = pub026.cs.technik.fhnw.ch supplement_report = /home/stixcore/soar_pub/supplement_report.csv include_products = ql,hk,sci,cal log_dir = /data/stix/out/fits_v1.2.0/logging [SOOP] endpoint = https://solarorbiter.esac.esa.int/soopkitchen/api user = smaloney password = xxxx soop_files_download = ./stixcore/data/soop 2024-01-09T23:29:11Z INFO __main__ 286: SINGLETONS SOOPManager: /data/stix/SOLSOC/from_soc SPICE: [PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V110_20231215_002.tm'), PosixPath('/data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20240108_001.tm')] IDBManager: /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb Versions: [{'label': '2.26.37', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.37', 'version': ['2', '26', '37']}, {'label': '2.26.36', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36', 'version': ['2', '26', '36']}, {'label': '2.26.32', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.32', 'version': ['2', '26', '32']}, {'label': '2.26.34', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.34', 'version': ['2', '26', '34']}, {'label': '2.26.33', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.33', 'version': ['2', '26', '33']}, {'label': '2.26.31', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.31', 'version': ['2', '26', '31']}, {'label': '2.26.35', 'path': '/home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.35', 'version': ['2', '26', '35']}] Force version: None History: IntervalTree([Interval(0.0, 640198039.0, '2.26.32'), Interval(640198039.0, 640265396.0, '2.26.31'), Interval(640265396.0, 642159993.0, '2.26.32'), Interval(642159993.0, 643123725.0, '2.26.33'), Interval(643123725.0, 677774249.0, '2.26.34'), Interval(677774249.0, 692380776.0, '2.26.35'), Interval(692380776.0, 761270182.0, '2.26.36'), Interval(761270182.0, 4294967295.0, '2.26.37')]) 2024-01-09T23:29:11Z INFO stixcore.processing.TMTCtoLB 30: Processing file: SOCPacketFile('/data/stix/SOLSOC/from_edds/tm/processing/TM_BatchRequest.PktTmRaw.SOL.0.2023.305.14.56.07.361.cfoe@2023.361.16.00.00.810.2.xml') 2024-01-09T23:29:15Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311210367-64730.fits exists appending data 2024-01-09T23:29:16Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311210367-64730.fits 2024-01-09T23:29:16Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311209183-64726.fits exists appending data 2024-01-09T23:29:16Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311209183-64726.fits 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311200098-64724.fits exists appending data 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311200098-64724.fits 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311201085-64725.fits exists appending data 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311201085-64725.fits 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311213968-64727.fits exists appending data 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311213968-64727.fits 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311213129-64728.fits exists appending data 2024-01-09T23:29:17Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311213129-64728.fits 2024-01-09T23:29:18Z INFO stixcore.io.fits.processors 443: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311214571-64729.fits exists appending data 2024-01-09T23:29:18Z INFO stixcore.io.fits.processors 474: Writing fits file to /data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311214571-64729.fits 2024-01-09T23:29:18Z INFO __main__ 211: generated LB files: {PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311200098-64724.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311201085-64725.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311209183-64726.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311210367-64730.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311213129-64728.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311213968-64727.fits'), PosixPath('/data/stix/out/fits_v1.2.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V02_2311214571-64729.fits')} 2024-01-09T23:29:18Z INFO stixcore.idb.idb 522: IDB loaded from /home/stixcore/STIXCore/venv/lib/python3.9/site-packages/stixcore/data/idb/v2.26.36/idb.sqlite 2024-01-09T23:29:18Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-pred-mk_V110_20231215_002.tm 2024-01-09T23:29:18Z INFO stixcore.ephemeris.manager 179: LOADING NEW META KERNEL: /data/stix/spice/kernels/mk/solo_ANC_soc-flown-mk_V110_20240108_001.tm 2024-01-09T23:29:43Z INFO stixcore.io.fits.processors 533: Fits file solo_L0_stix-sci-xray-cpd_0753837528-0753845927_V02_2311209183-64726.fits exists appending data 2024-01-09T23:29:44Z INFO stixcore.processing.LBtoL0 117: Tried to combine 2 BSD products: sequence_count sequence_flag scet_coarse -------------- ------------- ----------- 541 0 756952440 542 0 756952441 543 0 756952442 544 0 756952442 545 0 756952443 546 0 756952443 547 0 756952444 548 0 756952444 549 0 756952445 550 0 756952446 551 0 756952446 552 0 756952446 553 0 756952447 554 0 756952447 555 0 756952448 556 0 756952448 557 0 756952449 558 0 756952449 559 0 756952450 560 0 756952450 561 0 756952451 562 0 756952451 563 0 756952452 564 0 756952452 565 0 756952452 566 0 756952453 567 0 756952454 568 0 756952454 569 0 756952455 570 0 756952455 571 0 756952456 572 0 756952456 573 0 756952456 574 0 756952457 575 0 756952458 576 0 756952458 577 0 756952459 578 0 756952459 579 0 756952460 580 0 756952460 581 0 756952461 582 0 756952461 583 0 756952462 584 0 756952462 585 0 756952463 586 0 756952463 587 0 756952464 588 0 756952464 589 0 756952465 590 0 756952465 591 0 756952466 592 0 756952466 593 0 756952467 594 0 756952467 595 0 756952468 596 0 756952468 597 0 756952469 598 0 756952469 599 0 756952470 600 0 756952470 601 0 756952471 602 0 756952471 603 0 756952472 604 0 756952472 605 0 756952472 606 0 756952473 607 0 756952474 608 0 756952474 609 0 756952480 610 0 756952480 611 0 756952481 612 0 756952482 613 0 756952482 614 0 756952483 615 0 756952483 616 0 756952483 617 0 756952484 618 0 756952484 619 0 756952485 620 0 756952485 621 0 756952486 622 0 756952486 623 0 756952487 624 0 756952487 625 0 756952488 626 0 756952488 627 0 756952489 628 0 756952489 629 0 756952490 630 0 756952490 631 0 756952491 632 0 756952491 633 0 756952491 634 0 756952492 635 0 756952492 636 0 756952493 637 0 756952494 638 0 756952494 639 0 756952495 640 0 756952495 641 0 756952495 642 0 756952496 643 0 756952496 644 0 756952497 645 0 756952498 646 0 756952498 647 0 756952499 648 0 756952499 649 0 756952499 650 0 756952500 651 0 756952500 652 0 756952501 653 0 756952502 654 0 756952502 655 0 756952503 656 0 756952503 657 0 756952503 658 0 756952504 659 0 756952504 660 0 756952505 661 0 756952505 662 0 756952506 663 0 756952506 664 0 756952507 665 0 756952507 666 0 756952508 667 0 756952508 668 0 756952509 669 0 756952510 670 0 756952510 671 0 756952511 672 0 756952511 673 0 756952512 674 0 756952512 675 0 756952513 676 0 756952513 677 0 756952514 678 0 756952514 679 0 756952515 680 0 756952515 681 0 756952516 682 0 756952522 683 0 756952522 684 0 756952523 685 0 756952523 686 0 756952524 687 0 756952524 688 0 756952525 689 0 756952526 690 0 756952526 691 0 756952527 692 0 756952527 693 0 756952528 694 0 756952528 695 0 756952529 696 0 756952530 697 0 756952531 698 0 756952531 699 0 756952532 700 0 756952532 701 0 756952533 702 0 756952534 703 0 756952534 704 0 756952535 705 0 756952535 706 0 756952536 707 0 756952536 708 0 756952538 709 0 756952538 710 0 756952538 711 0 756952539 712 0 756952540 713 0 756952540 714 0 756952541 715 0 756952542 716 0 756952542 717 0 756952543 718 0 756952543 719 0 756952550 720 0 756952550 721 0 756952551 722 0 756952552 723 0 756952552 724 0 756952553 725 0 756952554 726 0 756952554 727 0 756952554 728 0 756952555 729 0 756952555 730 0 756952556 731 0 756952557 732 0 756952558 733 0 756952558 734 0 756952558 735 0 756952559 736 0 756952560 737 0 756952560 738 0 756952561 739 0 756952562 740 0 756952562 741 0 756952563 742 0 756952564 743 0 756952564 744 0 756952564 745 0 756952565 746 0 756952566 747 0 756952566 748 0 756952567 749 0 756952567 750 0 756952568 751 0 756952568 752 0 756952568 753 0 756952569 754 0 756952570 755 0 756952570 756 0 756952571 757 0 756952571 758 0 756952572 759 0 756952578 760 0 756952578 761 0 756952579 762 0 756952579 763 0 756952580 764 0 756952580 765 0 756952581 766 0 756952582 767 0 756952582 768 0 756952582 769 0 756952583 770 0 756952583 771 0 756952584 772 0 756952584 773 0 756952585 774 0 756952586 775 0 756952586 776 0 756952587 777 0 756952587 778 0 756952588 779 0 756952588 780 0 756952589 781 0 756952589 782 0 756952590 783 0 756952590 784 0 756952591 785 0 756952591 786 0 756952592 787 0 756952592 788 0 756952593 789 0 756952594 790 0 756952594 791 0 756952595 792 0 756952596 793 0 756952596 794 0 756952596 795 0 756952597 796 0 756952598 797 0 756952599 798 0 756952599 799 0 756952600 800 0 756952600 801 0 756952601 802 0 756952602 803 0 756952608 804 0 756952608 805 0 756952609 806 0 756952610 807 0 756952611 808 0 756952611 809 0 756952612 810 0 756952612 811 0 756952613 812 0 756952614 813 0 756952614 814 0 756952615 815 0 756952615 816 0 756952616 817 0 756952617 818 0 756952618 819 0 756952618 820 0 756952619 821 0 756952619 822 0 756952620 823 0 756952620 824 0 756952621 825 0 756952622 826 0 756952622 827 0 756952623 828 0 756952623 829 0 756952624 830 0 756952624 831 0 756952625 832 0 756952626 833 0 756952636 834 0 756952636 835 0 756952637 836 0 756952638 837 0 756952638 838 0 756952639 839 0 756952640 840 0 756952640 841 0 756952641 842 0 756952642 843 0 756952642 844 0 756952643 845 0 756952643 846 0 756952644 847 0 756952644 848 0 756952645 849 0 756952646 850 0 756952647 851 0 756952647 852 0 756952648 853 0 756952648 854 0 756952649 855 0 756952650 856 0 756952650 857 0 756952651 858 0 756952652 859 0 756952652 860 0 756952653 861 0 756952654 862 0 756952654 863 0 756952660 864 0 756952661 865 0 756952662 866 0 756952662 867 0 756952663 868 0 756952664 869 0 756952664 870 0 756952664 871 0 756952665 872 0 756952666 873 2 756952666 2024-01-09T23:29:48Z INFO stixcore.io.fits.processors 533: Fits file solo_L0_stix-sci-xray-cpd_0753846041-0753846231_V02_2311213968-64727.fits exists appending data 2024-01-09T23:29:48Z INFO stixcore.processing.LBtoL0 117: Tried to combine 2 BSD products: