ISDC END OF REVOLUTION REPORT (NRT)
REVOLUTION 1140 - Report of Feb 16, 2012
Perigee Passage at start : 2012-02-13T04:51:00
Perigee Passage at end : 2012-02-16T04:39:19
Radiation Belt exit : 60368 km (ijd 4426.3832)
Radiation Belt entrance : 23133 km (ijd 4429.1488)
Operations Coordinator : Carlo Ferrigno
Pipeline Operator : Ph.M.
Scientist on Duty : Adam Frankowski
S/W version : isdc-core-sw-0.3_2011-08-08T09:21:05
-----------
1. Planning summary
===================
1.1 General remarks
a) JEM-X 1 and 2 on.
b) 2012-02-13T07:48: IBIS DPE oems received, CSSW has unknown structure.
MOC switched off IBIS at 13:28, then stand-by at 13:52. Then IBIS IASW restarted, a
memory dump was run overnight, results were as expected.
c) 2012-02-14T15:54: Pointing 45 lost.
d) 2012-02-14T19:30: IBIS was back in science mode, until 21:30.At 21:03, On Event
messages were generated indicating a correction problem to MCE7. MOC decided to
leave this and wait for the next exposure to complete, which executed OK. However in
the subsequent exposure the same OEMs were generated together with some Out of Limits
related to MCE7 communications and Voltages, these events were not related to the
BCPKT. Therefore IBIS was put in Safe Mode again.
Pointings affected: NO IBIS DATA from SCW 114000080010 to 114000450010, and from
SCW 114000500010 to 114000610010.
e) 2012-02-15T06:49: Maintenance at MOC, 2 long telemetry gaps affecting pointings 60,
61 and 62.
f) 2012-02-16T00:33: Pointings 77, 78 missed, wrong attitude.
1.2 Pointings summary
Remarks: Only Science Windows (ScWs) of type 'pointing' are considered.
- Exposures info from POD version 2. Pointings info from TSF version 2.
- Durations given in the executed/planned format; data gaps and bad time intervals not
excluded from total durations.
- Deviations: only unexpected deviations >30 secs for pointings assigned to an exposure
are reported; expected deviations (first & last pointings of an exposure longer than
planned) not reported.
- Exposure 11400001: 'GPS-Scan-9', GPS (10x2200s)
10 pointings: 11400002 -> 11400011, 22050s/22000s (+49s)
- Exposure 11400002: 'GPS-Scan-9', GPS (7x2200s)
7 pointings: 11400012 -> 11400018, 15193s/15400s (-3m26s)
- Exposure 11400003: 'GPS-Scan-9', GPS (10x2200s)
10 pointings: 11400019 -> 11400028, 21855s/22000s (-2m25s)
- Exposure 11400004: 'GPS-Scan-9', GPS (4x2200s)
4 pointings: 11400029 -> 11400032, 10416s/8800s (+26m56s)
- Exposure 11400005: 'Gal. Bulge region', hexagon (7x1800s)
7 pointings: 11400034 -> 11400040, 12712s/12600s (+1m52s)
- Exposure 11400006: 'RX J1713.7-3946', 5x5 (4x3334s)
4 pointings: 11400042 -> 11400045, 10044s/13336s (-54m52s)
Deviations:
11400045 40/3334s: see 1.1.c)
- Exposure 11400007: 'RX J1713.7-3946', 5x5 (23x3334s)
23 pointings: 11400046 -> 11400068, 78680s/76682s (+33m17s)
Deviations:
11400060 4964/3334s: see 1.1.e)
11400061 4880/3334s: see 1.1.e)
11400062 410/3334s: see 1.1.e)
- Exposure 11400008: 'LMC/SN 1987A', 5x5 (9x3530s)
9 pointings: 11400070 -> 11400078, 32455s/31770s (+11m24s)
Deviations:
11400077 3252/3530s: see 1.1.f)
- Pointings with no assigned Exposure
6 pointings: 11400001, 0033, 0041, 0069, 0079, 0080, 5188s/4145s (+17m22s)
2. NRT Data processing
======================
2.1 Telemetry
* Start reception: 2012-02-13T06:01:14
End reception: 2012-02-16T03:28:57
* TM gaps of more than 30 seconds:
2012-02-13T07:22:44
2012-02-14T09:26:39
2012-02-14T20:27:40
2012-02-14T21:23:11
2012-02-15T01:18:52 - 2012-02-15T01:28:43
2012-02-15T06:49:12 - 2012-02-15T08:09:00
2012-02-15T08:26:54 - 2012-02-15T09:30:20
2012-02-15T11:45:35
2012-02-15T12:24:17
2012-02-15T13:05:37
2012-02-15T19:22:05
* Frames missed:
2012-02-13T07:22:44 807 frames missed (3469502103 to 3469502909)
2012-02-14T09:26:40 691 frames missed (3471011452 to 3471012142)
2012-02-14T20:27:40 791 frames missed (3471645548 to 3471646338)
2012-02-14T21:23:12 626 frames missed (3471699021 to 3471699646)
2012-02-15T01:18:52 699 frames missed (3471925192 to 3471925890)
2012-02-15T01:28:43 235 frames missed (3471934545 to 3471934779)
2012-02-15T01:28:44 511 frames missed (3471934850 to 3471935360)
2012-02-15T08:09:07 76261 frames missed (3472243265 to 3472319525)
2012-02-15T09:30:22 11368 frames missed (3472336128 to 3472347495)
2012-02-15T11:45:36 563 frames missed (3472475396 to 3472475958)
2012-02-15T12:24:18 760 frames missed (3472512354 to 3472513113)
2012-02-15T13:05:38 529 frames missed (3472552262 to 3472552790)
2012-02-15T19:22:06 619 frames missed (3472913583 to 3472914201)
* ERT not in sync with UTC:
ERT (2012-02-13T09:14:06.352) not in sync with UTC: UTC-ERT = 79752.4 seconds
ERT (2012-02-13T22:16:27.333) not in sync with UTC: UTC-ERT = 32816.5 seconds
ERT (2012-02-13T22:28:33.836) not in sync with UTC: UTC-ERT = 32090.1 seconds
ERT (2012-02-13T22:50:20.966) not in sync with UTC: UTC-ERT = 30783.2 seconds
ERT (2012-02-13T09:14:06.352) not in sync with UTC: UTC-ERT = 79785.6 seconds
ERT (2012-02-13T18:20:15.641) not in sync with UTC: UTC-ERT = 47019.5 seconds
ERT (2012-02-13T09:14:06.352) not in sync with UTC: UTC-ERT = 79800.4 seconds
ERT (2012-02-13T17:10:58.117) not in sync with UTC: UTC-ERT = 51193.8 seconds
ERT (2012-02-13T17:23:08.121) not in sync with UTC: UTC-ERT = 50464.0 seconds
ERT (2012-02-13T19:05:07.280) not in sync with UTC: UTC-ERT = 44345.8 seconds
ERT (2012-02-13T09:14:06.352) not in sync with UTC: UTC-ERT = 79814.8 seconds
ERT (2012-02-13T19:51:11.669) not in sync with UTC: UTC-ERT = 41595.0 seconds
ERT (2012-02-13T20:11:46.675) not in sync with UTC: UTC-ERT = 40360.1 seconds
ERT (2012-02-13T20:19:02.802) not in sync with UTC: UTC-ERT = 39924.1 seconds
ERT (2012-02-13T23:38:46.101) not in sync with UTC: UTC-ERT = 27942.7 seconds
ERT (2012-02-13T09:14:06.352) not in sync with UTC: UTC-ERT = 79828.1 seconds
ERT (2012-02-13T13:32:07.784) not in sync with UTC: UTC-ERT = 64349.4 seconds
ERT (2012-02-13T20:57:46.437) not in sync with UTC: UTC-ERT = 37614.2 seconds
ERT (2012-02-13T21:07:27.690) not in sync with UTC: UTC-ERT = 37033.1 seconds
ERT (2012-02-14T01:10:46.245) not in sync with UTC: UTC-ERT = 22359.0 seconds
ERT (2012-02-14T06:04:54.537) not in sync with UTC: UTC-ERT = 4764.2 seconds
ERT (2012-02-14T06:33:57.790) not in sync with UTC: UTC-ERT = 3021.0 seconds
ERT (2012-02-14T06:37:35.541) not in sync with UTC: UTC-ERT = 2803.5 seconds
ERT (2012-02-14T04:28:04.276) not in sync with UTC: UTC-ERT = 10600.3 seconds
ERT (2012-02-14T04:47:26.403) not in sync with UTC: UTC-ERT = 9438.2 seconds
ERT (2012-02-14T05:04:23.280) not in sync with UTC: UTC-ERT = 8421.6 seconds
* Statistics: Mean Rate: 15.44 frames/sec (mean)
Frames: 3861404 total Packets: 3867550 total
: 0 missed : 4376757 missed
: 1925208 TM : 3850416 TM
: 1936196 idle : 0 tcmd
: 0 invalid : 17134 time
: 0 idle
: 0 invalid
* Errors:
NCTRSFRAME: invalid quality = 256 (should be 0 or 1):
2012-02-14T07:23:17 - 2012-02-14T07:24:46
2012-02-14T10:41:56 - 2012-02-14T10:42:43
2012-02-14T18:29:18 - 2012-02-14T18:29:22
2012-02-15T09:44:44 - 2012-02-15T09:46:35
2012-02-16T01:11:54
End of File on RTTM socket:
2012-02-15T06:49:28
2012-02-15T08:51:42 - 2012-02-15T09:29:15
2.2 Auxiliary files summary
POD OPP TSF PAF OLF ASF AHF THF ORB REVNO
-----------------------------------------------------------
1 1 1 1 72 84 1 71 1 1
2.3 Pre-processing
* Frequent errors for days 2012-02-13, 2012-02-14, 2012-02-15, respectively:
6 3 14 "Histogram rejected"
0 0 3303 "OBT found too much higher"
2 1 4 "packet(s) of the Histogram are discarded"
0 2 2 "Can not store the Histogram"
0 0 0 "SpiSpectrum, decompression failed"
0 0 0 "SpiSpectrumParser, Failure"
2.4 OPUS Pipelines processing
* REV: completed | errors * INPUT/SCW: completed | errors
------------------------------- ----------------------------
IREM : 70 | 0 168 | 0
ISGRI_cal : 10 | 0
ISGRI_noise: 90 | 0
IBIS_veto : 18 | 0 * QLA completed | errors
PICsIT_cal : 18 | 0 -----------------------------
JMX : 258 | 0 IBIS : 82 | 0
ilt : 1 | 0 JEMX-1 : " | 0
Archiving : 1 | 0 JEMX-2 : " | 0
2.5 ISGRI context table
2012-02-15T08:30: IIMG_SDCMOC_D20120213092512_00001.INT sent to MOC
2012-02-15T12:09: IIMG_SDCMOC_D20120213092512_00002.INT sent to MOC
2nd version delivered by Saclay
3. Alerts
=========
3.1 All alerts except OOLs and missing scientific data
* Level 3:
101 Can't (re)connect to MOC (ECONNREFUSED). Line OK. TM transmitter not responding
2012-02-15T06:49:40
2012-02-15T07:49:41
2012-02-15T09:29:27
-> see 1.1.e)
* Level 2:
603 The pointing hasn't increased by one. From 44 to 9500
From aux file: 1140_0048_ASF
Convert attitude RRRR=1140 ROW=48. Missing pointing ?
603 The pointing hasn't increased by one. From 44 to 46
From aux file: 1140_0001_AHF
Convert attitude RRRR=1140 ROW=1860. Missing pointing ?
-> see 1.1.c)
603 The pointing hasn't increased by one. From 76 to 9501
From file: 1140_0081_ASF
Convert attitude RRRR=1140 ROW=80. Missing pointing ?
603 The pointing hasn't increased by one. From 77 to 9501
From file: 1140_0001_AHF
Convert attitude RRRR=1140 ROW=3115. Missing pointing ?
-> see 1.1.f)
These alerts occurred only after first restart of IBIS:
3001 Received 4th IBIS dump for revolution 1140.
Program / version that has created this alert: Pipeline - Rev IDP (NRT)
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214120205_00_idp
3001 Received 5th IBIS dump for revolution 1140.
Program / version that has created this alert: Pipeline - Rev IDP (NRT)
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214164137_00_idp
3021 HEPI differs for PICsIT GAIN Single/Multiple (on 2012-02-14T10:31:34)
Program / version that has created this alert: ibis_hepi_dump_decod 2.1
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214103134_00_idp
1296 pixels out of 4096 with different gain
3022 HEPI differs for PICsIT OFFSET Single/Multiple (on 2012-02-14T10:31:34)
Program / version that has created this alert: ibis_hepi_dump_decod 2.1
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214103134_00_idp
1296 pixels out of 4096 with different offset
3023 HEPI differs for PICsIT GAIN Calibration (on 2012-02-14T10:31:34)
Program / version that has created this alert: ibis_hepi_dump_decod 2.1
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214103134_00_idp
4096 pixels out of 4096 with different gain
3024 HEPI differs for PICsIT OFFSET Calibration (on 2012-02-14T10:31:34)
Program / version that has created this alert: ibis_hepi_dump_decod 2.1
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214103134_00_idp
4096 pixels out of 4096 with different offset
3036 LUT1 differs for ISGRI pixel gain/offset (on 2012-02-14T11:00:57)
Program / version that has created this alert: ibis_iasw_dump_decod 2.1
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214110057_00_idp
16384 rows out of 16384 are different (100%)
3037 LUT2 differs for ISGRI charge-loss table (on 2012-02-14T11:00:57)
Program / version that has created this alert: ibis_iasw_dump_decod 2.1
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120214110057_00_idp
1248 rows out of 2048 are different ( 61%)
* Level 1:
604 Exposure time is 42 sec. instead of 3334 sec.
Pointing ID (BCPPID): 11400045
-> see 1.1.c)
604 Exposure time is 4967 sec. instead of 3334 sec.
Pointing ID (BCPPID): 11400060
604 Exposure time is 4880 sec. instead of 3334 sec.
Pointing ID (BCPPID): 11400061
604 Exposure time is 402 sec. instead of 3334 sec.
Pointing ID (BCPPID): 11400062
-> see 1.1.e)
604 Exposure time is 3251 sec. instead of 3530 sec.
Pointing ID (BCPPID): 11400077
-> see 1.1.f)
605 IBIS: The mode differ for 2027 sec. from the planning
ScW: 114000080010 - 114000450010 and 114000500010 - 114000610010
-> see 1.1.b) & 1.1.d)
3041 Check NEW context from orbit 1140 (on 2012-02-13T09:25:12)
Program / version that has created this alert: ibis_isgr_low_thres 6.4
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120213092512_00_ilt
Number of DEAD: 739 (limit is 730)
Number NEW DEAD: 9 (limit is 9)
-> e-mail to AS
5022 Electronic calibration: 1 amplifier(s) changed slope value
Program / version that has created this alert: j_calib_adc 2.2
Directory of alert generation:
/export/isdc/run/pipelines/nrt/nrtrev/scratch/1140_20120213091150_00_j2e
JMX2: Revolution 1140 electronic calibration:
Amp(s) changed slope significantly: VETO4
3.2 Parameter out of limits
IBIS:
-----
Science Window ID: 114000460010,114000470010
P0E_MM1TEMP[1-4]
P0E_MM2TEMP[1-4]
P0E_MM5TEMP[1-4]
P0E_MM6TEMP[1-4]
P0E_MM7TEMP[1-4]
I0E_MTEMP1_MMDU4
-> due to IBIS restart, see 1.1.d)
OMC:
----
SCW 114000780010:
CENT__INFO
-> see 1.1.f)
3.3 Missing scientific data
IBIS:
-----
ScW: 114000070010,114000630010
These data structures are missing:
PICS-SIMH-RAW (or ALL) for mode Observation standard (41)
PICS-SISH-RAW (or ALL) for mode Observation standard (41)
SCW: 114000610010,114000620010
These data structures are missing:
PICS-SIMH-RAW (or ALL) for mode Observation standard (41)
PICS-SISH-RAW (or ALL) for mode Observation standard (41)
PICS-SPTI-RAW (or ALL) for mode Observation standard (41)
OMC:
----
ScW: 114000450010
These data structures are missing:
OMC.-SHOT-RAW (or ALL) for mode Science Normal (42)
-> see 1.1.c)
4. Instruments checks
=====================
4.1. IOSM daily check (standard long term displays)
Many IBIS OEMs from 2012-02-13T07:48:48 onwards:
DPE-CSSW, CSSW has unknown structure. Class 2 OEM.
2012-02-14T21:03:
DPE-IASW LSL transfer failed, overrun error, Class 2 OEM.
2012-02-14T21:04
2012-02-15T20:21
ISGRI MCE7: Time out CID 254, APID 1, Class 3 OEM.
2012-02-16T00:38: OMC OEM, rejected TC: invalid TC/mode combination
5. Science (AF)
==========
5.1 Summary
a) Planned observations
Last POD file: /isdc/nrt/ops/aux/adp/1140.000/pod_1140_0002.fits
Received at : 7 Feb 09:44
i EXP_ID OBS_ID SRC_NAME POINT_NUM POINT_LEN
1 11400001 09200050020 GPS-Scan-9 10 2200
2 11400002 09200050020 GPS-Scan-9 7 2200
3 11400003 09200050021 GPS-Scan-9 10 2200
4 11400004 09200050021 GPS-Scan-9 4 2200
5 11400005 09200010001 Gal. Bulge region 7 1800
6 11400006 08200270002 RX J1713.7-3946 4 3334
7 11400007 08200270002 RX J1713.7-3946 23 3334
8 11400008 09200220001 LMC/SN 1987A 9 3530
b) Solar activity & miscellaneous
Very low
5.2 IBAS
a) GRB in ISGRI FOV: No
b) GRB in SPI-ACS: No
c) Other IBAS alerts: No
5.3 TOOs
TOO criteria met on H 1608-522. Note sent to PI.
6. Anomalies report:
====================
IBIS DPE crash, see 1.1.b)
|
