INTEGRALPlanckGaiaHitomiPOLARCHEOPSEuclidATHENA
HEAVENSFACTCTALOFTSPICAJEM-EUSOXIPEeXTPTheseus
XRISMMAGBOUNDSMARTNet
ISDCCDCI
INTEGRAL Science Data Centre

ISDC END OF REVOLUTION REPORT (NRT)
REVOLUTION 1229 - Report of November 8, 2012


 
 Perigee Passage at start : 2012-11-05T09:49:48 
 Perigee Passage at end   : 2012-11-08T09:37:38
 Radiation Belt exit      : 55412 km (ijd 4692.5713)
 Radiation Belt entrance  : 26221 km (ijd 4695.3464)
 
 Operations Coordinator   : Enrico Bozzo
 Pipeline Operator        : Ph.M.
 Scientist on Duty        : Lucia Pavan

 1. Planning summary
 ===================

 1.1 General remarks
 
 a) JEM-X 1 and 2 on.
             
 b) 2012-11-05T12:30: Missing mount point on nrt machine, all processings hanged, 
    including data receipt. Resolved at around 16:30.

 c) 2012-11-06T02:30: IBIS VETO OEMS, "Time-out sending LSL".
    It was due to an LCL trip on the VETO electronics.
    Due to this MOC had to put IBIS in stand-by mode twice, first from 5:20z to 6:17z,
    and then again from 8:26z to 9:15z.  

 d) 2012-11-06T08:30: Preproc restarted, was rejecting ISGRI packets.  
    2012-11-06T11:14: Preproc not able to write alerts to alert directory, 
    then in undefined state after shut down command sent.
    2012-11-06T13:14: Preproc restarted after preproc machine reboot.
    
 e) 2012-11-06T03:42: PICsIT spurious reset, no HEPI resync.
    2012-11-06T07:02: PICsIT spurious reset, no HEPI resync.
 
 f) 2012-11-07T21:28: Guide star lost, AIMU went on, pointing 64 lost.
 
 1.2 Pointings summary

   Remarks: Only Science Windows (ScWs) of type 'pointing' are considered.
 - Exposures info from POD version 1. Pointings info from TSF version 7. 
 - Durations in exec/planned format; data gaps and bad time intervals not excluded from total time.
 - Deviations: only unexpected deviations >30 secs for pointings assigned to an exposure reported;
   expected deviations (first & last pointings of an exposure longer than planned) not reported. 
  • Exposure 12290001: 'GPS-Scan-30', GPS (10x2200s) 10 pointings: 12290004 -> 12290013, 16577s/22000s (-1h30m23s) Deviations: 12290004 0/2200s: see 1.1.b) 12290005 0/2200s: see 1.1.b) 12290006 1160/2200s: see 1.1.b) 12290007 2292/2200s: see 1.1.b)
  • Exposure 12290002: 'GPS-Scan-30', GPS (5x2200s) 5 pointings: 12290014 -> 12290018, 10849s/11000s (-2m30s)
  • Exposure 12290003: 'GRS 1915+105', hexagon (8x2857s) 8 pointings: 12290020 -> 12290027, 23825s/22856s (+16m09s) Deviations: 12290023 2826/2857s: see 1.1.c)
  • Exposure 12290004: 'GPS-Scan-30', GPS (10x2200s) 10 pointings: 12290029 -> 12290038, 21054s/22000s (-15m46s) Deviations: 12290029 0/2200s: see 1.1.d)
  • Exposure 12290005: 'GPS-Scan-30', GPS (1x2200s) 1 pointing: 12290039, 2280s/2200s (+1m19s)
  • Exposure 12290006: 'GPS-Scan-30', GPS (7x2200s) 7 pointings: 12290040 -> 12290046, 15201s/15400s (-3m18s)
  • Exposure 12290007: 'M82 X-1', 5x5 (1x3479s) 1 pointing: 12290048, 3508s/3479s (+28s)
  • Exposure 12290008: 'M82 X-1', 5x5 (12x3479s) 12 pointings: 12290049 -> 12290060, 45676s/41748s (+1h05m27s)
  • Exposure 12290009: 'M82 X-1', 5x5 (12x3479s) 12 pointings: 12290061 -> 12290072, 42295s/41748s (+9m07s) Deviations: 12290064 1343/3479s: see 1.1.e)
  • Pointings with no assigned Exposure 8 pointings: 12290001, 0002, 0003, 0019, 0028, 0047, 0073, 0074, 15242s/4639s (+2h56m43s)
2. NRT Data processing ====================== 2.1 Telemetry * Start reception: 2012-11-05T11:30:53 End reception: 2012-11-08T08:10:06 * TM gaps of more than 30 seconds: 2012-11-05T11:30:53 2012-11-05T13:06:18 2012-11-05T16:23:42 2012-11-05T16:29:34 2012-11-05T16:48:06 - 2012-11-05T16:57:43 2012-11-05T17:16:50 2012-11-05T17:48:08 2012-11-05T19:26:08 2012-11-05T21:50:30 2012-11-05T23:11:33 2012-11-05T23:20:09 2012-11-06T00:16:49 2012-11-06T03:44:23 2012-11-06T16:38:55 - 2012-11-06T16:39:26 2012-11-06T19:28:26 2012-11-06T19:51:35 * Frames missed: 2012-11-05T11:30:54 655 frames missed (3823398586 to 3823399240) 2012-11-05T13:06:18 659 frames missed (3823490170 to 3823490828) 2012-11-05T16:23:43 481 frames missed (3823679637 to 3823680117) 2012-11-05T16:29:35 480 frames missed (3823685269 to 3823685748) 2012-11-05T16:48:07 481 frames missed (3823703061 to 3823703541) 2012-11-05T17:05:01 16073 frames missed (3823703694 to 3823719766) 2012-11-05T17:16:50 309 frames missed (3823730473 to 3823730781) 2012-11-05T17:16:51 342 frames missed (3823730784 to 3823731125) 2012-11-05T17:48:08 240 frames missed (3823760654 to 3823760893) 2012-11-05T17:48:09 209 frames missed (3823760964 to 3823761172) 2012-11-05T19:26:09 494 frames missed (3823854757 to 3823855250) 2012-11-05T21:50:30 279 frames missed (3823993150 to 3823993428) 2012-11-05T21:50:31 385 frames missed (3823993459 to 3823993843) 2012-11-05T23:11:33 309 frames missed (3824071144 to 3824071452) 2012-11-05T23:11:33 181 frames missed (3824071456 to 3824071636) 2012-11-05T23:20:09 240 frames missed (3824079370 to 3824079609) 2012-11-05T23:20:09 207 frames missed (3824079680 to 3824079886) 2012-11-05T23:23:59 1381 frames missed (3824082194 to 3824083574) 2012-11-06T00:16:49 565 frames missed (3824133725 to 3824134289) 2012-11-06T03:44:25 753 frames missed (3824332833 to 3824333585) 2012-11-06T16:38:55 157 frames missed (3825076476 to 3825076632) 2012-11-06T16:39:27 905 frames missed (3825076710 to 3825077614) 2012-11-06T19:28:53 914 frames missed (3825239357 to 3825240270) 2012-11-06T19:51:37 592 frames missed (3825261502 to 3825262093) * ERT not in sync with UTC: - * Statistics: Mean Rate: 15.88 frames/sec (mean) Frames: 3947370 total Packets: 5321260 total : 0 missed : 67144 missed : 2742946 TM : 5304185 TM : 1204424 idle : 0 tcmd : 0 invalid : 17075 time : 0 idle : 0 invalid * Errors: NCTRSFRAME: invalid quality = 256 (should be 0 or 1): 2012-11-05T15:56:26 - 2012-11-05T15:57:00 2012-11-07T05:39:55 - 2012-11-07T05:40:26 2012-11-07T05:52:33 - 2012-11-07T05:52:34 2012-11-07T05:56:37 - 2012-11-07T05:57:01 2012-11-07T06:21:03 - 2012-11-07T06:21:39 2012-11-07T10:24:50 - 2012-11-07T10:25:40 2012-11-07T10:27:10 - 2012-11-07T10:27:13 2012-11-07T10:35:06 - 2012-11-07T10:35:38 2012-11-07T11:13:34 2012-11-07T11:20:12 - 2012-11-07T11:20:26 2012-11-07T11:26:34 - 2012-11-07T11:27:14 2012-11-07T12:06:59 - 2012-11-07T12:07:46 2012-11-07T12:15:58 - 2012-11-07T12:16:42 2.2 Auxiliary files summary POD OPP TSF PAF OLF ASF AHF THF ORB REVNO ------------------------------------------------------------- 1 1 2 2 72 81 1 92 1 1 2.3 Pre-processing * Frequent errors for days 2012-11-05, 2012-11-06, 2012-11-07, respectively: 16 24 23 "Histogram rejected" 188004 126542 0 "OBT found too much higher" 4 12 6 "packet(s) of the Histogram are discarded" 2 19 3 "Can not store the Histogram" 0 0 0 "SpiSpectrum, decompression failed" 0 0 0 "SpiSpectrumParser, Failure" -> Preprocessing lost IBIS packets synchronization on Nov 5. 2.4 OPUS Pipelines processing * REV: completed | errors * INPUT/SCW: completed | errors ------------------------------- ---------------------------- IREM : 70 | 0 149 | 0 ISGRI_cal : 22 | 0 ISGRI_noise: 130 | 1 IBIS_veto : 24 | 0 * QLA completed | errors PICsIT_cal : 39 | 0 ----------------------------- JMX : 258 | 2 IBIS : 71 | 0 ilt : 1 | 0 JEMX-1 : " | 0 Archiving : 1 | 0 JEMX-2 : " | 0 2.5 ISGRI context table 2012-11-T: IIMG_SDCMOC_D_00001.INT sent to MOC 2012-11-T: IIMG_SDCMOC_D_00002.INT sent to MOC 2nd version provided by IRFU/SAp, Saclay (F) * Errors: Date: 20121105165118 OSF: 1229_20121105160327_00_irn Stat: cxw Last: /bin/chmod Exit: See next line ... file /isdc/nrt/ops//scw//1229/rev.000/cfg/isgri_pxlswtch_20121105160327.fits exists already Date: 20121106105146 OSF: 1229_20121106102731_00_jm1 Stat: cxw Last: j_prp_frss_obt Exit: 1409 Date: 20121106105146 OSF: 1229_20121106102738_00_jm2 Stat: cxw Last: j_prp_frss_obt Exit: 1409 Date: 20121106143507 OSF: 122900270042 Stat: cxwww Last: spi_dp_derived_param Exit: 25005 Date: 20121106144107 OSF: 122900270051 Stat: cxwww Last: dp_aux_attr Exit: 25005 Date: 20121106151707 OSF: 122900280010 Stat: cxwww Last: spi_dp_derived_param Exit: 25005 Date: 20121106151707 OSF: 122900280021 Stat: cxwww Last: spi_dp_derived_param Exit: 25005 Date: 20121106160008 OSF: 122900290010 Stat: cxwww Last: spi_dp_derived_param Exit: 25005 -> due to network issue with preproc machine 3. Alerts ========= 3.1 All alerts except OOLs and missing scientific data * Level 3: 101 Can't (re)connect to MOC (ECONNREFUSED). Line OK. TM transmitter not responding. 2012-11-05T16:58:27 2012-11-05T23:22:44 2012-11-06T19:28:37 212 rttm_maq_read() says it missed 1 packets 2012-11-05T16:06:39 -> see 1.1.d) * Level 2: 303 Fail to read raw telemetry file, error# : -1106 Program / version that has created this alert: Preproc 5.8 Please verify why this error occured, the raw telemetry file /isdc/nrt/pck/1229/tm2012110610402600.fits could be missing! 303 Fail to read raw telemetry file, error# : -1106 Program / version that has created this alert: Preproc 5.8 Please verify why this error occured, the raw telemetry file /isdc/nrt/pck/1229/tm2012110610470800.fits could be missing! 2012-11-06T10:47:15 2012-11-06T10:53:57 -> network issue, see 1.1.d) 603 The pointing hasn't increased by one. From 27 to 9085 Program / version that has created this alert: convertattitude 2.4 Directory of alert generation: /export/isdc/run/pipelines/adp/adp/scratch/1229_0030_ASF Convert attitude RRRR=1229 ROW=30. Missing pointing ? -> as planned 603 The pointing hasn't increased by one. From 9085 to 9087 Program / version that has created this alert: convertattitude 2.4 Directory of alert generation: /export/isdc/run/pipelines/adp/adp/scratch/1229_0031_ASF Convert attitude RRRR=1229 ROW=31. Missing pointing ? -> as planned 603 The pointing hasn't increased by one. From 27 to 86 From attitude history: 1229_0001_AHF Convert attitude RRRR=1229 ROW=918. Missing pointing ? -> as it was planned 603 The pointing hasn't increased by one. From 63 to 65 From attitude history: 1229_0001_AHF Convert attitude RRRR=1229 ROW=3836. Missing pointing ? -> see 1.1.f) * Level 1: 604 Exposure time is 1161 sec. instead of 2200 sec. Pointing ID (BCPPID): 12290006 604 Exposure time is 2293 sec. instead of 2200 sec. Pointing ID (BCPPID): 12290007 604 Exposure time is 2158 sec. instead of 2200 sec. Pointing ID (BCPPID): 12290009 -> see 1.1.b) 604 Exposure time is 1342 sec. instead of 3479 sec. Pointing ID (BCPPID): 12290064 -> see 1.1.f) 605 IBIS: The mode differ for 78 sec. from the planning ScW: 122900240010 from 2012-11-06T05:19:45 to 2012-11-06T05:21:03 expected mode: 41 actual mode: 22 605 IBIS: The mode differ for 126 sec. from the planning ScW: 122900240021 from 2012-11-06T05:21:03 to 2012-11-06T05:23:09 expected mode: 41 actual mode: 22 605 IBIS: The mode differ for 2857 sec. from the planning ScW: 122900250010 from 2012-11-06T05:23:09 to 2012-11-06T06:10:46 expected mode: 41 actual mode: 22 605 IBIS: The mode differ for 116 sec. from the planning ScW: 122900250021 from 2012-11-06T06:10:46 to 2012-11-06T06:12:42 expected mode: 41 actual mode: 22 605 IBIS: The mode differ for 343 sec. from the planning ScW: 122900260010 from 2012-11-06T06:12:42 to 2012-11-06T06:18:25 expected mode: 41 actual mode: 22 -> see 1.1.c) 3.2 Parameter out of limits IBIS: ----- ScW: 122900210010 - 122900240010 from 2012-11-06T02:33:02 (UTC) to 2012-11-06T02:44:14 (UTC) V0E_MVDM[1-16]HPVS V1S_MVDM[1-16]HV V0E_MVDM[1-16]BGO V1S_MCDM01HV V1S_MCDM01STAT V1S_MVDMCDMCURR V0E_MVDM[1-16]VM5M V1E_MVEB_MTEMP V1E_MH4_MVECU5V V1E_MH4_MIFB_MANV V1E_MH4_MMOD28V V1E_MVEB_MTEMP V1E_MH4_MVECU_MAPV V0E_MVDM07VC5M V0E_MVDM04VC5P P0S_MM[1-8]VTC ScW: 122900210010 - 122900240010 PICsIT spurious reset in ScW 122900220021 and 122900260021 P0S_MM[1-8]LTC1 P0S_MM[1-8]LTC2 P0S_MM[1-8]RTC1 P0S_MM[1-8]RTC2 P0E_MMMCRER from 2012-11-06T03:42:01 (UTC) to 2012-11-06T03:43:21 (UTC): 3.3 Missing scientific data IBIS: ----- ScW: 122900060010,122900230010 - 122900240010, 122900630010 These data structures are missing: PICS-SIMH-RAW (or ALL) for mode Observation standard (41) PICS-SISH-RAW (or ALL) for mode Observation standard (41) 4. Instruments checks (IOSM) ===================== Nothing special 5. Science (LP) ========== 5.1 Summary a) Planned observations Last POD file: /isdc/nrt/ops/aux/adp/1229.000/pod_1229_0001.fits Received at : 30 Oct 14:22 i EXP_ID OBS_ID SRC_NAME POINT_NUM POINT_LEN 1 12290001 09200050070 GPS-Scan-30 10 2200 2 12290002 09200050070 GPS-Scan-30 5 2200 3 12290003 09200080023 GRS 1915+105 8 2857 4 12290004 09200050071 GPS-Scan-30 10 2200 5 12290005 09200050071 GPS-Scan-30 1 2200 6 12290006 09200050071 GPS-Scan-30 7 2200 7 12290007 09200140001 M82 X-1 1 3479 8 12290008 09200140001 M82 X-1 12 3479 9 12290009 09200140001 M82 X-1 12 3479 b) Solar activity & miscellaneous low 5.2 IBAS a) GRB in ISGRI FOV: No b) GRB in SPI-ACS: 2012-11-07T12:16:03: Possible short GRB121107A. c) Other IBAS alerts: No 5.3 TOOs None 6. Anomalies report: ==================== No anomaly