[ntp:questions] Panic stop?

A C agcarver+ntp at acarver.net
Wed Aug 15 06:04:34 UTC 2012


One of my systems running 4.2.7p270 just panic stopped with this message:

Aug 15 05:10:59 ntpd[4012]: 0.0.0.0 0117 07 panic_stop +214748365 s; set 
clock manually within 1000 s.

There's nothing prior to this message except some sys_fuzz messages. 
The only other items of interest in the logs are noted below in their 
entirety.  The system also was not performing any tasks except keeping time.

The clock wasn't wrong, however.  I used ntpdate to reset the clock 
before restarting ntpd and it reported the clock being out by about 0.7 
seconds.

The system is configured with five upstream network servers, PPS (ATOM) 
and GPS (SHM via gpsd).  The gps logs show nothing unusual except a 
brief dropout of the satellites (about two seconds or less).  This has 
happened in the past two months with no ill effects.

The system has been running continuously since July 10 (had to restart 
because of a leap second issue with the GPS receiver) with no 
interruptions or other errors except for a couple unexpected clock steps 
of less than two seconds.

So I'm a bit confused about what happened and why ntpd chose to panic 
stop when other clocks were fine.  Any and all insight is welcome.


Other than the sys_fuzz messages and the initial startup messages, the 
log contains only the two quoted blocks below for the two clock step events.

One clock step was on August 1 after a popcorn event (all logged 
messages, no omissions):

Jul 31 07:51:43 ntpd[4012]: SHM(0) 968d 8d popcorn 2147483647.989907 s
Aug  1 03:20:18 ntpd[4012]: 0.0.0.0 0113 03 spike_detect +0.150120 s
Aug  1 03:21:19 ntpd[4012]: SHM(0) 969a 8a sys_peer
Aug  1 03:25:03 ntpd[4012]: 0.0.0.0 041c 0c clock_step +1.592767 s
Aug  1 03:25:05 ntpd[4012]: 0.0.0.0 0415 05 clock_sync
Aug  1 03:25:05 ntpd[4012]: 0.0.0.0 c418 08 no_sys_peer
Aug  1 03:25:06 ntpd[4012]: 130.207.165.28 8014 84 reachable
Aug  1 03:25:07 ntpd[4012]: 64.6.144.6 8034 84 reachable
Aug  1 03:25:07 ntpd[4012]: 173.44.32.10 8014 84 reachable
Aug  1 03:25:10 ntpd[4012]: 184.105.192.247 8014 84 reachable
Aug  1 03:25:12 ntpd[4012]: 130.207.165.28 902a 8a sys_peer
Aug  1 03:25:13 ntpd[4012]: 131.144.4.10 8014 84 reachable
Aug  1 03:25:21 ntpd[4012]: SHM(0) 80a4 84 reachable
Aug  1 03:25:21 ntpd[4012]: SHM(0) 90ba 8a sys_peer
Aug  1 03:25:21 ntpd[4012]: PPS(0) 8074 84 reachable
Aug  1 03:25:37 ntpd[4012]: PPS(0) 908a 8a sys_peer

And another was August 4 after another spike (but no popcorn) (all 
logged messages, no omissions):
Aug  4 00:22:25 ntpd[4012]: 0.0.0.0 0113 03 spike_detect +0.199464 s
Aug  4 00:23:13 ntpd[4012]: SHM(0) 961a 8a sys_peer
Aug  4 00:27:13 ntpd[4012]: 0.0.0.0 041c 0c clock_step +1.613956 s
Aug  4 00:27:15 ntpd[4012]: 0.0.0.0 0415 05 clock_sync
Aug  4 00:27:15 ntpd[4012]: 0.0.0.0 c418 08 no_sys_peer
Aug  4 00:27:17 ntpd[4012]: 130.207.165.28 8034 84 reachable
Aug  4 00:27:19 ntpd[4012]: 64.6.144.6 8014 84 reachable
Aug  4 00:27:22 ntpd[4012]: 173.44.32.10 8014 84 reachable
Aug  4 00:27:23 ntpd[4012]: 131.144.4.10 8014 84 reachable
Aug  4 00:27:23 ntpd[4012]: 130.207.165.28 904a 8a sys_peer
Aug  4 00:27:24 ntpd[4012]: 184.105.192.247 8014 84 reachable
Aug  4 00:27:31 ntpd[4012]: SHM(0) 8024 84 reachable
Aug  4 00:27:31 ntpd[4012]: SHM(0) 903a 8a sys_peer
Aug  4 00:27:31 ntpd[4012]: PPS(0) 8094 84 reachable
Aug  4 00:27:47 ntpd[4012]: PPS(0) 90aa 8a sys_peer


This is all the log output in the vicinity of the panic stop:

Clockstats:
56154 18658.019 127.127.22.0    0.000030011
56154 18659.019 127.127.22.0    0.000034011
56154 18659.103 127.127.28.0     16  16   0   0   0
56154 19796.264 127.127.28.0      2   2   0   0   0
56154 19798.091 127.127.22.0    -0.074269412
56154 19799.090 127.127.22.0    -0.073845379
56154 19800.089 127.127.22.0    -0.073423345
56154 19801.090 127.127.22.0    -0.072998313


Loopstats:
56154 18611.179  0.000037054 -74.702  0.000122070  0.000683 4
56154 18627.201  0.000036525 -74.702  0.000122070  0.000669 4
56154 18643.220  0.000036390 -74.701  0.000122070  0.000655 4
56154 19796.235 -0.075410500 -74.733  0.026661883  0.000000 4
56154 19811.168 -0.070443566 -74.733  0.025001656  0.000000 4
56154 19827.163 -0.064702389 -74.733  0.023474829  0.000000 4
56154 19843.162 -0.057485637 -74.733  0.022106432  0.000000 4
56154 19859.187 -0.051527890 -74.733  0.020785677  0.000000 4


Peerstats:
56154 18627.058 127.127.28.0    963a  0.002911100  0.000000000 
0.001633092  0.008614349
56154 18627.161 127.127.22.0    97aa  0.000036525  0.000000000 
0.000353156  0.000122070
56154 18643.050 127.127.28.0    963a  0.003572200  0.000000000 
0.001045367  0.005938763
56154 18643.128 127.127.22.0    97aa  0.000036390  0.000000000 
0.000353156  0.000122070
56154 18659.056 127.127.28.0    963a  0.005651400  0.000000000 
0.000827252  0.004513229
56154 18659.119 127.127.22.0    97aa  214748364.800000012  0.000000000 
0.000292268  214748364.799961418
56154 19796.171 127.127.28.0    9024 -0.075410500  0.000000000 
7.945857649  0.000122070
56154 19801.318 205.196.146.72  9024 -0.068298664  0.090280683 
7.937562189  0.000122070
56154 19803.231 205.196.146.72  9024 -0.067398429  0.088432155 
3.937600770  0.000900235
56154 19804.270 209.239.120.20  9024 -0.044134932  0.081311979 
7.937562122  0.000122070
56154 19804.376 216.66.0.142    9024 -0.067095978  0.092959765 
7.937562686  0.000122070
56154 19804.503 130.207.165.28  9024 -0.077130779  0.095166747 
7.937562226  0.000122070

Sysstats:
56154  3536.025 3600 5684 17 59 0 0 0 0 0 0 0
56154  7136.017 3600 5661 17 37 0 0 0 0 0 0 0
56154 10736.048 3600 5667 18 43 0 0 0 0 0 0 0
56154 14336.058 3600 5663 16 78 0 0 0 0 0 0 0
56154 17936.050 3600 5696 18 80 0 0 0 0 0 0 0

Rawstats:
> 56154 18088.154 131.144.4.10    10.0.0.21       3553995688.053814058 3553995688.099221746 3553995688.099230865 3553995688.152310444
> 56154 18308.163 64.6.144.6      10.0.0.21       3553995908.087649438 3553995908.125800972 3553995908.125863353 3553995908.160759574
> 56154 18570.165 173.44.32.10    10.0.0.21       3553996170.056831096 3553996170.105554951 3553996170.105575999 3553996170.162246448
> 56154 19801.236 205.196.146.72  10.0.0.21       3553997401.132874331 3553997401.109716009 3553997401.109750283 3553997401.223189288
> 56154 19803.210 205.196.146.72  10.0.0.21       3553997403.119185652 3553997403.096003301 3553997403.096052675 3553997403.207667181
> 56154 19804.205 209.239.120.20  10.0.0.21       3553997404.121531852 3553997404.118052909 3553997404.118069076 3553997404.202859998
> 56154 19804.324 216.66.0.142    10.0.0.21       3553997404.120460726 3553997404.099844630 3553997404.099886558 3553997404.213462419
> 56154 19804.410 130.207.165.28  10.0.0.21       3553997404.119123645 3553997404.089576240 3553997404.089627001 3553997404.214341153



More information about the questions mailing list