[ntp:questions] Re: ntp4 new functionality testing

David L. Mills mills at udel.edu
Fri Feb 25 21:28:01 UTC 2005


I don't have formal test scripts, only configuration files. I munge an 
existing configuration file to test something, verify it works and move 
on. At various times I leave machines here running extended tests with 
Autokey and Manycast. I can't do that now, as the I/O and broadcast 
facilities are broken at the moment. Another thing is the scripts have 
to be configured for specific hosts as servers and clients. A third 
thing is that some of these tests, like recovering from an intentionally 
broken frequency file, takes a day or more.

When the I/O and broadcast facilities are working, I will run up a few 
tests and leave the configuration files in a handy place.


Sajitha T T wrote:
> Hi David,
> Thanks for your reply. Can we get access to the test scripts? Also could 
> you please share any documents on test strategy especially for the new 
> features (autokey protocol & automatic configuration).
> Thanks in advance,
> Regards,
> Sajitha
> David L. Mills wrote:
>> Sajitha,
>> We support two testbeds here, each including 6-8 systems of various 
>> manufacture on dedicated subnets. We have scripts that build the 
>> public software with several common options - with and without 
>> reference clocks, debugging, cryptographic authentication, etc. The 
>> daemon can be operated in siumulation mode where the basic protocol 
>> module and algorithms are driven by synthetic network jitter and 
>> oscillator wander. We use that and simple test scripts to test 
>> convergence and stability in various scenarios with very large time 
>> and frequency errors, for example.
>> We test things like Manycast, Autokey and selected reference clock 
>> drivers using ad-hoc scripts and local radios, but have no formal test 
>> suite. It would be a good idea to have a comprehensive suite of test 
>> scripts, but there are a great many options and configuration schemes 
>> and not enough time or enthusiasm among the volunteer Corps to 
>> construct scripts for all of them.
>> Much of the testing, especially recently when folks have pushed the 
>> envelope with unexpected parameter extremes, is prompted by some 
>> complaint or other about behavior the program was not intended or 
>> designed for. It's hard to anticipate such scenarios and design test 
>> scripts for these cases. As you can see, a thorough test suite is a 
>> serious project in its own right.
>> Dave
>> Sajitha T T wrote:
>>> Hi,
>>> Is there any test suite/cases available with which we can test the 
>>> ntp4 new functionality, specifically autokey authentication, 
>>> automatic configuration, ipv6 etc.  Greatly appreciate any pointers 
>>> on this.
>>> Regards,
>>> Sajitha
>> _______________________________________________
>> questions mailing list
>> questions at lists.ntp.isc.org
>> https://lists.ntp.isc.org/mailman/listinfo/questions

More information about the questions mailing list