Dependencies on Benchmark_O(& co.) --verbose format


(Pavol Vaskovic) #1

Hello,

I’m working of fixes to SR-4780 "Can not run performance tests that are not in precommit suite” <https://bugs.swift.org/browse/SR-4780> and SR-4669 "Add a Benchmark_Driver --rerun N option” <https://bugs.swift.org/browse/SR-4669>.

It would make my work easier if I could slightly modify the output format from the Benchmark_O(& co.) in the verbose mode, but before I do that I’d like to know if anybody has dependency on the exact format — any scripts that parse it?

Manual use shouldn’t be affected, the provided information would remain the same.

—Pavol


(Andrew Trick) #2

Hi Pavol,

The compare_perf_tests.py script parses that output. I don’t actually use the driver. I might start using the driver once it has a —rerun option, but the compare script should still work directly on the benchmark output.

-Andy

···

On May 15, 2017, at 2:42 AM, Pavol Vaskovic via swift-dev <swift-dev@swift.org> wrote:

Hello,

I’m working of fixes to SR-4780 "Can not run performance tests that are not in precommit suite” <https://bugs.swift.org/browse/SR-4780> and SR-4669 "Add a Benchmark_Driver --rerun N option” <https://bugs.swift.org/browse/SR-4669>.

It would make my work easier if I could slightly modify the output format from the Benchmark_O(& co.) in the verbose mode, but before I do that I’d like to know if anybody has dependency on the exact format — any scripts that parse it?

Manual use shouldn’t be affected, the provided information would remain the same.

—Pavol
_______________________________________________
swift-dev mailing list
swift-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-dev


(Pavol Vaskovic) #3

I am aware of that one. But my question is specifically about the
`--verbose` output. AFAIK compare_perf_tests.py parses results of normal
mode and can't handle --verbose.

--Pavol

···

On Mon, May 15, 2017 at 7:48 PM, Andrew Trick <atrick@apple.com> wrote:

The compare_perf_tests.py script parses that output.


(Andrew Trick) #4

OK. I may have asked that any new output go under “—verbose” to avoid breaking the compare script.
-Andy

···

On May 15, 2017, at 11:20 PM, Pavol Vaskovic <pali@pali.sk> wrote:

On Mon, May 15, 2017 at 7:48 PM, Andrew Trick <atrick@apple.com <mailto:atrick@apple.com>> wrote:
The compare_perf_tests.py script parses that output.

I am aware of that one. But my question is specifically about the `--verbose` output. AFAIK compare_perf_tests.py parses results of normal mode and can't handle --verbose.

--Pavol