[Swift CI] Build Failure: 0. OSS - Swift Incremental RA - Ubuntu 15.10 (master) #5898


(Jordan Rose) #1

This isn’t me. SwiftPM folks, is this real?

/home/buildnode/jenkins/workspace/oss-swift-incremental-RA-linux-ubuntu-15_10/swiftpm/Tests/Basic/PathPerfTests.swift:23: error: PathPerfTests.testJoinPerf_X100000 : failed: The relative standard deviation of the measurements is 12.993% which is higher than the max allowed of 10.000%.
Test Case 'PathPerfTests.testJoinPerf_X100000' failed (7.808 seconds).

Jordan

···

On Jun 22, 2016, at 19:51, no-reply@swift.org wrote:

[FAILURE] oss-swift-incremental-RA-linux-ubuntu-15_10 [#5898]

Build URL: https://ci.swift.org/job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/
Project: oss-swift-incremental-RA-linux-ubuntu-15_10
Date of build: Wed, 22 Jun 2016 19:36:24 -0700
Build duration: 14 min
Identified problems:

Compile Error: This build failed because of a compile error. Below is a list of all errors in the build log:
Indication 1 <https://ci.swift.org//job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/consoleFull#68441244ee1a197b-acac-4b17-83cf-a53b95139a76>
Tests:

Name: Swift
Failed: 0 test(s), Passed: 8017 test(s), Total: 8017 test(s)

Changes

Commit 4562567bb35127e5a75b886809648318ea59b40f by jordan_rose:
[docs] LibraryEvolution: size_in_bits -> maximumFootprint.

edit: docs/LibraryEvolution.rst

Commit 2ce6f1eace6fa1cc095fd6e96181359c447aadeb by jordan_rose:
[docs] LibraryEvolution: Camel-case hypothetical attributes.

edit: docs/LibraryEvolution.rst


(Daniel Dunbar) #2

+Anders, I don't think we want the perf tests enabled in this config.

- Daniel

···

On Jun 22, 2016, at 7:52 PM, Jordan Rose via swift-dev <swift-dev@swift.org> wrote:

This isn’t me. SwiftPM folks, is this real?

/home/buildnode/jenkins/workspace/oss-swift-incremental-RA-linux-ubuntu-15_10/swiftpm/Tests/Basic/PathPerfTests.swift:23: error: PathPerfTests.testJoinPerf_X100000 : failed: The relative standard deviation of the measurements is 12.993% which is higher than the max allowed of 10.000%.
Test Case 'PathPerfTests.testJoinPerf_X100000' failed (7.808 seconds).

Jordan

On Jun 22, 2016, at 19:51, no-reply@swift.org <mailto:no-reply@swift.org> wrote:

[FAILURE] oss-swift-incremental-RA-linux-ubuntu-15_10 [#5898]

Build URL: https://ci.swift.org/job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/
Project: oss-swift-incremental-RA-linux-ubuntu-15_10
Date of build: Wed, 22 Jun 2016 19:36:24 -0700
Build duration: 14 min
Identified problems:

Compile Error: This build failed because of a compile error. Below is a list of all errors in the build log:
Indication 1 <https://ci.swift.org//job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/consoleFull#68441244ee1a197b-acac-4b17-83cf-a53b95139a76>
Tests:

Name: Swift
Failed: 0 test(s), Passed: 8017 test(s), Total: 8017 test(s)

Changes

Commit 4562567bb35127e5a75b886809648318ea59b40f by jordan_rose:
[docs] LibraryEvolution: size_in_bits -> maximumFootprint.

edit: docs/LibraryEvolution.rst

Commit 2ce6f1eace6fa1cc095fd6e96181359c447aadeb by jordan_rose:
[docs] LibraryEvolution: Camel-case hypothetical attributes.

edit: docs/LibraryEvolution.rst

_______________________________________________
swift-dev mailing list
swift-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-dev


(Anders Bertelrud) #3

To close the loop on this, I have resolved the failures I introduced. There is one job that is currently still red, but it is unrelated to SwiftPM: OSS - Swift Package - Ubuntu 14.04 (master) <https://ci.swift.org/job/oss-swift-package-linux-ubuntu-14_04/>

FAIL: Swift :: AutolinkExtract/import.swift (188 of 8017)
<>******************** TEST 'Swift :: AutolinkExtract/import.swift' FAILED ********************

Anders

···

On 2016-06-22, at 19.52, Jordan Rose via swift-build-dev <swift-build-dev@swift.org> wrote:

This isn’t me. SwiftPM folks, is this real?

/home/buildnode/jenkins/workspace/oss-swift-incremental-RA-linux-ubuntu-15_10/swiftpm/Tests/Basic/PathPerfTests.swift:23: error: PathPerfTests.testJoinPerf_X100000 : failed: The relative standard deviation of the measurements is 12.993% which is higher than the max allowed of 10.000%.
Test Case 'PathPerfTests.testJoinPerf_X100000' failed (7.808 seconds).

Jordan

On Jun 22, 2016, at 19:51, no-reply@swift.org <mailto:no-reply@swift.org> wrote:

[FAILURE] oss-swift-incremental-RA-linux-ubuntu-15_10 [#5898]

Build URL: https://ci.swift.org/job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/
Project: oss-swift-incremental-RA-linux-ubuntu-15_10
Date of build: Wed, 22 Jun 2016 19:36:24 -0700
Build duration: 14 min
Identified problems:

Compile Error: This build failed because of a compile error. Below is a list of all errors in the build log:
Indication 1 <https://ci.swift.org//job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/consoleFull#68441244ee1a197b-acac-4b17-83cf-a53b95139a76>
Tests:

Name: Swift
Failed: 0 test(s), Passed: 8017 test(s), Total: 8017 test(s)

Changes

Commit 4562567bb35127e5a75b886809648318ea59b40f by jordan_rose:
[docs] LibraryEvolution: size_in_bits -> maximumFootprint.

edit: docs/LibraryEvolution.rst

Commit 2ce6f1eace6fa1cc095fd6e96181359c447aadeb by jordan_rose:
[docs] LibraryEvolution: Camel-case hypothetical attributes.

edit: docs/LibraryEvolution.rst

_______________________________________________
swift-build-dev mailing list
swift-build-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-build-dev


(Anders Bertelrud) #4

I'll disable it. What's the condition to check to disable it? It looks like the other performance tests are disabled permanently, is that appropriate?

Anders

···

On 2016-06-22, at 23.16, Daniel Dunbar <daniel_dunbar@apple.com> wrote:

+Anders, I don't think we want the perf tests enabled in this config.

- Daniel

On Jun 22, 2016, at 7:52 PM, Jordan Rose via swift-dev <swift-dev@swift.org <mailto:swift-dev@swift.org>> wrote:

This isn’t me. SwiftPM folks, is this real?

/home/buildnode/jenkins/workspace/oss-swift-incremental-RA-linux-ubuntu-15_10/swiftpm/Tests/Basic/PathPerfTests.swift:23: error: PathPerfTests.testJoinPerf_X100000 : failed: The relative standard deviation of the measurements is 12.993% which is higher than the max allowed of 10.000%.
Test Case 'PathPerfTests.testJoinPerf_X100000' failed (7.808 seconds).

Jordan

On Jun 22, 2016, at 19:51, no-reply@swift.org <mailto:no-reply@swift.org> wrote:

[FAILURE] oss-swift-incremental-RA-linux-ubuntu-15_10 [#5898]

Build URL: https://ci.swift.org/job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/
Project: oss-swift-incremental-RA-linux-ubuntu-15_10
Date of build: Wed, 22 Jun 2016 19:36:24 -0700
Build duration: 14 min
Identified problems:

Compile Error: This build failed because of a compile error. Below is a list of all errors in the build log:
Indication 1 <https://ci.swift.org//job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/consoleFull#68441244ee1a197b-acac-4b17-83cf-a53b95139a76>
Tests:

Name: Swift
Failed: 0 test(s), Passed: 8017 test(s), Total: 8017 test(s)

Changes

Commit 4562567bb35127e5a75b886809648318ea59b40f by jordan_rose:
[docs] LibraryEvolution: size_in_bits -> maximumFootprint.

edit: docs/LibraryEvolution.rst

Commit 2ce6f1eace6fa1cc095fd6e96181359c447aadeb by jordan_rose:
[docs] LibraryEvolution: Camel-case hypothetical attributes.

edit: docs/LibraryEvolution.rst

_______________________________________________
swift-dev mailing list
swift-dev@swift.org <mailto:swift-dev@swift.org>
https://lists.swift.org/mailman/listinfo/swift-dev


(Daniel Dunbar) #5

I'll disable it. What's the condition to check to disable it? It looks like the other performance tests are disabled permanently, is that appropriate?

It is the only option we have, currently.

- Daniel

···

On Jun 22, 2016, at 11:30 PM, Anders Bertelrud <anders@apple.com> wrote:

Anders

On 2016-06-22, at 23.16, Daniel Dunbar <daniel_dunbar@apple.com <mailto:daniel_dunbar@apple.com>> wrote:

+Anders, I don't think we want the perf tests enabled in this config.

- Daniel

On Jun 22, 2016, at 7:52 PM, Jordan Rose via swift-dev <swift-dev@swift.org <mailto:swift-dev@swift.org>> wrote:

This isn’t me. SwiftPM folks, is this real?

/home/buildnode/jenkins/workspace/oss-swift-incremental-RA-linux-ubuntu-15_10/swiftpm/Tests/Basic/PathPerfTests.swift:23: error: PathPerfTests.testJoinPerf_X100000 : failed: The relative standard deviation of the measurements is 12.993% which is higher than the max allowed of 10.000%.
Test Case 'PathPerfTests.testJoinPerf_X100000' failed (7.808 seconds).

Jordan

On Jun 22, 2016, at 19:51, no-reply@swift.org <mailto:no-reply@swift.org> wrote:

[FAILURE] oss-swift-incremental-RA-linux-ubuntu-15_10 [#5898]

Build URL: https://ci.swift.org/job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/
Project: oss-swift-incremental-RA-linux-ubuntu-15_10
Date of build: Wed, 22 Jun 2016 19:36:24 -0700
Build duration: 14 min
Identified problems:

Compile Error: This build failed because of a compile error. Below is a list of all errors in the build log:
Indication 1 <https://ci.swift.org//job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/consoleFull#68441244ee1a197b-acac-4b17-83cf-a53b95139a76>
Tests:

Name: Swift
Failed: 0 test(s), Passed: 8017 test(s), Total: 8017 test(s)

Changes

Commit 4562567bb35127e5a75b886809648318ea59b40f by jordan_rose:
[docs] LibraryEvolution: size_in_bits -> maximumFootprint.

edit: docs/LibraryEvolution.rst

Commit 2ce6f1eace6fa1cc095fd6e96181359c447aadeb by jordan_rose:
[docs] LibraryEvolution: Camel-case hypothetical attributes.

edit: docs/LibraryEvolution.rst

_______________________________________________
swift-dev mailing list
swift-dev@swift.org <mailto:swift-dev@swift.org>
https://lists.swift.org/mailman/listinfo/swift-dev


(Anders Bertelrud) #6

Ok. We need to fix that, but for the moment, I've disabled it. I'll double-check the CI after it's gone through.

Anders

···

On 2016-06-22, at 23.34, Daniel Dunbar <daniel_dunbar@apple.com> wrote:

On Jun 22, 2016, at 11:30 PM, Anders Bertelrud <anders@apple.com <mailto:anders@apple.com>> wrote:

I'll disable it. What's the condition to check to disable it? It looks like the other performance tests are disabled permanently, is that appropriate?

It is the only option we have, currently.

- Daniel

Anders

On 2016-06-22, at 23.16, Daniel Dunbar <daniel_dunbar@apple.com <mailto:daniel_dunbar@apple.com>> wrote:

+Anders, I don't think we want the perf tests enabled in this config.

- Daniel

On Jun 22, 2016, at 7:52 PM, Jordan Rose via swift-dev <swift-dev@swift.org <mailto:swift-dev@swift.org>> wrote:

This isn’t me. SwiftPM folks, is this real?

/home/buildnode/jenkins/workspace/oss-swift-incremental-RA-linux-ubuntu-15_10/swiftpm/Tests/Basic/PathPerfTests.swift:23: error: PathPerfTests.testJoinPerf_X100000 : failed: The relative standard deviation of the measurements is 12.993% which is higher than the max allowed of 10.000%.
Test Case 'PathPerfTests.testJoinPerf_X100000' failed (7.808 seconds).

Jordan

On Jun 22, 2016, at 19:51, no-reply@swift.org <mailto:no-reply@swift.org> wrote:

[FAILURE] oss-swift-incremental-RA-linux-ubuntu-15_10 [#5898]

Build URL: https://ci.swift.org/job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/
Project: oss-swift-incremental-RA-linux-ubuntu-15_10
Date of build: Wed, 22 Jun 2016 19:36:24 -0700
Build duration: 14 min
Identified problems:

Compile Error: This build failed because of a compile error. Below is a list of all errors in the build log:
Indication 1 <https://ci.swift.org//job/oss-swift-incremental-RA-linux-ubuntu-15_10/5898/consoleFull#68441244ee1a197b-acac-4b17-83cf-a53b95139a76>
Tests:

Name: Swift
Failed: 0 test(s), Passed: 8017 test(s), Total: 8017 test(s)

Changes

Commit 4562567bb35127e5a75b886809648318ea59b40f by jordan_rose:
[docs] LibraryEvolution: size_in_bits -> maximumFootprint.

edit: docs/LibraryEvolution.rst

Commit 2ce6f1eace6fa1cc095fd6e96181359c447aadeb by jordan_rose:
[docs] LibraryEvolution: Camel-case hypothetical attributes.

edit: docs/LibraryEvolution.rst

_______________________________________________
swift-dev mailing list
swift-dev@swift.org <mailto:swift-dev@swift.org>
https://lists.swift.org/mailman/listinfo/swift-dev