MemoryError in SIL/parse_stdlib_X.sil tests when building toolchain on Ubuntu 15.10

Development Compiler
1

Apologies if this is being tracked elsewhere, but I started getting these
failures when building the toolchain on Linux.

I triggered this by running utils/update-checkout --clone &&
utils/build-toolchain local.swift on a fresh machine. All other tests pass (
8457/8459).

Any thoughts as to why this may have started happening? Should I file a
ticket a JIRA about this?

On an unrelated note: is there a preset, or extra commands, to skip running
the tests when building the toolchain?

Thanks.

···

===

UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil (8443 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil'
FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in
execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12,
in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in
executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in
_runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in
executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 216, in
executeCommand
    out,err = p.communicate(input=input)
  File "/usr/lib/python2.7/subprocess.py", line 799, in communicate
    return self._communicate(input)
  File "/usr/lib/python2.7/subprocess.py", line 1417, in _communicate
    stderr = ''.join(stderr)
MemoryError

********************
UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil (8444 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil'
FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in
execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12,
in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in
executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in
_runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in
executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 224, in
executeCommand
    err = convert_string(err)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 22, in
convert_string
    return to_string(bytes.decode('utf-8'))
  File "/swift-development/llvm/utils/lit/lit/util.py", line 18, in
to_string
    return to_bytes(bytes)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 13, in to_bytes
    return str.encode('utf-8')
MemoryError

2

Hi,

Can you please file a bug on bugs.swift.org? Can you please include the commit(sha) you started seeing this?

Thanks,
Mishal Shah

···

On Aug 11, 2016, at 10:10 AM, Jean-Pierre Simard via swift-dev <swift-dev@swift.org> wrote:

Apologies if this is being tracked elsewhere, but I started getting these failures when building the toolchain on Linux.

I triggered this by running utils/update-checkout --clone && utils/build-toolchain local.swift on a fresh machine. All other tests pass (8457/8459).

Any thoughts as to why this may have started happening? Should I file a ticket a JIRA about this?

On an unrelated note: is there a preset, or extra commands, to skip running the tests when building the toolchain?

Thanks.

===

UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil (8443 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil' FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12, in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in _runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 216, in executeCommand
    out,err = p.communicate(input=input)
  File "/usr/lib/python2.7/subprocess.py", line 799, in communicate
    return self._communicate(input)
  File "/usr/lib/python2.7/subprocess.py", line 1417, in _communicate
    stderr = ''.join(stderr)
MemoryError

********************
UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil (8444 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil' FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12, in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in _runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 224, in executeCommand
    err = convert_string(err)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 22, in convert_string
    return to_string(bytes.decode('utf-8'))
  File "/swift-development/llvm/utils/lit/lit/util.py", line 18, in to_string
    return to_bytes(bytes)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 13, in to_bytes
    return str.encode('utf-8')
MemoryError

_______________________________________________
swift-dev mailing list
swift-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-dev

3

I think this is the spew of deprecation warnings thing I was investigating yesterday. I just merged the fix for that, so try updating to the latest master and try again.

Jordan

···

On Aug 11, 2016, at 10:21, Mishal Shah via swift-dev <swift-dev@swift.org> wrote:

Hi,

Can you please file a bug on bugs.swift.org <Issues · apple/swift · GitHub? Can you please include the commit(sha) you started seeing this?

Thanks,
Mishal Shah

On Aug 11, 2016, at 10:10 AM, Jean-Pierre Simard via swift-dev <swift-dev@swift.org <mailto:swift-dev@swift.org>> wrote:

Apologies if this is being tracked elsewhere, but I started getting these failures when building the toolchain on Linux.

I triggered this by running utils/update-checkout --clone && utils/build-toolchain local.swift on a fresh machine. All other tests pass (8457/8459).

Any thoughts as to why this may have started happening? Should I file a ticket a JIRA about this?

On an unrelated note: is there a preset, or extra commands, to skip running the tests when building the toolchain?

Thanks.

===

UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil (8443 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil' FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12, in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in _runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 216, in executeCommand
    out,err = p.communicate(input=input)
  File "/usr/lib/python2.7/subprocess.py", line 799, in communicate
    return self._communicate(input)
  File "/usr/lib/python2.7/subprocess.py", line 1417, in _communicate
    stderr = ''.join(stderr)
MemoryError

********************
UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil (8444 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil' FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12, in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in _runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 224, in executeCommand
    err = convert_string(err)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 22, in convert_string
    return to_string(bytes.decode('utf-8'))
  File "/swift-development/llvm/utils/lit/lit/util.py", line 18, in to_string
    return to_bytes(bytes)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 13, in to_bytes
    return str.encode('utf-8')
MemoryError

_______________________________________________
swift-dev mailing list
swift-dev@swift.org <mailto:swift-dev@swift.org>
https://lists.swift.org/mailman/listinfo/swift-dev

_______________________________________________
swift-dev mailing list
swift-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-dev

4

Thanks Jordan, that fixed it! Sorry for the noise here, will go straight to
file a bug next time.

···

On Thu, 11 Aug 2016 at 10:26 Jordan Rose <jordan_rose@apple.com> wrote:

I think this is the spew of deprecation warnings thing I was investigating
yesterday. I just merged the fix for that, so try updating to the latest
master and try again.

Jordan

On Aug 11, 2016, at 10:21, Mishal Shah via swift-dev <swift-dev@swift.org> > wrote:

Hi,

Can you please file a bug on bugs.swift.org? Can you please include the
commit(sha) you started seeing this?

Thanks,
Mishal Shah

On Aug 11, 2016, at 10:10 AM, Jean-Pierre Simard via swift-dev < > swift-dev@swift.org> wrote:

Apologies if this is being tracked elsewhere, but I started getting these
failures when building the toolchain on Linux.

I triggered this by running utils/update-checkout --clone &&
utils/build-toolchain local.swift on a fresh machine. All other tests
pass (8457/8459).

Any thoughts as to why this may have started happening? Should I file a
ticket a JIRA about this?

On an unrelated note: is there a preset, or extra commands, to skip
running the tests when building the toolchain?

Thanks.

===

UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil (8443 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_0.sil'
FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in
execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12,
in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in
executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in
_runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in
executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 216, in
executeCommand
    out,err = p.communicate(input=input)
  File "/usr/lib/python2.7/subprocess.py", line 799, in communicate
    return self._communicate(input)
  File "/usr/lib/python2.7/subprocess.py", line 1417, in _communicate
    stderr = ''.join(stderr)
MemoryError

********************
UNRESOLVED: Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil (8444 of 8459)
******************** TEST 'Swift(linux-x86_64) :: SIL/parse_stdlib_7.sil'
FAILED ********************
Exception during script execution:
Traceback (most recent call last):
  File "/swift-development/llvm/utils/lit/lit/run.py", line 166, in
execute_test
    result = test.config.test_format.execute(test, self.lit_config)
  File "/swift-development/swift/test/lit.cfg", line 175, in execute
    result = super(SwiftTest, self).execute(test, litConfig)
  File "/swift-development/llvm/utils/lit/lit/formats/shtest.py", line 12,
in execute
    self.execute_external)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 734, in
executeShTest
    res = _runShTest(test, litConfig, useExternalSh, script, tmpBase)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 680, in
_runShTest
    res = executeScript(test, litConfig, tmpBase, script, execdir)
  File "/swift-development/llvm/utils/lit/lit/TestRunner.py", line 470, in
executeScript
    timeout=litConfig.maxIndividualTestTime)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 224, in
executeCommand
    err = convert_string(err)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 22, in
convert_string
    return to_string(bytes.decode('utf-8'))
  File "/swift-development/llvm/utils/lit/lit/util.py", line 18, in
to_string
    return to_bytes(bytes)
  File "/swift-development/llvm/utils/lit/lit/util.py", line 13, in
to_bytes
    return str.encode('utf-8')
MemoryError

_______________________________________________
swift-dev mailing list
swift-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-dev

_______________________________________________
swift-dev mailing list
swift-dev@swift.org
https://lists.swift.org/mailman/listinfo/swift-dev