Skip to content

[CI][Integration][Archery] Show stderr in the test result summary section #46822

Open
@kou

Description

@kou

Describe the enhancement requested

We may have useful information in stderr. For example, JS may show backtrace into stderr:

https://github.com/apache/arrow/actions/runs/15670314882/job/44140207086?pr=46821#step:12:6691

  #
  # Fatal error in , line 0
  # unreachable code
  #
  #
  #
  #FailureMessage Object: 0x7f1c184736c0
  ----- Native stack trace -----
  
   1: 0x7f1c1eed4fd7  [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   2: 0x7f1c1fc0f91f V8_Fatal(char const*, ...) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   3: 0x7f1c1f91db8f int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   4: 0x7f1c1f91dd31 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   5: 0x7f1c1f91f4b6 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   6: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   7: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   8: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
   9: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  10: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  11: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  12: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  13: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  14: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  15: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  16: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  17: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  18: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  19: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  20: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  21: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  22: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  23: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  24: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  25: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  26: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  27: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  28: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  29: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  30: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  31: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  32: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  33: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  34: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  35: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  36: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  37: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  38: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  39: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  40: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  41: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  42: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  43: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  44: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  45: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  46: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  47: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  48: 0x7f1c1f91e03d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  49: 0x7f1c1f91f261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  50: 0x7f1c1f91f5aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  51: 0x7f1c1f91d545 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  52: 0x7f1c1f91dd31 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  53: 0x7f1c1f921796 v8::internal::ObjectDeserializer::Deserialize() [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  54: 0x7f1c1f9219a1 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  55: 0x7f1c1f9143d7 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  56: 0x7f1c1f3fd112  [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  57: 0x7f1c1f3fd4bd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  58: 0x7f1c1f35b9e6 v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  59: 0x7f1c1ee44b8b node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  60: 0x7f1c1f39923e  [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  61: 0x7f1c1f399560 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  62: 0x7f1c1f1611b6  [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
  Trace/breakpoint trap (core dumped)
  ======================================================================
  Testing file /tmp/arrow-integration-dyu44kc8/generated_dictionary_unsigned.json
  -- Creating binary inputs
  -- Validating file
  -- Validating stream
  Traceback (most recent call last):
    File "/arrow/dev/archery/archery/integration/runner.py", line 317, in _run_ipc_test_case
      run_binaries(producer, consumer, test_case)
    File "/arrow/dev/archery/archery/integration/runner.py", line 358, in _produce_consume
      producer.file_to_stream(producer_file_path, producer_stream_path)
    File "/arrow/dev/archery/archery/integration/tester_js.py", line 79, in file_to_stream
      self.run_shell_command(cmd, cwd=ARROW_JS_ROOT)
    File "/arrow/dev/archery/archery/integration/tester.py", line 233, in run_shell_command
      subprocess.check_call(cmd, **kwargs)
    File "/opt/conda/envs/arrow/lib/python3.11/subprocess.py", line 413, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '/build/js/bin/file-to-stream.ts < /tmp/tmpt03rssdk/4f8268e5_generated_dictionary_unsigned.json_as_file > /tmp/tmpt03rssdk/4f8268e5_generated_dictionary_unsigned.producer_file_as_stream' returned non-zero exit status 133.
  ======================================================================

If the information is available in the last "Integration: Test: Result" section, it's useful to find the problem:

FYI: The current message:

https://github.com/apache/arrow/actions/runs/15670314882/job/44140207086?pr=46821#step:12:19789

 Integration: Test: Result
  ################# FAILURES #################
  FAILED TEST: dictionary_unsigned JS producing,  C++ consuming
  <class 'subprocess.CalledProcessError'>: Command '/build/js/bin/file-to-stream.ts < /tmp/tmpt03rssdk/4f8268e5_generated_dictionary_unsigned.json_as_file > /tmp/tmpt03rssdk/4f8268e5_generated_dictionary_unsigned.producer_file_as_stream' returned non-zero exit status 133.

Component(s)

Continuous Integration, Archery, Integration

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions