[WIP] Add tests for multimodal runner

[jackzhxng]

Tests for multimodal runner

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13697

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 28 New Failures

As of commit b9c1fe2 with merge base 6e520e2 ():

NEW FAILURES - The following jobs have failed:

• Build Presets / apple (ios-simulator) / build (gh)
  /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long long') to 'int' in initializer list [-Wc++11-narrowing]
• Build Presets / apple (ios) / build (gh)
  /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long long') to 'int' in initializer list [-Wc++11-narrowing]
• Build Presets / apple (llm) / build (gh)
  /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long long') to 'int' in initializer list [-Wc++11-narrowing]
• Build Presets / apple (macos) / build (gh)
  /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long long') to 'int' in initializer list [-Wc++11-narrowing]
• Build Presets / linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• Build Presets / linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
  RuntimeError: Command docker exec -t 09436346b0926308c54cced5e4d5b6c034b02ef2bae85832b78c91c781f859e7 /exec failed with exit code 2
• Build Presets / linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• Build Presets / linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
  RuntimeError: Command docker exec -t af2d95bac5a8c0d7b8d2240b74fc7b164a12129debd0278cf100e181847b876f /exec failed with exit code 2
• Lint / lintrunner / linux-job (gh)
  >>> Lint for extension/llm/runner/test/test_multimodal_prefiller.cpp:
• pull / android / build-llm-demo / linux-job (gh)
  RuntimeError: Command docker exec -t d78b7ce68109438af2c127f1a5ea6818889182dfd3c0d7a9ea07221db42fe211 /exec failed with exit code 2
• pull / test-llama-lora-linux / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  RuntimeError: Command docker exec -t a4d8cea875cf7cd89d0a50f5537742745a9d0cd5338e38a6cd2bf4828651bd9b /exec failed with exit code 2
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
  RuntimeError: Command docker exec -t f5b2ea330dfdfc48fb14d2ee808aab829e4aa6fe1caec6ba36056d93d5a5241c /exec failed with exit code 2
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  RuntimeError: Command docker exec -t 4a681012dbcfaa83a015328312fb536e6af3097c3f5b065a6c233b25924e823d /exec failed with exit code 2
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  RuntimeError: Command docker exec -t 625cfde16bfd6f3f4ee1a5fcec5aa0ff56c4dfb7fe2aa86dced87b74274aed04 /exec failed with exit code 2
• pull / test-llama-runner-linux-android / linux-job (gh)
  RuntimeError: Command docker exec -t ede29bc512ae8ac01527916c7fa0f4e10027780b728b916eb9578aa4ce720944 /exec failed with exit code 2
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t d2b816a2c94df980930c5240ea12cf092ad51106fd18c8823089cca63b1b0b71 /exec failed with exit code 2
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / test-llava-runner-linux / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / test-phi-3-mini-runner-linux / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / test-static-llama-qnn-linux / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / unittest / linux / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / unittest / macos / macos-job (gh)
  /Users/ec2-user/runner/_work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / unittest-editable / linux / linux-job (gh)
  /pytorch/executorch/extension/llm/runner/multimodal_prefiller.cpp:107:32: error: non-constant-expression cannot be narrowed from type 'int64_t' (aka 'long') to 'int' in initializer list [-Wc++11-narrowing]
• pull / unittest-editable / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 2

This comment was automatically generated by Dr. CI and updates every 15 minutes.