Skip to content

feat[gen2][A/B testing]: ENG-6308 A/B testing support for data models in gen2 #14310

feat[gen2][A/B testing]: ENG-6308 A/B testing support for data models in gen2

feat[gen2][A/B testing]: ENG-6308 A/B testing support for data models in gen2 #14310

Triggered via pull request June 23, 2025 13:38
Status Failure
Total duration 20m 4s
Artifacts 1

ci.yml

on: pull_request
Gen 2 SDKs checks
3m 39s
Gen 2 SDKs checks
Gen 1 SDK Core
9m 49s
Gen 1 SDK Core
build-angular-gen1
40s
build-angular-gen1
Matrix: build
Matrix: Gen 1 React SDK
Matrix: Gen 1 SDK Snippets
Matrix: Gen 2 SDK Snippets
Matrix: Gen 2 SDKs
Fit to window
Zoom out
Zoom in

Annotations

37 errors, 59 warnings, and 29 notices
Gen 2 SDKs checks
Process completed with exit code 1.
Gen 2 SDKs checks: packages/sdks/src/components/content/data-content.lite.tsx#L6
All imports in the declaration are only used as types. Use `import type`
Gen 2 SDKs checks: packages/sdks/src/components/content/data-content.lite.tsx#L4
All imports in the declaration are only used as types. Use `import type`
Gen 2 SDKs checks: packages/sdks/src/components/content-variants/content-variants.lite.tsx#L17
All imports in the declaration are only used as types. Use `import type`
Gen 2 SDKs checks: packages/sdks/src/components/content-variants/content-variants.lite.tsx#L16
All imports in the declaration are only used as types. Use `import type`
Gen 2 SDK Snippets (solid)
Process completed with exit code 1.
Gen 2 SDK Snippets (solid)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDK Snippets (solid)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDK Snippets (solid)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDK Snippets (solid)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDK Snippets (solid)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDK Snippets (solid)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDK Snippets (angular-17)
Process completed with exit code 1.
Gen 2 SDKs (sveltekit)
Process completed with exit code 1.
Gen 2 SDK Snippets (svelte)
Process completed with exit code 1.
Gen 2 SDKs (svelte)
Process completed with exit code 1.
Gen 2 SDKs (solid-start)
Process completed with exit code 1.
Gen 2 SDKs (solid-start)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDKs (solid-start)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDKs (solid-start)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDKs (solid-start)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDKs (solid-start)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDKs (solid-start)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDKs (solid)
Process completed with exit code 1.
Gen 2 SDKs (solid)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDKs (solid)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDKs (solid)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDKs (solid)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDKs (solid)
Property 'render' of exported interface has or is using private name 'React'.
Gen 2 SDKs (solid)
Exported type alias 'VariantsProviderProps' has or is using private name 'React'.
Gen 2 SDK Snippets (sveltekit)
Process completed with exit code 1.
Gen 2 SDK Snippets (angular-17-ssr)
Process completed with exit code 1.
Gen 2 SDKs (angular-19-ssr)
Process completed with exit code 1.
Gen 2 SDKs (angular-17-ssr)
Process completed with exit code 1.
Gen 2 SDKs (angular-17)
Process completed with exit code 1.
Gen 1 React SDK (gen1-next14-pages)
Process completed with exit code 1.
[gen1-next14-pages] › countdown.spec.ts:5:3 › Symbol with JS Code › correctly updates countdown date: packages/sdks-tests/src/e2e-tests/countdown.spec.ts#L76
1) [gen1-next14-pages] › countdown.spec.ts:5:3 › Symbol with JS Code › correctly updates countdown date Error: Make sure the countdown updates a second time expect(received).toBe(expected) // Object.is equality Expected: true Received: false Call Log: - Timeout 10000ms exceeded while waiting on the predicate 74 | 75 | // repeat the process to ensure the countdown is updating correctly > 76 | await expect | ^ 77 | .poll( 78 | async () => { 79 | if (!secondCountdownValue) throw new Error('firstCheckTime is undefined'); at /home/runner/work/builder/builder/packages/sdks-tests/src/e2e-tests/countdown.spec.ts:76:5
build-angular-gen1
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build (widgets)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build (webcomponents)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Gen 2 SDK Snippets (solid)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDK Snippets (angular-17)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDKs (sveltekit)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDK Snippets (svelte)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDKs (svelte)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDKs (solid-start)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDKs (solid)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDK Snippets (sveltekit)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDK Snippets (angular-17-ssr)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDKs (angular-19-ssr)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDKs (angular-17-ssr)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Gen 2 SDKs (angular-17)
No files were found with the provided path: packages/sdks-tests/playwright-report/. No artifacts will be uploaded.
Slow Test: packages/sdks-tests/[gen1-next14-pages] › link-component.spec.ts#L0
packages/sdks-tests/[gen1-next14-pages] › link-component.spec.ts took 16.6s
Slow Test: packages/sdks-tests/[gen1-next14-pages] › countdown.spec.ts#L0
packages/sdks-tests/[gen1-next14-pages] › countdown.spec.ts took 19.3s
Slow Test: packages/sdks-tests/[gen1-next14-pages] › ab-test.spec.ts#L0
packages/sdks-tests/[gen1-next14-pages] › ab-test.spec.ts took 25.0s
Slow Test: packages/sdks-tests/[gen1-react] › link-component.spec.ts#L0
packages/sdks-tests/[gen1-react] › link-component.spec.ts took 16.9s
Slow Test: packages/sdks-tests/[gen1-react] › ab-test.spec.ts#L0
packages/sdks-tests/[gen1-react] › ab-test.spec.ts took 25.5s
Slow Test: packages/sdks-tests/[react] › ab-test.spec.ts#L0
packages/sdks-tests/[react] › ab-test.spec.ts took 23.6s
Slow Test: packages/sdks-tests/[react-native-76-fabric] › editing.spec.ts#L0
packages/sdks-tests/[react-native-76-fabric] › editing.spec.ts took 16.5s
Slow Test: packages/sdks-tests/[react-native-76-fabric] › link-component.spec.ts#L0
packages/sdks-tests/[react-native-76-fabric] › link-component.spec.ts took 18.1s
Slow Test: packages/sdks-tests/[gen1-next15-app] › link-component.spec.ts#L0
packages/sdks-tests/[gen1-next15-app] › link-component.spec.ts took 17.3s
Slow Test: packages/sdks-tests/[gen1-next15-app] › ab-test.spec.ts#L0
packages/sdks-tests/[gen1-next15-app] › ab-test.spec.ts took 27.6s
Slow Test: packages/sdks-tests/[react-native-74] › large-reactive-state.spec.ts#L0
packages/sdks-tests/[react-native-74] › large-reactive-state.spec.ts took 16.3s
Slow Test: packages/sdks-tests/[react-native-74] › editing.spec.ts#L0
packages/sdks-tests/[react-native-74] › editing.spec.ts took 17.2s
Slow Test: packages/sdks-tests/[react-native-74] › link-component.spec.ts#L0
packages/sdks-tests/[react-native-74] › link-component.spec.ts took 18.4s
Slow Test: packages/sdks-tests/[gen1-remix] › link-component.spec.ts#L0
packages/sdks-tests/[gen1-remix] › link-component.spec.ts took 17.2s
Slow Test: packages/sdks-tests/[gen1-remix] › slot.spec.ts#L0
packages/sdks-tests/[gen1-remix] › slot.spec.ts took 20.7s
Slow Test: packages/sdks-tests/[gen1-remix] › ab-test.spec.ts#L0
packages/sdks-tests/[gen1-remix] › ab-test.spec.ts took 28.7s
Slow Test: packages/sdks-tests/[vue] › link-component.spec.ts#L0
packages/sdks-tests/[vue] › link-component.spec.ts took 16.6s
Slow Test: packages/sdks-tests/[vue] › ab-test.spec.ts#L0
packages/sdks-tests/[vue] › ab-test.spec.ts took 24.1s
Slow Test: packages/sdks-tests/[react-sdk-next-pages] › link-component.spec.ts#L0
packages/sdks-tests/[react-sdk-next-pages] › link-component.spec.ts took 16.6s
Slow Test: packages/sdks-tests/[react-sdk-next-pages] › ab-test.spec.ts#L0
packages/sdks-tests/[react-sdk-next-pages] › ab-test.spec.ts took 23.6s
Slow Test: packages/sdks-tests/[remix] › link-component.spec.ts#L0
packages/sdks-tests/[remix] › link-component.spec.ts took 16.6s
Slow Test: packages/sdks-tests/[remix] › ab-test.spec.ts#L0
packages/sdks-tests/[remix] › ab-test.spec.ts took 23.3s
Slow Test: packages/sdks-tests/[react-sdk-next-14-app] › link-component.spec.ts#L0
packages/sdks-tests/[react-sdk-next-14-app] › link-component.spec.ts took 16.9s
Slow Test: packages/sdks-tests/[react-sdk-next-14-app] › blocks.spec.ts#L0
packages/sdks-tests/[react-sdk-next-14-app] › blocks.spec.ts took 23.2s
Slow Test: packages/sdks-tests/[react-sdk-next-14-app] › ab-test.spec.ts#L0
packages/sdks-tests/[react-sdk-next-14-app] › ab-test.spec.ts took 24.4s
Slow Test: packages/sdks-tests/[hydrogen] › blocks.spec.ts#L0
packages/sdks-tests/[hydrogen] › blocks.spec.ts took 15.9s
Slow Test: packages/sdks-tests/[hydrogen] › link-component.spec.ts#L0
packages/sdks-tests/[hydrogen] › link-component.spec.ts took 17.1s
Slow Test: packages/sdks-tests/[hydrogen] › ab-test.spec.ts#L0
packages/sdks-tests/[hydrogen] › ab-test.spec.ts took 25.7s
Slow Test: packages/sdks-tests/[react-sdk-next-15-app] › link-component.spec.ts#L0
packages/sdks-tests/[react-sdk-next-15-app] › link-component.spec.ts took 16.9s
Slow Test: packages/sdks-tests/[react-sdk-next-15-app] › blocks.spec.ts#L0
packages/sdks-tests/[react-sdk-next-15-app] › blocks.spec.ts took 24.0s
Slow Test: packages/sdks-tests/[react-sdk-next-15-app] › ab-test.spec.ts#L0
packages/sdks-tests/[react-sdk-next-15-app] › ab-test.spec.ts took 25.4s
Slow Test: packages/sdks-tests/[nextjs-sdk-next-app] › symbols.spec.ts#L0
packages/sdks-tests/[nextjs-sdk-next-app] › symbols.spec.ts took 16.9s
Slow Test: packages/sdks-tests/[nextjs-sdk-next-app] › link-component.spec.ts#L0
packages/sdks-tests/[nextjs-sdk-next-app] › link-component.spec.ts took 17.2s
Slow Test: packages/sdks-tests/[nextjs-sdk-next-app] › large-reactive-state.spec.ts#L0
packages/sdks-tests/[nextjs-sdk-next-app] › large-reactive-state.spec.ts took 22.4s
Slow Test: packages/sdks-tests/[nextjs-sdk-next-app] › ab-test.spec.ts#L0
packages/sdks-tests/[nextjs-sdk-next-app] › ab-test.spec.ts took 25.5s
Slow Test: packages/sdks-tests/[nextjs-sdk-next-app] › accordion.spec.ts#L0
packages/sdks-tests/[nextjs-sdk-next-app] › accordion.spec.ts took 1.0m
Slow Test: packages/sdks-tests/[nuxt] › blocks.spec.ts#L0
packages/sdks-tests/[nuxt] › blocks.spec.ts took 15.2s
Slow Test: packages/sdks-tests/[nuxt] › link-component.spec.ts#L0
packages/sdks-tests/[nuxt] › link-component.spec.ts took 17.1s
Slow Test: packages/sdks-tests/[nuxt] › ab-test.spec.ts#L0
packages/sdks-tests/[nuxt] › ab-test.spec.ts took 28.2s
Slow Test: packages/sdks-tests/[qwik-city] › blocks.spec.ts#L0
packages/sdks-tests/[qwik-city] › blocks.spec.ts took 16.1s
Slow Test: packages/sdks-tests/[qwik-city] › symbols.spec.ts#L0
packages/sdks-tests/[qwik-city] › symbols.spec.ts took 17.1s
Slow Test: packages/sdks-tests/[qwik-city] › link-component.spec.ts#L0
packages/sdks-tests/[qwik-city] › link-component.spec.ts took 17.4s
Slow Test: packages/sdks-tests/[qwik-city] › editing.spec.ts#L0
packages/sdks-tests/[qwik-city] › editing.spec.ts took 22.5s
Slow Test: packages/sdks-tests/[qwik-city] › ab-test.spec.ts#L0
packages/sdks-tests/[qwik-city] › ab-test.spec.ts took 28.7s
🎭 Playwright Run Summary
1 failed [gen1-next14-pages] › countdown.spec.ts:5:3 › Symbol with JS Code › correctly updates countdown date 76 skipped 171 passed (3.2m)
🎭 Playwright Run Summary
45 skipped 15 passed (18.1s)
🎭 Playwright Run Summary
25 skipped 35 passed (29.5s)
🎭 Playwright Run Summary
27 skipped 33 passed (21.5s)
🎭 Playwright Run Summary
39 skipped 21 passed (22.2s)
🎭 Playwright Run Summary
26 skipped 34 passed (35.2s)
🎭 Playwright Run Summary
27 skipped 33 passed (25.5s)
🎭 Playwright Run Summary
26 skipped 34 passed (23.0s)
🎭 Playwright Run Summary
49 skipped 11 passed (20.1s)
🎭 Playwright Run Summary
27 skipped 33 passed (26.9s)
🎭 Playwright Run Summary
2 skipped 58 passed (31.4s)
🎭 Playwright Run Summary
50 skipped 10 passed (17.4s)
🎭 Playwright Run Summary
26 skipped 34 passed (25.6s)
🎭 Playwright Run Summary
49 skipped 11 passed (23.9s)
🎭 Playwright Run Summary
70 skipped 178 passed (4.1m)
🎭 Playwright Run Summary
30 skipped 218 passed (4.0m)
🎭 Playwright Run Summary
131 skipped 117 passed (2.7m)
🎭 Playwright Run Summary
76 skipped 172 passed (4.4m)
🎭 Playwright Run Summary
131 skipped 117 passed (2.8m)
🎭 Playwright Run Summary
80 skipped 168 passed (4.7m)
🎭 Playwright Run Summary
71 skipped 177 passed (3.9m)
🎭 Playwright Run Summary
46 skipped 202 passed (4.3m)
🎭 Playwright Run Summary
48 skipped 200 passed (4.3m)
🎭 Playwright Run Summary
47 skipped 201 passed (4.7m)
🎭 Playwright Run Summary
46 skipped 202 passed (4.9m)
🎭 Playwright Run Summary
46 skipped 202 passed (4.9m)
🎭 Playwright Run Summary
87 skipped 161 passed (6.9m)
🎭 Playwright Run Summary
62 skipped 186 passed (7.3m)
🎭 Playwright Run Summary
52 skipped 196 passed (8.4m)

Artifacts

Produced during runtime
Name Size Digest
gen1-next14-pages-playwright-report
151 MB
sha256:7950ebccdf57c3a677417478696d18c2e4a977bda29892466940418bd5be36ca