feat(audoedit): autoedits provider integration tests (#6536) #25101
ci.yml
on: push
fast_tests_matrix_prep
0s
slow_tests_matrix_prep
0s
build
2m 23s
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Annotations
9 errors, 18 warnings, and 2 notices
test-integration (ubuntu)
Process completed with exit code 1.
|
test-e2e (windows)
npm failed with exit code 1
|
test-e2e (windows)
Process completed with exit code 1.
|
command-edit.test.ts:143:1 › edit (fixup) input - model selection:
vscode/test/e2e/command-edit.test.ts#L159
1) command-edit.test.ts:143:1 › edit (fixup) input - model selection ─────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
157 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
158 | await nap()
> 159 | expect(modelItem).toBeVisible()
| ^
160 |
161 | // Open the model input and check it has the correct item selected
162 | await modelItem.click()
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:159:23
|
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded.
Failed worker ran 22 tests, last 10 tests were:
test/e2e/chat-context.test.ts:11:5 › chat followup context
test/e2e/chat-history.test.ts:17:3 › restore chat from sidebar history view
test/e2e/chat-history.test.ts:50:3 › delete chat from sidebar history view
test/e2e/chat-input.test.ts:25:3 › chat input focus
test/e2e/chat-input.test.ts:96:69 › chat toolbar and row UI
test/e2e/chat-input.test.ts:192:3 › chat model selector
test/e2e/chat-input.test.ts:243:3 › editing follow-up messages in chat view
test/e2e/chat-keyboard-shortcuts.test.ts:14:5 › chat keyboard shortcuts for sidebar chat
test/e2e/chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection
test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
|
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded.
Failed worker ran 1 test:
test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
|
chat-messages.test.ts:17:5 › chat assistant response code buttons:
vscode/test/e2e/chat-messages.test.ts#L1
1) chat-messages.test.ts:17:5 › chat assistant response code buttons ─────────────────────────────
Tearing down "app" exceeded the test timeout of 30000ms.
|
chat-messages.test.ts:17:5 › chat assistant response code buttons:
vscode/test/e2e/chat-messages.test.ts#L1
1) chat-messages.test.ts:17:5 › chat assistant response code buttons ─────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Tearing down "app" exceeded the test timeout of 30000ms.
|
test-e2e (macos)
Process completed with exit code 1.
|
fast_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
slow_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-integration (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-unit (ubuntu, 20)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-unit (ubuntu, 18)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-e2e (windows)
No files were found with the provided path: playwright/
vscode/test-results/. No artifacts will be uploaded.
|
test-e2e (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.4m
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.2m
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 59.2s
|
Slow Test:
vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 51.6s
|
Slow Test:
vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 44.6s
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.2m
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.0m
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 54.4s
|
Slow Test:
vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 46.7s
|
Slow Test:
vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 37.2s
|
🎭 Playwright Run Summary
1 flaky
command-edit.test.ts:143:1 › edit (fixup) input - model selection ──────────────────────────────
5 skipped
46 passed (11.9m)
|
🎭 Playwright Run Summary
1 failed
chat-messages.test.ts:17:5 › chat assistant response code buttons ──────────────────────────────
4 skipped
47 passed (12.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-recordings macos
|
62.3 KB |
|