Skip to content

v2 Smoke Test & Integration Test #568

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 148 commits into from
Jul 23, 2025
Merged
Changes from 1 commit
Commits
Show all changes
148 commits
Select commit Hold shift + click to select a range
6cfaab9
Push Initial Commit for Main
imda-benedictlee May 21, 2025
fdd20d0
Add Compose for Prod
imda-benedictlee May 21, 2025
7be8f53
Debug Location
imda-benedictlee May 21, 2025
13a575a
Debug Files
imda-benedictlee May 21, 2025
7995bb0
Fix Directory Typo
imda-benedictlee May 21, 2025
cb4271e
Checkout current branch
imda-benedictlee May 21, 2025
bc0e5ac
Add Free Disk Space
imda-benedictlee May 21, 2025
5f91ae0
Fix Typo
imda-benedictlee May 21, 2025
3c4e166
Fix Free Disk Space Path
imda-benedictlee May 21, 2025
0004a67
Increase Workflow Timeout
imda-benedictlee May 21, 2025
f90c805
Fix Typo
imda-benedictlee May 21, 2025
db6c3c5
Debug Files in Directory
imda-benedictlee May 21, 2025
68f6309
Repositin Checkout of Smoke Test
imda-benedictlee May 21, 2025
062bdcd
Rearrange Smoke Test and Change Smoke Test Branch Ref Checkout
imda-benedictlee May 21, 2025
a01d9bf
Check Event Triggers
imda-benedictlee May 22, 2025
9bfffa1
Change Playwright Test URL
imda-benedictlee May 22, 2025
20b7830
Running Target Production Build
imda-benedictlee May 22, 2025
561e075
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee May 29, 2025
c83756e
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee May 30, 2025
7777736
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee May 30, 2025
432fe94
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee Jun 1, 2025
a6f0da5
Clean Up Smoke Test Workflow Run
imda-benedictlee Jun 1, 2025
df125ed
Add Command to Run Free Disk Space & Split Docker Compose Commands In…
imda-benedictlee Jun 1, 2025
2904c78
Add No-Cache When Building AI Verify Python Base
imda-benedictlee Jun 1, 2025
36c9ea0
Change Build Procedures
imda-benedictlee Jun 1, 2025
8d0be7a
Add Free Disk Space Command After Docker Compose
imda-benedictlee Jun 1, 2025
054be35
Remove NPM Install
imda-benedictlee Jun 1, 2025
07ab719
Use docker compose up to start containers
imda-benedictlee Jun 1, 2025
304352b
Change to NPM CI
imda-benedictlee Jun 1, 2025
069cda8
Refactor Smoke Test Workflow
imda-benedictlee Jun 1, 2025
9ca6460
Fix Typo
imda-benedictlee Jun 1, 2025
5da645e
Add Free Disk Space Command
imda-benedictlee Jun 1, 2025
8fb6366
Add Docker Builder Prune To Clear Builder Image Cache
imda-benedictlee Jun 1, 2025
2b61da9
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee Jun 8, 2025
0b128ed
Merge branch 'main' of https://github.com/aiverify-foundation/aiverif…
imda-benedictlee Jun 17, 2025
027b2ee
Refactor Smoke Test Workflow
imda-benedictlee Jun 17, 2025
02855b4
Fix Repo Naming
imda-benedictlee Jun 17, 2025
6ce0039
Fix Starting Parameters for Smoke Test
imda-benedictlee Jun 17, 2025
e4fedee
Add Commands to clear cache and free space
imda-benedictlee Jun 17, 2025
2a31248
Try logging into AWS for Integration Test
imda-benedictlee Jun 17, 2025
9b98104
Add Role to Assume
imda-benedictlee Jun 17, 2025
b747362
Add OIDC Permissions
imda-benedictlee Jun 17, 2025
38a9eb5
Add Command to Pull Portal Image
imda-benedictlee Jun 17, 2025
1c328eb
Add Commands To Pull Various Images
imda-benedictlee Jun 17, 2025
ddd1f9a
Add Command to Run AI Verify Containers
imda-benedictlee Jun 17, 2025
a2f6a9d
Rename Job Name
imda-benedictlee Jun 17, 2025
b5ace43
Add Schedule to run Integration Test Daily
imda-benedictlee Jun 17, 2025
217fe69
Add Tag for Test Engine Worker
imda-benedictlee Jun 17, 2025
50d9486
Fix Typo
imda-benedictlee Jun 17, 2025
1a65e3b
Add Test Engine Worker Tag
imda-benedictlee Jun 17, 2025
d658a66
Checkout Code Main
imda-benedictlee Jun 17, 2025
cb02d10
Comment Out Pull of Test Engine Worker Docker Image
imda-benedictlee Jun 17, 2025
42954dd
use self-hosted runner
kwkinet Jun 19, 2025
ad85bb8
use self-hosted runner
kwkinet Jun 19, 2025
e8cbfb1
use self-hosted runner
kwkinet Jun 20, 2025
b04e620
Merge branch 'main' of https://github.com/aiverify-foundation/aiverif…
imda-benedictlee Jun 24, 2025
61d3cc6
Merge branch 'ci/self-hosted-runner' of https://github.com/aiverify-f…
imda-benedictlee Jun 24, 2025
6f4b39f
Modify Smoke Test to Run on Runner
imda-benedictlee Jun 24, 2025
0a414f7
Change to npm install
imda-benedictlee Jun 24, 2025
4e866ff
Debug Port Number Process
imda-benedictlee Jun 24, 2025
08a1f80
Debug Port Number
imda-benedictlee Jun 24, 2025
08439aa
Debug Process 3000
imda-benedictlee Jun 24, 2025
872deac
Restart Docker To Reset Networking Ports
imda-benedictlee Jun 24, 2025
aaec260
Sudo Restart Docker
imda-benedictlee Jun 24, 2025
11fca67
Bring Down Containers
imda-benedictlee Jun 24, 2025
7c12de1
Fix Typo
imda-benedictlee Jun 24, 2025
ea57a73
Change Container Start Command
imda-benedictlee Jun 24, 2025
8de12ba
Revert To Original
imda-benedictlee Jun 24, 2025
aff0fbf
Remove Portal Profile Command
imda-benedictlee Jun 24, 2025
d0365f5
Add Docker Builder Prune Command
imda-benedictlee Jun 24, 2025
566fa07
Fix Typo
imda-benedictlee Jun 24, 2025
387ede8
Refactored Integration Test Workflow
imda-benedictlee Jun 24, 2025
9a236b4
Add Yes Option For Both Workflows
imda-benedictlee Jun 24, 2025
e85c17c
Change Docker Builder Prune Option to -f
imda-benedictlee Jun 24, 2025
e7a22dd
Add Downloadable Trace
imda-benedictlee Jun 24, 2025
81f55e0
Log GITHUB WORKSPACE
imda-benedictlee Jun 24, 2025
9a32d80
Fix Path
imda-benedictlee Jun 24, 2025
e4e07b4
Refactor Smoke Test
imda-benedictlee Jun 24, 2025
7e9f948
Clean Up Integration Test
imda-benedictlee Jun 24, 2025
766cdd3
Change to GitHub Workspace
imda-benedictlee Jun 24, 2025
6080033
Add Double Quotation For github.workspace
imda-benedictlee Jun 25, 2025
d095adf
Change GitHub Workspace in Smoke Test Command
imda-benedictlee Jun 25, 2025
2c0b474
Remove Additional Double Quote
imda-benedictlee Jun 25, 2025
4917443
Change Where Workspace Variable Is At
imda-benedictlee Jun 25, 2025
71433ed
List Folder Directory For Debug
imda-benedictlee Jun 25, 2025
eff9f6a
Add Double Quotation Marks
imda-benedictlee Jun 25, 2025
229fdf5
Fix Typo
imda-benedictlee Jun 25, 2025
40c007e
Fix Variable Typo
imda-benedictlee Jun 25, 2025
b024c6e
Add Stage to Prepare Test Data For Smoke Test
imda-benedictlee Jun 25, 2025
ce995c8
Run Upload Playwright Traces Always
imda-benedictlee Jun 25, 2025
bce9347
Change Path For Playwright Traces
imda-benedictlee Jun 25, 2025
9b48fd2
Add Standalone Plugin Integration Test
imda-benedictlee Jun 26, 2025
2b87c09
Change to --profile automated-tests-venv
imda-benedictlee Jun 26, 2025
ac0f040
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee Jul 1, 2025
106a78f
Update Smoke Test Execution Commands
imda-benedictlee Jul 1, 2025
8b7cd4a
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee Jul 9, 2025
892dd52
Merge branch 'main' into fix-smoke-test-workflow
imda-benedictlee Jul 15, 2025
6f47e01
Change Timeout Minutes to 60 Minutes
imda-benedictlee Jul 17, 2025
3439213
Make Changes To CI/CD Workflow and Added Debug Code
imda-benedictlee Jul 17, 2025
b6431c6
Fix Typo
imda-benedictlee Jul 17, 2025
3730cea
Revert Some Commands
imda-benedictlee Jul 17, 2025
467ad9e
Add Flag to Prune All Volumes
imda-benedictlee Jul 17, 2025
010fcb2
Add GCHR Login
imda-benedictlee Jul 17, 2025
b70907b
Fix Typo
imda-benedictlee Jul 17, 2025
217b6d5
Update v2-smoke-test.yml
imda-benedictlee Jul 17, 2025
997325e
Clean Up Smoke Test Workflow
imda-benedictlee Jul 17, 2025
d23b6b1
Add Log Message
imda-benedictlee Jul 17, 2025
6cb99ed
Change Timeout Minutes
imda-benedictlee Jul 17, 2025
d9e67f6
Add Integration Test Preparation Step
imda-benedictlee Jul 17, 2025
0e43f5f
Remove Unused Files
imda-benedictlee Jul 18, 2025
cc492af
Add Zip Package Install Command
imda-benedictlee Jul 18, 2025
45dc8f0
Merge branch 'main' of https://github.com/aiverify-foundation/aiverif…
imda-benedictlee Jul 18, 2025
374844b
Fix Path Typo
imda-benedictlee Jul 18, 2025
1c0dada
Change Cron Job for Integration Test to 11:05pm
imda-benedictlee Jul 18, 2025
9ce8190
Fix Path
imda-benedictlee Jul 18, 2025
bb6374d
Change Concurrency Group for Integration Test Workflow
imda-benedictlee Jul 18, 2025
188f162
Change Concurrency Group For Smoke Test
imda-benedictlee Jul 18, 2025
e10ac1b
Fix Path Typo
imda-benedictlee Jul 19, 2025
788a19c
Fixed Copying of Test Data
imda-benedictlee Jul 19, 2025
2e62f74
Update Copy Path
imda-benedictlee Jul 19, 2025
66777ae
Tidy Up Code
imda-benedictlee Jul 19, 2025
5d88f8a
Update APIGW and Standalone Integration Test Condition to run always …
imda-benedictlee Jul 19, 2025
b974d32
Add Always Conditional Statement to Standalone Plugin Step
imda-benedictlee Jul 19, 2025
61af702
Add A Step Where Playwright Traces Step does not run when Smoke Test …
imda-benedictlee Jul 19, 2025
01b4876
Skips Upload Playwright Traces Step If There Are No Failures
imda-benedictlee Jul 19, 2025
ec4ade6
Merge branch 'main' of https://github.com/aiverify-foundation/aiverif…
imda-benedictlee Jul 19, 2025
36ced75
Rearranging Uploading of Playwright Traces and fixing Standalone Plug…
imda-benedictlee Jul 21, 2025
4238f1d
Clean Up Integration Test Workflow
imda-benedictlee Jul 21, 2025
dc032be
Clean Up Smoke Test Workflow Code
imda-benedictlee Jul 21, 2025
9494a96
Debug Standalone Plugin Test
imda-benedictlee Jul 21, 2025
b5c829b
Restore Other Integration Test Workflow portion
imda-benedictlee Jul 21, 2025
3d08be3
Debug Permissions Issue
imda-benedictlee Jul 22, 2025
e088007
Add sudo
imda-benedictlee Jul 22, 2025
3af9337
Change File Owner
imda-benedictlee Jul 22, 2025
a76c897
Change Mod to 777
imda-benedictlee Jul 22, 2025
eff6e10
Clean Up chmod commands
imda-benedictlee Jul 22, 2025
a08fa98
Clean Up Chmod Commands and Debug Standalone Plugin Integration Test …
imda-benedictlee Jul 22, 2025
ceac480
Add Pytest Verbose Mode For Debug
imda-benedictlee Jul 22, 2025
b0d7539
Add pip install json Command
imda-benedictlee Jul 22, 2025
ff2c522
Merge branch 'main' of https://github.com/aiverify-foundation/aiverif…
imda-benedictlee Jul 22, 2025
b034d3b
Remove pip install json
imda-benedictlee Jul 22, 2025
4fca09d
Comment Out Docker Build Portion
imda-benedictlee Jul 22, 2025
5d26306
Add Shell to Standalone Plugin Test Portion
imda-benedictlee Jul 22, 2025
d376d08
Clean Up For API and UI Integration Testing
imda-benedictlee Jul 22, 2025
22e3b0a
Comment Out Standalone Integration Test Portion
imda-benedictlee Jul 22, 2025
80842cf
Merge branch 'main' of https://github.com/aiverify-foundation/aiverif…
imda-benedictlee Jul 22, 2025
3c12835
Add One More Copy Command
imda-benedictlee Jul 23, 2025
c0d4856
Add Line to Copy Corrupted ALE Plugin Zip File
imda-benedictlee Jul 23, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove NPM Install
imda-benedictlee committed Jun 1, 2025
commit 054be35231a03eabbe68d2b814def020d381392b
1 change: 1 addition & 0 deletions .github/workflows/v2-smoke-test.yml
Original file line number Diff line number Diff line change
@@ -166,6 +166,7 @@ jobs:
run: |
cd smoke-testing
npm install
bash ${GITHUB_WORKSPACE}/.ci/free_disk_space.sh
npx playwright install --with-deps
URL=http://127.0.0.1:3000 npx playwright test tests/03-smoke.spec.js