test: integration tests for PR pipeline #466

jwrobdolby · 2024-10-24T06:40:48Z

Initial integration tests of WebSDK to be run in PR pipeline. Next steps are:

create token before each run to avoid streamName conflicts
provide env variables used by tests
extend github workflow to run on rp2 and staging

changeset-bot · 2024-10-24T06:40:52Z

⚠️ No Changeset found

Latest commit: 94338b9

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

dubeyShivank · 2024-10-29T04:26:54Z

packages/millicast-sdk/integration-tests/tsconfig.json

@@ -0,0 +1,24 @@
+{


Question - does this need its own tsconfig? Won't it just use the one used by packages/millicast-sdk ?

@gregdolby @Santiago-Souto @vishalkharge if you guys know?

It looks like it is reccomended for playwright. lhttps://playwright.dev/docs/test-typescript#tsconfigjson

packages/millicast-sdk/integration-tests/src/support-utils/utils.ts

packages/millicast-sdk/integration-tests/src/support-utils/generic.ts

dubeyShivank · 2024-10-29T04:34:44Z

.github/workflows/integration-tests.yml

@@ -0,0 +1,78 @@
+name: Integration Tests


Question(s) maybe for @vishalkharge

This isn't running on a docker image, is it? It's running on GH runners, so should we be mindful of the number of tests and the number of re-tries we perform?

packages/millicast-sdk/integration-tests/features/connect.feature

…urceId

Santiago-Souto · 2024-12-02T20:59:41Z

packages/millicast-sdk/integration-tests/features/simulcast.feature

+        When the "viewer1" selects simulcast layer with encodingId "0"
+        Then the "viewer1" verifies video resolution for layer "0"
+
+        When the "viewer1" selects simulcast layer with encodingId "1"
+        Then the "viewer1" verifies video resolution for layer "1"
+
+        When the "viewer1" selects simulcast layer with encodingId "2"
+        Then the "viewer1" verifies video resolution for layer "2"


Instead of 0,1,2 this should be f,h,q

modifying to not require --testMatch for windows

jwrobdolby requested review from vincentsong, gregdolby, Santiago-Souto and dubeyShivank October 24, 2024 06:40

jwrobdolby force-pushed the int-tests branch from 2cf8652 to 32dc983 Compare October 28, 2024 11:20

jwrobdolby had a problem deploying to qa_dev October 28, 2024 11:20 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 28, 2024 11:20 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_dev October 28, 2024 11:32 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 28, 2024 11:32 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_dev October 28, 2024 11:57 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 28, 2024 11:57 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_dev October 28, 2024 12:08 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 28, 2024 12:08 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_dev October 28, 2024 12:27 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 28, 2024 12:27 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_dev October 28, 2024 13:39 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 28, 2024 13:39 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_dev October 28, 2024 13:54 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 28, 2024 13:54 — with GitHub Actions Failure

dubeyShivank reviewed Oct 29, 2024

View reviewed changes

packages/millicast-sdk/integration-tests/src/support-utils/utils.ts Outdated Show resolved Hide resolved

dubeyShivank reviewed Oct 29, 2024

View reviewed changes

packages/millicast-sdk/integration-tests/src/support-utils/generic.ts Outdated Show resolved Hide resolved

dubeyShivank reviewed Oct 29, 2024

View reviewed changes

packages/millicast-sdk/integration-tests/features/connect.feature Outdated Show resolved Hide resolved

jwrobdolby had a problem deploying to qa_dev October 29, 2024 06:03 — with GitHub Actions Failure

jwrobdolby had a problem deploying to qa_staging October 29, 2024 06:03 — with GitHub Actions Failure

vishalkharge had a problem deploying to dev October 29, 2024 06:43 — with GitHub Actions Failure

vishalkharge had a problem deploying to staging October 29, 2024 06:43 — with GitHub Actions Failure

vishalkharge had a problem deploying to dev October 29, 2024 07:24 — with GitHub Actions Failure

add debug print of layers

ca9a542

jwrobdolby had a problem deploying to dev November 7, 2024 16:50 — with GitHub Actions Failure

jwrobdolby had a problem deploying to staging November 7, 2024 16:50 — with GitHub Actions Failure

prompt 3 layers when found

9bb1e9b

jwrobdolby had a problem deploying to dev November 7, 2024 18:46 — with GitHub Actions Error

jwrobdolby had a problem deploying to staging November 7, 2024 18:46 — with GitHub Actions Error

stringify layers to debug

023de95

jwrobdolby had a problem deploying to dev November 7, 2024 18:54 — with GitHub Actions Failure

jwrobdolby had a problem deploying to staging November 7, 2024 18:54 — with GitHub Actions Failure

use f,h,q as encodingIds

c94ca35

jwrobdolby had a problem deploying to dev November 7, 2024 20:03 — with GitHub Actions Failure

jwrobdolby had a problem deploying to staging November 7, 2024 20:03 — with GitHub Actions Failure

extend simulcast scenario with vp8 codec

f8dfce1

jwrobdolby had a problem deploying to dev November 12, 2024 09:30 — with GitHub Actions Failure

jwrobdolby had a problem deploying to staging November 12, 2024 09:30 — with GitHub Actions Failure

after env variables updated

17adacf

jwrobdolby had a problem deploying to dev November 12, 2024 10:25 — with GitHub Actions Failure

jwrobdolby had a problem deploying to staging November 12, 2024 10:25 — with GitHub Actions Failure

remove ':' from scenario title

eca0346

jwrobdolby had a problem deploying to dev November 12, 2024 11:09 — with GitHub Actions Failure

jwrobdolby had a problem deploying to staging November 12, 2024 11:09 — with GitHub Actions Failure

jwrobdolby had a problem deploying to dev November 12, 2024 11:53 — with GitHub Actions Error

first scenario from multi-source scope - viewer projects specified so…

8385430

…urceId

jwrobdolby had a problem deploying to dev November 12, 2024 15:45 — with GitHub Actions Failure

jwrobdolby had a problem deploying to staging November 12, 2024 15:45 — with GitHub Actions Failure

Santiago-Souto suggested changes Dec 2, 2024

View reviewed changes

turbidwater and others added 2 commits December 3, 2024 15:52

modifying to not require --testMatch for windows

af79e7e

Merge pull request #482 from millicast/int-tests-tweaks

94338b9

modifying to not require --testMatch for windows

turbidwater had a problem deploying to dev December 5, 2024 15:49 — with GitHub Actions Failure

turbidwater had a problem deploying to staging December 5, 2024 15:49 — with GitHub Actions Failure

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

test: integration tests for PR pipeline #466

test: integration tests for PR pipeline #466

jwrobdolby commented Oct 24, 2024 •

edited

Loading

changeset-bot bot commented Oct 24, 2024 •

edited

Loading

dubeyShivank Oct 29, 2024

gregdolby Oct 31, 2024

dubeyShivank Oct 29, 2024

Santiago-Souto Dec 2, 2024

test: integration tests for PR pipeline #466

Are you sure you want to change the base?

test: integration tests for PR pipeline #466

Conversation

jwrobdolby commented Oct 24, 2024 • edited Loading

changeset-bot bot commented Oct 24, 2024 • edited Loading

⚠️ No Changeset found

dubeyShivank Oct 29, 2024

Choose a reason for hiding this comment

gregdolby Oct 31, 2024

Choose a reason for hiding this comment

dubeyShivank Oct 29, 2024

Choose a reason for hiding this comment

Santiago-Souto Dec 2, 2024

Choose a reason for hiding this comment

jwrobdolby commented Oct 24, 2024 •

edited

Loading

changeset-bot bot commented Oct 24, 2024 •

edited

Loading