Skip to content

bug: e2e tests failing randomly #6157

@danyball

Description

@danyball

Prerequisites

Stencil Version

4.26.0

Current Behavior

Having 500+ e2e tests and run them in parallel, you will see errors like that in your log:

 ● sdx-input-item › required checkbox › should have a space between label and asterisk when required field

    Timeout - Async callback was not invoked within the 30000 ms timeout specified by jest.setTimeout.Error: Timeout - Async callback was not invoked within the 30000 ms timeout specified by jest.setTimeout.

      at mapper (node_modules/jest-jasmine2/build/queueRunner.js:71:45)

  ● sdx-input-item › required checkbox › should have a space between label and asterisk when required field

    TypeError: Cannot read properties of undefined (reading 'getProperty')

      20 |
      21 |     it("should have a space between label and asterisk when required field", async () => {
    > 22 |       expect(await element.getProperty("required")).toBe(true)
         |                            ^
      23 |       expect(element.innerText).toContain("Checkbox")
      24 |       expect(label.innerText).toBe(" *")
      25 |     })

      at Object.<anonymous> (webcomponents/components/input-group/input-item/input-item.e2e.ts:22:28)

  ● sdx-input-item › checkbox without text › should be clickable

    App did not load within 30000ms. Please ensure the content loads a stencil application.

       9 |
      10 |     beforeEach(async () => {
    > 11 |       page = await newE2EPage({
         |              ^
      12 |         html: `
      13 |           <sdx-input-item type="checkbox" required>Checkbox</sdx-input-item>
      14 |         `,

      at waitForStencil (node_modules/@stencil/core/testing/index.js:10557:11)
      at e2eSetContent (node_modules/@stencil/core/testing/index.js:10550:3)
      at newE2EPage (node_modules/@stencil/core/testing/index.js:10462:7)
      at Object.<anonymous> (webcomponents/components/input-group/input-item/input-item.e2e.ts:11:14)




### Expected Behavior

no errors

### System Info

```shell
System: node 22.12.0
    Platform: darwin (24.3.0)
   CPU Model: Apple M1 Max (10 cpus)
    Compiler: /node_modules/@stencil/core/compiler/stencil.js
       Build: 1739293045
     Stencil: 4.26.0 🐇
  TypeScript: 5.5.4
      Rollup: 2.56.3
      Parse5: 7.1.2
      jQuery: 4.0.0-pre
      Terser: 5.31.1

Steps to Reproduce

No reproducer found. But there are at least 2 customers with the same errors. Some more info in another ticket from this comment downwards: #6072 (comment)

Code Reproduction URL

no sorry

Additional Information

Working workaround: add runInBand like stencil test --e2e --runInBand

Metadata

Metadata

Assignees

No one assigned

    Labels

    Bug: ValidatedThis PR or Issue is verified to be a bug within StencilHelp Wantedionitron: needs reproductionThis PR or Issue does not have a reproduction case URL

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions