Amin Yahyaabadi
f3e9434410
add core main timeout retry trigger
2020-09-17 19:51:47 -05:00
Amin Yahyaabadi
7d14d560c1
Finalize in the end (not between retry attempts)
...
don't finalize until the end which the test fails or passes.
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
30c35eec46
add Error Downloading Update to the retry commands
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
0572568ef5
increase the retryNumber to 6
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
e187bf26cb
Retry 4 times
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
c48aacd0e7
pass exitCode
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
8450f16bdb
call the callback only on fail or success
...
Don't call the callback on retry
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
4f0acf4a83
call the callback after retrying
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
7063b48f05
Retry the timed out tests for a number of times
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
5d09c88927
shouldTryAgain
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
d7f5ea58e0
isTimedOut
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
3b10e63204
createTestKey
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
44f7b43bbb
retryOrFailTest
2020-09-17 18:46:28 -05:00
Amin Yahyaabadi
a9e690d165
refactor the static parts out of the test function which runs by async
2020-09-15 20:40:03 -05:00
aminya
96480ea5b9
Use async.series
...
Revert b61475ffe4
2020-09-14 17:37:37 -05:00
Amin Yahyaabadi
3993c420b1
collect output only if stdout exits
2020-09-14 17:37:37 -05:00
Amin Yahyaabadi
3b796f7995
refactor spawnTest
2020-09-14 17:37:36 -05:00
Amin Yahyaabadi
a69e0f8117
function to create packageTestSuites only when needed
2020-09-14 17:37:36 -05:00
Amin Yahyaabadi
f4bdb22e7d
function to create coreRenderProcessTestSuites
...
only when needed
2020-09-14 17:37:36 -05:00
aminya
66c743465c
print the used testCommand for failed tests
2020-09-14 17:37:36 -05:00
aminya
a4fac1e772
test: use Azure format for printing
2020-09-14 17:37:10 -05:00
aminya
a69bf7be10
warn before error reporting
...
Helps visually
2020-09-14 17:26:50 -05:00
aminya
e386c2bf02
run tests using async.parallel
2020-09-14 17:26:50 -05:00
aminya
d04d91835c
allow requesting parallel tests for all OS
2020-09-14 17:26:50 -05:00
aminya
b992fbf1b1
parallelize core tests
2020-09-14 17:26:50 -05:00
aminya
a598fdd26e
run package tests in parallel for windows tests
2020-09-14 17:26:50 -05:00
sadick254
0b541e9120
Show approriate error when running test without building
2020-08-12 21:02:47 +03:00
Darangi
2c7092deb0
Logged error object
2020-02-14 10:48:46 +01:00
Darangi
6f851aeeee
removed logs and ⬇️ snippets@1.5.1
2020-02-13 22:13:42 +01:00
Darangi
be5a04feb4
logged more paths
2020-02-13 21:35:25 +01:00
Darangi
f9ba783098
Logged resource path
2020-02-13 21:08:23 +01:00
Darangi
db55725c5f
Removed logs
2020-01-23 18:10:36 +01:00
Darangi
5df052aec2
logged test variables
2020-01-21 19:37:45 +01:00
Darangi
47154351f0
added linux check
2020-01-09 19:42:43 +01:00
Darangi
d89d035e7f
added no-sandbox flag to core-main process tests
2020-01-09 19:38:59 +01:00
Rafael Oleza
6fcfaffa04
Do not depend on CONFIG.executableName on the windows tests
...
CONFIG.executableName depends on the ATOM_RELEASE_VERSION env variable
to work correctly on nightly releases.
Since this env variable is not being set for the testing steps, the
nightly release builds contain a wrong executableName on the testing
step, which causes a failure when trying to find the Atom executable.
This commit fixes that by stop using the executableName from the test
step, like it's done on other platforms.
2019-07-17 11:40:39 +02:00
Rafael Oleza
b6644dfad8
Merge branch 'master' into dw-windows-separate-channels
2019-06-25 15:49:34 +02:00
Antonio Scandurra
ee0ddaa1d8
Run each test suite with a pristine ATOM_HOME directory
...
This ensures that every test suite does not clutter subsequent ones. It
will also prevent altering the user's `~/.atom` directory when running
tests locally.
2019-06-07 09:33:09 +02:00
Antonio Scandurra
6a88fa4185
Don't symlink compile-cache folder in AtomWindow tests
...
In these tests, we create a temporary `ATOM_HOME` to avoid cluttering
the user's real `~/.atom` folder.
Adding a symlink to the real `compile-cache` was introduced to speed up
main process tests, so that the transpilation cache could be reused.
Unfortunately, when the real `~/.atom` folder did not exist (such as on
a pristine environment on CI), it would confuse Atom, which would think
that it didn't need to re-create a `compile-cache` folder again, but
wouldn't be able to write to it because the symlink pointed to a
non-existant directory.
Main process tests were overhauled and made faster recently, so we can
safely remove this performance optimization.
2019-06-06 17:11:01 +02:00
Antonio Scandurra
587a4dd72d
Run main process tests during build step
...
For some reason, one main process test fails when run in a different
container than the one in which Atom was built. These tests are pretty
quick, so their impact on parallelism should be negligible.
2019-06-05 14:11:11 +02:00
Antonio Scandurra
2b0e5b0c32
Split package tests more evenly across containers
2019-06-05 13:29:24 +02:00
Antonio Scandurra
791a583860
Run package tests in parallel
2019-06-05 10:05:19 +02:00
Antonio Scandurra
9d2494ca16
Don't run benchmark tests during script/test unless explicitly requested
2019-06-04 18:50:50 +02:00
Antonio Scandurra
0d00538da3
Run core and package tests in parallel for macOS on Azure Pipelines
2019-06-04 18:50:26 +02:00
Rafael Oleza
975f203dc7
Merge commit '677bbb7f0b8754787ff9e7bfab4602ba82e13b0b' into dw-windows-separate-channels
2019-06-01 00:27:52 +02:00
Nathan Sobo
770b8fdcf8
Revert "Merge pull request #19244 from atom/ns/notify"
...
This reverts commit b2ecabd527 , reversing
changes made to c3bf95194a .
2019-05-17 04:10:17 -06:00
Nathan Sobo
e58d52ee23
Add clarifying assertion to test script
2019-05-09 08:42:02 -06:00
Rafael Oleza
91558332de
Add debugging message specifying which step failed
2019-04-12 12:53:20 +02:00
Rafael Oleza
a7ac4a2147
Change the way exitCodes are passed from the test steps
2019-04-12 12:52:55 +02:00
Ash Wilson
efd9151589
Revert temporary script/test changes
2019-02-15 16:09:27 -05:00