Problem description
Unit test for ALOY-709 (included in
https://github.com/appcelerator/alloy/tree/master/test/apps/testing/ALOY-709 ) is reporting failures.
Steps to reproduce
1. Import the testing project from
https://github.com/appcelerator/alloy/tree/master/test/apps/testing/ALOY-709 and run (autostyle in config.json is set to 'false')
Result: 7 specs failed - see attachement 'ALOY709_autostyleTrue' for details
2. Set autostyle:true in config.json and run
Result: 9 specs failed - see attachement 'ALOY709_autostyleFalse' for details
Additional notes
Since is reproducible also using 3.2.2.GA and 1.3.1.GA is not a regression.
Switching back to Alloy version 1.2.0 & SDK 3.2.2.GA, only 1 failure is reported. See
'ALOY709_autostyleTrue_alloy121' attachment.
I updated the tests to fix two unrelated issues. There was a mistake in the counter used within a for-loop. For the other, the SDK now provides the apiName property on all proxies. The unit tests were finding that native property, instead of the one added by Alloy and thus failing. I removed those tests since the property is always present. PR: https://github.com/appcelerator/alloy/pull/360 Functional test: test app: https://github.com/appcelerator/alloy/tree/master/test/apps/testing/ALOY-709 Functional test can pass if the app can be run on all supported platforms and the automated runtime unit tests all pass. This must be confirmed under three separate app conditions for each platform. Once with autoStyle:true in the config.json Once with autoStyle:false in the config.json Once with no entry for autoStyle in the config.json
Reopening as I see some unit tests fail. This is random & intermittent. Sometimes I see failures with autoStyle:true & sometimes I do not, same for other 2 cases.
With no entry for autoStyle for android:
We see this errors:With autoStyle:false, for IOS
We see following logs:With autoStyle:false, for android:
We see the following logs:I've tested with the latest master and don't get any failures. I tried with all three scenarios and ran the tests twice each. In all cases, I got the same results:
3598 specs, 0 failures
If they're failing intermittently, I would suspect it's something to do with your computer (processes taking too long and timing out maybe?).Ran the tests again with autostyle set to true, false & none. I did not see any failures this time though. I am not sure why I did see this initially even though it was intermittent. Environment: Appc Studio : 3.3.0.201405121247 Ti SDK : 3.3.0.v20140513191712 Mac OSX : 10.8.5 Alloy : 1.4.0-dev CLI - 3.3.0-dev Samsung Galaxy S4 running android 4.2.2 Nexus 5 - android 4.4.2 iPhone 5s - iOS 7.1.1 Mobileweb
Should this now be reclosed?
Run again the test with: "autoStyle":true "autoStyle":false no "autoStyle" property set in config.json All unit tests pass. TiSDK 3.3.0.v20140522110830 Alloy 1.4.0-alpha4 Appcelerator Studio 3.3.0.201405211748 CLI 3.3.0-alpha5 Closing.
Removing sprint.