CTS fail分析

TestStatusDetailBugComments android.app.cts.DownloadManagerTest-- testDownloadManagerfailjunit.framework.AssertionFailedError: Make sure you have WiFi or some other connectivity for this test. at android.app.cts.DownloadManagerTest$DownloadCompleteReceiver.waitForDownloadComplete(DownloadManagerTest.java:140) Bug 105916：这个问题是由于cache的权限变更，init.rc中原来的cache是0777，现在的权限是0744。权限设置为744,会导致testDownloadManager测试不过
权限设置为777, 会导致另外一项测试不过,
修改为默认的770, testDownloadManager这一项也测试不过,并且会导致FOTA功能无法使用.需要再分析一下.DownloadManager是2.3新增的一个系统服务，用来处理长时间运行的HTTP下载，它不与webkit交互，详细请看
http://developer.android.com/reference/android/app/DownloadManager.htmlstart --plan CTS -t android.app.cts.DownloadManagerTest#testDownloadManager-- testMinimumDownloadfailjunit.framework.AssertionFailedError: Make sure you have WiFi or some other connectivity for this test. at android.app.cts.DownloadManagerTest$DownloadCompleteReceiver.waitForDownloadComplete(DownloadManagerTest.java:140)Bug 106196 ：Device implementations MUST have at least 128MB of memory available to the kernel and userspace.这个问题恐怕不只是遇到空间的问题，还有目录/文件权限问题.权限问题是android.app.cts.DownloadManagerTest --testDownloadManager这个case导致的start --plan CTS -t android.app.cts.DownloadManagerTest#testMinimumDownloadCompatibility Test Package: CtsContentTestCasesTestResultFailure Detailsandroid.content.cts.ContentResolverSyncTestCase-- testRequestSyncfailjunit.framework.AssertionFailedError at android.content.cts.ContentResolverSyncTestCase.addAccountAndVerifyInitSync(ContentResolverSyncTestCase.java:111)无start --plan CTS -t android.content.cts.ContentResolverSyncTestCase#testRequestSync-- testCancelSyncfailjunit.framework.AssertionFailedError at android.content.cts.ContentResolverSyncTestCase.addAccountAndVerifyInitSync(ContentResolverSyncTestCase.java:111)无start --plan CTS -t android.content.cts.ContentResolverSyncTestCase#testCancelSyncandroid.hardware.cts.CameraTest Bug 109395 - camera启动超出1500ms。导致全体失败-- testTakePicturefailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1501ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testTakePicture-- testPreviewCallbackfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1502ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testPreviewCallback-- testSetOneShotPreviewCallbackfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1503ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testSetOneShotPreviewCallback-- testSetPreviewDisplayfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1504ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testSetPreviewDisplay-- testDisplayOrientationfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1505ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testDisplayOrientation-- testParametersfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1506ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testParameters-- testJpegThumbnailSizefailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1507ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testJpegThumbnailSize-- testJpegExiffailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1508ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testJpegExif-- testLockUnlockfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1509ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testLockUnlock-- testPreviewCallbackWithBufferfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1510ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testPreviewCallbackWithBuffer-- testZoomfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1511ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testZoom-- testFocusDistancesfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1512ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testFocusDistances-- testCancelAutofocusfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1513ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testCancelAutofocus-- testPreviewPictureSizesCombinationfailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1514ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testPreviewPictureSizesCombination-- testPreviewFpsRangefailjunit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) Bug 109395 - camera启动超出1515ms。导致全体失败start --plan CTS -t android.hardware.cts.CameraTest#testPreviewFpsRangeCompatibility Test Package: CtsMediaTestCasesTestResultFailure Detailsandroid.media.cts.MediaPlayerTest-- testPlayOggStreamRedirectfail无start --plan CTS -t android.media.cts.MediaPlayerTest#testPlayOggStreamRedirectandroid.net.cts.ConnectivityManagerTest-- testStartUsingNetworkFeature_enableHiprifailjunit.framework.AssertionFailedError: Wifi must be configured to connect to an access point for this test. at android.net.cts.ConnectivityManagerTest.connectToWifi(ConnectivityManagerTest.java:261)
无hipri接入点类型，该测试项无法支持！
只要在10秒之内连接，就能通过测试。假如超过10秒才连上，那么就会通不过测试。
这完全变成一个测试WIFI性能的问题了。
APOLLO当前连接AP时间较长到底是否是受到HW的制约呢，或者SW WIFI模块存在优化的可能，这个需要WIFI组的专业人士继续跟踪分析了。


若wifi没在十秒内连接上一个连接点（是连接上，而不仅仅是打开wifi），就会报错。若wifi以前没有配置过连接点或者10秒内没有连接上，都会出错，测试很多遍都是因为10秒内没有成功连上而出错。
所以，尝试把wifi打开并连接上，这一步就能过去了。但是，又出现了以下问题：
android.net.cts.ConnectivityManagerTest#testStartUsingNetworkFeature_enableHipri..........(fail)应该是没找到有效的APN配置。start --plan CTS -t android.net.cts.ConnectivityManagerTest#testStartUsingNetworkFeature_enableHipriCompatibility Test Package: CtsPermission2TestCasesTestResultFailure Detailsandroid.permission2.cts.NoReceiveSmsPermissionTest-- testReceiveTextMessagefailjava.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84)无start --plan CTS -t android.permission2.cts.NoReceiveSmsPermissionTest#testReceiveTextMessageandroid.permission2.cts.NoReceiveGsmSmsPermissionTest-- testReceiveTextMessagefailjava.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84)无start --plan CTS -t android.permission2.cts.NoReceiveGsmSmsPermissionTest#testReceiveTextMessageCompatibility Test Package: CtsPermissionTestCasesTestResultFailure Detailsandroid.permission.cts.FileSystemPermissionTest-- testAllFilesInSysAreNotWritablefailjunit.framework.AssertionFailedError: /sys/sockutils/skutils_seq_ack at android.permission.cts.FileSystemPermissionTest.assertAllFilesInDirAndSubDirAreNotWritable(FileSystemPermissionTest.java:240)无start --plan CTS -t android.permission.cts.FileSystemPermissionTest#testAllFilesInSysAreNotWritableCompatibility Test Package: CtsSpeechTestCasesTestResultFailure Detailsandroid.speech.tts.cts.TextToSpeechTest-- testSynthesizeToFilefailjunit.framework.AssertionFailedError at android.speech.tts.cts.TextToSpeechTest.setUp(TextToSpeechTest.java:110)无start --plan CTS -t android.speech.tts.cts.TextToSpeechTest#testSynthesizeToFile-- testAndroidTestCaseSetupProperlyfailjunit.framework.AssertionFailedError at android.speech.tts.cts.TextToSpeechTest.setUp(TextToSpeechTest.java:110)无start --plan CTS -t android.speech.tts.cts.TextToSpeechTest#testAndroidTestCaseSetupProperlyCompatibility Test Package: CtsTelephonyTestCasesTestResultFailure Detailsandroid.telephony.cts.TelephonyManagerTest-- testGetNetworkCountryIsofailjunit.framework.AssertionFailedError: Country code '' did not match [a-z]{2} at android.telephony.cts.TelephonyManagerTest.testGetNetworkCountryIso(TelephonyManagerTest.java:429)无start --plan CTS -t android.telephony.cts.TelephonyManagerTest#testGetNetworkCountryIso-- testGetSimCountryIsofailjunit.framework.AssertionFailedError: Country code '' did not match [a-z]{2} at android.telephony.cts.TelephonyManagerTest.testGetSimCountryIso(TelephonyManagerTest.java:441)无start --plan CTS -t android.telephony.cts.TelephonyManagerTest#testGetSimCountryIsoandroid.telephony.cts.SmsManagerTest-- testSendMessagesfailjava.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84)无start --plan CTS -t android.telephony.cts.SmsManagerTest#testSendMessagesandroid.telephony.gsm.cts.SmsManagerTest-- testSendMessagesfailjava.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84)无start --plan CTS -t android.telephony.gsm.cts.SmsManagerTest#testSendMessagesCompatibility Test Package: CtsTextTestCasesTestResultFailure Detailsandroid.text.cts.AutoTextTest-- testGetfailjunit.framework.AssertionFailedError at android.text.cts.AutoTextTest.testGet(AutoTextTest.java:54)Bug 106219:经log出现mediaserver died的情况：/system/bin/mediaserver <<<
因此造成了接下来的cts test case失败

 Bug 106254:机器只有前摄像头被识别出来，因此这里返回null,使得cts测试fail。这个问题不是新硬件的问题，同一个版本烧在DVT1上面也有同样的问题。我们在DVT3上面测试0629user版本是无法通过，但同样用DVT3上面测试0706user版本是可以通过的，之后不知道为什么一直无法通过。0720工程模式应用测试可以正常切换到后camera，cts此两项case可以通过。0720
user模式的版本测试应用上测试切换后camera，弹出崩溃框，无法进入，导致cts此两项case失败。
start --plan CTS -t android.text.cts.AutoTextTest#testGet-- testGetSizefailjunit.framework.AssertionFailedError at android.text.cts.AutoTextTest.testGetSize(AutoTextTest.java:90)无start --plan CTS -t android.text.cts.AutoTextTest#testGetSizeandroid.text.format.cts.TimeTest-- testSetToNow0failjunit.framework.AssertionFailedError: expected:<3.4941376E8> but was:<3.49413E8> at android.text.format.cts.TimeTest.testSetToNow0(TimeTest.java:608)无start --plan CTS -t android.text.format.cts.TimeTest#testSetToNow0Compatibility Test Package: android.core.tests.luni.netTestResultFailure Detailsorg.apache.harmony.luni.tests.java.net.InetAddressTest-- test_getAllByNameLjava_lang_Stringfailjava.net.UnknownHostException: www.google.com at java.net.InetAddress.lookupHostByName(InetAddress.java:506)Bug 103645：该项和103646一样的原因，是对unknow.host地址无法解析，需要通过wifi连接上网（只通过sim卡上网不会pass）。所以建议在cts测试时，插入sim卡，通过wifi联网（需要保证能上网），可通过该项。通过2G
3G上网不能通过。所以在测试时，通过wifi上网这个跟ap的运营商有很大关系，总结出的经验是：在能联网的大前提下，adb shell进去输入ping unknow.host返回“ping unknow
host unknow.host”时，该项能通过。由于条件的限制，未能在上海对各种运营商的ap进行测试，目前能总结出的是电信的ap不能通过。start --plan CTS -t org.apache.harmony.luni.tests.java.net.InetAddressTest#test_getAllByNameLjava_lang_String-- test_isReachableLjava_net_NetworkInterfaceII_loopbackInterfacefailjava.net.UnknownHostException: www.google.com at java.net.InetAddress.lookupHostByName(InetAddress.java:497)无start --plan CTS -t org.apache.harmony.luni.tests.java.net.InetAddressTest#test_isReachableLjava_net_NetworkInterfaceII_loopbackInterfaceorg.apache.harmony.luni.tests.java.net.URLConnectionTest-- test_getAllowUserInteractionfailjava.net.UnknownHostException: onearth.jpl.nasa.gov at java.net.InetAddress.lookupHostByName(InetAddress.java:506)无start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getAllowUserInteraction-- test_getDatefailjunit.framework.AssertionFailedError: getDate gave wrong date: 0 at org.apache.harmony.luni.tests.java.net.URLConnectionTest.test_getDate(URLConnectionTest.java:790)无start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getDate-- test_getExpirationfailjunit.framework.AssertionFailedError: getExpiration returned wrong expiration: 0 at org.apache.harmony.luni.tests.java.net.URLConnectionTest.test_getExpiration(URLConnectionTest.java:1030)无start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getExpiration-- test_getLastModifiedfailjava.net.UnknownHostException: www.php.net at java.net.InetAddress.lookupHostByName(InetAddress.java:506)无start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getLastModified-- test_getOutputStreamfailjava.net.UnknownHostException: www.google.com at java.net.InetAddress.lookupHostByName(InetAddress.java:506)无start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getOutputStreamCompatibility Test Package: android.core.tests.luni.utilTestResultFailure Detailstests.api.java.util.DateTest-- test_Constructorfailjunit.framework.AssertionFailedError: Created incorrect date: 908305740000 now: 352704146 at tests.api.java.util.DateTest.test_Constructor(DateTest.java:49)无start --plan CTS -t tests.api.java.util.DateTest#test_ConstructorTest Timeouts (2)Compatibility Test Package: CtsMediaTestCasesTestResultFailure Details