You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flex.apache.org by Justin Mclean <ju...@classsoftware.com> on 2013/07/16 01:48:20 UTC
Apache Flex 4.10 test results
Hi,
Using 11.1 on OSX I getting failures mostly bitmaps (87 failures), Alex when you redid the baselines did you check if the tests passed on OSX?
What do we do when in this case when it fairly obvious that is the tests that have issues and "fixing" them on one platform breaks them for another?
With the MP_* test failures I'm seeing a broken image - should this be the case?
Here's list of failures:
[java] =====================================================
[java] Failed:
[java] =====================================================
[java] MarshallPlan/RSLs/allowDomain_Tests allowDomain_rsl Failed SetProperty(setup:step 12) Timeout waiting for complete from sl2
[java] MarshallPlan/RSLs/allowDomainFalse_Tests allowDomainFalse_rsl Failed SetProperty(setup:step 12) Timeout waiting for complete from sl2
[java] MarshallPlan/Controls/MP_Controls_Tests MP_EditableList_remote Failed SetProperty(body:step 1) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_EditableDataGrid_untrusted Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_ButtonWithEmbeddedIcon_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_OpeningTreeNodes_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_ColorPicker_swatchPanel_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_ColorPicker_closeOnMouseDown_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_ColorPicker_closeOnMouseDownOutside_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_DateField_calendar_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_DateField_closeOnMouseDown_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests MP_DateField_closeOnMouseDownOutside_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2 MP_ComboBox_dropdown_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2 MP_ComboBox_closeOnMouseDown_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2 MP_ComboBox_closeOnMouseDownOutside_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2 MP_PopUpMenuButton_dropdown_untrusted Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2 MP_PopUpMenuButton_closeOnMouseDown_untrusted Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2 MP_PopUpMenuButton_closeOnMouseDownOutside_untrusted Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2 MP_EditableDataGrid_errorString_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_CursorManager_Tests MP_CursorManager_DividedBox_remote Failed SetProperty(setup:step 9) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests DragManager_DragWithinSubApp_remote Failed SetProperty(setup:step 6) Timeout waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests DragManager_DragMainToSubApp_remote Failed SetProperty(setup:step 6) Timeout waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests DragManager_DragSubAppToMain_remote Failed SetProperty(setup:step 7) Timeout waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests DragManager_CustomDrag_UnTrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_NestedSWF_FocusManager_Tests NestedSWF_FocusManager_Tab_fromLocalhost Failed SetProperty(setup:step 9) Timeout waiting for complete from topSWF
[java] MarshallPlan/ManagerTests/MP_NestedSWF_FocusManager_Tests NestedSWF_FocusManager_ShiftTab_fromLocalhost Failed SetProperty(setup:step 9) Timeout waiting for complete from topSWF
[java] MarshallPlan/ManagerTests/MP_NestedSWF_FocusManager_Tests NestedSWF_FocusManager_ShiftTab_fromLocalhost_compatibilityMode Failed Timed out
[java] MarshallPlan/ManagerTests/MP_FocusManager_Tests MarshallPlan_FocusManager_Tab_fromLocalhost Failed SetProperty(setup:step 9) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_FocusManager_Tests MarshallPlan_FocusManager_ShiftTab_fromLocalhost Failed SetProperty(setup:step 9) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests MP_PopUpManager_addPopUp_modal_remote Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests MP_PopUpManager_createPopUP_nonmodal_remote Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests MP_PopUpManager_addPopUp_nonmodal_remote Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests MP_PopUpManager_centerPopUp_nonmodal_remote Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests MP_PopUpManager_centerPopUp_modal_remote Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests MP_PopUpManager_dragUnTrustedPopUp_remote Failed Timed out
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests MP_Spark_Component_toolTip_untrusted Failed SetProperty(setup:step 8) Timeout waiting for complete from swf1
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests MP_Spark_Component_TextAreaScrolling_untrusted Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests2 MP_Spark_Component_DropDownList_untrusted Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests2 MP_Spark_Component_Effects_untrusted Failed SetProperty(setup:step 7) Timeout waiting for complete from swf2
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_click Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseDown Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseUp Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseMove Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_click_shiftKey Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseDown_shiftKey Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseUp_shiftKey Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseMove_shiftKey Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseUp_buttonDown Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseMove_buttonDown Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_click_ctrlKey Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseDown_ctrlKey Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseUp_ctrlKey Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_mouseMove_ctrlKey Failed SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_AddChildBridgeEvent Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_RemoveChildBridgeEvent Failed SetProperty(setup:step 4) Timeout waiting for complete from swf1
[java] PerModuleStyles/api/loadCSS_SubApp loadCSS_SubApp Failed CompareBitmap(body:step 3) compare returned-3
[java] components/Charts/Area/Properties/AreaProperties AreaSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties AreaSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties AreaSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties AreaSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties AreaSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Bar/Properties/BarProperties BarSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Bar/Properties/BarProperties BarSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Bar/Properties/BarProperties BarSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Bubble/Properties/BubbleProperties BubbleSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Bubble/Properties/BubbleProperties BubbleSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Bubble/Properties/BubbleProperties BubbleSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties CandlestickSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties CandlestickSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties CandlestickSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties CandlestickSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties CandlestickSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties ColumnSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties ColumnSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties ColumnSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties ColumnSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties ColumnSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties HLOCSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties HLOCSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties HLOCSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties HLOCSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties HLOCSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties PlotSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties PlotSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties PlotSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties PlotSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java] spark/core/fxg/properties/fxgtemplate_tester filters_filters_blend Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java]
[java]
[java] =====================================================
[java] Passes: 0
[java] Fails: 87
[java] =====================================================
[java]
[java]
[java] Wrote summary to results.txt
[java] Wrote failures to failures.txt
Thanks,
Justin
Re: Apache Flex 4.10 test results
Posted by Justin Mclean <ju...@classsoftware.com>.
Hi,
> My guess is that the chart tests still have timezone sensitivities.
Looks that way looking at the bitmaps, date scales are different.
It could to be a daylight savings time issue (which may or may not be a real bug) as the days seem out by one during the southern hemisphere summer.
> No, this list of MP failures sounds like localhost is not pointing to the
> mustella tests folder.
That's also likely to be the case as on my the machine I run the tests on I have other web servers etc set up.
Thanks,
Justin
Re: Apache Flex 4.10 test results
Posted by Alex Harui <ah...@adobe.com>.
On 7/15/13 4:48 PM, "Justin Mclean" <ju...@classsoftware.com> wrote:
>Hi,
>
>Using 11.1 on OSX I getting failures mostly bitmaps (87 failures), Alex
>when you redid the baselines did you check if the tests passed on OSX?
All baselines are cut from my Mac unless it is a Windows-only test. My
guess is that the chart tests still have timezone sensitivities. I ran
into some of that already since the VM is in Europe time so I'm not
surprised there are more.
>
>What do we do when in this case when it fairly obvious that is the tests
>that have issues and "fixing" them on one platform breaks them for
>another?
In some cases, checking in the png.xml file is enough to make the test
pass. Otherwise, I have re-written some of the tests to make them
platform independent.
>
>With the MP_* test failures I'm seeing a broken image - should this be
>the case?
No, this list of MP failures sounds like localhost is not pointing to the
mustella tests folder.
>
>Thanks,
>Justin