When dealing with large datasets in WATS, we recommend using the Test Step Analysis (TSA) module. Here's why TSA is the preferred method for big data analysis:
- Designed for big data sets: TSA has no limits on the data volume you can analyze. It lets you thoroughly explore extensive datasets, ensuring you don't miss any valuable insights.
- Designed for exploration: TSA is great for exploring data when you don't know where to look. It can help you in finding key areas of interest for deeper analysis.
Common Misconception: Test Reports for big data analysis
Many users mistakenly rely on the Test Reports module for all their data analysis needs. However, it is not intended for analysis of large datasets. This module is better suited for finding and analyzing smaller data sets and specific UUT reports.
Example of how to use Test Step Analysis for big data analysis.
In the following example we do an open search for data in the last 12 months. The top result is a test sequence with 53.000 units. We select it and hit Apply selected.
The step list for the selection appears, including valuable information such as number of failures for each step, how many UUT reports those failures caused, Cpk and more. All columns can be used for sorting and filtering, as a way to find key areas of interest.
In this example, we'll add another Column option (Step type) and use that to filter the data.
After filtering out non-numerical steps using the added Step type column and sorting by number of Caused UUT Failed/Error/Terminated, we have identified the numerical step that has caused the most UUT failures for this dataset.
To further investigate data and trends for this measure, select the step and click "Open step details". Alternatively, click the magnifying glass for said step on the left side.
This opens the Step details in a separate window. Apply a timeframe using the sliders in the Aggregated overview graph, click Apply selection, and inspect the data and trends. In this example, there are 50.000 measures within the selected timeframe.
The Max allowed selected measurements setting limits how many measures a selection can load. It is 10.000 by default and can be raised to 100.000. The Default selected measurements setting decides how many measures are selected when Step details opens. You find both under Settings (gear icon) in the menu bar on the left. To analyze all 50.000 measures in this example, raise Max allowed selected measurements to at least 50.000.
Note that the Aggregated overview graph and the step list always show the full data set, while the other charts and views only use the measures loaded from your selection. Metrics can therefore differ between the two. For details, see Step details - feature overview.
Alternative way of opening Step details.
Once making a selection in Test Step Analysis, graphs providing a general overview will also be made available. The user can drill down to Step details, by clicking directly on a given step in one of four available graphs.
For a more comprehensive guide on how to use the Test step analysis module and Step details, refer to additional articles.
See also:
Comments
0 comments
Please sign in to leave a comment.