Merge, Diff, Compare Reports

Merge HTML Reports

verissimo.sh <MERGE ARGS>

Arguments Description

Merge Arguments

<MERGE ARGS>
-merge <dir> [-info <key=value>] [-html_report_location <dir>]
<MERGE ARGS> Description
-merge <dir>                       Directory of the HTML report to be merged with other reports specified by subsequent -merge arguments.
                                   Must be repeated.
-info <key=value>                  [Optional] Place a ‘key=value’ annotation on all hits from a generated HTML report, in order to create filters based on them after a merge between reports.
-html_report_location <dir>        [Optional] Destination directory for the HTML lint report.
                                              Default value: current directory.

Examples

  • Generating multiple reports and merging them:

verissimo.sh -cmd .dvt/default.build -ruleset verissimo_ruleset.xml -gen_html_report -info "Config=T1" -html_report_location /path/to/report1
verissimo.sh -cmd .dvt/default.build -ruleset verissimo_ruleset.xml -gen_html_report -info "Config=T2" -html_report_location /path/to/report2
...
verissimo.sh -cmd .dvt/default.build -ruleset verissimo_ruleset.xml -gen_html_report -info "Config=TN" -html_report_location /path/to/reportN

# Merge the reports into a new HTML report
verissimo.sh -merge /path/to/report1/verissimo_html_report -merge /path/to/report2/verissimo_html_report ... -merge /path/to/reportN/verissimo_html_report

# Merge the reports into a new HTML report and generate the custom report for it
verissimo.sh -merge /path/to/report1/verissimo_html_report -merge /path/to/report2/verissimo_html_report ... -merge /path/to/reportN/verissimo_html_report -gen_custom_report <FTL file> -custom_report_location /path/to/custom_report

Diff between HTML Reports

verissimo.sh -diff <dir>

Arguments Description

Diff Arguments

<DIFF ARGS>
-diff <dir> [-info <key=value>] [-html_report_location <dir>]
<DIFF ARGS> Description
-diff <dir>                        Directory of the HTML report to be differentiated with other reports specified by subsequent -diff arguments.
                                   Must be repeated.
-info <key=value>                  [Optional] Place a ‘key=value’ annotation on all hits from a generated HTML report, in order to create filters based on them after a diff between reports.
-html_report_location <dir>        [Optional] Destination directory for the HTML lint report.
                                              Default value: current directory.

Examples

  • Generate a diff report that shows all the new failures in the current report starting from the baseline report:

verissimo.sh -cmd .dvt/default.build -ruleset verissimo_ruleset.xml -gen_html_report -info "Report=Baseline" -html_report_location /path/to/baseline_report -include_html_code
verissimo.sh -cmd .dvt/default.build -ruleset verissimo_ruleset.xml -gen_html_report -info "Report=Current"  -html_report_location /path/to/current_report  -include_html_code

verissimo.sh -diff /path/to/current_report/verissimo_html_report -diff /path/to/baseline_report/verissimo_html_report -html_report_location /path/to/diff_report -info "Report=New Failures"

Compare HTML Reports

verissimo.sh [<EXIT CODE ARGS>] <COMPARE ARGS>

Arguments Description

Exit Code Arguments

<EXIT CODE ARGS>
[-zero_exit_on_lint_failures] [-fail_on_severity <severity>] [-ignore_lint_errors] [-ignore_lint_warnings] [-ignore_lint_infos]
<EXIT CODE ARGS> Description
-zero_exit_on_lint_failures         [Optional] Return exit code zero even if some checks fail.
                                               Non-zero exit code is returned only when an internal error occurs
                                               (execution exceptions or wrong arguments).
-fail_on_severity <severity>        [Optional] Fail if the result contains checks with severities equal or higher
                                               than the specified severity.
                                               Must be one of: error, warning, info.
                                               Default value: info.
-ignore_lint_errors                 [Optional] Ignore lint errors and disable printing of lint errors.
-ignore_lint_warnings               [Optional] Ignore lint infos and disable printing of lint infos.
-ignore_lint_infos                  [Optional] Ignore lint warnings and disable printing of lint warnings.

Compare Arguments

<COMPARE ARGS>
-compare_baseline <dir> -compare_current <dir> [-map <mapping>] [-html_report_location <dir>]
<COMPARE ARGS> Description
-compare_baseline <dir>            Directory of the baseline HTML report to be compared with the current report specified by the ‘compare_current’ argument.
-compare_current <dir>             Directory of the current HTML report to be compared with the baseline report specified by the ‘compare_baseline’ argument.
-map <mapping>                     [Optional] Create a mapping between linted files from current and baseline reports.
                                              The mapping has the format ‘type+current_report_path_pattern=baseline_report_path_pattern’, where the type is one of PERL or SIMPLE.
                                              Default value for type: PERL.
-html_report_location <dir>        [Optional] Destination directory for the HTML lint report.
                                              Default value: current directory.

Examples

  • Generate a compare report:

verissimo.sh -cmd .dvt/default.build -ruleset verissimo_ruleset.xml -gen_html_report -html_report_location **/path/to/baseline_report** -include_html_code
verissimo.sh -cmd .dvt/default.build -ruleset verissimo_ruleset.xml -gen_html_report -html_report_location **/path/to/current_report**  -include_html_code

verissimo.sh -compare_current **/path/to/current_report/verissimo_html_report** -compare_baseline **/path/to/baseline_report/verissimo_html_report** -map type+current_path_pattern1=baseline_path_pattern1 -map type+current_path_pattern2=baseline_path_pattern2