Smart - Customer Knowledge BaseSmart - User Guide Test Run CreationComparing Integrations Between Workday Tenants

Comparing Integrations Between Workday Tenants

Smart provides functionality to run Integrations (alongside Business Processes) on two different Workday tenants and compare the Deliverable Output Files automatically. This can be used during Workday Update periods to verify that the output of integrations will not change on the new version of Workday. In addition, it will allow verification of the integrations when migrating between tenants.  

You need to have two Workday tenants configured in your Smart tenant to run this comparison test. Smart will prompt you to configure a second tenant if there is only one present.  

Creating Integration Tenant to Tenant Comparison Test Runs

Integrations Tenant to Tenant Comparison test run can be created by navigating to CREATE A TEST > Integrations > Compare Integrations Between Tenants .

Smart supports launching all types of Workday Integrations.

The standard 'Create BP/Integration Test' screen will appear.

The process of downloading/populating/uploading the data template is similar to creating a regular Integration Test Run. You can upload a template for an Integration or Business Process test run or download a blank one.

Integrations Tenant to Tenant Comparison tests must have at least one Integration test. Business Processes test type(s) are optional. 

Exclude Fields from Comparison View

You can also choose to exclude fields from the comparison. This is really useful for ignoring fields that change regularly but aren’t important to the success of the integration.

This is done by entering a comma separated list of XML fields in the row in the template labelled 'Exclude from Comparison'. Older integration templates may not have this row, but it can be added in manually.

Fields to be excluded must be listed individually, field groups cannot be specified in the template. In the following example, 'orgc:Organization' is a field group and cannot be excluded from the comparison. However, 'orgc:Organization_ID' is an individual field and can be excluded by listing it in the template.

 

For example, to exclude the XML fields in the example below:

You would type 'ws:Current_Entry_Time, ws:Prior_Effective_Time' into the test case data cell of the 'Exclude from Comparison' row as shown in the example below:

Smart will then exclude these fields when the output files are compared. This exclusion feature is currently limited to XML deliverable output files only.

To complete the Integration Tenant to Tenant Comparison test run creation, upload the completed data template by selecting the Upload Files option, set the Integration Comparison Tenant to Tenant test run name and save the test run. Optionally, Integration test runs can also be tagged.

Executing Integration Tenant to Tenant Comparison Test Runs

You can execute Integration Tenant to Tenant Comparison test runs the same way as other test run types in Smart.  Please refer to Test Run Execution section for more details.

The only difference is that you will need to provide two Workday tenants instead of one.

Integration Tenant to Tenant Comparison test runs require two configured Workday tenants to execute against. Smart will prompt you to configure a second Workday tenant if there is only one configured.  

Viewing Integration Tenant to Tenant Comparison Test Runs Results

Once executed, users can start to the review the results as the test cases complete. Clicking on one of these runs will take you to the Test Run Results page with the following sections: 

  • Executions Details - provides test run execution details
  • Overall Results Summary - provides test run results summary
  • Test Cases - provides Integration execution and comparison details

Test Cases section provides execution and comparison overview for all the Integration test cases. There are following columns available:

  • Test Case ID - Integration test case ID
  • Int System - name of the executed Integration
  • First Workday tenant Status - Integration execution status in first Workday tenant
  • Second Workday tenant Status - Integration execution status in second Workday tenant
  • Comparison Status - Integration Deliverable Output files comparison status 
  • Test Result - test case result


Smart sets Comparison Status and Test Case Results for you based on the following: 

1st Tenant Execution Status
2nd Tenant Execution Status
Comparison Status
Completed
Completed
MATCH / NON MATCH / COULD NOT TEST
Completed
Failed to Complete
NON MATCH
Failed to Complete
Completed
NON MATCH
Failed to Complete
Failed to Complete
COULD NOT TEST
Comparison Status
Test Case Result
MATCH
Passed
NON MATCH
Failed
COULD NOT TEST
Failed

Test Results can be overridden on the Test Case Results page. 


Clicking the Test Case ID link will take you to the Test Case Results page.

The following information is displayed: 

  • Test Case Details section: 
    • Result
    • Comparison Result
    • Test Case ID
    • Integration System - name of the Integration System
    • First Integration Event - name of the Integration Event from the first Workday tenant, with a link to Workday tenant
    • Second Integration Event - name of the Integration Event from the second Workday tenant, with a link to Workday tenant
    • Comment

Clicking on the Change Results link allows for changing the Test Case Result.


There are 4 tabs available below Test Case Details section:

  • Comparison
  • First Workday tenant
  • Second Workday tenant
  • Test Data


Comparison Tab


Comparison is the default tab, with Output File Comparison Results section providing information about retrieved Integration Output files from both Workday tenants and their comparison. Following columns are available:

  • First Workday tenant Output File(s) - Integration Deliverable Output file(s) from the first Workday tenant
  • Second Workday tenant Output File(s) - Integration Deliverable Output file(s) from the second Workday tenant
  • Differences - number of differences between Integration Output files
  • Comparison Result - Integration Output files comparison result
  • Additional Info - link to Integration Output files comparison

Smart retrieves Integration Output files marked as Deliverable.


Clicking the View Comparison link from here will take you to the Output File Comparison screen.

The following information is displayed:

  • Output File Details section:
    • Comparison Result
    • Integration System
    • Integration Output File
  • Output File Comparison section - displaying differences between two Integration Output files.


Retrieved Integration Output Files are compared by file name.

If Filename Sequence Generator is used, Smart will match the files by static parts of their filenames.

In case Integration generates multiple Output files with same names, Smart will not conduct a comparison and set Comparison Status to COULD NOT TEST.


Smart only shows the differences found along with surrounding lines for context. Each difference shows: 

  • 10 lines above the difference
  • line containing difference
  • 10 lines below the difference

This is dependent on the number of differences and their location in the file.

In addition, Smart will display up to 20 lines containing differences. If this threshold is exceeded user will be advised to review the differences in the Workday tenant(s).


First/Second Workday tenant tab

The Workday Tenants tabs will show you the execution details of each Integration (and Business Processes if they were included in the test run). If there was a problem running the Integration then investigation should be conducted here.

The following information is displayed:

  • Steps tab - Integrations (Business Processes) execution information
  • Debug tab - Detailed execution information

Re-Executing Integration Tenant to Tenant Comparison Test Runs

You can re-execute existing test runs against the same tenants or you can choose a different set. 

Integration Tenant to Tenant Comparison test runs re-execution is similar to other test types re-execution covered in Test Run Re-execution section, with two exceptions:

  1. You need to specify two Workday tenants  
  2. You cannot select test cases for re-execution, all test cases are re-executed