/
SIC_PF_MERGE_ERROR_REPORT

SIC_PF_MERGE_ERROR_REPORT

Owned by Subrat Sandilya
Sept 25, 2024
8 min read

Overview:

  • This process flow is used to merge the error records of V3 and EBMR flow.

  • This process flow is called from “SIC_PF_Orchestration”.

High-Level Description:

Key Components:

  1. File Retrieval:

    • The process retrieves error reports for both V3 and EBMR flows using file sources such as LFS and LAN sources.

    • It handles different types of error reports, including GID errors, dependent errors, and error reports based on specific criteria like FIF and CON errors.

  2. Error Report Parsing:

    • Various TXLO schemas are used to parse the error records from V3, EBMR, and duplicate data sources. This ensures that all error types are correctly formatted for further processing.

  3. Data Mapping and Merging:

    • DM (Data Mapping) steps merge error reports from the V3 and EBMR flows, generating consolidated records. The merged error reports are stored and processed for further analysis.

  4. Database Updates:

    • The process involves inserting file details and error records into the File Name Detail and Application Data tables.

    • Database targets (ADT) are used to update the file queue with error counts, overall statuses, and other critical information.

  5. Error Report Generation and Storage:

    • Consolidated error reports are created and stored at specified locations, including SFTP and LAN.

    • Error file names and details are also archived for future reference.

  6. DB Query Handling:

    • The process also retrieves and processes DB queries related to account structures for both V3 and EBMR flows, merging the data and generating reports.

 

Detailed Level Description of the Flow:

 

image-20240925-100252.png

 

 

image-20240925-100329.png

 

 

image-20240925-100252.png

 

 

image-20240925-100329.png

 

 

  • LFS: “SIC_Source_V3_Error_Report” - Picks the error report for the V3 flow.

  • TXLO Schema: “SIC_TXLO_ErrorRecord_Output” - Parses the error report data for the V3 flow (Structure canonical XML format).

  • LFS: “SIC_Source_V3_Error_Report” - Picks the error report for the EBMR flow.

  • TXLO Schema: “SIC_TXLO_ErrorRecord_Output” - Parses the error report for the EBMR flow.

  • LFS: “SIC_LAN_Merge_Duplicate_Source” - Picks merged duplicate data of V3 and EBMR flows.

  • TXLO Schema: “SIC_TXLO_DuplicateRecord” - Parses duplicate records of V3 and EBMR flows.

  • LFS: “SIC_LFS_Merge_DroppedRecord_Report” - Picks duplicate records of EBMR and V3 flows.

  • TXLO Schema: “SIC_TXLO_ErrorRecord” - Parses duplicate records of EBMR and V3 flows.

  • LFS: “SIC_LFS_GID_ErrorReport” - Picks error report files based on GID errors.

  • TXLO Schema: “SIC_TXLO_ErrorRecord” - Parses the GID error report.

  • LFS: “SIC_LFS_duplicateDependent” - Picks files based on dependent errors.

  • TXLO Schema: “SIC_TXLO_ErrorRecord” - Parses the error report of dependents.

  • LFS: “SIC_LFS_FIF” - Picks the FIF error report file from the given location.

  • TXLO Schema: “SIC_TXLO_ErrorRecord” - Parses the FIF error report.

  • LFS: “SIC_LFS_CON” - Picks the CON error report file.

  • TXLO Schema: “SIC_TXLO_ErrorRecord” - Parses the CON error report.

  • DM: “SIC_DM_MERGE_V3_CORE_ERROR_REPORT” - Data mapping to merge error reports of V3 and EBMR.

  • TXLO Schema: “SIC_TXLO_ErrorRecord_Output” - Parses the consolidated error report of V3 and EBMR.

  • SFTP: “SIC_SFTP_Error_Target” - Drops the error report file on the SFTP location.

Gateway for Count the Error Record :

  • LFT: “SIC_LEF_Archival” - Drops the file at the archival location.

  • DM: “SIC_DM_ERROR_File_Name_Detail_Insert_v3” - Data mapping to get error file name details of V3.

  • ADT: “SIC_DBT_FIle_Name_Detail” - Database target to load the error file name details.

  • DM: “SIC_DM_Error_ApplicationData_Insert_Duplicate_Dropped_GID” - Data mapping to insert duplicate records for GID errors.

  • ADT: “SIC_DBTL_ApplicationData_V3” - Database target to drop the error record for GID.

  • LFS: “SIC_LanSource_DBQuery” - Picks the file to execute the DB query.

  • LFS: “SIC_LanSource_DBQuery” - Picks the DB query file for EBMR.

  • TXLO Schema: “SIC_TXLO_AccountStructure_DbQuery” - Parses the account structure DB query for EBMR.

  • TXLO Schema: “SIC_TXLO_AccountStructure_DbQuery” - Parses the account structure DB query for V3.

  • DM: “SIC_DM_MERGE_DB_Query_Report” - Merges data from the DB query.

  • TXLO Schema: “SIC_TXLO_AccountStructure_DbQuery” - Parses the merged data of V3 and EBMR flows.

  • SFTP: “SIC_SFTP_dbQuery_Target” - Drops the account structure file on SFTP.

  • LFT: “SIC_LFT_AccountStructure” - Drops the account structure file on LAN.

  • DM: “SIC_DM_AccountStructure_File_Name_Detail_Insert_v3” - Inserts the file name details of V3.

  • DBT: “SIC_DBT_FIle_Name_Detail” - Drops the file name details inside the DB.

  • DM: “SIC_DM_EBMR_Update_FileQueue_OverallStatus” - Updates the overall status of the FileQueue flow for EBMR.

  • DBT: “SIC_DBT_FileQueue_Update” - Update the data in  FileQueue table.

Activity Used In Flow:

  1. LFS - Picking Error Report for v3:
    The activity involves generating the "SIC_Source_V3_Error_Report" for the V3 flow.

  2. TXLO Schema - Parse Error Report for V3:
    This activity focuses on parsing the "SIC_TXLO_ErrorRecord_Output" data for the V3 flow in a canonical XML format layout.

  3. LFS - Picking Error Report For EBMR:
    This task is centered around picking the "SIC_Source_V3_Error_Report" for the EBMR flow.

  4. TXLO Schema - Parse Error Report Output for EBMR:
    In this step, the process involves parsing the error report for the EBMR flow using the "SIC_TXLO_ErrorRecord_Output."

  5. LFS - Picking merged duplicate File:
    The "SIC_LAN_Merge_Duplicate_Source" is utilized in this task to pick merged duplicate data from the V3 and EBMR flows.

  6. TXLO Schema - Duplicate record of V3 and EBMR:
    The "SIC_TXLO_DuplicateRecord" text schema is employed to parse duplicate records from both the V3 and EBMR flows.

  7. LFS - Picking the duplicate record:
    This task involves using the "SIC_LFS_Merge_DroppedRecord_Report" Lan File Source to pick duplicate records from the EBMR and V3 flows.

  8. TXLO Schema - Parse the duplicate record:
    Utilizing the "SIC_TXLO_ErrorRecord" text schema, this step focuses on parsing duplicate records from the EBMR and V3 flows.

  9. LFS - Picking the GID error record File:
    The "SIC_LFS_GID_ErrorReport" Lan File Source is responsible for selecting the Error Report File based on GID Error.

  10. TXLO Schema - Parse the GID Error Report:
    This schema, "SIC_TXLO_ErrorRecord," is dedicated to parsing the GID Error report.

  11. LFS - Picking the Error Report of Dependent:
    This task involves picking the file based on Dependent error using "SIC_LFS_duplicateDependent."

  12. TXLO Schema - Parse the dependent Error Report:
    The "SIC_TXLO_ErrorRecord" text schema is utilized to parse the Error Report of dependents.

  13. LFS - Picking file for FIF Error Report:
    The "SIC_LFS_FIF" Lan File Source is responsible for picking the FIF Error Report File from the specified location.

  14. TXLO Schema - Parse the FIF Error Report : “SIC_TXLO_ErrorRecord” This text schema is used to Parse the FIF Error Report

  15. LFS - Picking the CON error Report File : “SIC_LFS_CON” This Lan File Source is used to Picking the CON error Report File

  16. TXLO Schema - Parse the CON error report : “SIC_TXLO_ErrorRecord” This text schema is used to Parse the CON error report

  17. DM - Merge Error Report of V3 and EBMR : “SIC_DM_MERGE_V3_CORE_ERROR_REPORT” This data mapping is used to Merge Error Report of V3 and EBMR

  1. TXLO Schema - Parse Consolidated Error Report of V3 and EBMR : “SIC_TXLO_ErrorRecord_Output” This text schema is Parsing Consolidated Error Report of V3 and EBMR

  2. SFTP  - Dropped the Error Report File : “SIC_SFTP_Error_Target” it is used to Dropped the Error Report File on SFTP location

Gateway for Count the Error Record :

  1. LFT - Dropped the File at Archival : “SIC_LEF_Archival” This target activity used to  Dropped the File at Archival

  2. DM -  Get Error File Name Details of V3 : “SIC_DM_ERROR_File_Name_Detail_Insert_v3” Data Mapping to get Error File Name Details of V3

Process Level Variables : 

FILE_UNIQUE_ID: $$FILE_UNIQUE_ID$$ - Getting the file unique id.

fileName : $$SIC_LEF_Archival.params$$ - Getting the file name.

partnerName : $$partnerName$$ - Getting the partner name.

MasterAgreementNumber_GroupID: $$MasterAgreementNumber_GroupID$$ - Getting the master agreement number.

GoodRecordFileName: $$SIC_LGRF_Archival.params$$ - Getting the good record file name.

PhaseID: ''P0005''' - It is used to display the phase on UI.

Error_Code: E0055- It is used to display the Error message on UI. If this activity failed due to some reason then on the basis of this code ‘E0055’ the error message is fetched from the solution database and displayed on UI.

V3Phase: 'P0008'- It is used to display the phase on UI.

  1. ADT - Load the error file name details: “SIC_DBT_FIle_Name_Detail” Database Target is used to Load the Error File name details 

  2. DM - Insert Duplicate Record for GID Error : “SIC_DM_Error_ApplicationData_Insert_Duplicate_Dropped_GID” This data mapping is used to insert the duplicate record of GID

  1. ADT - Dropped the error record for GID : “SIC_DBTL_ApplicationData_V3” This Database target is used to Dropped the error record for GID.

  2. LFS - Picked File for DB Query : “SIC_LanSource_DBQuery” This Lan Source is used to Picked File for execute the DB Query.

  3. LFS - Picked DB Query Report for EBMR : “SIC_LanSource_DBQuery” This Lan File Source is used to Picked the DB Query File for EBMR.

  4. TXLO Schema -  Parse Account Structure DB Query for  EBMR : “SIC_TXLO_AccountStructure_DbQuery” This text schema is used to Parse Account Structure DB query for EBMR

  5. TXLO Schema -  Parse Account Structure DB Query for  V3 : “SIC_TXLO_AccountStructure_DbQuery” This text schema is used to  Parse Account Structure DB Query for V3

  6. DM - Merge the data of DB Query  : “SIC_DM_MERGE_DB_Query_Report” This data mapping is used to merged the data of DB Query

  1. TXLO Schema - Merged the data : “SIC_TXLO_AccountStructure_DbQuery” This Text schema is used to Parse the merged data of v3 and EBMR flow

  2. SFTP - Dropped the merged file : “SIC_SFTP_dbQuery_Target” This LAN target is used to Drop the Account structure file on LAN 

  3. LFT - Dropped the file of AccountStructure : “SIC_LFT_AccountStructure” This Lan File Target is used to Dropped the Account structure file on LAN 

  4. DM - Insert the filename details of V3 : “SIC_DM_AccountStructure_File_Name_Detail_Insert_v3” This Data mapping is used to insert the file name details of v3

Process Level Variables : 

ASfileName : DBQuery_$$UniqueFileID$$_$$FileNameWithoutExtension$$.csv       - Set file name.

Activity Level Variables : 

FILE_UNIQUE_ID : $$FILE_UNIQUE_ID$$- Getting Unique id.

  1. DBT -  Dropped the file name details : “SIC_DBT_FIle_Name_Detail” This database target is used to Dropped the file name details using dbquery

  2. DM - Update the overall status of File : “SIC_DM_EBMR_Update_FileQueue_OverallStatus” Data mapping is used to update the FileQueue flow overall status of EBMR

  1. DBT - Dropped the updated  FileQueue File : “SIC_DBT_FileQueue_Update” This data mapping is used to Dropped the updated files of FileQueue flow

Conclusion:

The SIC_PF_MERGE_ERROR_REPORT process flow effectively consolidates and manages error reports from both V3 and EBMR flows. By retrieving, parsing, and merging various types of error data, the flow ensures comprehensive error handling and reporting. It updates databases with relevant details, generates consolidated error reports, and stores them securely on SFTP and LAN locations. This process streamlines error management, providing an efficient solution for tracking, reporting, and archiving errors across multiple flows, enhancing overall system reliability and data integrity.

 

 

 

 

 

 

 

 

Related content