OnyxOS 5.5 Early Winter'23 Edition

Back to Release Notes Summary

OnyxOS Updated to Release 5.5

OEM Team

Data Ingestion Pipelines – General

1. Preprocessing audit error logging change –
   a. Added pipeline type condition for Formulary.
   b. Added count to count unique row count.
2. Commonfunctions – Write Delta function added, this function is used to write delta files in preprocess location.
3. GlobalVariables.py - reading Cloud watch channel from common functions library.
4. Reporting Dashboard changes –
   a. Added a dropdown list of Report type and IG type.
5. Added empty file function to check if csv files exist in source location, if not then upload source files with just headers in source location.
6. Cloud watch and IAM role – removed usage of AWS secrets and replaced it with IAM role.

Data Ingestion Pipelines – Claims

1. Added Cloudwatch library from common function repo
2. Added default file generator
3. Parameterized FHIR converter repartitioning
4. Parameterized cloudwatch occurrence in all the files.
5. Removed Coalesce when writing the file.
6. Reading source files using a read function instead of reading a parquet file.
7. Added empty file generator generates empty files in sourcefile location.
8. Added Spark Catalog instead of default metadata.
9. Included Unity Catalog changes.
10. Sample files and Data Guide matching.

Data Ingestion Pipelines – Clinical

1. Added Cloudwatch library from common function repo
2. Added default file generator
3. Parameterized FHIR converter repartitioning
4. Parameterized cloudwatch occurrence in all the files.
5. Removed Coalesce when writing the file.
6. Reading source files using a read function instead of reading a parquet file.
7. Added Spark Catalog instead of default metadata.
8. Removed Path check as none of the profiles are interdependent.
9. Included 3 more profiles to the workflow.
10. Included Unity Catalog changes.
11. Sample files and Data Guide matching.

Data Ingestion Pipelines – Provider Directory

1. Added Cloudwatch library from common functions.
2. Added default file generator.
3. Parameterized FHIR converter repartitioning Copyrights Protected by Onyx 2023-2024
4. Parameterized cloudwatch occurrence in all the files.
5. Removed Coalesce when writing the file.
6. Reading source files using a read function instead of reading a parquet file.
7. Added Spark Catalog instead of default metadata.
8. Removed Path check as none of the profiles are interdependent.
9. Removed PVD common functions library
10. Consolidated common functions into the common-wheel-package.
11. Included Unity Catalog changes.
12. Sample files and Data Guide matching.
13. File name changes in setup file

Client Apps Team

FITE:

1. Optum configuration for Quartz UAT and PROD environment
2. Capability statement update for ABACUS to fix FITE Cards issue
3. US Core/Clinical capability statement update for CHGSD UAT to fix the reported resource count issue
4. Missing Search parameter issue fix in US Core/Clinical for CHGSD

SLAP V2:

1. Code updates in member match logic to fix IDAHO issue with member login

SLAP V3:

1. Code fixes for ABACUS based on issues reported post testing in ABACUS environment.

Reporting Dashboard:

1. Monthly Log reports for API access deployed to IDAHO UAT and PROD

PAA Team

Claims: CHGSD(V4.2)

1. Issue: In the Main EOB_Inpatient notebook during the transformation Query of Claims_item_modifier_stack the Business Identifier variable should be the Capital Letters but small letters being present because of that Inpatient is failing.

   Resolution: We have modified the variable and placed the Capital Letter of business Identifier.

2. Issue: During the Conditional Init Script one of the folders under this path /FileStore/tables/Claims /SAFHIR/AppLog/Retry is not getting created hence resulting in failure during the ingestion.

   Resolution: As the index present inside [5:] causing the issue while creating the folders. As it expects complete path. So, we have removed the [5:] to prevent causing the issue. Currently this change is deployed to prod and working as expected.

Clinical: Quartz (V4.3.2)

1. Issue: While developing the Pyspark Version of Clinical Code. The Client sent us the wrong file naming convention. So, we have developed the code based on the File naming provided. When it moved to UAT. Client sends the same File naming convention that provided in Internal. So, we have deployed that to Production but in Production we are receiving a different naming convention for 2 of the profiles Immunization and Laboratory Result.

   Resolution: We have modified the code in CopySourceFiles.py to handle all type of Cases.

Back to Release Notes Summary

[]: