RDC 2.0

ETL code which transforms data from Washington University Medical Center and Barnes-Jewish/Christian Healthcare medical systems into a research data base for the Washington University Insitute for Informatics (I2).

Versions

v1.29.1

  • Bug 41480 missing TW vital data (v1.29.1)
  • Bug 45771 TW vital remove iserrorflag=true data (v1.29.1)
  • Bug 46864 measurement lab bug (v1.29.1) Part-1
  • Bug 48685 measurement lab bug (v1.29.1) Part-2
  • Bug 42319 px_person_identifier bug (v1.29.1)
  • Bug 46863 drug_exposure ambulatory bug stat name (v1.29.1)
  • Bug 49212 Bug Soarian filter cncl_dtime downstream fix (v1.29.1)
  • Bug 47937 missing px_visit_occurrence data (v1.29.1)
  • Bug 47892 Px Location missing updates than location table (v1.29.1)
  • US 39261 px_visit_occurrence_insurance missing visit_occurrence_id
  • US 44604 Adding a primary key on px_visit_occurrence_provider table
  • US 47852 Remove historical vital records (esp. BP) with no result value
  • US 47850 Measurement Vital remove empty records (v1.29.1)
  • US 45547 missing px_measurement.panel_name for HDC post epic data

v1.29.0

  • (Task 41834): EDH to databricks epic clarity switch
  • (Task 45972): NK Update to include dxid~current_icd10_list wherever applicable
  • (Task 46385): datalake table name change
  • (Task 47039): Encounter Diagnosis for all service areas
  • (Bug 41128): TW condition_id bug - wrong dss coding system + nk contains mrn
  • (Bug 45501): condition_occurrence condition_source_value bug dx_id_icd codes
  • (Bug 45988): edh_encounter_master admit_date/sync visit id map fix/ data fix
  • (Bug 48076): Delta rule dependency removal, use of CIA tables only going forward
  • (Bug 48078): Update Soarian filter, remove cncl_dtime

v1.28.0

  • (UserStory 37835): New Domain Flowsheets (v1.28.0)
  • (Bug 46502): srn_encounter invalid id (v1.28.0) (DATA FIX ONLY)
  • (Bug 46418): px_visit_occurrence_identifier performance (v1.28.0) (CODE CATCHUP ONLY)
  • (Task 44297): CLARITY_SER Inactive provider are filtered out (v1.28.0) (NO DATA FIX NEEDED)
  • (Task 37835): Visit function update : checkout_time < checkin_time (v1.28.0) (DATA FIX AND FUNCTION FIX)
  • (Task 47851): Measurement vitals remove empty records (v1.28.0)
  • (Task 47851): px_drug_exposure_provider dup data bug fix (v1.28.0)

v1.27.0

  • (Task 45079): Social History Re-Org of Observation table
  • (Task 45078): DRG data from Epic
  • (Task 43309): Move Sequences from wz_schema
  • (Task 44631): Px_meaurement add antibiotic hidden indicator
  • (Task 42792): Clarity Changes for May 2023 + Aug 2023 Release
  • (Task 44800): Bring Enterprise ID Number to Px_person_identifier
  • (Task 45446): Reprocess drug exposure bug records missed in 1.26.0
  • (Task 33568): Provider Location Bug

v1.26.1

  • Bug 41198(Task 41491): HDC observation NS bug
  • Bug 42520(Task 42998): RDC bitbucket code catch up v1.26.1
  • Bug 42512(Task 42787): Condition_occurrence non-billing HAR bug
  • Bug 34380(Task 39647): Procedure_occurrence soarian bug(one-time update)
  • Bug 40463(Task 41174): Value_as_number measurement rounding off(one-time update)
  • Bug 42695(Task 43131): Visit_occurrence_source_nk soarian issue
  • Bug 42832(Task 42999): Process error table for EPIC only

v1.26.0

  • User Story 38032: Drug exposure end_date omop-recommended logic
  • User Story 34941: Drug exposure dosing bug
  • User Story 40880: source_epic_clarity indexes dup bug
  • User Story 40381: Provider specialty improvement
  • User Story 43467: EDH Encounter - Null Facility Bug (v1.26.0)
  • User Story 41286: epic_clarity_person_merge_unmerge function bug (v1.26.0)

v1.25.0

  • User Story 30140: OMOP CDM UPGRADE Changes v5.3

v1.24.1

  • epic_clarity_procedure_occurrence to fix issues with NK design REF: #39520
  • epic_clarity_px_procedure_occurrence to fix issues with NK design REF: #39520

v1.24.0

  • User Story 40345: Additional Encounters to add from EPIC Clarity (v1.24.0)
  • Bug 40374: utilize delta_ignore_fieldlist in delta_rule bug (v1.24.0)
  • Bug 39148: px_person_race pk bug (v1.24)
  • Spike 40064: Spike: Death Date < Update Date
  • User Story 40071: Clarity Logical Mapping - BJCMG Non-Billing Encounter Dx
  • Bug 33960: procedure_occurrence function bug nk issue (v1.24)
  • User Story 37746: create px_procedure_occurrence description view
  • Bug 40172: Type issue with non-surgery procedure occurrence (v1.24.0)

v1.23.3

  • Added dss_coding_system for tables "condition_occurrence","specimen","measurement","drug_exposure","procedure_occurrence","observation"

v1.23.2

  • added x_v_of_hsp_account to replace hsp_account & hsp_account_3
  • updated procedure_occurrence function to use the new table and correct error
  • data fix needed to correct procedure_occurrence data

v1.23.0

Updates

  • Adding in patient cell phone information (px_person_contact)
  • Adding in patient SSN information (px_person_identifier_ssn)
  • Added SQL scripts to common folder

Hot fixes

  • corrected condition occurrence problem list function
  • corrected procedure occurrence function
  • corrected pro-billing condition and procedure occurrence function

v1.22.0

Updated functions

  • source_epic_clarity/epic_clarity_allergy.sql
  • source_epic_clarity/epic_clarity_observation_social_history.sql
  • source_epic_clarity/epic_clarity_payer_plan_period.sql
  • source_epic_clarity/epic_clarity_px_payer_plan_period.sql
  • source_epic_clarity/epic_clarity_px_visit_occurrence_insurance.sql
  • source_epic_clarity/epic_clarity_visit_occurrence.sql
  • stage_omop/load_omop_condition_era.sql
  • stage_omop/load_omop_drug_era.sql
    Created functions
  • source_epic_clairty/epic_clarity_person_merge_unmerge.sql

Hot fixes included

  • fixing the priority of zc_ tables in the config_ingestion_artifacts table...and updating the files we currently have for the zc_ tables
  • fixing up several concept rules for observation domain, missing dss_coding_systems and unused vocabularies
  • fixing up the epic_clarity_visit_occurrence() function in several areas

Code catchup:

  • added 2 table creation scripts for 'px_person_identifier_tw_ssn_only' and 'stage_omop.merge_person_data'

v1.21.0

Updated functions

  • drug_exposure_med/drug_exposure_immune functions changed to use HAR numbers
  • drug_exposure_med functions to use static etl_ndc_contacts & etl_temp_ndc in the source_epic_clarity schema for performance gains
  • measurement lab/micro/vitals updated to use HAR numbers
  • load_omop_fact_relationship function corrected to stop adding duplications
    Hot Fixes included
  • will reprocess drug_exposure med/immune records with null/0 visit_occurrence_ids to try to match with new HAR visit_occurrences
  • will reprocess measurement lab/micro/vitals to match HAR visit_occurrences
  • will fix duplication in fact_relationship table

v1.20.0

  • MOBap-type condition_occurrence domain data
  • MOBap-type procedure_occurrence domain data
  • visit_occurrence functions code-catchup for incorrect filter

v1.19.0

release of MOBap Encounters

  • codebase changes for databricks server change from 'DEV' to 'PROD'
  • Person function fix & data fix to remove phi from source value & UPPER on NK string
  • added epic clarity source tables (edh_encounter_master) (hsp_account, hsp_account_3 not for ETL purposes)

v1.18.1

  • TASK 33789 - v1.18.1. Person location datafixes (NULL Person Address, function fixed in v1.18.0)
  • BUG 34750 - fact_relationship bug
  • Fixes missed from v1.16.0
    • Visit info not available (visit_source_value=null)
    • Fixed for measurement_type_concept_id = 0
  • TASK 33933 Measurement Fix (lab and vitals)
  • Nifi search path work

v1.18.0

  • Adding professional billing procedures to the procedure_occurrence domain
  • Adding new px_procedure_occurrence_modifier table to the omop_'env' schema
  • Adding professional billing diagnosis to the condition_occurrence domain
  • Codebase fix to functions\source_touchworks\tw_px_drug_exposure.sql for codebase purposes
  • Fixing constraints on px_visit_occurrence_location in OMOP_'env' schema.

v1.17.0

  • Clarity Immunization domain
  • Person Merge history Hx
  • Visit updates for measurement domain (VITALS and LABS on DEV environment only)
  • Update source_pk field for delta_rules/file_source-to_concept_map.sql
  • Person zip OT fix

v1.16.0

  • Fix gender, race and ethnicity in function epic_clarity_person. Also include Soarian and GE mrns.
  • Fix s_observation null constraints - ALL ENVIRONMENTS
  • Move sig data to px_drug_exposure fix - ALL ENVIRONMENTS
  • Adjust visit functions to include enc_type_c values of 3 and 76 along with data fixes for backfill
  • Adjust drug_exposure functions to include 'ambulatory' items
  • Person Duplicates removal from ID MAP based on MRN and fix for downstream domains
  • Cancelled Soarian Visit Fix
  • Visit Type Fix for Drug Exp, measurement and Observation
  • Index and constraints Sync across envs
  • Sync Function making use of delete_flag for id map
  • fixed the concept rules for HDC/TOUCHWORKS for procedure_occurrence (dss_coding_system missing) REF: 31268
  • updated some measurements for 0 concept ids REF: 31083

v1.15.0

Hot Fixes included

  • #29820-Improvement to the ingress priority for Epic Clarity tables (ingress_priority_update.sql)
  • #29819-Rename "stage_omop.stage_omop_error" table to "stage_omop.omop_stage_error" to prevent it from being truncated before every ETL (stage_omop_error_corretion.sql)
  • #29474-Corrected person function to insert null into person_source_value
  • #29821-Changed date fields in the etl_rules.ingress_rules table from date -> timestamp (ingress_rules_field_update.sql)
  • #29826-Improvement to the stage priority (stage_priority_update.sql)
  • #28120 Clarity drug_exposure fix to correct the px_drug_exposure_provider function and the drug_exposure function
  • function fix for drug exposure where the route_concept_id was set to null
  • function fix for measurement date stored as DATE and not TIMESTAMP (epic_clarity_px_measurement_vitals())
  • function fix for social hx data with incorrect nk construction (epic_clarity_px_observation_social_history())
  • function fix for value_as_string field for social hx records (epic_clarity_observation_social_history())
  • added the sk1 and sk2 fields in epic_clarity_measurement_vitals()
  • code fix to rdc_common.sh to correct if statement
  • function code fix to px_visit_occurrence_insurance to match filtering with parent function
  • function code fix to px_visit_occurrence_identifier to match filtering with parent function
  • function code fix to px_visit_occurrence_location to match filtering with parent function
  • added a "SMB check" to delta.sh, omop_stage.sh & stage.sh
  • added finer control to ingress dates -> hours/mins/secs
  • improvements to logging (only for 1904 process...not NiFi)
  • setting person_source_nk to nullable for the following stage_omop tables: s_observation, s_person, s_specimen, and s_visit_occurrence
  • setting visit_type_source_value to nullable in s_visit_occurrence

Data Fixes included

  • #29822-Fixing null route_concept_id in drug_exposure records (null_route_concept_id.sql)
  • #29474 data fix to set person_source_value to null to avoid PHI issues (person_source_value_fix.sql)
  • #27856-Removing canceled drug exposure orders (DEV_canceled_med_orders.sql)
  • Partial data fix for px_drug_exposure TOUCHWORKS records that have the wrong andministration_flag (px_drug_exp_admin_flag_fix.sql) Actual fix will be in v1.16.0
  • #27342 data fix to px_drug_exposure_provider (DEV_px_drug_exp_provider_datafix.sql)
  • provider type capitalization (DEV_px_drug_exp_provider_type_datafix.sql)
  • TW procedure code mismatch fix (TW_proc_occur_concept_fix.sql)
  • #29005-px_allergy reprocessing in Dev and QA to correct data (DEV_px_allergy_fix.sql)
  • #29561-HDC procedure data fix for surgery id (proc_occur_fix_hdc_data.sql)
  • data fix for value_as_string field in observation (value_as_string_fix.sql)
  • px_observation data fix (px_observation_data_fix.sql)
  • #27641 data fix for measurement date stored as DATE and not TIMESTAMP (px_meas_date_fix.sql)
  • #27436 restor the fact_realtionship table (DEV_fact_relationship_fix.sql)
  • #27344/#27435 location map fix (DEV_location_id_map_fix.sql)
  • #28119/#29721 measurement lab/micro re-run to fix the function issues (DEV_meas_lab_micro_datafix.sql)
  • #27434-Remove Data Duplicates due to old nk (Procedure_occurrence_source_nk_fix.sql)

v1.14.1

  • TOUCHWORKS visit fixes
  • TOUCHWORKS visit downstream domain data fixes
  • TouchWorks Function fix for typo for job_id
  • TouchWorks Delta Rule fix for Workslive_Encounter_ItemChild_Verb

v1.12.5

  • location function needs to remove phi from address and zip as this is already stored part of px_location

v1.14.0

  • Bringing in TOUCHWORKS Social HX domains
  • Short fix to the function: load_omop_fact_relationship
  • Adding some performance tweaks to Clarity drug exposure/measurement/specimen/observation (social hx) functions
  • Adding in the stage_omop_error tables and load_stage_omop_error() function for QA/Validation tasks
  • Fixes added to Concept.py to enable testing of a single record for concepts/vocabulary

v1.13.0

  • Addition of TOUCHWORKS domains of insurance and problem lists
  • Includes data fixes to type_concept_ids in certain OMOP tables (release/v1.13.0/scripts/type_concept_fixes/*)
  • Changes for log file overwrite (delta.sh & e2e.sh)
  • Changes for performance (Concept.py)
  • Changes for DDL creation for devs (MsSQLDDL.py)
  • Corrected function name (load_omop_obseration_period)
  • Includes data fixes to type_concept_ids in certain OMOP tables

v1.12.5

  • location function needs to remove phi from address and zip as this is already stored part of px_location

v1.12.4

  • Hotfix to disable deletion code from staging functions - epic_clarity_cond_occur_prob_list,epic_clarity_drug_exposure_med,epic_clarity_measurement_lab_micro,epic_clarity_observation_social_history,epic_clarity_px_cond_occur_prob_list,epic_clarity_px_drug_exposure_med,epic_clarity_px_drug_exposure_provider_med,epic_clarity_px_measurement_lab_micro,epic_clarity_px_observation_social_history,epic_clarity_specimen
  • Hotfixes to the payor plan period function to find ids from HDC and Clarity source and added a script to load id map from standard table.
  • Hotfix added Clarity_vital as dss_coding_system in Measurement Vitals, needed for populating concept id.
  • Hotfix for fixing drug exposure function, changed bill_num = null to bill_num is null as hotfix.
  • Hotfix for fixing qualitative_value originally using order_num_val instead of order_val.
  • Hotfix for fixng specimen_nk for Clarity Lab Micro originally using null as specimen_source_nk.
  • Hotfix for Specimen function to default concept value to 0 if null (coalesce(stype.name, '0')).
  • Hotfix for performance tweaks on staging function to include indexes and analyze on temp table.

v1.12.3

  • Hotfix to change connection strings for Azure QA/PROD servers

v1.12.2

  • Hotfix to catch up bugs/errors in v1.12.0 release (functions, scripts, some code changes for log file over-write protection)

v1.13.0

  • Addition of TOUCHWORKS domains of insurance and problem lists
  • Includes data fixes to type_concept_ids in certain OMOP tables

v1.12.1

  • Hotfix to catch up bugs/errors in v1.12.0 release (functions, scripts, some code changes for log file over-write protection)
  • Performance tweaks to staging functions

v1.12.0

  • Switching processes from Prognosis to 1904 for Observation: Allergy/Social History domain (Clarity)
  • Switching sources from HDC to Epic Clarity for Observation: Allergy/Social History domain
  • Switching processes from Prognosis to 1904 for Encounter Insurance (Clarity)
  • Switching sources from HDC to Epic Clarity for Encounter Insurance: Payer Plan Period, Visit Occurrence Insurance domains
  • Fixing the running of the stage_omop functions: load_omop_drug_era, load_omop_condition_era, load_omop_fact_relationship, load_omop_observation_period
  • Fixing printing the write_log calls in the sync_omop functions to the log file
  • Adding etl rules dumps to the logs
  • Addding log file overwrite prevention logic

v1.11.0

  • Switching processes from Prognosis to 1904 for measurements domain (Clarity)
  • Switching sources from HDC to Epic Clarity for measurements domain

v1.10.0

  • Switching processes from Prognosis to 1904 for drug exposure domain, this excludes immunization (Clarity)
  • Switching sources from HDC to Epic Clarity for drug exposure domain, this excludes immunization (Clarity)

v1.9.0

  • Switching processes from Prognosis to 1904 for procedure occurrence domain (Clarity Procedure)
  • Switching sources from HDC to Epic Clarity for procedure occurrence domain (Clarity Procedure)

v1.8.0

  • Switching processes from Prognosis to 1904 for condition occurrence domain (diagnosis/problem list)
  • Switching sources from HDC to Epic Clarity for condition occurrence domain (diagnosis/problem list)

v1.7.0

  • Switching processes from Prognosis to 1904 for encounter domain
  • Switching sources from HDC to Epic Clarity for encounter domain

v1.6.0

  • Switching processes from Prognosis to 1904
  • Switching sources from HDC to Epic Clarity for PPL Domain
  • Adding in Azure connectivity

v1.5.0

  • Adding measurement domains to RDC 2.0
  • Hot fix to the px_visit_occurrence_provider ETL
  • Hot fix to medication stage function

v1.4.1

  • Fix to diagnosis_occurrence function
  • Fix to procedure_occurrence function
  • Fix concept.py copy-back function
  • Add type conversions to MsSQLDDL.py

v1.4.0

  • Update to sync_omop function
  • Adding condition_occurrence and procedure_occurrence domains to RDC 2.0
  • Hot fix to load_omop_death() and load_omop_observation() due to hard-coded concepts
  • Hot fix to delta rules for I2_Appointment_Detail and I2_Charge_Details due to incorrect activity_type
  • Hot fix to alter px_measurement to include priority field

v1.3.2

  • Fixes to v1.3.1 Drug Exposure Domain

v1.3.1

  • Fixes and updates to v1.3.0 Drug Exposure Domain

v1.3.0

  • Drug Exposure Domain
  • Valid patient indicator improvement
  • source_to_concept_map constraints improvement

v1.2.1

  • hotfix to transposed scrapper code (12_LoadMicrobiology__Microbiology_Organism_input.sql)

v1.2.0

  • Added/modified code, tables, functions and scripts to enable TW Visits
  • Modified code for ingestion of src_concept_mapping csv files.
  • Included hotfix fur null gender source values
  • Modified sync_omop_person_id_map for performance

v1.1.5

  • Uncommented load_omop_death in run_load_omop_tables.sh
  • mkdir and smbclient code added for std_cm

v1.1.4

  • Hard coded environment variable fix discovered during QA deployment

v1.1.3

  • Enable SSL connections to the HDC data warehouse
  • Added a procedure to kill extraneous processes before running the ETL (v1.1.3\kill_process.sql)

v1.1.2

  • Fix the unlogged issue on tables s_condition_occurrence, s_px_person, d_procedure_occurrence
  • Added staging rules for hdc_px_person_location

v1.1.1

  • Code fix to delta_rules for VitalSigns and SurgeryProcedures (ref: User Story #7638)

v1.1.0

  • LIR-648 Bug fixes for visit and patient.
  • LIR-648 Fixed non-truncate for file loads.
  • LIR-648 Fixed diff detection of EXTRACT_ALL.
  • LIR-648 Limited multi-process queue size to 1M rows.
  • LIR-648 Modified round-robin queue insert to detect full queues.
  • LIR-512 Error detection prior to loading stage_omop delta table.
  • LIR-554 Procedures.
  • LIR-648 Corrected delta rule for px_person_identifier
  • LIR-648 Removed sample rules from deployment.
  • LIR-648 Modified unzip for vocabulary to not overwrite and not to create dirs.
  • LIR-648 Fixed death insert and delete logic.
  • LIR-648 Fixed patient diff detection.
  • LIR-648 Enhanced job_id for tw functions.
  • LIR-648 Fixed omop s_px_person_race.
  • LIR-648 Removed pk from s_px_person_race.
  • LIR-648 Added custom logic for LOAD_INFO ingress.
  • LIR-648 Fixed typos tw_person, tw_provider.
  • LIR-648 Change ID map for encoutner to 'ENCOUNTER'
  • LIR-648 Fixed duplicates based on MRN in tw visit_occurrence.
  • LIR-648 Fixed person_id null in tw visit_occurrence.
  • LIR-648 Fixed PK in s_px_visit_occurrence_provider.
  • LIR-648 Fixed HDC duplicates in encntr_2_ptnt.
  • LIR-648 Fixed duplicates in Touchworks Visits.

v1.0.0

  • LIR-468 Docker changes for use within RIS.
  • LIR-447 Mapping rules for provider.
  • LIR-474 Ingestion MVP - generate ingestion SQL for Extract Observation Date for DB2
  • LIR-475 Ingestion MVP - generate ingestion SQL by Load_info_sk for DB2 HDC
  • LIR-476 Streamio POC.
  • LIR-492 Docker Related work (notes for building, publishing, starting)
  • LIR-499 NK Mapping Function for Prescriber, and NK Rules
  • LIR-436 Create ddl for source_touchworks and delta_rules for all of the sources needed for patient, provider, and location
    Create ddl for source_hdc and delta_rules for all sources needed for patient, provider, and location
  • LIR-460 ETL engine; ingest NK rules and SQL generation. Ingest concept rules and SQL generation.
  • LIR-587 DDL for the OMOP database. Add audit columns and history tables.
  • LIR-510 ETL engine; omop delta calculation and merge.
  • LIR-459 Provider ETL.
  • LIR-430 Create DDL and ETL to load omop person for HDC and TouchWorks.
  • LIR-592 Person ETL & Testing tests for incrimentaly
  • LIR-493 Location ETL & Testing test for incrimental loads
  • LIR-515 Pentaho scrapper. Bash scripts.
  • LIR-598 Stage script and supporting tables.
  • LIR-599 Integration bash scripts.
  • LIR-549 Docker scripting and bug fixing
  • LIR-603 Date logic integration
  • LIR-607 Add index for batch_job_id
  • LIR-597 Pentaho Scrapper Bash Script
  • LIR-595 Release Script
  • LIR-511 Flat file ingestion.
  • LIR-615 End-to-end bash script restart.
  • LIR-616 Loading of source_to_concept_map.
  • LIR-246 Concept copy-back
  • LIR-528 Diagnosis ETL
  • LIR-644 Minor features to check for HDC status before extracting, change delta rule is_enabled with Touchworks catches up, change Touchworks extract_window to extract NULL values as well when from_dt = 1900-01-01
  • LIR-628 Added multi-process loading to Python.
  • LIR-619 Added version.txt file, version table, and functions deploy script validation.
  • LIR-629 QA build automation (second try)
  • LIR-582 Added release deployment scripts for v1.0.0 and latest (for developers).
  • LIR-621 Added Patient HDC-Touchworks Mapping
  • LIR-640 Added CONCEPT_CPT4 file.

v0.2.0 Release Notes

  • LIR-295 Change to not allow invalid concepts in concept map.
  • LIR-327 OMOP Staging to Provider POC
  • LIR-328 I2B2 ETL and automation.
  • LIR-330 Load src_concept_mappings from file mount.
  • LIR-331 Load updated measurement concept maps.
  • LIR-401 Load updated procedure concept maps.
  • LIR-406 Use incremental_info instead of job table.
  • LIR-403 Dockerizing RDC 2.0 ETL - Discovery; Creation of several docker files and docker compose.
  • LIR-427 I2B2 Bug Fixes.
  • LIR-488 I2B2 encounter_mapping patient race.
  • LIR-467 Added stage_omop rules tables.
  • LIR-470 Create schemas for RDCv2 database objects
  • LIR-471 Create a script for HDC stage tables
  • LIR-478 generate ingestion SQL for Extract All add SQL Server to feature
  • LIR-480 Create a script for TW stage tables
  • LIR-494 Update specimen_id in px_measurement.
  • LIR-479 generate ingestion SQL for Extract Observation Date for SQL Server
  • LIR-608a HOTFIX: Fix DB2 to_char() with explicit formatting. Put back
    pull from date if Pentaho fails.

v0.1.0 Release Notes

  • Big automation release. Goal is to schedule incrementals in Cron.
  • LIR-257 Automate RDC ETL run in bash scripts.
  • LIR-264 Fix patient merge records for Drug Exposure.
  • LIR-295 Fix invalid concept mapping.
  • LIR-296 Add HDC test DDL.
  • LIR-316 Stop using postgres userid in scripts.
  • LIR-320 Fix measurement RI issue.
  • LIR-321 Fix LOINC drug exposure concept id mapping.
  • LIR-323 Add specimen_id to px_measurement for MDClone.
  • LIR-337 Add e-mail to RDC scripts.
  • LIR-338 Automate backup, restore, drop of LZ tables.
  • LIR-341 Script automation bug fixes.
  • LIR-346 Add .gitignore to filter out temp files.
  • LIR-384 Cron specific script environment changes.
  • LIR-591 HOTFIX: Reset extract date after failed extract.

v0.0.11 Release Notes

  • First release from 1904labs taking over the code.
  • LIR-50 (DW-315) bug fix for insurance RI issues.
  • LIR-55 HDC address type adjustment.
  • LIR-167 Remove update_std_concept_mappings becuase it is not used.
  • LIR-173 remove schema create statements.
  • LIR-288 Fix nulls in tenant_cmn_cd_descr.
  • LIR-212 Change drug concept mapping to prefer NDC.
  • LIR-249 Load custom drug concept map (cs-188).
  • LIR-259 Fix drug start date filter for EPIC.
  • LIR-298 Updated drug concept mappings.
  • LIR-305 Fix payer plan period copy-paste bug.

© 2025 Washington University in St. Louis


Updated on August 7, 2025