Automation Systems
The page is about all the details related to the data automation systems and process regarding the MARS project.
More details will be coming. For the time being please visit Warren's MARS Automation page for any current information.
Overview
*Ongoing project to provide daily data extract (145-150 different files) totaling 141 tables, all sourced from Epic. Productionized data lives in QA environment. (completed week of 5/24/21)
HIPFS endpoint will be utilized (we need service credentials for MARS in order to automate) for delivery of data from our folders. Request has been submitted for this; endpoint extraction can be updated going forward.
*Neurology department staff has movement disorder database (even pre-Epic) integrated with numerous systems, including some that are now retired. This database was being used clinically and the desire was to have pre-Epic data available post-Epic in a specific format and with specific integrations.
-
In meeting with the department, this database is not being used widely, but this database has a high cost to maintain/enhance.
-
Desire is to sunset the database, even though only about 60 percent of the desired information can be found in Epic.
- Automation of a daily process, to include an automated run from Clarity and an automated load into the final environment. (Ticket submitted for service credentials for automation to HIPFS)
-
Automation of taking files, moving into DB is done; our pulls are done by running a script that is already developed. Additional automation work includes pulling files from landing point (in QA environment) to final destination.
-
File storage for older files with date stamping in order to provide a history (instead of overriding same file); archiving process tbd is how long do we keep these files in the RDC storage bucket