2025-03-17 Meeting Notes

Cost Center impact and considerations for MARs in Databricks

Points of contact

Dr. Joel Permutter (perlmutterjoel@wustl.edu) - PI

Karen Klumpp - coordinator

Dan Kelly - Analyst

Notes

• What cost center information considerations do we need when deploying Databricks resources

  ~ $100 month, PLUS REPORTING AND USAGE

  ~ free currently, ICS PMO (Nicole/Evin) -> MARs PI

• Does MARs qualify for provisioning in the cleansed catalog

  ~curated not Cleasned

  ~datawarehouse not Dakelake

• Previous request for Epic One push to Databricks volume

  look at pipeline automation

  test spark for ingestion of data as is

  sftp IF AVAILABLE INSTEAD OF smb ?????

• Should we start onboarding user for development testing, what are the access needs

  Onboarding intake process REDCap and Training

  Tooling is at user discretion