Azure Infrastructure: Azure Resource Logging

This document provides an insight into our current reporting and logging capabilities withing our current azure environment. This document aims to detail the tools, configuration and practices we currently in place to monitor, track and manage logs effectively.

Splunk Logging

• I2DB currently has a few resources whose logs are been ingested into Splunk.
• These logs are shipped to Splunk via azure event hub namespaces, click this link to access the i2db-redcapprod namespace.
• This namesspace consist of 4 event hubs:
  • i2db-app-svc-logs:
    • This Event hub sends all azure app service logs that are in the ICS - Redcap subscription to splunk.
  • i2db-appgw-logs:
    • This Event hub sends all azure app gateway logs that are in the ICS - Redcap subscription to splunk.
  • i2db-database-logs:
    • This Event hub sends all MySQL database logs that are in the ICS - Redcap subscription to splunk.
  • i2db-vmnic-logs:
    • Thisevent hub sends all virtual machine network logs that are in the ICS - Redcap subscription to splunk.
    • It is important to note that this event hub will be decommissioned once REDCap is fully migrated to azure app service.
• The i2db-rdc-resources was created to ship resources within the i2-rdc2.0 azure poc - dev subscription to splunk.
• However, there only event hub in the namespace is i2db-atlas-appsvc.
  • This event hub ships atlas application logs to splunk.
• There are additional event hub namespace that were not set up by the platform engineering team, i believe these were deployed by WuIT to collect logs for WashU gpt resources.
• These event namespaces consist of the following:
  • wuit-gpt-dev
  • wuit-gpt-test
  • wuit-gpt-prod.

Azure Monitor:

• Azure monitor is the primary tool that platform engineering uses for collecting, analyzing, and acting on telemetry from cloud and on-premises environments.
• Within azure monitor, we have what we call Alerts that is used to proactively identify and respond to critical conditions within our azure environment.
• Alerts are usually configured to monitor metrics, activity logs, log alerts and application insights alerts.
• When Alerts are fired & fixed, the details of the alert will appear on the dashboard as follow:

• These alerts are configured using Alert Rules.
• These alerts are then sent out to users using Action Groups.
• These action groups are comprised of user emails that the alerts use to send out emails when an alert is fired or ressolved.

Below are the alert rules categorized by subscriptions and resource types

DI2 - WashU AI Services - Dev subscription:

DI2 - WashU AI Services - Test subscription:

I2 - MDClone Pilot subscription:

I2 - Neurology - Cervical Myelopathy subscription:

I2 - RDC 2.0 Azure POC - Dev subscription:

I2 - RDC 2.0 Azure POC - Prod subscription:

I2 - RDC 2.0 Azure POC - QA subscription:

I2 - Sandbox subscription:

ICS - Redcap subscription:

Budgets

• It is a service that helps track our spending and can alert us when our cost exceeds a threshold.
• As it stands, we currently have a budget set up for every subscription within our environemnt except the WashU AI Services subscriptions.
• These budgets are as follows:

I2 - Biostatistics

• To access the budget for this subscription click biostatistics-monthly-cost

I2 - MDClone Pilot:

• To access the budget for this subscription click mdclone-subscription

I2 - Neurology - Cervical Myelopathy

• To access the budget for this subscription click Monthly-Neurology-Budget

I2 - RDC 2.0 Azure POC - Dev

• To access the budget for this subscription click Monthly-RDC-dev-Budget

I2 - RDC 2.0 Azure POC - Prod

• To access the budget for this subscription click Monthly-RDC-Prod-Budget

I2 - RDC 2.0 Azure POC - QA

• To access the budget for this subscription click Monthly-RDC-QA-Budget

I2 - Sandbox

• To access the budget for this subscription click sandbox-subscription

ICS - Redcap

• To access the budget for this subscription click ics-redcap-subscription

Pediatrics - PEDScreen

• To access the budget for this subscription click Monthly-Pediatrics-PEDScreen-Budget

Pediatrics - Sisk Novel Chatbots

• To access the budget for this subscription click Monthly-Pediatrics-subscription