PE CQI
Overview
-
The Office of Education has a pilot PECQI relational database which needs to be migrated to the Data Lake and transitioned to active use while also being merged with additional datasets. The database needs to support their online Tableau dashboards. They would like to incorporate it into a data pipeline connecting Qualtrics to their relational database and their online dashboards. They are currently using R scripts and Box to piece everything together. R has a Qualtrics package that allows them to fetch survey data using the Qualtrics API. Matt registers his Qualtrics credentials in R using an API key tied to his Qualtrics account and the WUSM Qualtrics URL.
-
The PE/CQI unit developed a series of Tableau dashboards for multiple purposes. They are in the process of rolling out more. Qualtrics holds their source data. They use an R script to query the data from the Qualtrics API. R then transforms the data and saves it to Box as a flat file. Their Tableau dashboards point to various flat files on Box. They would like to replace Box with a relational SQL database. The hope is to off-load calculations that are occurring both in R and Tableau into the SQL database, improving performance for their ETL scripts and dashboards, while simultaneously unifying their data which currently lives separately. Matt Wroblewski has been studying relational database best practices and SQL scripting. He plans to do most of the heavy lifting himself in terms of database development. His team needs access to the database environment, info on which software is being used/how to get it, etc.
ICS' Role
- The initial task was to onboard the team to the Data Lake and provide an overview session so ultimately they can integrate a relational database (PECQI) into Databricks for better dashboard utilization. Moving forward, this gives them the ability to develop a coordinated and integrated education data warehouse with potential to join to other datasets. Dean Carolyn Dufault is the owner of the pre-existing office of education Azure database environment and she uses that data for both student assessment needs (non-research) AND occasionally for research. Users were set up as operational, with instructions to notify Data lake support and submit a new intake form if they do any research.
Meeting Notes
Contacts
Internal
| Name | Role |
|---|---|
| Nicole Venteris | PM |
| Ian Lackey | Tech |
External
| Name | Role | Contact Info |
|---|---|---|
| Matthew Wroblewski | Senior Statistical Data Analyst, Office of Education | mWroblewski@wustl.edu |
| Maria Perez | Research Projects and Planning Manager, Office of Education | mperez@wustl.edu |
| Yaheng Lu | Senior Statistical Data Analyst, Office of Education | yaheng@wustl.edu |
| Carolyn Dufault | Assistant Dean for Educational Technology and Innovation, Office of Education | cdufault@wustl.edu |
| Eve Coulson | Associate Dean for Program Evaluation, Office of Education | eve.colson@wustl.edu |
| Leslie Blaylock | Dir. of Innovation and Continuous Process Improvement, Office of Education | llblaylock@wustl.edu |
Project Management
Major Tasks & Initiatives
Important Dates & Notes
(As of January 2025)
Important Deadlines
Deliverables
Standard Meetings
| Name | Occurrence | Frequency | Zoom Link | Attendees | Description |
|---|---|---|---|---|---|
| ad hoc meetings | Random |
Administrative Details
Tracking Time
Please ensure all work is categorized underneath the PE/CQI Dashboard Integration project in Tracking Time..
Digital Landmarks
Project Web Pages
Document Repositories
InfoSec Report
- n/a
Code Repositories
Technical Information
Guides, Tutorials, & References
Team Specific Documentation
Glossary / Acronyms
| Term | Definition |
|---|---|
| PE/CQI | Program Evaluation and Continuous Quality Improvement |