Shared Infrastructure Accomplishments December 2021

Submitted by David Sterling

AccomplishmentImpact
Patched Papercut servers for Log4j vulnerabilityRemoved possibly of security vulnerability related to Log4j
Tested and scheduled Log4j patch for Maestro serverEngineering work to prepare for upgrade
Gave guidance to Depot on providing laptops for Wustl Secure EnclaveProvided Knowledge sharing between teams to transition to operations
Began required deployments of Windows 10 20H2 Task Sequence to 1909 and 2004 workstationsBrings more Windows client to up-to-date operating system version
Used F5 to help mitigate log4j security vulnerability for AIS and HRMS.Enabled request filtering to mitigate exposure
Verified that there are no other log4j vulnerabilities in the Web Tools portfolio.Confirmed with vendors
Upgraded F5 DNS devices (to an “engineering hot fix”) to resolve ongoing HA DNS issue.Bug fix
Four Azure SharePoint ECM 2013 servers retired.Excess server capacity removed pursuant to ongoing SharePoint migrations to SharePoint Online, Teams, Box.
Archived three more SharePoint sites after migration.Preliminary step toward retirement of migrated sites
Eric Wolbert completed the EHS data separation from OFMD file shares. This move included working with PE for IC data as well.Isolated Increased Controls data and moved all EHS/Radiation Safety data to new volume.
Coordinating Citrix clean up with ITSS and Danforth groups. This will get the last active EPIC users up to current Citrix Workspace client.Identifying existing clients installed to ensure all endpoints will have a consistent experience. Those with outdated or newer clients will be updated to the supported client for the environment.
Met with ITSS and WUIT SD to coordinate Knowledge Base improvements for deployments. The goal is to ensure that all KB’s and knowledge Base Blocks are updated properly prior to any changes going live.Multi team collaboration to ensure the organization is utilizing the Knowledge Base and Knowledge Base Blocks in Service Now in a consistent manner. Review of these are now agenda items for deployments and other projects.
Tivoli Endpoint Manager (TEM) server retirement scheduled for 12/6Tivoli Endpoint Manager is a legacy endpoint management system that has been phased out to the new tools that WUIT utilizes.
Worked with School of Engineering to open up printers identified for students to all Wash U students with no limitations.  Will coordinate printer cleanup with them over winter break.The School of Engineering requested that all Washington University students be able to print on their identified student printers.  This work was coordinated with the School of Engineering team and Shared Infrastructure Desktop Engineering team.
Consolidated Task Sequence 2.0 100% through QA – released to depot as test TS. and PSA engaged – TS scheduled for 1/24 release with training and communication plan complete.Major improvements on endpoint builds, new naming convention, functional areas built into name etc. https://sharedtech.wustl.edu/destandards/DepartmentInformation
Kicked off 2nd phase of Depot optimization project – Working with Dell to automate builds with bar codes per their requirements. once complete will allow endpoint builds to be done by Dell, thereby freeing up Depot resources. 
Completed 257 tickets/work orders (Blue Light, CATV, Telecom Work Orders, Cable Installs, Fiber Paths, Locates)Provides resolution for network, voice and other infrastructure services
Completed wireless assessment/survey for Advancement in West Campus.  The assessment identified upgrades and once complete will provide complete wireless coverage for Advancement in West Campus
Completed reconfiguration of auto attendants and call centers for holiday hours. Adjusted voice recording to support holiday schedule
Completed CSRB 10th flr. battery life cycle management replacementTo assure we have proper run time on our UPS’s as part of our life cycle management effort
Completed the upgrade wireless CMX OS due to log4j vulnerabilityThe upgrade address the log4j vulnerability
Validated West Campus’s wired/wireless network performance and identified faulty interface and switched to new fiber path and portCompleted troubleshooting efforts and fixed faulty fiber that was causing interment tent network connectivity issues for Advancement
Decommissioned legacy Art/Sci remote access VPN profilePart of our Remote Access VPN project, in which we are migrating users to new VPN services that will improve security.
Completed Public Safety DAS assessment with vendor for the North Side Residential BuildingsCompleted assessment that identified spaces to buildout public safety distributed antenna system that directly supports the university and clayton police and fire communications.
Completed testing for Shibboleth and 2FA integration with PCR, as part of the telemanagement replacement projectEnabling 2FA as part of the VoIP Telemanagment system project
 Follow up discussions with Business School U regarding Memorandum of Understanding, ATT SOW and financial doc for the Knight Center Hotel HVS migrationPreparing for the Knight Center Hotel VoIP migration
Completed reconfiguration of 29 phones in University Advancement (Alumni & Dev)To support Advancements move efforts
Supporting 65 active construction projects for both Danforth (15) and Medical campus (50).Assuring that the proper technology and infrastructure are being installed in all construction projects
Completed Life Cycle Management  battery refresh for Barnes West 955 Executive parkway, Cortex 3rd floor, and 4444 Forest park 6th floor, Barnes Central Pavilion 2nd and 3rd floors, Barnes West Pavilion 10th floor, Barnes East Pavilion 2nd floor.To assure we have proper run time on our UPS’s as part of our life cycle management effort
Completed UPS install for the Delmar Divine project.Providing backup power services for this project
Upgrade the EAST and EASTI Distribution router uplinks to 10Gig (20Gig aggregate to the WUCON Core)Increase network capacity on the Medical Campus 
Decommissioned nexus 2k;s in 4480 DC Row 4 as part of our LCM effortsPart of our LCM efforts, which includes decommissioning legacy hardware
Created 2 ILO networks and wrote specific rules in FTD for SEAS DC migrationSupport the McKelvy Engineering school data center network environment 
Upgraded lab and prod Cisco ISE servers to hotfix resolving log4j vulnerabilityAddress the log4j vulnerability
Research all networking systems for possible log4j vulnerabilityAssessed all network infrastructure for the log4j vulnerability
Completed 4 battery pack refreshes – MSUL-CP02A-Z, MSUL-CP03A-Z, MSUL-EP02A-Z, MSUL-WP10A-ZTo assure we have proper run time on our UPS’s as part of our life cycle management effort
Completed configuration changes and testing for End User Services call centers and all agents for new VIP call center initiative.Support of the new VIP call center
Completed 4 battery/UPS refreshes; 2 @ Cancer Research, 1 @ NWT, 1 @ McMillanTo assure we have proper run time on our UPS’s as part of our life cycle management effort
Completed the install of 4 UPS for the Department of Orthopedic Surgery in BJCIH To assure we have proper run time on our UPS’s as part of our life cycle management effort
Completed the West Campus Data Center computer room air conditioning preventative maintenanceMonthly inspection of the  computer room air conditioning units are running properly 
Completed the West Campus Data Center generator preventative maintenance Monthly inspection of the  generator and ensure that it is running properly 
Returned auto attendants for major departments to regular business hours/days configurations/recordings.Complete call center programing to support Danforth campus departments holiday schedule
Decommissioned CFU and Olin Library vpn profilesPart of our Remote Access VPN project, in which we are migrating users to new VPN services that will improve security.
Completed testing to move wustl-encrypted-2.0 to ISE radius, Part of network engineering efforts of continuous improvement
Completed final report for the 2021 Disaster Recovery tabletop exerciseProvide information to leadership regarding performance of disaster recovery processes and potential areas for improvement.
Completed 2021 risk and vulnerability assessmentProvide information to leadership regarding current risks and vulnerabilities to assist in identification of future improvement projects.
Completed server build for the ADIS database archive serverImprove reporting capabilities using archived data.
Completed retirement of legacy Surgery Commvault environmentSimplification of hardware environment by retiring legacy hardware.
Completed server build for testing Globus data migrations to RIS environment for AnesthesiologyEnable fast transfer of data from legacy Anesthesiology file shares to RIS storage.
Completed manual scans of Windows servers for Log4j vulnerabilityImprove information security posture by identifying potential vulnerabilities.
Successfully implemented fix for Windows update issues impacting a specific serverImprove operational process by resolving blocking issue.
Completed removal of desktop machines from Symantec Endpoint ProtectionSimplification of software environment by retiring legacy application.
Completed removal of servers from Symantec Endpoint ProtectionSimplification of software environment by retiring legacy application.
Completed integration of vSphere and RumbleImprove investigative capabilities by integrating additional data.
Completed migration efforts to move legacy AISwiki help websites to WordPressSimplification of software environment by retiring legacy application.
Completed server refresh for the AISrelay Serv-U environmentMaintain operational efficiency by performing lifecycle maintenance.
Completed retirement of the shared MySQL database hosting platformSimplification of software environment by retiring legacy application.
Completed retirement of the shared MariaDB 10.1 database hosting platformSimplification of software environment by retiring legacy application.
Completed installation of SQL Server for AutoSys server refresh projectMaintain operational efficiency by performing lifecycle maintenance.
Retired NetApp 8020 nodes from GDCE environmentSimplification of hardware environment by retiring legacy hardware.
Completed renewal of licenses for Azure GCC High environmentMaintain operational efficiency by performing lifecycle maintenance.
Completed AWS Educator training to enable management of AWS Educator environmentSupport faculty utilization of AWS for educational purposes.
Completed log4j scans against Windows servers through CrowdStrikeImprove information security posture by identifying potential vulnerabilities.
Completed initialization of pathfiles.wustl.edu replication and backup processesMaintain operational efficiency by verifying proper process configuration.
Reclaimed 325TB of space from Veeam backup servers by migrating servers from legacy backup retention schemes to standard Private Cloud schemesImprove operational process by reducing unnecessary system utilization.
Completed reporting of hosts using large volumes of backup capacity to assist with backup option managementImprove operational process by reducing unnecessary system utilization.
Reconfigured wuit-s-00197 as a “scrapyard” backup repository for use in reorganizing backup repository space utilizationImprove operational process by enabling efficient resource reorganization.
Completed phased plan for VMware vCenter 7.0 upgrade projectMaintain operational efficiency by performing lifecycle maintenance.
Applied mitigation for log4j vulnerability in VMware componentsImprove information security posture by remediating potential vulnerabilities.
Completed closeout of VMware Tools and Hardware version upgrade pilot projectMaintain operational efficiency by performing lifecycle maintenance.
Completed closeout of DR Protection and Enhancement Proof of Concept projectIdentify potential improvements to disaster recovery capabilities in the WashU IT Private Cloud.
Completed deployment of Occupational Therapy SLiC application update phase 1Maintain operational efficiency by performing lifecycle maintenance.
Completed Linux Physical Backup Strategy developmentImplement appropriate backup strategy for physical Linux systems.
Completed annual Disaster Recovery tabletop exerciseAssess performance of disaster recovery processes and potential areas for improvement.
Completed migration of databases for Center for Clinical Services from legacy server to WashU IT shared hosting environmentMaintain operational efficiency by performing lifecycle maintenance.
Completed retirement of NetApp 8020 nodes at West Campus Data CenterSimplification of hardware environment by retiring legacy hardware.
Completed deployment of MDClone VDI environment for Lassa-Claxton labImprove access methods for MDClone environment.
John Bailey delivered a cloud network architecture presentation and hosted a panel workshop at the Internet2 Cloud Forum conference at Cornell UniversityShare WashU IT knowledge and expertise with peer institutions.
Completed enhancements in Box for the Pediatrics ER/Epic integration processImprove Epic integration capabilities.
Command Center printed 8699 Accounts Payable and 691 payroll checks in the month of Decemberfacilitate check printing for vendor payments and staff paychecks
Completed the 2960X model of network switches for the NAC projectProvides compatibility towards the NAC project
Identified public IP printers not behind firewalls for Desktop Engineering groupTo provide better security for devices on our network
Coordinated WashU IT response to the log4j vulnerabilityFacilitated regular meetings to remediate the vulnerability
Upgraded East Building at the medical school to a 10GB uplinksAllows for better network throughput for devices on this network
Activated new network lines for a clinic opening on CAM 12th floorAllow for clinic to provide patient care 
Developed automated ticket process for disk drive full on desktop computersAllow for better patch management and reduce vulnerabilities on the supported desktops
Upgraded operating system on 80 network switches for the NAC project at the med schoolProvides compatibility towards the NAC project
Installed new fabric extenders in GDCE and Brauer Hall data center for private cloud expansionIncrease capacity within the private cloud environment
Built new virtual servers for Card ServicesUpgrade server infrastructure 
Installed new Fabric Extenders in GDCE for cloud expansionIncrease capacity within the private cloud environment
Installed new Fabric Extenders in BHDCIncrease capacity within the private cloud environment
Built new servers for WordPress – Card ServicesUpgrade server infrastructure 
Retired servers for Olin Library (2), Student Health (1), SharePoint 2013 (4), and SITS Desktop Migration (2)Reducing server footprint within our supported datacenters