Evolze - Data Platform Upgrade
Evolze is an engineering solutions company that provides innovative and sustainable engineering services across different industries.
In this project, I contributed to a data platform upgrade initiative, focusing on migration planning, data pipeline adjustment, deployment preparation, data validation, and issue resolution during the migration process.
Link: Evolze
Project Background
The existing data platform required an upgrade to support a more reliable, maintainable, and scalable data processing workflow.
The project involved migrating and adjusting existing data pipelines to align with the new platform architecture, while ensuring data consistency, controlled deployment, and rollback readiness.
The upgrade required close collaboration with the data platform team to validate pipeline behavior, access permissions, data flow, and reporting dependencies.
System Architecture
Original System Architecture
New System Architecture
My Role
I was involved in the planning and delivery of the data platform upgrade. My responsibilities covered migration preparation, technical documentation, data pipeline adjustment, testing support, and production deployment readiness.
Key Contributions
- Designed the data platform upgrade plan and supported the overall migration strategy.
- Prepared key technical documents, including:
- Branch strategy
- Data comparison strategy
- Test plan
- Deployment plan
- Rollback plan
- Migrated and adjusted existing data pipelines to support the new data platform architecture.
- Worked closely with the data platform team to validate pipeline execution, data flow, and platform compatibility.
- Investigated and resolved migration issues, including access permission problems, data consistency issues, and environment configuration differences.
- Supported data validation to ensure the migrated pipelines produced accurate and consistent results.
- Prepared deployment and rollback procedures to reduce production release risk.
Deployment and Rollback Plan
A structured deployment and rollback plan was prepared to ensure the platform upgrade could be delivered safely.
The plan covered deployment steps, validation checkpoints, rollback conditions, and recovery procedures in case unexpected issues occurred during or after the migration.
Technical Highlights
- Data pipeline migration and adjustment
- Data consistency validation
- Release and rollback planning
- Cross-team communication with the data platform team
- Azure-based data platform integration
- Reporting and analytics data flow support
