Dushyant Kumar Singh
Senior Data Engineer
Copenhagen,Brondby
Summary
Senior Data Engineer & Solution Architect with 11+ years of experience in designing and delivering enterprise-scale data platforms. Proven expertise in Azure Data Factory, Databricks, PySpark, Synapse, and SQL, with a strong focus on data architecture, cost optimization, and cloud migration. Skilled in solution design, data modelling, and architecture reviews, while leading teams and collaborating with business stakeholders to deliver reliable, scalable, and cost-efficient data solutions that drive business growth.
Overview
11
11
years of professional experience
4
4
years of post-secondary education
2
2
Certification
2
2
Languages
Work History
Senior Data Engineer
Tata Consultancy Services
Copenhagen, Capital Region
2020.10 - Current
- Designed and implemented end-to-end cloud-based data architectures on Azure, ensuring scalability, security, and high availability.
- Built data pipelines using ADF, Databricks, and Synapse, enabling enterprise-wide analytics and faster decision-making.
- Developed automation scripts for cost optimization, aligning cloud usage with business demand.
- Defined solution architecture and design patterns for data integration and analytics solutions.
- Led incident management and proactive monitoring, ensuring reliable data platforms with high uptime.
- Managed CI/CD pipelines, standardizing deployment processes across environments.
- Partnered with stakeholders to translate business requirements into architecture blueprints and technical solutions.
- Acted as people manager, driving resource planning, mentoring, and performance reviews for engineers.
Lead Engineer – Data Warehousing
Tata Consultancy Services
Copenhagen, Capital Region
2018.09 - 2020.10
- Architected and maintained a SQL Server-based data warehouse, ensuring availability and stability of business-critical systems.
- Designed ETL workflows in SSIS and optimized existing pipelines for performance and reliability.
- Built SSAS analytical models and contributed to solution design for BI architecture.
- Automated integrations using TimeXtender, improving development agility.
- Developed custom C# automation utilities, streamlining workflows and reducing manual effort.
- Led platform optimization initiatives, reducing incident counts from 450+ to ~100 per month.
- Guided a team of engineers, ensuring delivery of scalable solutions aligned with architecture best practices.
Education
Bachelor of Technology - Electrical Engineering
Siliguri Institute of Technology
Siliguri 2009.07 - 2013.04
Skills
Cloud & Data Architecture: Azure Data Lake Gen2, Synapse Analytics, Data Factory v2, Azure Analysis Services
Big Data & Processing: Databricks (PySpark, Delta Lake), scalable ETL frameworks, orchestration, solution design
Programming & Scripting: Python 3x, SQL (T-SQL, advanced stored procedures, performance tuning)
Data Modelling & Architecture: Dimensional modelling (Star, Snowflake), OLAP, architecture reviews, solution blueprints Data Warehousing
DevOps & Automation: Azure DevOps (CI/CD pipelines), Git, cloud cost optimization scripts, monitoring solutions
BI & Reporting: Power BI, TimeXtender automation, architecture for reporting layers
Certification
Microsoft Certified: Azure Data Engineer Associate
Project Highlights
1. Automated Cloud Cost Optimization
- Designed and deployed automation scripts to pause Azure Analysis Services during non-working hours.
- Resulted in ~25% annual cloud cost savings without impacting business operations.
2. Enterprise Data Platform on Azure
- Architected and built end-to-end data pipelines using Azure Data Factory, Databricks (PySpark), and Synapse.
- Delivered a scalable data lake and analytics platform supporting multi-terabyte datasets, enabling faster decision-making across global business units.
3. Data Warehouse Optimization & Stabilization
- Re-architected SQL Server–based data warehouse and optimized ETL processes with SSIS and TimeXtender.
- Reduced incident counts from 450+ to ~100 per month, significantly improving platform stability and user confidence.
4. Cloud Migration Initiative
- Played a key role in migrating on-premise data warehouse solutions to Azure Cloud, ensuring scalability, performance, and cost efficiency.
- Provided solution design inputs for architecture patterns and data modelling during the migration.
Attributes
- Problem-solver with a keen eye for optimization and efficiency
- Strong communicator with experience in stakeholder management
- Passionate about continuous learning and innovation in data engineering
Accomplishments
- Automated Azure server optimization, reducing cloud costs by ~25% annually.
- Designed and implemented enterprise-scale data pipelines in ADF, Databricks, and Synapse, enabling faster analytics and business insights.
- Re-architected a data warehouse platform, reducing incidents from 450+ to ~100 per month, improving stability and user confidence.
- Played a key role in cloud migration projects, moving on-premise warehouses to Azure and enhancing scalability.
- Managed and mentored a team of engineers, ensuring on-time, high-quality delivery aligned with architecture best practices.
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Timeline
Senior Data Engineer
Tata Consultancy Services
2020.10 - Current
Lead Engineer – Data Warehousing
Tata Consultancy Services
2018.09 - 2020.10
Bachelor of Technology - Electrical Engineering
Siliguri Institute of Technology
2009.07 - 2013.04