Senior Data Engineer

Signature IT World Inc is seeking a Senior Data Engineer to lead the development, maintenance, and optimization of data pipelines within their Enterprise Data Platform. The role involves applying data engineering fundamentals and collaborating with cross-functional teams to ensure data accuracy, reliability, and accessibility for informed decision-making across the organization. Responsibilities: Lead the design, development, and maintenance of scalable data pipelines that process and integrate data from multiple sources into the Enterprise Data Platform; Build pipelines and workflows as code using modern engineering practices (version control, code reviews, automated testing, reusable components); Define and implement patterns for CI/CD for data pipelines (automated builds, tests, deployments, and environment promotion); Partner with data scientists, analysts, and business teams to gather Qualifications: 6+ years of experience; Pyspark (Hands-on experience in development); Bachelor's degree in computer science, Information Systems, or a related field (or equivalent experience); 5–8 years of experience in data engineering or a related role; Advanced proficiency in SQL for complex data transformation and analysis; Hands-on experience with cloud-based data platforms such as Databricks, Snowflake, or similar tools; Experience with ETL/ELT tools and frameworks (e.g., Informatica, Talend, dbt, or equivalent); Strong proficiency in Python and/or PySpark for data processing and pipeline development; Strong understanding of data modeling, database design principles, and building curated datasets for analytics and operational use cases; Experience with DevOps practices and Git-based development (branching strategies, pull requests, code reviews); Experience implementing CI/CD for data pipelines/workflows and managing deployments across environments; Strong problem-solving skills, attention to detail, and ability to troubleshoot complex issues end-to-end; Excellent communication skills and ability to collaborate across technical and non-technical teams Required Skills: Databricks, Snowflake, PySpark, SQL, Python, ETL/ELT tools, Data modeling, Database design, DevOps practices, Git, CI/CD, Data pipeline orchestration, Communication