Databricks data engineer

as a data engineer , you’ll be a key player in transforming data into actionable insights. You’ll collaborate with cross-functional teams to design and build scalable data solutions that support strategic decision-making.

what you’ll do

• design, develop, and maintain etl/elt pipelines using azure data factory , azure databricks , and other azure services.
• build and evolve data architecture , including models, schemas, and dictionaries.
• integrate data from multiple sources, ensuring quality, consistency, and readiness for analytics and operations.
• apply data governance policies to ensure security, privacy, and compliance.
• collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable solutions.
• stay current with emerging technologies and identify opportunities to enhance data infrastructure.
• implement best practices in big data and cloud computing to ensure efficiency and scalability.

qualifications

• 4 to 7 years of overall experience in data warehouse, data engineering, etls, data mapping, sql, databases, data lakes or lakehouse.
• 2 years of experience in databricks, azure data factory and devops/cicd automation.
• strong knowledge of azure services: adls gen2 , synapse , sql server , adf , databricks .
• proficiency in spark and pyspark for distributed data processing.
• solid programming skills in python for scripting and automation.
• understanding of data warehousing and relational modeling.
• familiarity with compiled languages ( java, scala ) and scripting languages ( sql, r ).
• excellent communication, problem-solving, and collaboration skills.
• growth mindset with a passion for continuous learning and improvement.
• experience working in agile/scrum teams using tools like jira , teams , and mural .
• knowledge of performance tuning , capacity planning , and production support models.