We're looking for a *sr. Data engineer*
*location: remote mx*
*qualifications*:
- experience working in azure databricks, apache spark
- proficient programming in scala/python/java
- experience setting up databricks environment in azure, spark clusters, scalable and sustainable data engineering jobs
- experience designing data flows, building data strategy and documenting the process
- working knowledge in azure datalake, azure data factory, azure log analytics, delta lake, kafka, structured streaming, dataframe api, sql, nosql database
- comfortable working in azure services like azure key vault, azure functions, azure vnet
- experience designing and developing database tables and/or schemas using sql/no-sql;
- experience monitoring and maintaining the data pipelines and jobs
- experience setting up data zones in delta lake and implementing fine grained access control
- experience working in power bi to setup data flows, create dax queries, reports and dashboards with near real time updates
- comfortable with api, git, notebooks, spark jobs, performance tuning, container-based deployments, terraform
- familiarity with data streaming architecture, azure synapse, azure nsg, data catalog, azure purview a plus
- the role has to have 4 hours of overlap with the us (east-coast)
*what you can expect from us*
at digitalonus by tech mahindra, what distinguishes us from other teams is the comfortable environment which engenders trust within teams and with our customers.
trust and openness leads to quality, innovation, commitment to deliverables, efficiency and cost-effectiveness for all our customers.
- work with some truly remarkable it engineers, architects, specialists and more.
- we're growing at a phenomenal pace and we'd like some company.
- hear your voice, nurture your talent and help you strengthen your foot print!
- benefits above the law
- mentorship, and opportunities to grow and learn