Carrix / ssa marine is committed to making our employees feel welcome and respected. Our team is unique and our approach successful because we have fostered an environment that values varying backgrounds, perspectives, and experiences and takes pride in how the collective delivers value to our customers and partners.
*summary/objective*:
as a data engineer at carrix / ssa marine you are charged with making the appropriate data available to various data consumers including data and business analysts, integrators, citizen data scientists, etc. You build, manage, and optimize data pipelines and move these data pipelines effectively into production for key data and analytics consumers.
*essential responsibilities*:
- embrace and implement devops principles and practices, identify and assess operations opportunities such as automation, provisioning, etc.
- learn to use innovative and modern tools, techniques, and architectures to automate the most-common, repeatable and tedious data preparation and integration tasks.
- assist with renovating the data management infrastructure to drive automation.
- collaborate across teams and departments to refine data and data consumption requirements for various initiatives.
- work to propose appropriate data ingestion, preparation, integration, and operationalization techniques to address data requirements.
- perform data conversions, imports and exports of data within and between internal and external software systems.
- create data transformation processes (etl, sql stored procedures, etc. to support moderately complex to complex business systems and operational data flows.
*requirements*:
*key knowledge, skills & abilities*:
- knowledge of programming languages such as (r, pearl, python, java, c++, c#, scala, etc..
- knowledge of commercial etl / elt platforms such as (boomi, informatica, alteryx, aws glue, adf, etc..
- deep knowledge of sql, pl/sql, oracle.
- knowledge of etl processing and change data capture (cdc technologies.
- knowledge of big data concepts, analysis, frameworks, api development, and visualization.
- knowledge of streaming data technologies like apache spark, flink and kafka.
- knowledge of business intelligence tools (such as tableau, qlik, powerbi.
- knowledge of data management architectures like data warehouse, data lake, data hub and the supporting processes like data integration, governance, metadata management.