CincinnatiOHRecruiter Since 2001
the smart solution for Cincinnati jobs

Lead Data Engineer

Company: Compunnel
Location: Cincinnati
Posted on: May 15, 2024

Job Description:

Tooling & Platforms include, but not limited to: Azure Databricks, Databricks Workflows, Databricks Delta Live Tables, Databricks Unity Catalog, Delta Lake, Azure Data Factory (ingestion & orchestration), ADLS Gen 2, Azure SQL Database, Azure CosmosDB, Neo4j, Apache Spark, PySpark, Spark SQL, SQL, PL/SQPl, Oracle Database Technologies (19c), Kafka, REST APIs, Alation, Terraform

[Lead] Spearheads planning, design, development, execution, and monitoring of complex data integrations to support project delivery.

[Lead] Mentors less experienced analysts on proper standards/techniques to improve their accuracy and efficiency.

[Lead] Knowledge of CI/CD practices for Azure Data Factory & Azure Databricks to implement and streamline CI/CD processes with engineering teams.

[Lead] Nice to have: Databricks Certified Data Engineer Professional

Nice to have: Databricks Certified Data Engineer Associate

Familiarity with ETL/ELT in Databricks and with Medallion architecture

Implement & perform unit testing, system integration testing, regression testing and assist with user acceptance testing.

Adhere to established standards and best practices and provide input for improvement of those processes.

Self-motivated team player who can work with minimal supervision and can adapt to a quickly changing environment.

Ability to work on multiple tasks simultaneously, ability to switch between tasks and work in conflicting priorities.

Must have strong knowledge of Software Development Life Cycle including requirement analysis, design, development, testing, and implementation. \

Hands on experience in performance tuning of sources, targets, mappings, and sessions.

Primary Skills: Azure, DataBricks, ADF, Unity Catalogue

Education: Bachelors Degree

Additional client information:

Keywords: Compunnel, Cincinnati , Lead Data Engineer, Engineering , Cincinnati, Ohio

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest Ohio jobs by following @recnetOH on Twitter!

Cincinnati RSS job feeds