Lead Data Engineer Job at Openkyber, Delaware, OH

WE1JZnI3Ylhkb2lVQzg4eUlUNytCMm0r
  • Openkyber
  • Delaware, OH

Job Description

Job Title: Sr.Data Engineer AWS & Streaming

Location: Fort Mill SC or New York, NY (2-3 Days Hybrid)

Experience level 10- 15 Years

Role Summary: We are seeking a Mid Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms.

Key Responsibilities:

  • Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python
  • Build event-driven workflows using AWS Lambda
  • Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink
  • Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation
  • Optimize data processing performance, scalability, reliability, and cost in cloud environments
  • Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline

Required Skills: Strong hands-on experience with Python and PySpark Proven expertise in AWS Glue, Lambda, and other cloud-native data services Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns) Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection) Strong understanding of distributed data processing and scalable architecture patterns

Good-to-Have Skills Experience with Apache Flink for real-time stream processing and stateful computations Knowledge of KSQL or other streaming SQL engines Exposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi Experience working in enterprise or financial data environments

For applications and inquiries, contact:hirings@openkyber.com

Job Tags

Similar Jobs

Eisenhower Health United States Full-time 2 months ago

Registered Nurse (RN) - Eisenhower Health - United States Job at Eisenhower Health United States Full-time 2 months ago

 ...Sign On Bonus Eligible Default Work Shift: Day (United States of America) Hours: 36 Salary range: $43.38 - $70.17 Schedule...  ...based on the nurses knowledge of growth/development, the hospital and nursing philosophy, policies/procedures and standards.... 

Axiom

Senior Anti Trust and Competition Legal Consultant Job at Axiom

 ...closing filing requirements, risks, and timelines with local counsel Providing antitrust support for corporate transactions and other special projects as needed Regulatory Engagement Formulating responses and legal arguments for inquiries and investigations from competit...

Highlands County Board of County Commissioners

Firefighter/Paramedic - Part-time Job at Highlands County Board of County Commissioners

 ...Expires: Until Filled GENERAL DESCRIPTION: A professional position responsible for knowing and maintaining essential firefighting skills in the prevention and extinguishment of fires, protecting and saving life and property, knowledge and enforcement of... 

Express HR Hub

USPS Mail Delivery Driver - Cassville, MO Job at Express HR Hub

 ...locations nationwide, is currently seeking applicants for mail delivery driver/mail carrier on a United States Postal Service mail route in Cassville...  ...: Route delivery/ unloading experience Former USPS, UPS, FedEx employees Requires a minivan or large SUV... 

Openkyber

SIEM Engineer Job at Openkyber

 ...Job: Cybersecurity Engineer with Must have Splunk SIEM Location: Richmond, Virginia (In Person Interview & Onsite) Contract Our client is hiring an experienced Cybersecurity Engineer with strong expertise in Splunk SIEM. Required Skills Hands...