Senior Data Engineer

• Designing, optimizing, and maintaining reliable batch data pipelines for processing, filtering, and integrating large datasets.
• Managing the entire data lifecycle – from acquisition to quality control and storage – ensuring data integrity and availability.
• Optimizing data pipelines and warehouse architecture for scalability, low latency, and high throughput.
• Collaborating with analytics and engineering teams to translate business requirements into scalable data solutions.
• Implementing validation standards, quality control, and documentation to ensure data reliability.
• Developing and maintaining CI/CD pipelines using DevOps tools for seamless deployments and iteration.
• Monitoring, diagnosing, and implementing safeguards in data pipelines to minimize downtime.
• Mentoring junior team members and sharing knowledge.

• Salary up to 195 PLN/H net + VAT on B2B contract
• Possibility of working for a company with a stable market position
• Benefits: Multisport card, medical care, insurance
• Long-term cooperation

ID: SNR-Data009

• 5+ years as a Data Engineer with experience in building and maintaining large-scale batch data pipelines.
• Proficient in Python, Spark, and Airflow (or similar ETL/ELT orchestration tools).
• Strong knowledge of AWS (S3, Glue, IAM, Redshift, Lambda, CloudWatch, Kinesis) for cloud-based data workflows.
• Experience with data warehouses and technologies like Apache Iceberg.
• Familiarity with Terraform (or similar IaC tools) for cloud infrastructure management.
• Hands-on experience with Jenkins (or equivalent) for CI/CD automation.
• Deep understanding of batch processing, scheduling, dependencies, and performance optimization.