About the role
As a (Senior) Data Engineer you will be responsible for designing, building and supporting scalable data ingestion and transformation pipelines that power the enterprise Operational Data Store (ODS). You will work within a cloud-native AWS environment, developing event-driven data solutions using Kafka (MSK), AWS Glue and Python-based engineering services.
You will collaborate closely with Technical Leads, Solution Architects, API Engineers and Domain Teams to onboard new data domains into the ODS platform using reusable, metadata-driven patterns and enterprise data standards. This role focuses on delivering high-quality, reliable and scalable data pipelines that enable trusted business data across the organisation.
What will you be doing?
- Building and maintaining scalable data pipelines using Kafka/MSK, AWS Glue, Python and PySpark.
- Designing and implementing ingestion, transformation, validation and publishing processes.
- Delivering end-to-end Operational Data Store (ODS) data flows integrating APIs, event streams and batch sources.
- Developing reusable frameworks, metadata-driven solutions and onboarding patterns across business domains.
- Ensuring data quality, integrity, traceability and adherence to enterprise data models and standards.
- Writing clean, testable and maintainable code while participating in code reviews and technical discussions.
- Supporting CI/CD pipelines, monitoring, logging and operational excellence initiatives.
- Identifying opportunities to improve platform performance, scalability and reliability.
- Collaborating with Product Owners, Architects, Domain SMEs and engineering teams to deliver business outcomes.
- Contributing to technical documentation, design artefacts and domain onboarding activities.
In Aviva Services Excellence Centre, we provide:
- Contract of employment
- Performance Bonus
- Private medical care (ENEL-MED)
- Cafeteria system of benefits (e.g. MultiSport card)
- Additional parent privileges: - baby leave – 6 weeks leave for second parent - shortened working time after parental leave
- Employer-funded group insurance
- Employee Shares Plan
- Extra day off for birthday
- Paid time off to volunteer
- Additional leave acquired over the years in the company (even 5 days more in a year)
- Wellbeing Leave - additional two weeks paid leave after 10 years of service
- Psychological support consultations
- Access to the e-learning platforms
- Internal employee referral program
- Hybrid working model from Poland with a few days in Warsaw office per month
- Attractive office location in Warsaw - Gdański Business Center
- Additional entitlements for people with disabilities - Work Without Barriers
- Work environment that promotes diversity - Diversity Charter
Essential
- Strong experience in Data Engineering (Senior over 5 years, regular over 3 years).
- Experience with Kafka or event-driven architectures.
- Hands-on experience with AWS services including: AWS Glue, S3, ECS, MSK , Aurora/PostgreSQL
- Strong Python development skills.
- Experience building ETL/ELT pipelines.
- Good understanding of data modelling concepts.
- Experience working with JSON, Avro and schema-based integrations.
- Familiarity with CI/CD and DevOps practices.
- Knowledge of data quality and data validation techniques.
Desirable
- Experience with Apache Kafka/MSK.
- Experience with CDC technologies such as Debezium.
- Knowledge of metadata-driven data platforms.
- Experience working within Financial Services or Insurance organisations.
