We are seeking a seasoned data engineer who is equally comfortable designing and building data pipelines as they are building software solutions. You will work with other engineers to design and build a data ingestion framework utilized by hundreds of internal software initiatives to accelerate access to mission-critical data. You love data engineering, but you also love building software solutions to solve difficult problems.
- Help lead the effort to design a data ingestion framework
- Collaborate across teams to gather requirements and feedback to inform the overall design
- Iterate rapidly to build the initial design while incorporating continual feedback from stakeholders
- Participate in active development of other mission-critical initiatives
MUST
Required Qualifications:
- 3+ years of experience:
o Designing, creating, and maintaining data pipelines
o Orchestrating pipelines on Airflow
o Deep experience building within AWS in a production environment (MWAA, Glue/EMR (Spark), S3, ECS/EKS, IAM, Lambda, etc.)
o Python expertise
o SQL-based data modeling
- Demonstrated ability for system design thinking and documentation
- Hands-on experience with Databricks and/or Dremio lakehouse platforms
- Experience with infrastructure-as-code tools like Terraform or CloudFormation
- Familiarity with CI/CD pipelines and DevOps practices
- Understanding of software design paradigms (OOP, functional, declarative/aspect-oriented)
- Ability to break through ambiguity and clearly define/document requirements
- Strong debugging and root cause analysis skills.
Related Platforms/Tools/Skills:
- SQL/DBT for data modeling
- DLT for data pipelines
- Apache Spark (PySpark/SparkSQL)
- Databricks
- Dremio
- AWS services
- Data mesh technologies
- Production experience in another high-level language (C#, Java, TypeScript, etc.)
- Experience building CLI-based applications in Python
- Financial services industry experience
Luxoft DXC
2000
Luxoft, a DXC Technology Company is a global digital strategy and software engineering firm with over 17,000 international employees within its 58 offices in 29 countries. It is headquartered in Zug, Switzerland.
In January 2019, Luxoft was acquired by U.S. company DXC Technology. Luxoft partnered with LG Electronics to create a next-generation Autonomous Mobility concept vehicle that integrates consumers' personalized digital lifestyles into a driving experience. Luxoft enabled Switzerland's first Blockchain based e-vote platform with the City of Zug and Hochschule Luzern's Blockchain Lab.
Luxoft, a DXC Technology Company is a world-renowned company. It has been present on the Polish market for over 13 years. We have offices in Krakow, Warsaw, Wroclaw, and Gdansk. We employ over 2,000 professional experts carrying out projects for over 100 clients from the financial, automotive, medical, tourist industries, etc. We work for many international clients, including the USA, Great Britain, and Switzerland.
So far, Luxoft Poland has made a name for itself as a company that offers work on innovative projects, we offer various experiences in the field of IT, opportunities for rapid development, an extensive training program, and attractive benefits for employees.
At present, 62% of Luxoft Poland employees come from Poland, and 38% from around 50 countries, including Ukraine, Brazil, India, Turkey, Spain, Portugal, Italy, Romania, USA, etc.
At Luxoft, a DXC Technology Company almost 80 percent of employees are experts with the "Senior" experience level, with at least five years of experience. We care about our employees, so every day we try to provide them with the best possible conditions for work and development.
Technology is our passion! We focus on top engineering talent means that you will be working with the best industry professionals from around the world. Because of that, Luxoft is a global family with an epic atmosphere – we love what we do!