We are seeking a skilled, hands-on Data Engineer with demonstrated experience in Databricks, Apache Spark, Python, and real-time data streaming solutions.
- Implement resource composition logic provided by the Product team into scalable and efficient PySpark code.
- Develop, optimize, and maintain PySpark applications within the Databricks environment.
- Utilize and maintain existing CI/CD pipelines in Databricks for automated build, testing, and deployment.
- Write and maintain unit tests to ensure high code quality and reliability.
- Perform data validation and quality checks to ensure compliance with defined business rules
- Support and manage production deployments, ensuring system stability and performance.
- Troubleshoot and resolve issues across development, testing, and production environments.
- Collaborate with Product, QA, DevOps, and healthcare domain teams to ensure accurate implementation.
- Maintain technical documentation for code, workflows, and deployment processes.
- Pull from and push code to GitHub repositories, following version control and branching best practices.
MUST
- 5+ years of experience in data engineering roles
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
- 4+ years of experience with Databricks data pipelines
- Strong hands-on experience with PySpark and/or Apache Spark.
- Experience working with CI/CD pipelines and DevOps best practices.
- Proficiency with CI/CD, GitHub (pull requests, branching, code reviews).
- Experience writing unit tests and performing data validation
- Experience supporting production systems and deployments
- Strong analytical and troubleshooting skills.
- Knowledge of FHIR (Fast Healthcare Interoperability Resources) standards.
- Experience with healthcare data integration projects.
- Familiarity with REST APIs and FHIR server integrations.
- Experience in Agile/Scrum development environments.
Luxoft DXC
2000
Luxoft, a DXC Technology Company is a global digital strategy and software engineering firm with over 17,000 international employees within its 58 offices in 29 countries. It is headquartered in Zug, Switzerland.
In January 2019, Luxoft was acquired by U.S. company DXC Technology. Luxoft partnered with LG Electronics to create a next-generation Autonomous Mobility concept vehicle that integrates consumers' personalized digital lifestyles into a driving experience. Luxoft enabled Switzerland's first Blockchain based e-vote platform with the City of Zug and Hochschule Luzern's Blockchain Lab.
Luxoft, a DXC Technology Company is a world-renowned company. It has been present on the Polish market for over 13 years. We have offices in Krakow, Warsaw, Wroclaw, and Gdansk. We employ over 2,000 professional experts carrying out projects for over 100 clients from the financial, automotive, medical, tourist industries, etc. We work for many international clients, including the USA, Great Britain, and Switzerland.
So far, Luxoft Poland has made a name for itself as a company that offers work on innovative projects, we offer various experiences in the field of IT, opportunities for rapid development, an extensive training program, and attractive benefits for employees.
At present, 62% of Luxoft Poland employees come from Poland, and 38% from around 50 countries, including Ukraine, Brazil, India, Turkey, Spain, Portugal, Italy, Romania, USA, etc.
At Luxoft, a DXC Technology Company almost 80 percent of employees are experts with the "Senior" experience level, with at least five years of experience. We care about our employees, so every day we try to provide them with the best possible conditions for work and development.
Technology is our passion! We focus on top engineering talent means that you will be working with the best industry professionals from around the world. Because of that, Luxoft is a global family with an epic atmosphere – we love what we do!