We are seeking a seasoned Databricks Developer with a strong backend engineering background to lead a critical integration project. The primary focus of this role is to architect and implement the integration of our MARS (Market and Risk System) into the Databricks Lakehouse environment hosted on AWS.
Key Responsibilities
System Integration: Design and build robust data pipelines to ingest and synchronize data from MARS into the Databricks environment.
Code Development: Develop high-performance transformation logic using a mix of PySpark (Python) and Java, ensuring code is optimized for distributed processing.
Infrastructure Management: Deploy and manage Databricks clusters and jobs within the AWS ecosystem, ensuring high availability and cost-efficiency.
Risk Data Engineering: Translate complex Market and Risk logic into scalable data models within the Delta Lake architecture.
Collaboration: Work closely with Risk Managers and BI Analysts to ensure data integrity and sub-second query performance for financial reporting.
MUST
Proven Databricks Expertise: Extensive real-world experience building production-grade Lakehouse solutions. You should be comfortable with Delta Lake, Unity Catalog, and Photon.
Strong Python (PySpark): Mastery of Python for data manipulation, ETL processes, and automation.
Strong Java Foundations: Experience in Java is essential for maintaining existing system components or building custom Spark listeners/UDFs where performance is critical.
AWS Cloud Native: Solid understanding of AWS services (S3, IAM, EC2, Lambda) and how they interface with Databricks.
NICE TO HAVEViam Technology: Active knowledge of Viam for hardware/sensor integration or specialized automation workflows.
Markets & Risk Domain Knowledge: Understanding of financial instruments, Greeks, VaR, or market data feeds is a significant plus.
Business Intelligence (BI): Experience connecting Databricks to BI tools (like Tableau, PowerBI, or Quicksight) for executive-level reporting.
Infrastructure as Code (IaC): Knowledge of Terraform or AWS CloudFormation for deploying Databricks workspaces.
Luxoft DXC
2000
Luxoft, a DXC Technology Company is a global digital strategy and software engineering firm with over 17,000 international employees within its 58 offices in 29 countries. It is headquartered in Zug, Switzerland.
In January 2019, Luxoft was acquired by U.S. company DXC Technology. Luxoft partnered with LG Electronics to create a next-generation Autonomous Mobility concept vehicle that integrates consumers' personalized digital lifestyles into a driving experience. Luxoft enabled Switzerland's first Blockchain based e-vote platform with the City of Zug and Hochschule Luzern's Blockchain Lab.
Luxoft, a DXC Technology Company is a world-renowned company. It has been present on the Polish market for over 13 years. We have offices in Krakow, Warsaw, Wroclaw, and Gdansk. We employ over 2,000 professional experts carrying out projects for over 100 clients from the financial, automotive, medical, tourist industries, etc. We work for many international clients, including the USA, Great Britain, and Switzerland.
So far, Luxoft Poland has made a name for itself as a company that offers work on innovative projects, we offer various experiences in the field of IT, opportunities for rapid development, an extensive training program, and attractive benefits for employees.
At present, 62% of Luxoft Poland employees come from Poland, and 38% from around 50 countries, including Ukraine, Brazil, India, Turkey, Spain, Portugal, Italy, Romania, USA, etc.
At Luxoft, a DXC Technology Company almost 80 percent of employees are experts with the "Senior" experience level, with at least five years of experience. We care about our employees, so every day we try to provide them with the best possible conditions for work and development.
Technology is our passion! We focus on top engineering talent means that you will be working with the best industry professionals from around the world. Because of that, Luxoft is a global family with an epic atmosphere – we love what we do!