We are looking for a Senior Data Engineer – Reporting & Process Optimization to support our regulatory reporting transformation initiative within an investment banking environment. The primary focus of this role is to maintain the current reporting system built in Python, while also leading the migration to Azure Databricks to improve performance, scalability, and efficiency.
This role involves developing, optimizing, and automating reporting processes using PySpark and SQL, ensuring accurate and timely regulatory report generation. The successful candidate will work closely with risk teams, regulatory compliance teams, and data engineers to enhance reporting workflows and integrate the new system into our Azure cloud infrastructure.
This is an exciting opportunity to work on critical financial reporting processes, contributing to regulatory compliance, data governance, and process efficiency improvements.
- Maintain and enhance the existing Python-based reporting system, ensuring stability and accuracy in regulatory reporting.
- Monitor, troubleshoot, and resolve issues in the current reporting workflows.
- Ensure that reports comply with regulatory requirements and meet audit standards.
- Lead the migration of the existing reporting system to Azure Databricks, ensuring a smooth transition.
- Design and implement new, scalable reporting solutions using PySpark, SQL, and Databricks visualization tools.
- Optimize data processing pipelines to enhance performance, reliability, and efficiency of regulatory reports.
- Optimize PySpark performance to handle large-scale financial data processing for regulatory reporting.
- Improve SQL query execution to ensure fast, efficient report generation.
- Implement best practices for structured and unstructured data processing.
- Automate reporting processes to reduce manual intervention and enhance accuracy.
- Work with DevOps teams to ensure seamless Azure Databricks integration into the existing infrastructure.
MUST
- Databricks Concepts
- Databricks performance optimizations
- ACID properties of RDMS
- Python, PySpark
- SQL Concepts
- Databricks Queries and Visualization
- Exposure to CI/CD DevOps Pipelines
- Azure Data Services
- ETL & Data Processing,
- Financial Data Processing, experience handling risk, compliance, and regulatory data in an investment banking environment.
- Data Modeling, meta data management
- Git, GitHub, GitLab,
- Jenkins
- Regulatory compliance knowledge: Basel, MiFID, GDPR
- Big Data
- Cloud security and access controls (IAM, RBAC)
- Familiarity with Docker, Kubernetes, Apache
Luxoft DXC
2000
Luxoft, a DXC Technology Company is a global digital strategy and software engineering firm with over 17,000 international employees within its 58 offices in 29 countries. It is headquartered in Zug, Switzerland.
In January 2019, Luxoft was acquired by U.S. company DXC Technology. Luxoft partnered with LG Electronics to create a next-generation Autonomous Mobility concept vehicle that integrates consumers' personalized digital lifestyles into a driving experience. Luxoft enabled Switzerland's first Blockchain based e-vote platform with the City of Zug and Hochschule Luzern's Blockchain Lab.
Luxoft, a DXC Technology Company is a world-renowned company. It has been present on the Polish market for over 13 years. We have offices in Krakow, Warsaw, Wroclaw, and Gdansk. We employ over 2,000 professional experts carrying out projects for over 100 clients from the financial, automotive, medical, tourist industries, etc. We work for many international clients, including the USA, Great Britain, and Switzerland.
So far, Luxoft Poland has made a name for itself as a company that offers work on innovative projects, we offer various experiences in the field of IT, opportunities for rapid development, an extensive training program, and attractive benefits for employees.
At present, 62% of Luxoft Poland employees come from Poland, and 38% from around 50 countries, including Ukraine, Brazil, India, Turkey, Spain, Portugal, Italy, Romania, USA, etc.
At Luxoft, a DXC Technology Company almost 80 percent of employees are experts with the "Senior" experience level, with at least five years of experience. We care about our employees, so every day we try to provide them with the best possible conditions for work and development.
Technology is our passion! We focus on top engineering talent means that you will be working with the best industry professionals from around the world. Because of that, Luxoft is a global family with an epic atmosphere – we love what we do!