About payabl.
payabl. empowers businesses to grow through payments innovation and banking services. Our ambition is to expand our strong portfolio of global financial services we provide to businesses and make them all available in one place on our platform we call payabl.one. As a licensed financial company with principal membership with card schemes, we specialize in global payments and providing businesses with multi-currency accounts.
The Role
Working as part of our Data Team to build and maintain reliable data pipelines and datasets that support analytics and decision-making across the organization. You will work with SQL, Python, cloud data platforms, batch and streaming pipelines, and modern data engineering technologies. You will collaborate with engineers, analysts, and business teams to understand data requirements, improve data quality, and make data easier to consume.
Responsibilities
- Data Pipelines and Data Platform: Build and maintain reliable ETL/ELT data pipelines using SQL and Python. Develop and maintain datasets used for analytics, reporting, and other business use cases. Work with batch and streaming data pipelines running on AWS. Contribute to the continuous improvement of our data platform, architecture, and engineering practices.
- Data Modelling and Business-Ready Data: Work with analysts, engineers, and business teams to understand data requirements and translate them into technical solutions. Develop well-structured and reusable datasets that make data easier to consume across the organization. Support data transformations and data modelling for analytics and reporting use cases. Contribute to improving the consistency, usability, and reliability of business data.
- Data Quality and Production Reliability: Support data quality checks and validation processes to ensure reliable and consistent datasets. Monitor data pipelines and help identify and troubleshoot data or pipeline issues. Support production reliability and investigate issues when pipelines or datasets do not behave as expected. Contribute to improvements in monitoring, observability, documentation, and data reliability practices.
- Batch and Streaming Processing: Work with batch and streaming data pipelines across the data platform. Support data processing and transformation workflows running on cloud-based infrastructure. Contribute to the development and maintenance of scalable and reliable data processing solutions.
- Data Integration and Platform Development: Work with data from relational and non-relational databases and other internal or external data sources. Support integrations and data ingestion workflows across different systems. Contribute to the evolution of the data platform as new requirements and technologies are introduced.
Technology Stack
Our data platform includes technologies such as AWS, S3, Apache Iceberg, AWS Glue, EMR, Apache Kafka, Debezium, Kafka Connect, Apache Airflow, Airbyte, PySpark, Terraform, and Kubernetes.