IT Job Offers
Warsaw
Analyst
Azure Big Data Engineer with Python/Spark

Azure Big Data Engineer with Python/Spark

Sii Polska

•••

Mid

16 000 - 28 000

PLN

net / month (B2B)

Online interview

B2B

Warsaw Gdańsk Wrocław Poznań Krakow Łódź Lublin Katowice Rzeszów Częstochowa Piła Bydgoszcz Gliwice Białystok Remote

Remote possible

100%

Project description

We are looking for an Azure Big Data Engineer with Python/Spark to join our growing team of analytics experts. The Data Engineer will be working on projects of Trading, Supply, Chemicals and Manufacturing with IDA (Information, Data, Analysis) and will support software developers, database architects, data analysts and data scientists on data initiatives to ensure optimal data delivery architecture is consistent throughout ongoing projects. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

Your tasks

Expanding and optimizing data and data pipeline architecture
Optimizing data flow and collection for cross-functional teams
Supporting the data needs of multiple teams, systems and products
Redesigning company’s data architecture to support next generation of products and data initiatives

Who we're looking for?

4+ years of experience in Data Engineering projects
2+ years of relevant experience on Azure technology services
Experience with Azure: ADLS, Databricks, Stream Analytics, Analysis Services, Azure Functions, Serverless Architecture
Knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra
Experience with object-oriented/object function scripting languages: Python, SQL, Scala, Spark-SQL etc.
Knowledge of Hadoop, Spark, Kafka (nice to have)
Good knowledge of the English language