Principal Data Engineer

Company Description

Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that take ownership and crave more means we’re always on the lookout for talented people who bring passion and creativity to every project. Our culture embraces openness, acts with respect, shows grit & guts and combines employment with enjoyment.

Job Description

Project – the aim you’ll have:

Our client provides global enterprises with a real-time Carbon Planning & Intelligence platform to power forward-looking emissions management, so they can close the gap between climate-related actions and intentions.

The right person for this role will be a highly, internally motivated, strong backend technical contributor with strong experience expertly balancing quality and time to market over short, medium, and long time horizons. It is important that you work fluidly through the whole lifecycle of delivering value and delight to our customers, from pain to medicine. How you prioritize and manage your focus is key. You have seen a wide range of problems and efficiently pattern match solutions, which you leverage to facilitate collaboration across both technical and non-technical audiences. Most of all, you’re interested in using your software engineering capabilities to make a foundational contribution to reversing climate change.

Position – how you’ll contribute:

• Develop and maintain Clarasight’s data architecture strategy
• Own Clarasight’s data warehouse – the backend of our B2B SaaS platform
• Work directly with customers on data ingest and reporting requirements
• Manage the process of data ingestion into Clarasight’s data warehouse
• Establish an enterprise ETL technical architecture for ingestion of all third party and customer data feeds
• Perform data cataloging analytics on source data including data provided by clients and determine business rules for data ingestion
• Write requirements for and then implement ETL and data pipelines including exception-handling protocols and processes
• Perform continuous improvement of ETL processes
• Build core datasets
• Implement manual and automated data quality management
• Define and uphold SLAs
• Become a subject matter expert in travel and expense data
• Collaborate with Software Development, Data Scientists, Product Management, and Customer Success
• Democratize compliant and secure access to data through self-serve channels
• Establish data governance policies and procedures
• Monitor and troubleshoot data infrastructure issues
• Manage the planning, implementation and testing of Continuity of Business and Disaster Recovery for Clarasight’s data warehouse
• Provide technical leadership and share knowledge, for instance, through code reviews, pairing, ADRs, and presentations

Our offer – professional development, personal growth:

• Flexible employment and remote work
• International projects with leading global clients
• International business trips
• Non-corporate atmosphere
• Language classes
• Internal & external training
• Private healthcare and insurance
• Multisport card
• Well-being initiatives

Position at: Software Mind Poland

Expectations – the experience you need:

• 5+ years of data architecture, data modeling, data warehousing concepts, methodologies, and best practices
• Experience working directly with customers
• Experience scaling and re-architecting data platforms and infrastructure through orders of magnitude of growth and scaling data volume
• Experience working on data infrastructure-focused engineering teams building a data lake or data warehouse from scratch
• Experience with state-of-the-art ETL tools, techniques and processes
• Experience with AWS and cloud-based data services
• RDBMS; SQL; query optimization; performance troubleshooting
• Familiarity with DBT or SQLMesh
• Familiarity with several data warehousing platforms like Google Big Query, Snowflake, MemSQL (SQL Store), Apache Ignite, Redshift, Databricks
• 0 to 1 startup experience
• Exceptional common sense and the ability to manage ambiguity