One of the world's largest multichannel video programming distributor is searching for a Data Engineer. The project focuses on a video streaming platform development. You'll be developing and maintaining a mixture of production-ready components for various digital enterprise systems, including Metadata and Content Management systems. Our team spans across multiple time zones (majorly, USA & Poland) and covers the entire product life cycle, including architecture, design, coding, DevOps, testing, and the rest of the software development activities required to ensure uninterrupted content streaming service to millions of customers worldwide. We work using Scaled Agile Framework (SAFe) as a process framework and use software development best practices such as CI/CD, TDD, etc.
- Design, create and execute data processing, enrichment and summarization workflows utilizing SQL and No-SQL
- Develop new technical KPIs utilizing existing data by creating SQL-based workflows running on AWS and/or Snowflake/Redshift
- Ensure that various KPI summarization workflows execute according to designated daily/weekly/monthly SLAs
- Maintain real-time Kinesis-based data pipeline that is used for alerting and monitoring (Kinesis, OpenSearch/Kibana, Grafana, Prometheus, Glue, RedShift, RDS, etc.)
- Investigate data discrepancies, identify root cause and apply corrective changes/fixes following pre-determined SLAs
- Security vulnerability remediation (patching, key rotations, security ticket management, etc.)
- Data retention/lifecycle management (maintain cost structure)
- Ability to automate manual tasks into recurring reports/tasks/workflows
- Adept at AWS development practices using OpenSearch, Glue, Kinesis, RedShift, CloudWatch, Athena, Grafana, Prometheus
- Familiarity with external data sets (NewRelic, ServiceNow, JIRA)
- Maintain existing data workflows to ensure correctness of hourly/daily/weekly/monthly/quarterly) reports
- Maintain up-to-date documentation
MUST
- Develop workflows using AWS Airflow server that utilize RDS, Snowflake, Redshift as back-end data sources
- Develop workflows using AWS Kinesis, OpenSearch, Blue, Grafana, Redshift
- Maintain data stored in AWS and Snowflake/Redshift following predetermined SLA and cost forecast
- Familiar with JIRA, Confluence, Bitbucket, Airflow/MWAA, Snowflake, Tableau
- Familiar with AWS cloud stack supporting data services (OpenSearch, Athena, Grafana, Kibana, Kinesis, RedShift)
- Dev skill set - Python (Java, JS, ES|QL - is good to have)
- Good written/verbal communication skills.
- Good problem-solving, and analytical abilities
- Good planning, organizational, and follow-up skills.
- Familiar with Git, JIRA, Bitbucket, Jenkins,
- Familiar with Agile software development practices
- Operations - Experience with troubleshooting and data analysis
- Developers - Adept experience with various languages such as Java, ES|QL
- Developers - Deep understanding of software development principals
- Attention to detail and completing work with high degree of accuracy
Luxoft Poland
2000
Luxoft, a DXC Technology Company is a global digital strategy and software engineering firm with over 17,000 international employees within its 58 offices in 29 countries. It is headquartered in Zug, Switzerland.
In January 2019, Luxoft was acquired by U.S. company DXC Technology. Luxoft partnered with LG Electronics to create a next-generation Autonomous Mobility concept vehicle that integrates consumers' personalized digital lifestyles into a driving experience. Luxoft enabled Switzerland's first Blockchain based e-vote platform with the City of Zug and Hochschule Luzern's Blockchain Lab.
Luxoft, a DXC Technology Company is a world-renowned company. It has been present on the Polish market for over 13 years. We have offices in Krakow, Warsaw, Wroclaw, and Gdansk. We employ over 2,000 professional experts carrying out projects for over 100 clients from the financial, automotive, medical, tourist industries, etc. We work for many international clients, including the USA, Great Britain, and Switzerland.
So far, Luxoft Poland has made a name for itself as a company that offers work on innovative projects, we offer various experiences in the field of IT, opportunities for rapid development, an extensive training program, and attractive benefits for employees.
At present, 62% of Luxoft Poland employees come from Poland, and 38% from around 50 countries, including Ukraine, Brazil, India, Turkey, Spain, Portugal, Italy, Romania, USA, etc.
At Luxoft, a DXC Technology Company almost 80 percent of employees are experts with the "Senior" experience level, with at least five years of experience. We care about our employees, so every day we try to provide them with the best possible conditions for work and development.
Technology is our passion! We focus on top engineering talent means that you will be working with the best industry professionals from around the world. Because of that, Luxoft is a global family with an epic atmosphere – we love what we do!