eng
#107018 Senior Data Engineer Closed
- Long term (more than 6 months)
Description:
We are looking for Senior Data Engineer to join our client’s team on a subcontract basis.
Our client is an exciting tech company and the leading sports betting provider in Germany and globally. Our mission is to electrify the sports betting experience for every customer, every bet. is a product organization at its core.
All of the clients functions are aligned towards delivering the best end-to-end product experience to customers. Product and technology teams work hand-in-hand to advance the development of client’s products and services.
Responsibilities:
- Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process terabytes of data quickly at big data scales
- Contributes design, code, configurations, manage data ingestion, real time streaming, batch processing, ETL across multiple data storages
- Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
- Responsible for performing performance tuning of complicated SQL queries and Data flows
- Identify gaps and improving the platform’s quality, robustness, maintainability, and speed
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
- Contribute in CoE activities and community building, participate in conferences, provide excellence in exercise and best practices
Should have:
- 3+ years of experience coding in Python, SQL, with solid CS fundamentals including data structure and algorithm design
- Experience on large-scale production databases and SQL
- Time-series/analytics databases, preferably Elasticsearch or OpenSearch
- Experience either with
1) ETL: Experience with ETL development (extractions, data load, aggregation, ideally experience with Talend).
or/and
2) Real time engineering: Hands-on implementation experience/ familiarity working with a combination of the following technologies: Hadoop, NIFI, Kafka, Spark, and Hudi
- 1+ years of experience in cloud data platforms - AWS: S3, Athena, EC2, RedShift, EMR, and Lambda
- Experience with Docker/Kubernetes
- Knowledge of professional software engineering best practices for the full software
- Knowledge of Data Warehousing, design, implementation and optimization
- Knowledge of Data Quality testing, automation and results visualization
- Knowledge of BI reports and dashboards design and implementation
- Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
- Upper-Intermediate or Advanced English
- Location: Spain, Poland, Bulgaria, Romania
Nice to have:
- Experience with Airflow
- Coding experience with Java/Scala
- Familiarity with Apache Hudi
We offer:
- The full-time workload on a remote basis
- Start - ASAP
- Duration - 6+ months
If you think you are the right person, we'd welcome your application!
Contact me to get more details at as@it-outstaffing.com
Skills
- SQL
- IBM Netezza
- ETL
- Kafka
- Java6
- Docker
- Hadoop
- SQL
- Redshift
- Apache Airflow
- Amazon Elastic Compute Cloud
- AWS Lambda
- Kubernetes
- Python
- CSS
- Vertica
- Elasticsearch
- Greenplum
- Spark
- Scala
Similar requests
Suggested Vacancies
Duration: Long term (more than 6 months)
Start from: ASAP
We are looking for Senior .NET Back-End Developer to join our client’s team on a subcontract basis. The client is one of the largest worldwide accounting, tax, audit, and consultancy companies and ...
Duration: Short term (from 1 to 3 months)
Start from: 21 Aug 2022
We are looking for a Senior/Lead Data Engineer to join our client’s team on a subcontract basis. Client is a family business with roots firmly embedded in Bregenz, Austria, but with reach across th...
Duration: Middle term (more than 3 months)
Start from: ASAP
We are looking for a Senior Java Developer to join our client’s team on a subcontract basis. You’ll be working on the next generation of DMM (Digital Marketing Management) platform based on a real-...