DATA PLATFORM ENGINEER – SENIOR
Place of work:
Bratislava
Salary offered (gross):
From 3.500,- € – based on experience
Contract type:
full-time
Start date:
ASAP
Your Responsibilities:
- Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive business growth.
- Build scalable data platform products leveraging Airflow scheduler/executor framework.
- Work with modern cloud data stack on GCS, Pub/Sub, Kafka, BigQuery, Postgres, Looker.
- Build scalable, reliable, secure, efficient and highly performant platforms and infrastructure for a variety of analytics and business applications.
- Contribute on data pipelines tooling to implement and extend its functionality using Python such that all users of the framework benefit from it.
- Contribute to shared data engineering tooling & standards to improve the productivity and quality of output for data engineers across the company.
- Improve data quality by using & improving internal tools to automatically detect issues.
Requirements
Must-have Skills:
- Python
- Big Data engineering in the Cloud (ideally GCP)
- Airflow or alternatives
What Do We Expect:
- 5+ years of full-time, industry experience in software development
- Strong coding skills in Python
- Broad knowledge of different types of data storage engines (relational, non-relational)
- Hands on experience with at least 2 of them – e.g. PostgreSQL, MySQL, Redshift, ElasticSearch
- Experience with orchestration tools (Airflow ideally)
- Advanced query language (SQL) knowledge
- Working with batch or real-time data processing
- Rigor in high code quality, automated testing, and other engineering best practices
- Cloud Knowledge – Google Cloud (best fit), AWS, Azure
- BS/MS in Computer Science or a related field (ideal)
Contact:
E-mail: astell@astell.sk