Senior Data Engineer (Portugal-based Remote/Hybrid)
SWORD Health
Data Science
Porto, Portugal
Posted on Oct 23, 2024
What you'll be doing:
- Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.);
- Architect and maintain Sword’s (complex) data warehouse; We own lots of different types of data;
- Work with complex data architectures, like Kappa and lambda architectures. You’ll have the opportunity to work with batch and/or streaming processes;
- Have the opportunity to work with some of the most exciting and newest technologies in the data field;
- Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines.
What you need to have:
- Strong experience with Python programming language;
- Previous experience in Software Engineering is considered;
- Very high level of SQL and data modelling expertise;
- Knowledge about other database types, like NoSQL databases is considered;
- Experience in cloud-based architectures, such as GCP and AWS;
- Experience with orchestration frameworks like Apache Airflow;
- Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements.
What we would love to see:
- Knowledge of Data Governance;
- Experience with Modern Data Stack such as DBT, Bigquery;
- Experience with Kafka Ecosystem. E.g. Kafka, Kafka Connect, Schema Registry and others;
- Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;
- Capable of Zooming out and being able to propose changes to data architecture.
To ensure you feel good solving a big Human problem, we offer:
- A stimulating, fast-paced environment with lots of room for creativity;
- A bright future at a promising high-tech startup company;
- Career development and growth, with a competitive salary;
- The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;
- A flexible environment where you can control your hours (remotely) with unlimited vacation;
- Access to our health and well-being program (digital therapist sessions);
- Remote or Hybrid work policy (Portugal only);
- To get to know more about our Tech Stack, check here.
* Please note that this position does not offer relocation assistance. Candidates must possess a valid EU visa and be based in Portugal.