Data & Cloud Engineer

Responsibilities:

• Design and implement data pipelines using Python and Google Cloud Platform (GCP)
• Develop and maintain databases for large-scale data analysis, with knowledge of  relational, No-SQL, and analytics databases (e.g. MySQL, PostgreSQL, Clickhouse, Elasticsearch).
• Integrate data from various sources, including databases, SaaS applications, and web APIs
• Build and maintain Elasticsearch clusters to index and search data
• Collaborate with data scientists and analysts to develop innovative data-driven solutions.
• Oversee pipeline orchestration for both streaming and batch processes using appropriate tools such as Jenkins, Pub-Sub, Dataflow, etc.
• Write and optimize complex SQL queries for effective data extraction, transformation, and loading into data warehouses and lakes.

Qualifications:

• Bachelor's degree or MSC in Computer Science, Statistics, or a related field
• 3+ years of experience as a Data Engineer
• Strong experience with Python and SQL
• Proficient in Google Cloud Platform or any other Cloud Provider, including BigQuery, Dataflow, and Cloud Storage
• Experience with Jenkins and Pub/Sub
• Experience with Clickhouse or Elasticsearch is a plus
• Ability to design and implement scalable and reliable data pipelines
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills

‍