Senior Data Engineer (GCP) – LATAM

Latin America

About Distillery

Distillery accelerates innovation through an unyielding approach to nearshore software development. The world’s most innovative technology teams choose distillery to help accelerate strategic innovation, fill a pressing technology gap, and hit mission-critical deadlines. We support essential applications, mobile apps, websites, and eCommerce platforms through the placement of senior, strategic technical leaders and by deploying fully managed technology teams that work intimately alongside our client’s in-house development teams.
At Distillery, we’re not here to reinvent nearshore software development, we’re on a mission to perfect it.

About the Position

As a Senior Data Engineer you will work on new technologies and find ways to meet our customers’ needs and make it easy for them to do business with us. You will be a part of a team to resolve a diverse range of complex problems and regularly lead multiple, technically complex, large-scale projects.

Responsibilities

  • Design and build the data structure in Snowflake
  • Design, build, and maintain data pipelines and ETL/ELT processes using SQL, Python, or other relevant tools
  • Optimize data for scalability, performance, quality, and security while balancing compute and storage costs
  • Document and maintain data definitions, metadata, and lineage
  • Collaborate with analysts and business stakeholders to understand business and data requirements 
  • Combine data from various sources to provide tables/views to be used by data analysts
  • Rebuild existing Domo data transformations in Snowflake

Requirements

  • SQL Server expertise is needed.
  • LiquiBase
  • Python advanced skills (Scripting, Pandas, PySpark, HttpRequest)
  • Softskill needed to gather requirements from the stakeholders.
  • DBT Modeling.
  • GCP expertise is a must.
  • GCP Cloud SQL (Sql Server)
  • GCP BigQuery knowledge.
  • GCP DataProc
  • Docker / Kubernetes 
  • Orchestration knowledge is needed (GCP CloudComposer nice to have / Apache Airflow)
  • Expected experience on Datafusion, Salesforce, Gainsight, Marketo, Hubspot or Sora
  • Marketing and sales reporting skills knowledge
  • Git knowledge (Gitlab preferred)
  • CI/CD knowledge is needed (GitlabCI preferred).
  • Quality Assurance on data.

Nice to Have

  • Linear or regression models.
  • Business intelligence tools knowledge (PowerBI).

Why You'll Like Working Here

  • The ability to work on and partner with multi-national teams that are committed to our BEST core values: Best People, Best Expertise, Best Service, Best Teamwork
  • A generous, competitive compensation package for exceptional performers, as well as a generous vacation package and competitive benefits plan
  • Remote working environment
  • Professional and personal development