Data Engineer & Data Architect – LATAM

LATAM


About Distillery

Distillery Tech Inc accelerates innovation through an unyielding approach to nearshore software development. The world’s most innovative technology teams choose Distillery to help accelerate strategic innovation, fill a pressing technology gap, and hit mission-critical deadlines. We support essential applications, mobile apps, websites, and eCommerce platforms by placing senior, strategic technical leaders and deploying fully managed technology teams that work intimately alongside our client’s in-house development teams. At Distillery Tech Inc, we’re not here to reinvent nearshore software development, we’re on a mission to perfect it. Distillery Tech Inc is committed to diversity and inclusion. We actively seek to cultivate a workforce that reflects the rich tapestry of perspectives, backgrounds, and experiences present in our society. Our recruitment efforts are dedicated to promoting equal opportunities for all candidates, regardless of race, ethnicity, gender, sexual orientation, disability, age, or any other dimension of diversity.


About the Position

We are seeking a highly skilled and detail-oriented Lead Data Engineer to support a strategic project focused on assortment lifecycle, competitive positioning, consumer behavior, and market trends within the retail sector. This role will be responsible for developing, optimizing, and maintaining scalable data pipelines that integrate multiple data sources—including web scraping, consumer surveys, social listening, and third-party market intelligence tools—to ensure seamless data ingestion, transformation, and availability for business analysis. The ideal candidate will work closely with data analysts and business teams to ensure reliable and efficient data access, enabling accurate business insights without compromising data integrity.


Responsibilities

  • Design, develop, and maintain scalable data pipelines for ingesting structured and unstructured data sources.
  • Automate data ingestion and transformation from web scraping, APIs, and third-party market intelligence tools (e.g., Numerator, Covariance).
  • Ensure data consistency, integrity, and availability across analytical systems.
  • Optimize data storage and retrieval performance for large-scale datasets.
  • Implement data validation and quality checks to maintain accuracy.
  • Work with cloud-based or distributed data environments to support storage and processing needs.
  • Maintain technical documentation for data architecture, workflows, and processes.
  • Collaborate with data analysts to ensure structured, ready-to-use datasets for business reporting.


Required Skills & Qualifications:

  • 7-10 years of experience in data engineering, with a focus on data ingestion, processing, and automation.
  • Strong proficiency in SQL for data extraction, transformation, and optimization.
  • Experience with cloud-based data storage and processing solutions (AWS, GCP, or Azure).
  • Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow, dbt, Prefect).
  • Proficiency in Python or Scala for scripting and automation.
  • Familiarity with APIs and web scraping for integrating external data sources.
  • Strong understanding of data quality management, validation, and monitoring.
  • Ability to work with large, diverse datasets from various sources while ensuring scalability and performance.


Nice-to-Have:

  • Experience with real-time or streaming data processing (Kafka, Kinesis, Pub/Sub).
  • Exposure to data governance and compliance best practices.
  • Understanding of CI/CD workflows for automating data engineering pipelines.


Why You’ll Like Working Here                   

  •  Opportunity to collaborate with multinational teams committed to Distillery's core values of Unyielding Commitment, Relentless Pursuit, Courageous Ambition, and Authentic Connection.
  • A generous, competitive compensation package for exceptional performers, as well as a generous vacation package and competitive benefits plan
  • Remote working environment
  • Professional and personal development