Senior Data Engineer [Web API & AI Integration] – LATAM
About Distillery
Distillery accelerates innovation through an unyielding approach to nearshore software development. The world’s most innovative technology teams choose distillery to help accelerate strategic innovation, fill a pressing technology gap, and hit mission-critical deadlines. We support essential applications, mobile apps, websites, and eCommerce platforms through the placement of senior, strategic technical leaders and by deploying fully managed technology teams that work intimately alongside our client’s in-house development teams. At Distillery, we’re not here to reinvent nearshore software development, we’re on a mission to perfect it.
Distillery Tech is committed to diversity and inclusion. We actively seek to cultivate a workforce that reflects the rich tapestry of perspectives, backgrounds, and experiences present in our society. In our recruitment efforts, we are dedicated to promoting equal opportunities for all candidates, regardless of race, ethnicity, gender, sexual orientation, disability, age, or any other dimension of diversity.
About the Position
As a Data Engineer with Web API expertise, you will play a key role in modernizing the distribution model by implementing cutting-edge AI-driven solutions to enhance efficiency, accuracy, and sales performance. You will be responsible for building, maintaining, and optimizing data pipelines, ensuring data quality, and integrating web APIs using Python frameworks. Working alongside cross-functional teams, you will transform manual processes into streamlined, technology-driven workflows, contributing to increased market share and stronger distributor relationships. Your work will involve managing complex datasets, ensuring compliance with data privacy regulations, and driving innovation in the distribution sector.
Responsibilities
-
Design, develop, and maintain data pipelines and orchestration processes.
-
Implement and optimize ETL/ELT processes, ensuring efficient data flow.
-
Build and maintain data warehouses, data lakes, and data marts.
-
Ensure data quality through cleansing, validation, and profiling techniques.
-
Develop and integrate Python Web APIs using Flask or FastAPI.
-
Collaborate with stakeholders to align data solutions with business metrics like sales and customer satisfaction.
-
Ensure compliance with data privacy regulations (GDPR, CCPA) and implement data security best practices.
-
Work closely with distribution data sources such as POS, inventory management systems, and weather data.
-
Troubleshoot and resolve data issues, ensuring accurate and consistent data delivery.
-
Keep up to date with emerging trends and technologies in data engineering and AI-driven solutions.
Requirements
-
Bachelor’s or Master’s degree in Computer Science, Data Science, or related fields.
-
Strong experience in data engineering, data warehousing, data modeling, and ETL processes.
-
Expertise in Python Web API frameworks like Flask or FastAPI.
-
Proficient in database management systems and SQL.
-
Hands-on experience with tools like Apache Airflow, Apache Spark, or AWS Glue.
-
Experience with cloud platforms such as AWS (Redshift, DynamoDB, S3, Glue, EMR, Kinesis, Athena, Timestream).
-
Knowledge of distribution and supply chain data, including CRM, POS systems, and weather data.
-
Understanding of data privacy regulations (GDPR, CCPA) and data security best practices.
-
Experience in ensuring data accuracy and reliability for business-critical metrics.
Nice to Have
-
Knowledge of AI applications in distribution and supply chain management.
-
Experience with additional cloud platforms or technologies relevant to large-scale data engineering.
Why You’ll Like Working Here
-
The ability to work on and partner with multi-national teams that are committed to our core values: Unyielding Commitment, Relentless Pursuit, Courageous Ambition, and Authentic Connection.
-
A generous, competitive compensation package for exceptional performers, as well as a generous vacation package and competitive benefits plan
-
Remote working environment
-
Professional and personal development