AWS Data Engineer
Location: Remote (Mexico)
Salary: Up to $90,000 MXN gross per month
We are looking for an experienced AWS Data Engineer with strong expertise in Python, data pipelines, SQL, AWS services, and cloud data engineering solutions. The ideal candidate will have hands-on experience building scalable data pipelines, optimizing data processes, implementing automation, and working with cloud-based data platforms.
Requirements
- 10+ years of professional experience in Data Engineering.
- Strong communication skills and experience working directly with clients.
- Detail-oriented professional with the ability to work independently and as part of a team.
- 100% hands-on experience with the required technologies and tools.
Programming & Data Engineering Skills
- Advanced proficiency in Python, including:
- Code structures
- Modules and packages
- Classes, subclasses, and inheritance
- Multi-threading
- Functional programming
- Experience developing reusable Python packages for internal or public use.
- Ability to develop and automate ETL processes.
- Experience scheduling and managing workflows using tools such as Apache Airflow DAGs.
- Ability to monitor pipeline executions, troubleshoot failures, and reprocess error records.
- Experience orchestrating multiple data pipelines running sequentially or in parallel.
- Experience importing and exporting data in formats such as CSV, JSON, and XML from cloud storage solutions (preferably AWS S3).
- Experience using AI IDE tools.
SQL & Data Warehouse Skills
- Advanced SQL skills, including:
- Complex joins
- CTEs
- Subqueries
- Experience optimizing SQL queries for performance.
- Experience working with data warehouse technologies, preferably Snowflake.
Testing & Documentation
- Experience implementing Python unit, integration, and system testing.
- Experience implementing DBT tests for data validation and data quality checks.
- Ability to create technical documentation and maintain data quality standards.
Code Generation & Version Control
- Experience generating code using Python configurations and Jinja templates.
- Strong experience with GitHub.
- Experience implementing CI/CD processes from scratch.
AWS Experience
- Strong knowledge of AWS data services, including:
- Amazon S3 for data storage
- ECS
- IAM and security best practices
- Understanding of AWS cloud security practices, including:
- IAM roles and permissions
- Encryption standards
- Secure coding guidelines
- DBT profile access configurations
Nice to Have Skills
- Experience with AWS Lambda for serverless data processing.
- Experience using Apache Airflow on AWS to design, schedule, and monitor complex data workflows.
- Experience integrating Airflow with AWS services and DBT models, including:
- Triggering DBT models
- EMR processing
- Reading from S3 and writing to Redshift or Snowflake
- Experience integrating APIs with platforms such as:
- Salesforce
- SFTP
- SharePoint
- OneDrive
- Other enterprise applications
- Experience with DBT Core/Cloud:
- Creating complex DBT models
- Full refresh and incremental models
- Snapshots
- Documentation
- Creating and maintaining DBT macros using Jinja and Python
- Experience with monitoring and logging tools:
- AWS CloudWatch
- Datadog
- Pipeline monitoring and workflow failure alerts
If you are a highly skilled AWS Data Engineer looking for a challenging opportunity in a remote environment, we would like to hear from you.
Job Type: Full-time
Pay: $85,000.00 - $90,000.00 per month
Language:
Work Location: Remote
