Data Engineer, Azure - Remote, Latin America

Bluelight is a leading software consultancy focused on designing and developing innovative technology, with a commitment to quality, customer satisfaction, and fostering a collaborative work environment. They are expanding across the US and Central/South America and are seeking talented professionals to join their diverse team.

Location: Remote (US)

Responsibilities

• Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks and Pipelines.
• Design and build data storage structures in a Massively Parallel Processing (MPP) SQL Pool.
• Extract data from REST APIs, SQL database tables, and CSV files.
• Design and optimize data notebooks/pipelines in Azure Synapse Analytics for scalability and performance.
• Implement and understand Data Fabric concepts such as data lakes, lakehouses, delta lakes, and data cataloging.
• Create data models and schemas in collaboration with data architects.
• Implement data quality checks and validation processes.
• Identify and resolve performance bottlenecks, optimize ETL pipelines.
• Monitor ETL jobs, diagnose issues, and ensure data pipeline reliability.
• Maintain documentation of data engineering processes, data flows, and transformations.
• Collaborate with cross-functional teams to understand data requirements.
• Ensure data security and compliance with governance and privacy standards.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or related field, or equivalent work experience. Certifications like Azure Data Engineer are a plus.
• Proven experience in ETL data engineering using Python (PySpark) for data extraction, transformation, and loading from REST APIs, SQL databases, and CSV files.
• Proficiency in Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Ability to write complex SQL queries, optimize query performance, and work with SparkSQL and MS SQL.
• Knowledge of data integration best practices and tools.
• Experience with version control systems such as Git (Azure DevOps).
• Strong problem-solving and analytical skills, with attention to detail.
• Excellent verbal and written communication skills, and ability to work collaboratively.
• Familiarity with big data technologies, machine learning, and data analysis (preferred).
• Experience with data visualization tools like Power BI or Tableau and Agile methodologies (a plus).

Benefits

• Competitive salary and bonuses, including performance-based increases.
• Generous paid-time-off policy.
• Flexible working hours.
• Remote work opportunity.
• Continuing education, training, conferences.
• Company-sponsored coursework, exams, and certifications.