All jobs
PetroAppData
Senior Data Engineer
RemotePosted today
The role involves designing, maintaining, and optimizing data pipelines, models, and governance for a data platform supporting various business functions. It requires collaboration across teams to enable analytics, ensure data quality, and support infrastructure and security.
Location: Remote
Responsibilities
- Design and maintain scalable batch and near-real-time data pipelines across mobile applications, NFC/fuel transactions, station integrations, ERP integrations, payments, support systems, and operational databases.
- Create clean, reusable data models for core entities such as customers, vehicles, drivers, stations, transactions, wallets, limits, invoices, products, maintenance services, and geographic coverage.
- Implement data validation, lineage, observability, alerting, reconciliation, and automated quality checks to ensure business-critical dashboards and reports are accurate and timely.
- Partner with analytics, product, finance, operations, and customer success teams to deliver self-service datasets, metrics layers, and well-documented data marts.
- Tune queries, storage layouts, orchestration schedules, and cloud resources to improve platform performance and manage infrastructure cost.
- Apply data access controls, PII handling, retention practices, auditability, and compliance-aware engineering patterns across the data lifecycle.
- Build robust ingestion patterns for APIs, webhooks, CDC, files, event streams, third-party integrations, and partner station data feeds.
- Use CI/CD, version control, automated testing, infrastructure-as-code, and deployment standards for data pipelines and transformations.
- Troubleshoot data incidents, conduct root-cause analysis, reduce recurring failures, and communicate impact clearly to stakeholders.
- Review designs and code, establish engineering standards, mentor junior team members, and raise the quality bar for data engineering.
Requirements
- 5+ years of professional experience in data engineering, analytics engineering, platform engineering, or backend engineering with strong data ownership.
- Advanced SQL skills, including query optimization, data modeling, window functions, incremental transformations, and large-table performance tuning.
- Strong Python programming experience for data pipelines, automation, testing, and production-grade data workflows.
- Hands-on experience with workflow orchestration such as Airflow, Dagster, Prefect, or similar tools.
- Experience with modern data warehouses or lakehouse platforms such as BigQuery, Snowflake, Redshift, Databricks, Delta Lake, Iceberg, or equivalent.
- Experience building reliable ELT/ETL pipelines using tools such as dbt, Spark, Kafka, Flink, Fivetran, Stitch, custom API ingestion, or CDC frameworks.
- Practical understanding of data quality, schema evolution, monitoring, alerting, backfills, idempotency, and failure recovery.
- Experience designing dimensional, wide-table, and event-based data models for BI, analytics, and operational reporting.
- Comfort working with cloud platforms such as AWS, GCP, or Azure, plus Git-based engineering workflows.
- Strong communication skills with the ability to translate business requirements into clear technical designs and delivery plans.
Benefits
- Competitive salary and benefits package.
- Opportunity to work on cutting-edge technology with a passionate team.
- Career growth and development opportunities.
- A collaborative and inclusive work environment.