Senior Data Engineer Python

Key Responsibilities:

• Understanding the business requirements
• Writing code and implementing the proposed solutions
• Creating data pipelines, versioning and change management
• Manage the complexity inherent in versioned data pipelines
• Building and maintaining ETL processes
• Logging and instrumentation of pipelines and services
• Ensuring data quality
• Strong debugging skills to analyze and fix a defect in the data processing
• Should be a good team player and a great collaborator

Minimum Qualifications:

• Demonstrated expertise with a minimum of 3+ years of experience as data engineer or similar role
• Advanced SQL skills and experience with relational databases
• Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
• Strong exposure to write ETL / pipeline code
• Experience in Data collection from multiple sources and integrating based on business needs
• Experience in working with Google Cloud Platform and Amazon Web Services
• GCP: Cloud Functions, Cloud Storage, Dataform, etc.
• AWS: ECS, Lambda, EC2, S3, etc.
• GitHub Actions for CI/CD, workflows
• Terraform
• Proficiency in the English language.

Additional Experience Desired:

• Exposure to AI / ML
• Exposure to Looker Studio, Tableau, PowerBI;
• Experience in working with:
  • Looker Enterprise
  • Google Analytics
  • Google Tag Manager
  • Firebase
  • Salesforce
  • Hightouch
  • Datadog