Accountabilities:
- Design, build, and maintain scalable distributed data processing systems using modern big data technologies.
- Develop robust ETL/ELT pipelines and real-time streaming architectures to support large-scale analytics and operational needs.
- Architect and optimize data lakes, data warehouses, and streaming platforms for performance, scalability, and reliability.
- Implement secure and fault-tolerant data infrastructure across cloud-based environments.
- Improve data quality, governance, lineage, and platform reliability to ensure trusted and accessible data across teams.
- Collaborate cross-functionally with engineers, analysts, and data scientists to deliver impactful data solutions aligned with business objectives.
- Drive infrastructure modernization initiatives, evaluate emerging technologies, and contribute to continuous platform improvement.
- Mentor junior engineers, promote best practices, and contribute to a culture of collaboration and technical excellence.
- Optimize system and pipeline performance through efficient partitioning, indexing, caching, and query optimization strategies.
- Support CI/CD workflows, automation, and deployment processes to ensure efficient and reliable delivery cycles.
Requirements:
- Strong experience designing and managing distributed data systems and large-scale data architectures.
- Advanced knowledge of technologies such as Apache Spark, Hadoop, Flink, Kafka, and cloud-based data platforms.
- Proven expertise in building scalable ETL/ELT pipelines and streaming data solutions.
- Strong programming skills in Python and SQL; additional experience with Java or Scala is considered a plus.
- Experience with containerization and orchestration technologies such as Docker and Kubernetes.
- Solid understanding of data governance, security, reliability, and infrastructure best practices.
- Familiarity with cloud ecosystems and tools such as AWS, Confluent, Airflow, dbt, GitHub Actions, and CI/CD workflows.
- Excellent analytical and problem-solving skills with the ability to independently manage projects from concept to production.
- Strong communication and collaboration abilities within remote and globally distributed teams.
- Experience mentoring team members and contributing to technical leadership initiatives is highly valued.
- Hospitality industry knowledge or experience working with commercial platform ecosystems is considered an advantage.
Benefits:
- Fully remote-first working environment with global collaboration opportunities.
- Competitive compensation package aligned with experience and market standards.
- Paid time off in accordance with local labor regulations.
- Monthly Wellness Fridays offering extended weekends each month.
- Fully paid parental leave.
- Home office stipend based on country of residence.
- Access to professional development programs, technical training, and continuous learning opportunities.
- Manager coaching, upskilling initiatives, and internal knowledge-sharing programs.
- Inclusive and diverse workplace culture focused on collaboration and innovation.
- Opportunities to work on large-scale AI-driven and cloud-based technologies impacting a global industry.
🇧🇷 Essa vaga exige inglês. Você está pronto?
A DevSpeak Academy prepara desenvolvedores brasileiros para conquistar vagas internacionais. Domine o inglês técnico com professores que entendem o mundo dev.
Conheça a DevSpeak Academy