Senior Data Engineer (PowerBI & Data Integration)

Key Responsibilities

• Collaboration with U.S-based client stakeholders on solution design/definition. Identify solutions that solve business problems, translating requirements into technical specifications and actionable work.
• Writing code and implementing the proposed solutions.
• Creating data pipelines, versioning and change management.
• Manage the complexity inherent in versioned data pipelines.
• Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
• Design, build and maintain batch or real-time data pipelines in production.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Logging and instrumentation of pipelines and services.
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.

Minimum Qualifications

• Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role.
• Advanced SQL skills and experience with relational databases and database design.
• Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
• Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries.
• Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc.
• Proficient in data pipeline and workflow management tools e.g. Airflow.
• Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc.
• Experience with the AWS/Azure/GCP data engineering services.
• Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM.
• OR Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB.
• Very good exposure of working on Data Lakes & Data Warehouses solutions.
• Excellent problem-solving, communication, and organizational skills.
• Proven ability to work independently and with a team.
• Ability to guide other data engineers.
• High level of English proficiency required to interact directly with U.S-based client.

Additional Experience Desired

• Java and key Java-based frameworks (Spring, Springboot, Hibernate, Apache, etc).
• Good understanding of NoSQL databases like Redis.

Client-Prioritized Values

• Multi-dimensional contributor.
• Comfortable wearing multiple hats.
• Excels at multitasking.
• Operates with a sense of urgency.
• Hands-on, tactical contributor.
• Effectively pass along relevant context to the broader team.
• Takes consultative approach.
• Ability to formulate solutions from abstract requirements.
• Balancing between what needs to be done and what should be done.
• Forward-thinking approach, getting ahead of functionality that serves the business.
• Takes ownership of the work item, drives progress forward, understands all the moving parts, pieces & impacts (from business side, product side, and implementation).
• Quick ramp, hands-on.
• Quick digestion of product architecture/design & goals.
• Technical curiosity and eagerness to understand the business and underlying drivers.

Benefits

• Medical Insurance benefits as per company policy.
• Life Insurance as per company policy.
• 15 days of paid vacation plus additional days based on tenure.
• Vacation bonus as per local law.
• Sick leave and paid holidays as per local law.
• Profit sharing as per local law.
• Paternity and maternity leave as per local law.
• Marriage, bereavement and graduation leaves as per company policy.
• Christmas bonuses as per local law.
• Work from home allowance as per company policy.
• Punctuality and attendance bonuses as per company policy.
• Food tickets as per company policy.
• Direct deposit of payroll.
• Paid professional certifications.