Lead data engineer

  • Full Time
  • Bengaluru
  • Posted 1 week ago
  • 88 Views

Koch Industries

Your Job

The lead data engineer will be a part of a global team that architects, designs, develops, and delivers data pipeline solutions leveraging the latest technology stacks of data engineering technologies for Koch Industries. Koch Industries is a privately held global organization with over 120,000 employees around the world, with subsidiaries involved in manufacturing, trading, and investments. Koch global services India (KGSI) is being developed in India to extend its IT operations, as well as act as a hub for innovation in the IT function. as well as improving existing solutions for Georgia Pacific. This position will be responsible for creating and enhancing data pipelines for procurement data delivery team. This position will also be responsible for providing support for mission critical data applications and bug fixes.

Our Team

We are seeking a Lead Data Engineer who will be responsible to take a lead in architecture, developing and implementing a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams. This will be a hands-on role to build ingestion pipelines and the Datawarehouse.

What You Will Do

Ability to scale up, lead, propose better architecture, present solutions and take care of delivery.
Hands-on experience with AWS technologies and at least one full life cycle project experience using various cloud technologies (Redshift, Lambda, Step functions, RDS, event bridge)
Hands-on expertise with writing, modifying, tuning SQL queries and stored procedures.
Well architect the solution to optimize, scale and perform performance tuning on DW on AWS Redshift and the data lake on AWS S3
Analyze, design, development, testing, and support of Talend DI/ Big Data solution.
Expert in backtracking, troubleshooting failures and provide fix for production issues.
On demand support data feeds from various ERP source systems into Data warehouse
Proactively identify gaps and propose better/best possible solutions to the existing system.
Ability to independently work on full life cycle projects.
Expert analysis of large complex data sets to resolve data quality issues and propose permanent fix.
Translate the functional requirements into technical specification and assist team.
Lead the design and development of data pipeline along with ensuring delivery.
Be able to adopt to technical stack used by Procurement Data Lake and Data Warehouse
Position’s day to day responsibility will be directed by the technical lead who is part of the KGSI / GP. All team members are required to be on a daily status call with GP Technical Lead.
Who You Are (Basic Qualifications)

•        Bachelor’s/master’s degree in computer science/information technology with 5 to 8 years of overall IT experience.

•        6+ years of data engineering experience, Data Modelling, Data Lake, Data Warehouse, Data Quality and Data Engineering Projects.

•        Focus on value creation through transformation and process improvement initiatives.

•        Strong customer focus, communication, collaboration, and problem-solving skills

•        Strong people management skills, willing to spend time to coach and train.

•        Strategic Leadership, Technology Transformations

•        Challenging the status quo and focusing on long-term value when designing solutions

•        Excellent communication, facilitation, negotiation, and coaching skills.

•        Experience working in a multi-cultural environment with a diverse workforce.

What Will Put You Ahead

•        Take a lead in the data delivery and guide the team of data engineer.

•        AWS Certification (Dev, Solutions Architect, DevOps, or Big Data)

•        Experience with AWS native tools – Python, Spark, Lambda, Glue for data pipelines.

•        Strong English language communications.

•        Ability to pull together complex and disparate data sources, warehouse those data sources and architect a foundation to produce BI and analytical content, while operating in a fluid, rapidly changing data environment

•        2+ years of Procure to Pay Domain knowledge.

Who We Are

As a Koch company, Koch Global Services (KGS) creates solutions spanning technology, human resources, finance, project management and anything else our businesses need. With locations in India, Mexico, Poland and the United States, our employees have the opportunity to make a global impact.

Job Overview
Job Location