Data Engineer

We are looking for a Data Engineer with hands-on experience in designing, building, and maintaining scalable and robust ETL pipelines. This role requires a deep understanding of data modeling, ETL processes, and data integration, as well as a strong background in various database systems and big data technologies. 

As a Data Engineer, you’ll work closely with the founders, tech leads, data scientists, and backend engineers to develop a next-gen AI-powered SaaS solution to help companies optimize their supply chains, reduce wastage, and become more efficient, sustainable, and profitable.

If you enjoy working in a fast-paced dynamic environment, love working on new challenges, and care deeply about building innovative and beautiful products that users love, then we might be the right fit for you. 

As a part of this role, you’ll experience how companies are built from the ground up, and get to own and lead critical parts of the product roadmap and research innovations.

Responsibilities

• Build and maintain data pipelines for efficient data processing and ML modeling
• Monitor and troubleshoot data pipelines and systems to ensure reliability and performance
• Assemble large, complex data sets that meet functional/non-functional business requirements.
• Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability.
• Collaborate with stakeholders to understand business requirements and assist the team with data requirements

 Minimum Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 1+ years experience in Python and pandas/spark or other similar technologies
• Expertise in advanced SQL, ETL, Airflow, and big data technologies
• Experience in building and managing complex data pipelines involving multiple formats and sources of data and transforming it into desired outputs
• Strong problem-solving and analytical skills and attention to detail
• Excellent communication and teamwork abilities
• Ability to work in a fast-paced environment and manage multiple priorities.

Preferred Qualifications

• Experience in building integration with Third-party tools using their published APIs
• Experience in working with large datasets to manage computation time and memory for data pipelines is a big plus
• Strong knowledge of OOP and Data Structures & Algorithms

‍