Software Engineer - Big Data

Engineering · Lahore, Punjab
Department Engineering
Employment Type Full-Time
Minimum Experience Mid-level

About Us

Bazaar is an online B2B marketplace startup that is working towards its mission of revolutionizing traditional retail in Pakistan. Through our mobile app and tech-enabled supply chain, retailers can access a large assortment of branded and unbranded products, and seamlessly procure goods for their store. 

Bazaar is working towards this mission by bringing together and cultivating talent both in Pakistan and the diaspora and building cutting-edge technology across the supply chain. With its passion to build a great institution, Bazaar has raised a total of $107.8 million since its inception in May 2020. 

If you find our mission inspiring and wish to get aboard the rocketship, get excited because we’re looking for talented, proactive go-getters to join our rockstar team of ex Careem, Daraz, McKinsey, Unilever, Swvl folks! 

Job Overview

As a Software Engineer in Big Data, you will be creating and managing robust data pipelines, both realtime and batch based. You will be working with most of the standard data engineering tools like Hadoop, Spark, Flink, AirFlow, Kafka etc. You will also be interacting with different kinds of databases and various sources of data. Other than these, managing and updating data warehouse and analytics tools, establishing logging and monitoring of pipelines, maintaining several ETL and ELT jobs will be among the responsibilities. You will also get to work with several microservices and other areas of tech like backend, frontend, devops, security or mobile development. You will also be needed to ensure proper ingestion of data from various sources and microservices.

Technical Skills Required

  • Properly unit Testing the code you write
  • Experience building and optimizing big data pipelines, architectures and data sets
  • Various kinds of databases like MySQL, PostgreSQL, MongoDB, 
  • Open source Big Data Stack including Hadoop, Hive, Kafka, Spark, Flink, Presto, HDFS etc
  • Experience with Big Data Stack on any cloud provider like AWS, Google Cloud, Azure
  • Experience with Data Warehousing and Business Intelligence tools
  • Experience with programming languages commonly used for Big Datalike Python, Java, Scala
  • Experience with ELK stack
  • Experience with monitoring and support tools like Prometheus, Grafana
  • Experience with pipelines and workflow automation tools like Azkaban, Luigi, AirFlow
  • Experience with Containers and Docker is a plus
  • Computer science fundamentals
  • Good Problem Solving

Skills Required

  • Expertise with DevOps would be beneficial
  • Self-starter, 100% ownership and unshakeable enthusiasm
  • Strong communication and interpersonal skills
  • Should possess strong willingness to get hands dirty (literally), get stuff done and strong work ethics
  • Has relentless focus, strong prioritization skills, and the ability to multitask while working in a highly charged environment

What We Offer

  • A culture that empowers you everyday to take charge and deliver outstanding results
  • A power-packed team that develops you to be the best version of yourself
  • An opportunity to explore new avenues, break down barriers and execute on own ideas with complete autonomy
  • A chance to get aboard the rocketship as revolutionize the Pakistani retail industry
  • Rewards based on merit and a flexible work environment with an unlimited leave policy
  • A healthy compensation, insurance, and stock options plan to take care of yourself and your families

Thank You

Your application was submitted successfully.

  • Location
    Lahore, Punjab
  • Department
  • Employment Type
  • Minimum Experience