Data Engineer

Company Description

Who we are?
Become a Zider member and join this amazing company that is on top of the
e-commerce game! Join a company that is not only growing but having fun while
doing it. We are a human centric organization with huge growth plans and with
a purpose to help more and more people with little or no digital experience to
start their online business (e-commerce), move their offline to online or grow
their offline businesses even more by having an online presence.
Where are we coming from and where are we going?
Zid has had a tremendous grow over the last ‎5 years. From ‎5 people to ‎300+
people at present and counting. Our revenues have been increasing more than ‎3
times year on year and we have had a great success. We are an e-commerce SaSS
platform, a fintech startup, a logistics and shipping consolidator and we
understand and believe that technology and business go hand-in-hand.

Job Description
* Architecture and implement optimal data pipelines.
* Redesign and improve current processes to eliminate manual processes and ensure timely delivery of data.
* Prepare scalability plans for smoother expansion when needed.
* Build data models that ensure wholesome view of the company's needed analytics.
* Work with Data Analysts to prepare Ad-Hoc or permanent batch/real-time data pipelines to enable further analysis or machine learning requirements.
* Perform basic Database Administration Tasks (e.g. Data Masking, Access management)
* Work with different business stakeholders and technical teams to gather requirements.
* Implement quality checks and monitoring schemes to ensure data quality and successful completion of data pipelines.

Qualifications
* ‎5+ years or more of experience working as a Business Intelligence / Data Engineering role.
* Strong problem solving and root cause analysis skills.
* Advanced knowledge of variety Relational Database Engines of a large scale.
* Ability to write advanced SQL queries.
* Enterprise-level knowledge of designing and implementing data pipelines.
* Ability to work with scripting languages such as Python for data manipulation and data pipelines orchestration.
* Ability to build complex data models for Reporting or Functional purposes.
* Solve performance issues in terms of data injection or data retrieval.
* Candidate should have experience and familiarity working with the following tools:
* Relational Database Management Systems, such as: Postgres, MySQL, SQL Server.
* Real-time OLAP data stores, such as: ClickHouse
* Distributed query engines, such as: Presto
* Stream processing tools, such as: Apache Kafka, Apache Spark, Apache Druid.
* NoSQL databases.
* Dataflow management tools, such as: Nifi, Prefect, Airbyte, Fivetran, Alteryx, Apache Airflow, Stitch.
* Reverse ETL tools, such as: Census.
* API integration with external sources.
* AWS cloud services, such as: S3, RedShift, DMS, RDS, CloudWatch, EMR, Athena.
* Object-oriented/Object Function programming in: Python, Java, Scala, etc.
* Data transformation tools, such as: dbt
* Data Visualization tools, such as: Tableau, Metabase, Apache Superset.

Additional Information

What are we offering?
* Competitive Salary
* Holidays of ‎21 days + additional days given regularly
* Training (we kicked the learning internally and recently completed an AWS Architecting course)
* Career path clearly defined!
* ZEA - Zid Entertainment - Fun Thursdays!