Data Engineer

؜ - ؜القاهرة ؜ -
موقع المُعلن

تفاصيل الوظيفة

Job Description



  • Develop and maintain data pipelines implementing ETL processes.

  • Take responsibility for data warehouses and data lakes (i.e. Hadoop, Elastic Stack and Spark) development and implementation.

  • Work closely with a data scientists implementing data analytic pipelines.

  • Help define data governance policies and support data versioning processes.

  • Maintain security and data privacy working closely with Data Protection Officer internally.

  • Analyze a vast number of data stores and uncover insights.

  • Prepare / Review low-level design.

  • Prepare unit test cases and writing unit test code.

  • Write automated build and execution scripts for data software artifacts.

  • Fix data services bugs reported by internal and external testing teams.

  • Accountable for providing high quality data services.


Personal Skills



  • Excellent communication skills

  • Flexibility to work under pressure and in different environments.

  • Problems solving skills.


Technical Skills



  • Proven experience in Python, Spark, HBase, Hive and Elastic search.

  • Proven experience developing and building Spark Jobs.

  • Proven experience on one or more ETL data integration platforms (i.e. Informatica, Talend, ODI, SAS … etc.).

  • Good understanding of map-reduce concepts.

  • Proven Understanding of data warehousing and data modeling techniques.

  • Knowledge of industry-wide analytical and visualization tools (Tableau, Kibana, and R).

  • Knowledge of core Java, Linux, SQL, and any scripting language.

  • Good knowledge of container management (i.e. Docker and OpenShift) is preferred.

  • SQL

  • Linux shell commands

  • Virtual machines

  • Containers

  • Python

  • R

  • Hadoop

  • Data Modeling

  • ETL

  • Data Analytics


Education


MS / BS degree in Computer Science, Computer Engineering


Job Details


Job Location
Cairo, Egypt
Company Industry
System Integrator
Company Type
Employer (Private Sector)
Job Role
Engineering
Job Division
COO Office
SW Engineering


Preferred Candidate


Career Level
Mid Career
Years of Experience
Min: ‎2 Max: ‎6
Degree
Bachelor's degree

بلغ عن إساءة

ملخص الوظيفة

  • المُعلن : Giza Systems EG
  • تاريخ الإعلان : 02/08/2022
  • نوع العمل : -
  • مستوى الخبرة : -
  • المستوى التعليمي : -
  • مكان العمل : القاهرة
  • الراتب : -
  • الهاتف : -

وظائف أخرى مثل هذه الوظيفة

Data Engineer
القاهرة
03/05/2023

## **Role purpose:** The Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain. ## **Key accountabilities and decision ownership:** …

Data Engineer
القاهرة
11/01/2023

#### **Job Description** * Develop and maintain data pipelines performing ETL processes. * Work closely with data scientists and software developers to implement pipelines performing advanced * analytics including machine learning models. * Selecting features, building and optimizing pipeli…

Data Engineer
القاهرة
31/07/2023

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we sup…

Data Engineer-Data Integration
القاهرة
13/04/2023

**Introduction** At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lea…

Data Engineer-Data Integration
القاهرة
11/03/2023

**Introduction** In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based …

Data Engineer-Data Integration
القاهرة
19/12/2022

**Introduction** At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lea…

Data Engineer-Data Integration
القاهرة
17/02/2023

**Introduction** In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based …

Senior Data Engineer-Data Integration
القاهرة
29/08/2022

**Introduction** At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lea…

Data Engineer-Data Integration Internship
القاهرة
05/12/2022

**Introduction** At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lea…

Big Data Engineer
القاهرة
28/05/2022

Our Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work …

Language: English