Your challenges?
- Gather and address technical and design requirements.
- Architect our data platform & develop real-time apps ingesting large volumes of data and processing messages real-time.
- Handle all our data pipeline and contribute towards our data strategy and its execution.
- Architecting, building, testing & managing our data platform infrastructure from data collection all the way to data processing & data storage.
- Develop, customize and manage integration tools, monitoring tools, databases, warehouses, and analytical systems.
- Support the developers through training and transfer of knowledge.
- Participate in the entire application life-cycle mainly focusing on coding, debugging, and testing.
What do we expect from you?
- BSc degree in Computer Science/Computer Engineering. Masters is a plus.
- Strong competencies in algorithms and software architecture.
- 3+ years of experience in Python.
- 2+ years of experience as a Data Engineer.
- Strong experience in real-time data processing and data ingestion.
- Strong experience in batch data processing and data pipelines.
- 3+ years of experience in developing APIs (REST & SOAP protocols).
- 2+ years of experience in using AWS/Azure/Google cloud and its resources/services.
- Strong experience in Relational Databases (MySQL, SQL Server or PostgreSQL) and non-relational databases (MongoDB or Cassandra. etc.)
- Strong knowledge in Continuous Integration & Continuous Deployment (CI/CD) utilizing Docker containers.
- Strong knowledge in Pandas & NumPy libraries is a big plus.
- Strong knowledge in workflow orchestration tools (Airflow …etc.) is a plus.
- Experience in Java is a plus.
- Previous experience in automated testing including unit testing & UI testing is a plus.
- Strong in-depth understanding of the entire web development process (design, development, and deployment) Excellent analytical, time management and teamwork skills.