یہ کمپنی اب اس نوکری کیلیۓ مزید سی ویزنہیں لے رہی۔

Data Engineer

CredibleX

جنوری ۱۹, ۲۰۲۴ شائع ہوئی 317 نے دیکھا

PKR. 35,000 - 45,000/Month

Who we are

CredibleX is a new Fintech player specializing in Embedded Finance, targeting partners who serve the SME banking and lending segment within the UAE. We tackle the difficulty most local SMEs face when seeking credit by removing the barriers that traditional lenders have in place. We want to make accessing credit simple, transparent, digital, and friction-free for those who need it most, local SMEs. CredibleX is also backed by a newly launched investment fund from the region, ensuring an unfair advantage from day one.

We are looking for a rockstar Data Engineer to join us and help our team transform the SME industry in the region.

Responsibilities

Practice agile and continuous delivery by ensuring value is being continuously delivered to internal stakeholders in small batches.
Take ownership of the services you build by ensuring they’re robust, tested, maintainable and operating as expected.
Develop high quality, maintainable data pipelines using Python.
Implement data pipeline orchestration and scheduled jobs with a tool such as Dagster.
Ingest data from 3rd parties using a tool such as Meltano.
Ingest data from relational databases and topics via replication, streaming and change data capture.
Establish a Data Lake in AWS S3 using Parquet files providing interactive querying via Athena.
Establish a Data Lakehouse using an open table format such as Apache Iceberg.
Create dashboards and MI reports using a BI tool such as Power BI.

About You

Software development is a passion, not just a day job.
You deliver value to customers, not just write code.
4+ years of software development experience focusing on data engineering with Python.
Data science and machine learning experience is a plus.
Expertise working with relational databases, bonus points for PostgreSQL.
You’ve worked with complex DAGs using an orchestrator such as Apache Airflow, Prefect or Dagster.
You’ve developed complex data transformations using a tool like dbt.
You’re aware of open table formats and want to be on the forefront of this technology.
You’re a strong communicator and can work directly with internal stakeholders to develop dashboards and reports.
You have experience working with both batch and streaming.
You’ve ingested data from 3rd party systems, ideally with specialized tools such as Airbyte, Fivetran or Meltano.
You have experience with data schemas and formats such as JSON schema, Avro, Protobuf and Parquet.
You’re familiar with CI/CD best practices and take ownership of what you build end-to-end.
Strong problem-solving skills and ability to troubleshoot and trace complex issues in large-scale production environments.
Professional proficiency in written and spoken English.