Python / Airflow / Meltano / DBA / Cloud / ETL & BI
( AWS / Google / Azure ) Cloud Architect
Converting Data into Information with Prooven Experience best Strategies
Responsible for all DataOps (Data Operations, Data Product Development, Data Product Deliveries)
Responsible for Cloud Infrastructure (AWS Compute, Storage and Serverless Functions e.g. EMR Jobs, Athena, QuickSight etc. and Database in terms of RDS)
Responsible for Research and Apply latest concept and technology uses and best approach
Requirement Gathering and its Ingestion or Digestion or Delivery from both client and internally.
Project Management (Define Projects in JIRA for colleagues and communication in semi scrum or semi agile fashion)
Tier 2 Support for Data related inquires by Clients and Mentor other folks
ETL / ELT Workflows Design and Development
MultiCloud Data Integrations
Develop End to End Data Provision solutions inclusive of Extraction, Transformation shaping requirements into information
FTP based Provision automated solutions
Elastic Search API Based Data Provision
Airflow DAG development
Complex Processes Automation Using Python
Infrastructure (AWS / Google) Optimization and Administration.
Databases Optimize and Administration both on Premises and on Cloud (RDS)
Application Feature backend development in Python
Python, Shell, advance SQL, EMR, Athena, QuickSight
Docker, Airflow, Jenkins, Meltano, MySql Aurora, RedShift, KNIME, SQL Yog, DBeaver, SQL Bench, Workbench, PyCharm, GIT, Bitbucket, JIRA
ETL / ELT Workflows Design and Development
MultiCloud Data Integrations
Responsible for Client and internal Data Deliveries and Architect Data
Develop End to End Data Provision solutions inclusive of Extraction, Transformation shaping requirements into information
FTP based Provision automated solutions
Elastic Search API Based Data Provision
Airflow DAG development
Complex Processes Automation Using Python
Infrastructure (AWS / Google) Optimization and Administration.
Databases Optimize and Administration both on Premises and on Cloud (RDS)
Application Feature backend development in Python
Python, Shell, advance SQL
Airflow, Jenkins, Meltano, KNIME, SQL Yog, DBeaver, SQL Bench, Workbench, PyCharm, GIT, Bitbucket, JIRA
Genie Technologies, Lahore (Pakistan) develop software for IDM Software [idmsoftware.com], London (UK).
Responsibilities as DBA (Oracle, Amazon AWS Postgress both SAS and PAS, MySQL, MSSQL).
Designing, installing and maintaining Oracle databases, setting up database replication (homogenous & heterogeneous) and configure database HA (dataguard,).
Work closely with development team to decide partitioning schema, parallel processing and code review.
Monitoring database for performance issues, perform database tuning and SQL tuning to improve database performance using Explain Plan.
Tuning for Performance enhancements, Schema Maintenance: Design, Create, Alter database objects, Review Invalid or Stale Objects, Index recommendations, Vacuuming etc.
Hardware Benchmarking (Physical IO test, sustainable throughput test)
Installing, configuring and setup Report Server / Services in MSSQL Server 2008/2008R2/2012.
Performance Tuning, Query Optimization, Client/Server Connectivity and Database Consistency Checks.
Hands-on working experience with analyzing query plans, managing indexes and locks, troubleshooting query.
Faster ETLs (parallel processing) to make data availability quick
Fully automated processes from data extraction by API to alerts delivery (html emails) to client
ETL Design, Mappings, Integration with BI, ETL Scheduling
Write complex SQL queries to generate a variety of views of underlying operational and analytical data sets
Database Development, Database Advanced Security, Data Redaction and Transparent Data Encryption Policies,
Logical Design (ERD) & Physical design and creation of physical database, data & user security, enforcement of standards, 24x7 production support
Perform exports, backups and data extracts
Advanced level of skill with Microsoft Excel, i.e. pivot tables etc for reporting and dashboards.
Automate procedures to confirm the correct report file should be deliver e.g. File should not be empty.