Highly motivated, dedicated and Energetic Business Intelligence and Data Integration developer having excellent communication and decision making skills along with strong analytical and problem identification/solving skills to undertake challenging jobs. Capable of handling multiple simultaneous tasks. Experience with Agile/Scrum methodology.
Extrovert, flexible and able to perform well independently and in team with a passion for innovation and learning technology.
· Diversified working experience in capacity of Development, ETL, Data Integration, Big Data Technologies and Amazon Web Services.
· Worked with both file based and database based repository.
· Experience of working with Apache NIFI to create different types of flows.
· Use the NiFi Expression Language to control data flows. Organize and simplify data flows.
· Connect data flows with other systems, such as HDFS, and HBase.
· Experience of working with various AWS Cloud Services (EC2, SNS, SQS, S3, Athena).
· Experience of loading data from Parquet files to AWS Redshift using Informatica Cloud.
· Experience in loading data from flat files (placed over Amazon S3) to Redshift DWH.
· Experience of Integration of APIs with DWH using PENTAHO DATA INTEGRATION.
· Expertise in report designing using PENTAHO RERPORT DESIGNER.
· Developed Data Pipelines, dashboards and jobs with PDI and PENTAHO BI which run on KUBERNETES K8S clusters.
· Experience of working PYTHON for data analysis using Pandas, Numpy.
· Strong proficiency in business solution development with outstanding capabilities in analysis, problem definition and requirements gathering.
· Experience with a version control system (Bit Bucket, Git).
· Experience with an issue/problem tracking system (Jira).
· Experience working in an Agile environment.
· Knowledge of Big Data, Hadoop, HDFS, Map Reduce, Spark, Apache Kafka.
· Familiarity with Tableau, Power BI.
Goal oriented person with A “work hard, play hard” approach
Data Engineer
Responsibilities includes :
• Communicate with clients and deliver them satisfactory results
• Advise more efficient architecture
• Analyze the source data coming from various heterogeneous data sources to be consumed in the ETL procedures to load data into data warehouse Targets using Pentaho.
• Made use of different transformations in PDI designer to cleanse and manipulate source data e.g. Database Lookup & Join, Generate rows, Calculator, Row normalizer & denormalizers, Java Script, Add constant, Add Sequence etc.
• Used different types of input and output steps for various data sources including Tables, Access, Text File, Excel and CSV files.
• Develop, test and deploy various ETL jobs
• Participate in data conversion and data migration efforts
• Monitor long running ETL jobs
• Troubleshoot and resolve issues in ETL jobs
• Design reporting systems solutions
• Contribute independently while functioning as a member of a high performing team
• Fine-tuning of reports created with Report Designer.
• Manages the ETL process, including data quality and testing.
• Design and enhance ETL programs and processes using Pentaho.
• Implementing data transformation rules and data validations into the data warehouses.
• Uploading and extracting data from various API's.
• Involved in Performance Tuning on Transformation level to decrease the job execution time
• Migrating data between applications or databases.
• Exporting data from databases to flat files.
• Developed Reporting software using Crystal Reports in Visual Studio for Pakistan Radio.
• Developed Financial reporting in Smart Stock Movement using C#,Crystal Reports in Visual Studio, SQL Server for a medium size company.
• Developed Time Management System (with Face recognition) using C#, WPF for automobile company.
• Integrated Finger Authentication System with Koha Library Solution using C#, PERL CGI, MySQL and Ubuntu as operating system for a University.
• Developed Bio-metric Attendance System in C# and MSSQL for a University.
• Integrated Finger Authentication System (FAS) with MLIMS Library Solution in C# and MSSQL for a public University.
• Developed VMS (Visitor Management System) using C#, Visual Studio and MS SQL for University.
• Developed Accounts Management System including finance reports for Accountancy firm.
• Developed Haram Cart Management app using Android Studio, Java, XML and SQLite for Arabic rent a cart firm in Saudi Arabia.