$$$
{{ $t($store.state.user.experience_value_in_dollars) }}
Senior
{{ $t($store.state.user.experience_search_name) }}
0
jobs
Azure datafactory,data bricks,adls,poweshell,pyspark
Maha M
,
London, United Kingdom
Experience
Other titles
Skills
I'm offering
• Having around 7+ years of experience in a critical production, development and test environments • Having 2+ years of experience in Azure Cloud using Data warehouse tools like Azure Data Factory, Azure Databricks, Azure SQL DW, Azure Data Analytics, Azure Data lake Storage, Azure SQL Database, Azure Blob Storage, Azure Functions, Azure logic apps. • Having 5+ years of Experience in ETL Design, Development and implementation of Data Warehousing Systems using DataStage, SQL Server and Teradata. • Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW • Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale • Proficient in developing strategies for Extraction, Transformation and Loading (ETL) mechanism. • Leading application development projects, ideally in the Financial Services • Developing software experience using UNIX, Oracle, Autosys, Control-M • Expertise in UNIX shell scripts for the automation of processes and scheduling jobs • Experience in using software configuration management tools like Rational Clear case/Clear quest for version control. • Expert in unit testing, system integration testing, implementation and maintenance of databases jobs. • Experienced in integration of various data sources (DB2, PL/SQL, Oracle, Teradata, XML) into data staging area. • Expert in working with Data Stage Manager, Designer, Administrator, and Director. • Expert in working on various operating systems like UNIX AIX, Sun Solaris and Windows. • Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML. • Take responsibility for ensuring that risks and issues are identified and managed closely and drive all stakeholders to deliver on time and to the required quality standards • Strong experience with SQL - Oracle • Monitoring the Data stage job on daily basis by running the UNIX shell script and made a force start whenever job fails. • Developed complex jobs using various stages like Lookup, Join, Transformer, Dataset, Row Generator, Column Generator, Datasets, Sequential File, Aggregator and Modify Stages. • CI/CD pipeline configuration • Used DevOps tools for continuous integration and delivery • Agile development, SDLC, Scrum, Continuous Integration and Continuous Delivery.
Markets
United Kingdom
Language
English
Fluently
Ready for
Available
My experience
2017 - 2019
job
Manager
FIS (Fidelity).
Environment: Azure Data Factory, U-SQL, Azure Databricks, UNIX, Oracle, Datastage
Duration: Aug'17 to Jan'19
Responsibilities:
• Worked with Metadata Definitions, Import and Export of Datastage jobs using Data stage Manager.
• Monitoring the Datastage job on daily basis by running the UNIX shell script and made a force start whenever job fails.
• Extensively used slowly changing dimension Type 2 approach to maintain history in database.
• Created queries to compare data between two databases to make sure data is matched.
• Generated Surrogate ID's for the dimensions in the fact table for indexed and faster access of data
• Designing and developing the jobs using Datastage server environment.
• Involved in all the steps in the Agile starting from requirement gathering to moving jobs to production
• Peer Review the code before deploying into higher regions.
• Requirement gathering from the end users and preparation of the BRDs.
• Involved in design and development of the Azure system.
• Creation of Azure Data Factory Pipelines to move the data from source to Data Lake store.
• Supporting the business in order to ensure the SLA are met with the deliverables or resolving the incident
• Good experience in creating Azure Data Factory pipelines to extract data from heterogeneous sources and creating jobs in Azure Data Lake Analytics.
• Good experience in writing USQL programs to compute huge volumes of data in Azure Data Lake Store.
Project #3 LBG-Trade transformation
Duration: Aug'17 to Jan'19
Responsibilities:
• Worked with Metadata Definitions, Import and Export of Datastage jobs using Data stage Manager.
• Monitoring the Datastage job on daily basis by running the UNIX shell script and made a force start whenever job fails.
• Extensively used slowly changing dimension Type 2 approach to maintain history in database.
• Created queries to compare data between two databases to make sure data is matched.
• Generated Surrogate ID's for the dimensions in the fact table for indexed and faster access of data
• Designing and developing the jobs using Datastage server environment.
• Involved in all the steps in the Agile starting from requirement gathering to moving jobs to production
• Peer Review the code before deploying into higher regions.
• Requirement gathering from the end users and preparation of the BRDs.
• Involved in design and development of the Azure system.
• Creation of Azure Data Factory Pipelines to move the data from source to Data Lake store.
• Supporting the business in order to ensure the SLA are met with the deliverables or resolving the incident
• Good experience in creating Azure Data Factory pipelines to extract data from heterogeneous sources and creating jobs in Azure Data Lake Analytics.
• Good experience in writing USQL programs to compute huge volumes of data in Azure Data Lake Store.
Project #3 LBG-Trade transformation
Design, Sql, Writing, Oracle, Azure, Agile, Unix, Database, Analytics, Transformation, Monitoring, Development, Server, Production, Manager
2014 - 2016
job
Team Member
FORD (Tech Mahindra).
Duration: May'14 to May'16
Responsibilities:
• Extensively used Essential Data stage designer, director for creating and implementing jobs.
• Created source table definitions in the DataStage Repository.
• Identified source systems, their connectivity, related tables and fields and ensure data suitability for mapping.
• Generated Surrogate ID's for the dimensions in the fact table for indexed and faster access of data.
• Created hash tables with referential integrity for faster table look-up and for transforming the data representing valid information.
Project #5 Online banking account management
Responsibilities:
• Extensively used Essential Data stage designer, director for creating and implementing jobs.
• Created source table definitions in the DataStage Repository.
• Identified source systems, their connectivity, related tables and fields and ensure data suitability for mapping.
• Generated Surrogate ID's for the dimensions in the fact table for indexed and faster access of data.
• Created hash tables with referential integrity for faster table look-up and for transforming the data representing valid information.
Project #5 Online banking account management
Account management, Management, Banking, Online, UP
2011 - 2011
job
Extensively used Essential Data stage designer, director
unknown.
Duration: Jan'11 to Jun'11
Responsibilities:
• Detailed Analysis of Functional and Technical Specifications.
• Extensively used Essential Data stage designer, director for creating and implementing jobs.
• Resolving Bugs presented in case of testing the jobs.
• Designing and giving support to the designed jobs using AUTOSYS.
• Designing, scheduling and monitoring the sequences.
• Updating the Clear case for the status on incidents assigned to support.
Responsibilities:
• Detailed Analysis of Functional and Technical Specifications.
• Extensively used Essential Data stage designer, director for creating and implementing jobs.
• Resolving Bugs presented in case of testing the jobs.
• Designing and giving support to the designed jobs using AUTOSYS.
• Designing, scheduling and monitoring the sequences.
• Updating the Clear case for the status on incidents assigned to support.
Support, Testing, Monitoring
My education
n/a
Masters, Computer Applications
Masters, Computer Applications
Maha's reviews
Maha has not received any reviews on Worksome.
Contact Maha M
Worksome removes the expensive intermediaries and gives you direct contact with relevant talent.
Create a login and get the opportunity to write to Maha directly in Worksome.
are ready to help you
and get specific bids from skilled talent in Denmark