$$$
{{ $t($store.state.user.experience_value_in_dollars) }}
Senior
{{ $t($store.state.user.experience_search_name) }}
0
jobs
sandeepmehta
Sandeep Mehta
,
Bexley, United Kingdom
Experience
Other titles
Skills
I'm offering
A versatile, result driven Big Data Engineer with experience in designing and executing solutions for complex Big Data and large-scale Data warehouse projects mainly focused on developing ETL pipelines, release management, real-time analysis and delivering Valuable insights to Business.
Good expertise working on AWS, Hortonworks, Kafka and Spark with focus on CI/CD on both on premise and cloud
Good expertise working on AWS, Hortonworks, Kafka and Spark with focus on CI/CD on both on premise and cloud
Markets
United Kingdom
Language
English
Fluently
Ready for
Larger project
Ongoing relation / part-time
Available
My experience
2018 - 2019
job
Data Engineer
Funding Circle.
● Created real time pipelines using Kafka Connect, Kafka Streams, Clojure, Python, AWS, Postgres to bring data from core sources of business into DataWarehouse.
● Created multiple tools and applications to automate the development, monitoring and maintaining the pipelines.
● Working in a Dockerize development environment.
● Conducting rigorous testing using Jenkins and Circle CI.
● Have ownership on your own projects and adhering to use of an agile way of working.
● Worked on projects that support the business in product improvement, growth engineering in order to facilitate more efficient marketing analysis and improvement of our risk models using machine learning.
● Created multiple tools and applications to automate the development, monitoring and maintaining the pipelines.
● Working in a Dockerize development environment.
● Conducting rigorous testing using Jenkins and Circle CI.
● Have ownership on your own projects and adhering to use of an agile way of working.
● Worked on projects that support the business in product improvement, growth engineering in order to facilitate more efficient marketing analysis and improvement of our risk models using machine learning.
Marketing, Python, Machine learning, AWS, Agile, Jenkins, Engineering, Support, Kafka, Growth, Development, Testing, Postgres, Monitoring, Clojure
2016 - 2018
job
Big Data Engineer
Worldpay.
Developed, tested and implemented various ETL pipelines and real-time applications load data from 130+ sources into HDFS using Spark, Kafka, HBase, MapReduce, Hive on TEZ, Sqoop, Oozie, Ambari, Scala, Shell and Python scripting and other big data related technologies on Hortonworks Platform.
Took on the release management responsibilities and coordinated the delivery of releases using GIT version control.
Identified and suggested new technologies and tools for enhancing product value and increasing team productivity.
Worked in the Agile environment using Kanban and contributed in key decision document sessions.
Lead the handover of the existing project to the offshore team and supported them with key decisions.
Took on the release management responsibilities and coordinated the delivery of releases using GIT version control.
Identified and suggested new technologies and tools for enhancing product value and increasing team productivity.
Worked in the Agile environment using Kanban and contributed in key decision document sessions.
Lead the handover of the existing project to the offshore team and supported them with key decisions.
Python, Git, Big Data, Agile, ETL, Scripting, Management, Scala, Kanban, Spark, Kafka, Offshore, Hive
2014 - 2015
freelance
Big Data Consultant
Accenture.
KA
Worked for Virgin Media client as Big Data Engineer; planned, designed and developed multiple modules in the project to handle Customer Calls related data and store in HDFS using Kafka, Map Reduce, Hive, Pig, Oozie, Flume environment as network files and developed a data warehouse to extract Network Usage Related reports.
Maintained the contact between stakeholders and Release Management offshore team and coordinated the delivery of components.
Worked for Virgin Media client as Big Data Engineer; planned, designed and developed multiple modules in the project to handle Customer Calls related data and store in HDFS using Kafka, Map Reduce, Hive, Pig, Oozie, Flume environment as network files and developed a data warehouse to extract Network Usage Related reports.
Maintained the contact between stakeholders and Release Management offshore team and coordinated the delivery of components.
Big Data, Data Warehouse, Management, Network, Kafka, Offshore, Hive
2012 - 2014
freelance
DataWarehouse Consultant
Big Data Technologies.
like Kafka, Spark, etc.
Identified and suggested new technologies and tools for enhancing product value and increasing team productivity.
DataWarehouse Consultant, 07/2012 to 01/2014
Accenture - Bengaluru, KA
Worked for Virgin Media client (onsite in the UK)as Data Warehouse consultant, coordinating the
analysis, design, and extraction of encounter data from multiple source systems into the data warehouse.
Mediator between reporting team and business to ensure delivery of final products on time and without failures.
As part of this trained offshore team to take on this responsibility.
Used ER/Studios for logical and physical dimensional data modeling to support data architecture.Designed and developed Star Schema dimension and fact tables to support data warehouse requirements for the Sales, Customer, General Ledger and Police Unit modules.
Identified and suggested new technologies and tools for enhancing product value and increasing team productivity.
DataWarehouse Consultant, 07/2012 to 01/2014
Accenture - Bengaluru, KA
Worked for Virgin Media client (onsite in the UK)as Data Warehouse consultant, coordinating the
analysis, design, and extraction of encounter data from multiple source systems into the data warehouse.
Mediator between reporting team and business to ensure delivery of final products on time and without failures.
As part of this trained offshore team to take on this responsibility.
Used ER/Studios for logical and physical dimensional data modeling to support data architecture.Designed and developed Star Schema dimension and fact tables to support data warehouse requirements for the Sales, Customer, General Ledger and Police Unit modules.
Design, Data Warehouse, Data Modeling, Sales, Architecture, Spark, Support, Kafka, Offshore
My education
?
-
2012
Graphic Era University
Bachelors, Computer Science
Bachelors, Computer Science
Sandeep's reviews
Sandeep has not received any reviews on Worksome.
Contact Sandeep Mehta
Worksome removes the expensive intermediaries and gives you direct contact with relevant talent.
Create a login and get the opportunity to write to Sandeep directly in Worksome.
38100+ qualified freelancers
are ready to help you
Tell us what you need help with
and get specific bids from skilled talent in Denmark