About
Data Engineer with 2+ years of experience in building data intensive applications, tackling challenging architectural and scalability problems in Finance. Currently working on migration of on-premise data solutions to Azure data solutions. Mostly worked on Big data tech-stack : Hive, HDFS, Impala, Hbase, Shell Script, Apache Spark. Cloud Stack : ADF, ADB, CosmosDB, ADLS Gen2, Blob Storage, VM, Azure Functions
Data Engineer (UBS)
- Birthday: 21 March 1996
- Phone: +91 8329216326
- City: City : Pune, Maharashtra, India
- Degree: BE - Computer Engineer
- Email: vetalpallavi21@gmail.com
Skills
Resume
Detail-oriented, responsible, assiduous and committed engineer.
Sumary
Pallavi Vetal
Data Engineer with 3+ years of experience in building data intensive applications, tackling challenging architectural and scalability problems in Finance. Currently working on migration of on-premise data solutions to Azure data solutions. Mostly worked on Big data tech-stack : Hive, HDFS, Impala, Hbase, Shell Script, Apache Spark. Cloud Stack : ADF, ADB, CosmosDB, ADLS Gen2, Blob Storage, VM, Azure Functions
- Pune, Maharashtra, India
- +91 8329216326
- vetalpallavi21@gmail.com
Education
BE - Computer Engineering
2015 - 2018
Pune Institute Of Computer Technology
- GPA: 3.4/4
Diploma - Computer Engineering
2010 - 2014
Government Polytechnic Pune
- Final Year Percentage: 91%
Schooling - Rani Laxmibai Girls Military School
2005 - 2010
- SSC Percentage: 95.34%
Professional Experience
Fractal Analytics, Azure Data Engineer
July 2021 - Present
Location : Bangalore
- Expertise in relational and dimensional modelling, including big data technologies
UBS, Data Engineer
July 2018 - June 2021
Location : EON IT , Kharadi, Pune
- Worked on migration of on-premise data solutions to Azure Cloud. Resources Used : CosmosDB, Azure Data factory, Azure Databricks, ADLS Gen2
- Experience with developing dynamic Azure data factory pipelines which gets triggered on arrival of control file in Blob Storage
- Designed Azure Databricks notebooks to consume data from ADLS Gen2, process it and ingest processed data to CosmosDB. Created and managed Hive as well as Delta tables in ADB. Databricks Runtime : 6.5, Spark: 2.4.3, Scala: 2.11, Hive 2.1.2
- Experience in loading and retrieving data from CosmosDB (SQL Api) as well as optimizing write and read operations on data stored in CosmosDB
- Designed and developed Spark-based framework to process the data present in HDFS and create reports for UBS regulatory team
- Well versed with Data Warehousing (ETL) methods including historical and incremental loading from heterogeneous data source.
- Experience in reconfiguring & tuning spark for performance tuning.
- Build Unix shell scripts to automate the task and reduce manual efforts.
- Experience with version control systems Git and working in Agile project model.
Personal Projects
Code for all below projects can be found at my GitHub Page : github.com/pallavi-vetal
- All
- Web
- ML
- Data
Certifications
Microsoft Certified DP200 : Implementing an Azure Data Solution
Validates the skills and knowledge to implement security requirements, implement data retention policies and access external data sources. Azure services covered : Azure Cosmos DB, Azure SQL Database, Azure SQL Data Warehouse, Azure Data Lake Storage, Azure Data Factory, Azure Stream Analytics, Azure Databricks, and Azure Blob storage.
Microsoft Certified AZ - 900 : Azure Fundamentals
Demonstrated foundational level knowledge of cloud services and how those services are provided with Microsoft Azure.
Front-End Web Development with React
Demonstrated foundational level knowledge of front end Development using ReactJS. Covered React-Router, building single page application, state management using react-redux, deploying react application on Heroku.
JavaScript
Demonstrated foundational level knowledge of javascript Functions, Currying, Hoisting, Scope, Inheritance, Events and Error Handling.
Coursera Deep Learning Specialization by Andrew Ng
Covered Fundamentals of Deep learning. Mainnly focused on Improving Deep Neural Networks,Structuring Machine Learning Projects (, Sequence Models(RNN), CNN
Awards and Achievements
Winner of AI and Automation Competition conducted by UBS Developed prediction model to get insights on Client loyalty.
Certificate of appreciation. Contributed in WMA Automation community to increase the throughput and reduce manual efforts by building various tools and utilities. Displayed UBS Principle and sustainable performance.
Silver medal at State level in Kick Boxing awarded by Indian Association Of Kick boxing Organization (ISKO) Won Silver medal in Full contact event, in -44 kg weight , in 25th Maharashtra State Kick boxing championship 2011 at Balewadi
Techgig Cloudify Everything Hackathon Finalists